Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →sonichi/macos-use
GUI control for macOS apps via mediar-ai's mcp-server-macos-use. Click, type, scroll, key-press, open apps — driven by accessibility tree, works in non-interactive Claude Code mode. Use this for any Sutando task that needs to drive another macOS application (Safari, Zoom, Mail, Finder, etc.).
Passed 15 of 20 test cases with the skill, and 6 of 20 without it.
and 7 more in the full report
10 fixed7 passed either way5 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 10 test cases the skill fixed. Same model, same prompt, with and without the skill.
What is the exact script relative path used to compile the Swift project binary from source?
| Checked | Without skill | With skill |
|---|---|---|
| Identifies bash skills/macos-use/scripts/build.sh. | Missed | Passed |
The instructions your model reads when the skill loads.
Drive macOS applications from Claude Code via mediar-ai's mcp-server-macos-use. A Swift MCP server that wraps the macOS Accessibility API. Unlike Claude's built-in computer-use, this works in non-interactive mode (which is how Sutando's proactive loop and task bridge run), does not hold a machine-wide lock, and does not require a Pro/Max subscription.
src/inline-tools.tsPrefer this skill over:
bash src/screen-capture.sh — that captures screenshots; macos-use actually interactstell application blocks — more reliable, better error handlingcliclick — lower-level, no accessibility contextcomputer-use — that mode requires interactive sessions and holds a lock that contends with Sutando's own loopAfter install, these appear as mcp__macos-use__* in Claude Code:
| Tool | Parameters | Purpose |
|---|---|---|
open_application_and_traverse | identifier (name/bundle ID/path) | Launch or activate an app, return its a11y tree |
click_and_traverse | pid, x, y | Click at coordinates in a target app, return updated tree |
type_and_traverse | pid, text | Type into the frontmost element |
press_key_and_traverse | pid, key | Press a named key (Return, Tab, Escape, arrows, ...) |
scroll_and_traverse | pid, direction, amount | Scroll in a direction |
refresh_traversal | pid | Re-read the a11y tree without acting |
Every tool returns an accessibility-tree snapshot of the target app — structured UI elements with roles, titles, positions, and identifiers. No pixels. Model reasons over the tree, not over screenshots.
Two steps, one-time:
# 1. Build the Swift binary (~35s)
bash skills/macos-use/scripts/build.sh
test cases passed, vs 6 / 20 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.