aiskillstore/marketplace / skills/0xselenicdove/auv-computer-control
auv-computer-control
VerifiedIncorporate moeru-ai/AUV into native desktop app control through its CLI or connected MCP for observation, targeted input, reusable operations, and verification. Use for native app automation, repeated desktop workflows, or explicit AUV requests.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 6.3 KB |
| agents/openai.yaml | config | 234 B |
| references/operations.md | markdown | 4.1 KB |
| skill-report.json | config | 23.0 KB |
references/operations.md
View on GitHub# Setup and operation examples
Inspected 2026-10-06 against upstream commit `f87265e4768e3456381d50ef24443e256f5315cd`. Released binaries may differ; installed help takes precedence.
Sources: [README](https://github.com/moeru-ai/auv/blob/f87265e4768e3456381d50ef24443e256f5315cd/README.md), [invoke help](https://github.com/moeru-ai/auv/blob/f87265e4768e3456381d50ef24443e256f5315cd/crates/auv-cli-invoke/src/help.rs), [input commands](https://github.com/moeru-ai/auv/blob/f87265e4768e3456381d50ef24443e256f5315cd/crates/auv-cli-invoke/src/commands/input.rs), [window commands](https://github.com/moeru-ai/auv/blob/f87265e4768e3456381d50ef24443e256f5315cd/crates/auv-cli-invoke/src/commands/window.rs), [result envelope](https://github.com/moeru-ai/auv/blob/f87265e4768e3456381d50ef24443e256f5315cd/crates/auv-cli-invoke/src/models/invoke_result.rs).
## Setup
Upstream's prebuilt macOS installation:
```sh
brew install moeru-ai/tap/auv
auv --version
```
Official releases include the signed helper. If needed on macOS 13+:
```sh
auv setup macos-helper install
auv setup macos-helper status
```
The user grants Accessibility for AX/input, Screen Recording for capture/OCR, and Automation for relevant activation fallbacks to the application launching AUV. This can be the agent's host rather than an interactive terminal. Restart that launcher after permission changes, then run `auv doctor` and `auv invoke app.probePermissions`. Helper setup can also require user approval of Background Items/Accessibility. Do not change OS permissions automatically.
Linux/Windows have native drivers, but individual core commands have narrower platform support. Follow upstream installation instructions and installed help rather than transplanting macOS selectors. Windows helper setup requires elevated PowerShell. Cargo/Nix builds do not embed the signed macOS helper. The inspected README lists a first-party Python SDK and AUV REPL as planned; do not assume they exist.
## Core examples
These demonstrate syntax; substitute identifiers/titles from live observations. Do not execute TextEdit examples as an incidental test on the user's desktop.
```sh
auv invoke window.list --json
auv invoke window.capture --target app:com.apple.TextEdit --title Untitled --json
auv invoke window.findText 'Search' --target app:com.apple.TextEdit --title Untitled --json
auv invoke input.focusText 'Search' --target app:com.apple.TextEdit --json
auv invoke input.typeText 'example query' --target app:com.apple.TextEdit --input-policy foreground-preferred --json
auv invoke input.pressKeys cmd a --target app:com.apple.TextEdit --json
auv invoke window.waitForText 'Ready' --target app:com.apple.TextEdit --title Untitled --json
```
Inspect help for wait limits and OCR candidate selection. `window.clickText` locates/clicks OCR anchors: disambiguate instead of blindly using candidate zero. `input.clickPoint` accepts logical coordinates or target-local normalized values where supported. A window target supported by keyboard commands is not proof that capture/OCR accepts it.
For ordered keyboard actions, inspect `input.keyboard --help`; `--actions` accepts tagged JSON actions. Limit batches to actions safe without intermediate verification; do not bundle submission after unverified field edits.
## Plugins, MCP, remote targets
- `auv plugin list` discovers `auv-*` executables on PATH. Inspect `auv <plugin-name> --help`; core installation does not guarantee app/game plugins are installed.
- The optional stdio MCP server uses command `auv`, args `["mcp", "serve"]`. Use the host's supported registration flow when integration setup is requested. Starting a server alone does not expose tools to an active chat.
- `auv devices list` discovers daemon-visible Devices. Root selection precedes the subcommand: `auv --device-id <observed-id> invoke display.list --json`. Preserve selection for every related call. Pairing/enrollment is separate setup.
- Inspect `auv run --help` for correlation/inspection and `auv runner --help` for persistent execution when needed. Do not start network listeners, enroll unlock credentials, or modify host configuration incidentally for local one-off operations.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness. | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependencies | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is available | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |