donaldfilimon/abi / .agents/skills/browser-studio
browser-studio
VerifiedDrive ABI's loopback multimodal browser studio — camera/image/video frames, microphone PCM, client-side Web Speech STT/TTS, and deterministic local analysis via `abi agent browser --studio`. Use for vision, voice, image, video, getUserMedia, or browser-studio work. Not a neural vision/STT/TTS model.
browser-studio — loopback multimodal capture
Driver: .agents/skills/browser-studio/serve.sh (paths relative to repo root).
Builds the CLI, launches abi agent browser --studio on 127.0.0.1, exercises
GET /health, GET /capabilities, and POST /analyze, then tears the server
down. Loopback only.
What this is
abi agent browser --studio [--port <port>] [--once] serves a single-page
studio and JSON routes from crates/abi-cli/src/browser_studio.rs. Analysis
runs through abi_ai::multimodal (bucket-hash embeddings + classical stats).
Honest boundaries:
- Not a neural vision, STT, or TTS model.
- Speech recognition and speech synthesis, when used, are browser Web Speech APIs in the page. The server only embeds a supplied transcript and/or PCM.
- Navigation planning stays on
abi agent browser <task>and still reportsembedded_browser=false/delegation_hint=external-mcp-playwright. - The 14-command CLI and 12-tool MCP catalogs are unchanged.
Run
./tools/cargo.sh build -p abi-cli
./target/debug/abi agent browser --studio --port 8095
# open http://127.0.0.1:8095/
.agents/skills/browser-studio/serve.sh # health + analyze smoke
.agents/skills/browser-studio/serve.sh 9105 # custom port
--once handles a single connection and exits (tests / scripts).
Routes
| Method | Path | Body |
|---|---|---|
| GET | / | HTML studio (camera, frames, mic, Web Speech, local TTS) |
| GET | /health | {"status":"ok","surface":"browser-studio"} |
| GET | /capabilities | claim-honest capability document |
| POST | /analyze | {"kind":"image|video|audio|voice", ...} |
| POST | /fuse | {"vision":[32 floats], "audio":..., "video":...} |
Limits: grayscale 1..=64 side, <=8 video frames, <=2048 PCM samples,
sample rate 8000..=48000. Requests use the foundation 64 KiB cap.
Auth
ABI_BROWSER_STUDIO_TOKEN gates every route except GET / and GET /index.html
so the page can load. POST analyze/fuse then need
Authorization: Bearer <token>. Loopback bind plus Host/Origin allowlists;
this is not a TLS front.
Gotchas
- Leave the token unset for interactive camera/mic use. A set token makes the
page's
fetchcalls 401 unless the operator adds a header. createScriptProcessoris the page's PCM tap — deprecated in browsers but available without a worklet build step. Disclosure stays "classical PCM".- Do not claim Whisper, GPT-4V, or in-process neural TTS in docs or skills.
- Default plan path (
abi agent browser "open docs") must keep emittingorchestration=browser-localandembedded_browser=false.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis. | Stars: 468k | Updated | Claude CodeCodex | Verified | Install |
| diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness. | Stars: 321k | Updated | Claude CodeCodex | Verified | Install |
| dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependencies | Stars: 321k | Updated | Claude CodeCodex | Verified | Install |
| executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is available | Stars: 321k | Updated | Claude CodeCodex | Verified | Install |