Skip to content

donaldfilimon/abi / .agents/skills/browser-studio

browser-studio

Verified

Drive ABI's loopback multimodal browser studio — camera/image/video frames, microphone PCM, client-side Web Speech STT/TTS, and deterministic local analysis via `abi agent browser --studio`. Use for vision, voice, image, video, getUserMedia, or browser-studio work. Not a neural vision/STT/TTS model.

browser-studio — loopback multimodal capture

Driver: .agents/skills/browser-studio/serve.sh (paths relative to repo root). Builds the CLI, launches abi agent browser --studio on 127.0.0.1, exercises GET /health, GET /capabilities, and POST /analyze, then tears the server down. Loopback only.

What this is

abi agent browser --studio [--port <port>] [--once] serves a single-page studio and JSON routes from crates/abi-cli/src/browser_studio.rs. Analysis runs through abi_ai::multimodal (bucket-hash embeddings + classical stats).

Honest boundaries:

  • Not a neural vision, STT, or TTS model.
  • Speech recognition and speech synthesis, when used, are browser Web Speech APIs in the page. The server only embeds a supplied transcript and/or PCM.
  • Navigation planning stays on abi agent browser <task> and still reports embedded_browser=false / delegation_hint=external-mcp-playwright.
  • The 14-command CLI and 12-tool MCP catalogs are unchanged.

Run

./tools/cargo.sh build -p abi-cli
./target/debug/abi agent browser --studio --port 8095
# open http://127.0.0.1:8095/

.agents/skills/browser-studio/serve.sh        # health + analyze smoke
.agents/skills/browser-studio/serve.sh 9105   # custom port

--once handles a single connection and exits (tests / scripts).

Routes

MethodPathBody
GET/HTML studio (camera, frames, mic, Web Speech, local TTS)
GET/health{"status":"ok","surface":"browser-studio"}
GET/capabilitiesclaim-honest capability document
POST/analyze{"kind":"image|video|audio|voice", ...}
POST/fuse{"vision":[32 floats], "audio":..., "video":...}

Limits: grayscale 1..=64 side, <=8 video frames, <=2048 PCM samples, sample rate 8000..=48000. Requests use the foundation 64 KiB cap.

Auth

ABI_BROWSER_STUDIO_TOKEN gates every route except GET / and GET /index.html so the page can load. POST analyze/fuse then need Authorization: Bearer <token>. Loopback bind plus Host/Origin allowlists; this is not a TLS front.

Gotchas

  • Leave the token unset for interactive camera/mic use. A set token makes the page's fetch calls 401 unless the operator adds a header.
  • createScriptProcessor is the page's PCM tap — deprecated in browsers but available without a worklet build step. Disclosure stays "classical PCM".
  • Do not claim Whisper, GPT-4V, or in-process neural TTS in docs or skills.
  • Default plan path (abi agent browser "open docs") must keep emitting orchestration=browser-local and embedded_browser=false.
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 468kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 321kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 321kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 321kUpdated Claude CodeCodexVerifiedInstall