x402agent/SolanaOS / skills/e2b
e2b
VerifiedE2B Desktop Sandbox with autonomous computer use β cloud Linux environments for browser automation, visual UI grounding, screenshot analysis, and shell execution. Supports Browser Use cloud sessions, Playwright integration, and LLM-driven desktop control. Use when asked about sandboxes, computer use, browser automation, E2B, desktop control, visual testing, or cloud Linux environments.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 10.4 KB |
SKILL.md
View on GitHub---
name: e2b
description: "E2B Desktop Sandbox with autonomous computer use β cloud Linux environments for browser automation, visual UI grounding, screenshot analysis, and shell execution. Supports Browser Use cloud sessions, Playwright integration, and LLM-driven desktop control. Use when asked about sandboxes, computer use, browser automation, E2B, desktop control, visual testing, or cloud Linux environments."
version: 1.0.0
emoji: "π₯οΈ"
tags:
- e2b
- sandbox
- desktop
- browser
- computer-use
- automation
- playwright
- browseruse
- cloud
- linux
requires:
env:
- E2B_API_KEY
- BROWSERUSE_API_KEY
bins: []
allowed-tools:
- sandbox
- desktop
- shell
- run
- screenshot
- browse
- browseruse
---
# E2B β Cloud Desktop Sandbox & Computer Use
Secure cloud Linux desktops powered by [E2B Desktop Sandbox](https://e2b.dev) with autonomous computer-use capabilities, Browser Use integration, and LLM-driven visual control.
## Quick Start
```bash
# Set up environment
export E2B_API_KEY="your-e2b-api-key"
export BROWSERUSE_API_KEY="your-browseruse-api-key" # Optional: for cloud browser sessions
# Via daemon commands
/sandbox new # Spin up a code sandbox
/desktop new # Spin up a desktop sandbox (with display)
/desktop browse https://example.com # Open browser in desktop sandbox
/desktop screenshot # Capture current screen
/desktop click 512 384 # Click at coordinates
/desktop type "hello world" # Type text
/desktop key Return # Send key
/shell ls -la # Run shell command in sandbox
/sandbox kill # Terminate sandbox
```
## Architecture
```
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β SolanaOS Daemon β
β β
β ββββββββββββββββββββ βββββββββββββββββββ βββββββββββββββββ β
β β E2B Client β β Desktop Client β β Browser Agent β β
β β (code sandbox) β β (desktop VNC) β β (autonomous) β β
β β β β β β β β
β β β’ RunCode() β β β’ Screenshot() β β β’ Vision LLM β β
β β β’ RunCommand() β β β’ Click() β β β’ Action LLM β β
β β β’ ListSandboxes β β β’ TypeText() β β β’ Tool Exec β β
β β β’ KillSandbox() β β β’ SendKey() β β β’ OODA Loop β β
β β β β β’ OpenBrowser() β β β β
β ββββββββ¬ββββββββββββ β β’ RunShell() β ββββββββ¬βββββββββ β
β β β β’ Scroll() β β β
β β β β’ Stream() β β β
β β ββββββββββ¬ββββββββββ β β
β β β β β
β ββββββββ΄ββββββββββββββββββββββββ΄βββββββββββββββββββββ΄βββββββββ β
β β E2B REST API β β
β β https://api.e2b.dev/sandboxes β β
β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β
β β
β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β
β β Browser Use Integration β β
β β β β
β β Cloud Providers: β β
β β β’ Browser Use API (BROWSERUSE_API_KEY) β β
β β β’ Browserbase (BROWSERBASE_API_KEY) β β
β β β β
β β Features: β β
β β β’ CDP-based browser control β β
β β β’ Cloud session management β β
β β β’ Headed/headless modes β β
β β β’ Profile persistence β β
β β β’ Proxy support β β
β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β
βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
```
## Sandbox Types
### Code Sandbox (Default)
Standard E2B code interpreter β Python execution, file I/O, shell commands. No display.
```
/sandbox new # Create code sandbox
/run print("hello world") # Execute Python
/shell pip install requests # Install packages
/sandbox kill # Terminate
```
### Desktop Sandbox
Full Linux desktop with X11 display, VNC streaming, mouse/keyboard control.
```
/desktop new # Create desktop sandbox
/desktop screenshot # Capture screen
/desktop click 100 200 # Click at (100, 200)
/desktop type "search query" # Type text
/desktop key ctrl+a # Send key combo
/desktop browse https://... # Open browser
/desktop kill # Terminate
```
### Browser Use Cloud Session
Cloud-hosted browser via Browser Use or Browserbase APIs.
```
/browseruse connect # Start cloud browser session
/browseruse open https://... # Navigate
/browseruse close # End session
```
## Autonomous Computer Use (Browser Agent)
The Browser Agent combines vision LLMs with desktop control for autonomous task completion.
### Agent Loop (OODA)
```
1. OBSERVE: Take screenshot of desktop
2. ORIENT: Send screenshot to vision LLM with objective
3. DECIDE: LLM analyzes screen, determines next action
4. ACT: Execute action (click, type, command, etc.)
5. REPEAT: Until objective is complete or max steps reached
```
### Supported LLM Providers for Vision
The agent supports multiple vision LLM providers (configured via daemon):
| Provider | Models | Capabilities |
|----------|--------|-------------|
| OpenAI | GPT-4o, GPT-4o-mini | Vision + Action |
| Anthropic | Claude 3.5 Sonnet | Vision + Action |
| Google | Gemini 2.0 Flash | Vision + Action |
| Groq | Llama 3.2 | Vision + Action |
| OpenRouter | Qwen 2.5 VL, Llama 3.2 | Vision |
| Fireworks | Llama 3.2 | Vision |
| Mistral | Pixtral | Vision |
### Agent Tools
| Tool | Description | Parameters |
|------|-------------|------------|
| `click` | Left-click at coordinates | x, y |
| `double_click` | Double-click at coordinates | x, y |
| `right_click` | Right-click at coordinates | x, y |
| `type_text` | Type text into active input | text |
| `send_key` | Send key or combo | key (e.g. "Return", "ctrl+c") |
| `run_command` | Execute shell command | command |
| `open_browser` | Open browser to URL | url |
| `scroll` | Scroll mouse wheel | x, y, clicks |
| `screenshot` | Capture screen state | β |
| `stop` | Mark task as complete | β |
## Daemon Integration
### Chat Commands
| Command | Description |
|---------|-------------|
| `/sandbox [new\|kill\|list]` | Manage code sandboxes |
| `/run <code>` | Execute Python in sandbox |
| `/shell <command>` | Execute shell in sandbox |
| `/desktop [new\|kill\|screenshot\|click\|type\|key\|browse]` | Desktop sandbox control |
| `/browseruse [connect\|open\|close\|status]` | Browser Use sessions |
| `/agent browse <objective>` | Start autonomous browser agent |
### Natural Language Detection
The daemon detects sandbox-related intents from natural language:
- "spin up a sandbox" β `/sandbox new`
- "open a browser and go to..." β `/desktop browse <url>`
- "take a screenshot" β `/desktop screenshot`
- "run this code" β `/run <code>`
## Playwright Integration
For structured E2E testing (vs. autonomous browsing), use the [browse skill](../browse/SKILL.md):
```bash
# Playwright tests run against the desktop sandbox
PLAYWRIGHT_BASE_URL="https://<sandbox-id>-8080.e2b.dev" npx playwright test
# Or against Browser Use cloud session
PLAYWRIGHT_CDP_URL="wss://..." npx playwright test --connect
```
## Environment Variables
| Variable | Required | Description |
|----------|----------|-------------|
| `E2B_API_KEY` | Yes | E2B API key for sandbox creation |
| `BROWSERUSE_API_KEY` | No | Browser Use cloud API key |
| `BROWSERBASE_API_KEY` | No | Browserbase API key (alternative) |
| `BROWSERBASE_PROJECT_ID` | No | Browserbase project ID |
| `ANTHROPIC_API_KEY` | No | For vision/action LLM (Claude) |
| `OPENAI_API_KEY` | No | For vision/action LLM (GPT-4o) |
| `GROQ_API_KEY` | No | For vision/action LLM (Llama) |
| `OPENROUTER_API_KEY` | No | For vision LLM (multi-model) |
## API Reference
### E2B REST API
```
POST /sandboxes Create sandbox
GET /sandboxes List sandboxes
DELETE /sandboxes/:id Kill sandbox
POST /sandboxes/:id/code Execute code
POST /sandboxes/:id/commands Run shell command
GET /sandboxes/:id/screenshot Capture desktop (desktop template)
POST /sandboxes/:id/timeout Extend timeout
```
### Browser Use API
```
POST https://api.browser-use.com/api/v2/browsers Create session
PATCH https://api.browser-use.com/api/v2/browsers/:id Stop session
```
### Browserbase API
```
POST https://api.browserbase.com/v1/sessions Create session
POST https://api.browserbase.com/v1/sessions/:id Close session
```
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |