0x0funky/agent-sprite-forge / skills/generate2dmedia
generate2dmedia
VerifiedThe art-route layer of the Forge skills. route_media.py is the one command that generates an image or an image-to-video clip - through the paid API of any provider whose key is configured (OpenAI, Google Gemini, xAI, BytePlus ModelArk, fal.ai; the configured key is the owner's consent), else through the user's own signed-in Codex or Grok CLI - and prints one JSON line with the route, artifact, sha256 and cost estimate; with no route it answers no-route (codeart2d is then the last resort). Also the capability check (forge_doctor), API key configuration, the spend ledger, resume and Codex image adoption. Use when a Forge skill sends a generation here, for the capability check, or when the user asks about keys, routes or spend. Not for planning, processing or QA of sprites, video frames or maps (generate2dsprite, video2dsprite, generate2dmap) or for code-drawn art (codeart2d).
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 9.0 KB |
| agents/openai.yaml | config | 388 B |
| references/agent-profiles/README.md | markdown | 1.3 KB |
| references/agent-profiles/video-agent.md | markdown | 981 B |
| references/api-usage.md | markdown | 18.6 KB |
| references/capabilities.json | config | 32.9 KB |
| references/cli-routes.md | markdown | 15.3 KB |
| references/prices.json | config | 23.5 KB |
| references/provider-survey.md | markdown | 17.2 KB |
| references/route-media.md | markdown | 12.8 KB |
| references/schemas/common.schema.json | config | 12.9 KB |
| references/schemas/host.schema.json | config | 18.8 KB |
| references/schemas/media.schema.json | config | 22.5 KB |
| scripts/cli_media.py | script | 113.3 KB |
| scripts/forge_doctor.py | script | 74.5 KB |
| scripts/forge_index.py | script | 24.8 KB |
| scripts/generate_media.py | script | 72.1 KB |
| scripts/media_config.py | script | 9.1 KB |
| scripts/media_ledger.py | script | 29.8 KB |
| scripts/media_mp4.py | script | 9.4 KB |
| scripts/media_providers.py | script | 66.9 KB |
| scripts/route_media.py | script | 41.7 KB |
references/cli-routes.md
View on GitHub# Local CLI media routes
`scripts/cli_media.py` drives the user's own installed Codex CLI or Grok CLI to make one image,
one reference edit or one image-to-video clip with that CLI's native media tool. These are the
**local** routes: they come after the API routes (when a key is configured) and spend the
**subscription quota of the user's own sign-in**, never API credit. Skills normally reach them
through [`route_media.py`](route-media.md), which picks the route; a host tool you can call
yourself (your own `image_gen`) needs none of this; the paid API route is
[`generate_media.py`](api-usage.md).
Run every command from the user's project root. `<skill-dir>` is this skill's folder
(`${CLAUDE_SKILL_DIR}` in Claude Code). Outputs, the ledger, run records and proofs stay in the
project, never in the skill folder.
## Route order
The owner's order (2026-10-06), which `route_media.py` follows for every image and clip:
1. **the paid API**, when a key is configured (each provider's own key, in the environment or the
user config file: `OPENAI_API_KEY`, `GOOGLE_API_KEY` or `GEMINI_API_KEY`, `XAI_API_KEY`,
`ARK_API_KEY`, `FAL_KEY`; see [route-media.md](route-media.md)): the configured key is the
owner's consent;
2. **local**: the host's own image tool (Codex `image_gen`) when you have one, then
**Codex (local CLI)**: `codex exec` with its native `image_gen`, reference images attached
(route id `codex-cli`), then **Grok (local CLI)** in one-shot mode, `image_gen` or
`image_edit` (route id `grok-cli`); for video **Grok (local CLI)** in ACP mode,
`image_to_video` (route id `grok-acp`);
3. **codeart2d**, only when the user asks for code-drawn art or no route exists.
An installed CLI is used as is: its first successful run records the **VERIFIED** proof for that
CLI version, so there is no separate verification step. Tell the user about one "Grok (local
CLI)" route: it is the same `grok` executable, run in one-shot mode for images and in ACP mode for
video. The ids `grok-cli` and `grok-acp` are internal (ledger, proofs, job.json).
## Capability check first
Once per session, before choosing an art route:
```bash
python "<skill-dir>/scripts/forge_doctor.py" --host-tools image_gen
```
Pass the media tools in **your own** tool list (`image_gen`, `image_edit`, `image_to_video`, or
`none`); a script cannot see them. The doctor reads no CLI sign-in or credential file (of the
user config file it reports only whether a key is configured) and runs nothing but local
`--version` calls (`--no-exec` skips those too). Use only the routes its `ROUTES` block
names, in the order above; save the report beside your outputs with `--save outputs/doctor.json`.
A route with status `ready` can be used now: a configured API key, your own tool, or an installed
local CLI. `blocked` means the CLI's sign-in mode cannot run it; `routeOrder` is the resolved order.
Each local route climbs a readiness ladder: **PRESENT** (the native executable exists; an npm
launcher is resolved to its binary and never run) -> **AUTH_MODE** (sign-in mode known:
`--probe-auth` runs `codex login status`; Grok has no read-only status command) ->
**TOOL_EXPOSED** (the native tool answered a `cli_media.py` run) -> **VERIFIED** (a run of this
exact CLI version and recipe published a verified artifact). Proofs live in
`.forge/route-proofs.json` and are keyed by CLI version and recipe, so a CLI update drops a route
back to "not yet verified" until its next successful run records a new proof.
To verify a route ahead of time (one quota call; optional, and again after a CLI update):
```bash
python "<skill-dir>/scripts/forge_doctor.py" --verify-route codex-cli
python "<skill-dir>/scripts/forge_doctor.py" --verify-route codex-cli --execute
```
The installed CLI version is part of the verification request, so a re-verification after an
update is a new request, and a consented verification is never refused as a duplicate. An image
route's verification makes one image, so it proves `image_gen` only; Grok's `image_edit` becomes
VERIFIED after one successful `cli_media.py edit --route grok-cli ... --execute`.
## When to ask the user
- A local route: run it without a per-call question and always name the route you used
("Codex (local CLI)" or "Grok (local CLI)"). With `cli_media.py` directly, `--execute` stays the
guard: without it the tool only prints the plan; `route_media.py` passes it for you.
- The paid API: a configured key is the owner's consent ([route-media.md](route-media.md)).
- Ask before an opt-in cap is raised, and before `--allow-unverified` in a batch.
## Routes
| Route | Command | Native tool | How it runs |
|---|---|---|---|
| `codex-cli` | `image` | `image_gen` | `codex exec`: read-only sandbox, ephemeral session, user config ignored, web search, shell, plugins, apps, hooks, browser, MCP and sub-agents disabled; prompt on stdin; `--reference` images (up to 8) are copied into the run folder and attached with `--image` |
| `grok-cli` | `image` | `image_gen` | `grok` one-shot with `--output-format streaming-json`: only the one tool offered, web search and sub-agents off, Bash, WebFetch and MCP denied |
| `grok-cli` | `edit` | `image_edit` | as above; the reference image is copied into the run folder |
| `grok-acp` | `video` | `image_to_video` | `grok agent --no-leader --agent-profile references/agent-profiles/video-agent.md stdio` (ACP): one permission granted, only for the exact image, duration and resolution. It renders 6 or 10 s at 480p or 720p: `--duration` (1..15) is snapped to the nearer length before anything is sent (the plan, the result and `job.json` say `durationRequested` and `durationUsed`), and it takes the first frame only (`lastFrameUsed: false`) |
| `auto` | `image`, `edit`, `video` | as chosen | `cli_media.py`'s own auto: the first local route (Codex, then Grok) that is VERIFIED for the installed CLI version; `route_media.py` also runs a route that is not verified yet |
Every CLI runs in a fresh temporary folder with API keys, other credential-like variables and
the calling agent's own session variables removed from its environment (Grok also gets memory,
managed MCPs, foreign agent rules and its auto-updater switched off). The folder is a plain new
folder in the system temporary folder (`TMPDIR`, `TEMP` or `TMP`), removed after the run. On
Windows it inherits that folder's permissions, which Codex's sandbox setup extends to its own
users: `tempfile.mkdtemp` would make it owner-only (Python 3.12.4 and later), and the sandbox could
then not read the attached references. On macOS and Linux it stays private to the user. Any other
tool call, a second media call, mismatched arguments, more output than allowed or `--timeout`
(default 300 s for images, 600 s for video) stops it at once. The
[agent profile](agent-profiles/video-agent.md) limits the ACP agent to `image_to_video`.
```bash
python "<skill-dir>/scripts/cli_media.py" image --route auto --prompt-file prompts/hero.txt --output-dir outputs/hero-local
python "<skill-dir>/scripts/cli_media.py" image --route auto --prompt-file prompts/hero.txt --output-dir outputs/hero-local --execute
python "<skill-dir>/scripts/cli_media.py" image --route codex-cli --prompt-file prompts/hero.txt --output-dir outputs/hero-codex
python "<skill-dir>/scripts/cli_media.py" image --route codex-cli --reference art/identity.png --reference art/peer.png --prompt-file prompts/master.txt --output-dir outputs/hero-master --execute
python "<skill-dir>/scripts/cli_media.py" image --route grok-cli --prompt-file prompts/forest.txt --output-dir outputs/forest-grok
python "<skill-dir>/scripts/cli_media.py" edit --route grok-cli --reference hero.png --prompt-file prompts/hero-night.txt --output-dir outputs/hero-night
python "<skill-dir>/scripts/cli_media.py" video --route auto --reference hero.png --prompt-file prompts/idle.txt --duration 6 --resolution 720p --output-dir outputs/hero-idle-grok
```
`--route auto` names its choice in `routeChoice` (the route, its label, the order tried and why
earlier routes were skipped), in the printed result and in `job.json`. With no VERIFIED local
route it stops with `NOT_VERIFIED` and runs nothing. A dry run starts no process, so it cannot
read a Grok version: it plans with the newest VERIFIED proof (`verifiedFor`), and `--execute`
checks the installed version again before the call.
## The plan (every run)
Run the command **without** `--execute` first when you need the plan; nothing is started or
written. The plan shows the route and its label, the `consent` block (route, account, one call,
`quota: true`), the exact CLI arguments, the ledger totals with the session usage
(`ledger.session`), and `warnings`: CLI not installed, route not yet verified for this version,
output folder exists, an identical earlier request, or a cap that would block.
## Session cap (opt-in)
There is **no session cap by default** (owner decision 2026-10-06). A user who wants one sets it
with `--session-images N`, `--session-videos N` and `--session-hours H`, or for a whole session
with `FORGE_SESSION_IMAGES`, `FORGE_SESSION_VIDEOS` and `FORGE_SESSION_HOURS` (a flag wins over
the environment; `0` blocks that kind; the window defaults to 12 hours). It is counted in the
project's ledger before anything is started; a call that would exceed it stops with `CAP` and runs
nothing. Calls that never left the machine (`not_sent`) do not count; paid API calls have their
own opt-in caps in `generate_media.py`.
## Quota and the ledger
Each executed run is reserved in `.forge/ledger.jsonl` before the CLI starts, as a quota call
(`route` `codex-cli`, `grok-cli` or `grok-acp`, `quotaCall: true`, 0 USD), then committed
`done`, `failed`, `unknown` or `not_sent`. Besides the opt-in session cap, `--max-calls N` counts
paid and quota calls in the project's ledger and `FORGE_MAX_PAID_REQUESTS` counts paid API calls
only. Run directly, `cli_media.py` refuses an identical request that succeeded, is still open or
has an unknown outcome unless `--allow-duplicate`; `route_media.py` passes it, since a new output
folder is a new take. `python "<skill-dir>/scripts/media_ledger.py" summary` shows the totals and
the session usage.
## A Grok sign-in is never an API key
The REST routes (`generate_media.py`) use only each provider's own API key from that provider's
console (`XAI_API_KEY` for xAI, and so on). Forge never reads `~/.grok/auth.json` or any other Grok or Codex login file, never
turns a CLI sign-in into a REST credential and never sends one to an API. The local routes run the
user's own CLI, which uses its own sign-in, and their children receive no API key. If the user
wants API billing, use `generate_media.py`; if they want their subscription, use these routes.
## Provenance
- The run record `.forge/cli-runs/<run>.json` (a `job_v2` document) is written before the CLI
starts; the Codex thread id or Grok session id is saved the moment the CLI reports it.
- The artifact is taken only from the CLI's own folder for that run:
`CODEX_HOME/generated_images/<thread>/` or `GROK_HOME/sessions/*/<session>/images|videos/`.
It must sit there without a symlink or junction, be a regular file of a sane size, be newer
than the run, be the only output, carry PNG/JPEG/WebP (image) or MP4 (video) magic bytes and
decode. A Codex final answer naming a different file is refused.
- It is copied with an exclusive create and its sha256 checked, into a staged `--output-dir`
that is published only when every check passes: `generated.<ext>`, `job.json` (route, CLI
version, recipe, receipt, provenance, ledger reservation) and `prompt.txt`. A failed run
leaves no output folder; its run record says why.
## Resume and adopt
```bash
python "<skill-dir>/scripts/cli_media.py" resume --run <run-id>
python "<skill-dir>/scripts/cli_media.py" resume --run <run-id> --adopt
python "<skill-dir>/scripts/cli_media.py" adopt --codex-thread <thread-id> --output-dir outputs/hero-desktop
```
- `resume` inspects an interrupted, timed-out or failed run; `--adopt` publishes its output
after the same checks **without running the CLI again**, and settles the ledger reservation
as `done`. `--file NAME` picks one image when the folder holds several; `--output-dir` picks a
new folder.
- `adopt --codex-thread` copies an image that Codex Desktop or an interactive Codex session
generated: from the thread's `generated_images` folder, or, where the host keeps no PNG, from
the image inline in the thread's session rollout (`--index N` when it holds several). It makes
no call and writes no ledger line. It replaces `save_imagegen_result.py` (PR #5) and covers
issue #4.
## Batch
```bash
python "<skill-dir>/scripts/cli_media.py" batch jobs.json
python "<skill-dir>/scripts/cli_media.py" batch jobs.json --execute --max-calls 10
```
`jobs.json` holds `{"jobs": [{"id", "command", "route", "prompt_file", "output_dir", ...}]}`
(paths relative to the file; `route` may be `auto`). The default is a dry-run consent list.
`--execute` runs one job at a time, refuses routes with no proof for the installed CLI version
unless `--allow-unverified`, reuses finished outputs, never retries, stops at the first
account-level or unexpected outcome and writes `<jobs stem>.progress.json`, whose `jobsFile` and
`jobDir` paths are relative to the progress file's folder. An opt-in session cap applies to every
job; an image job's `reference` may be a list (Codex attaches every image).
## Error codes
| Code | Meaning | Ledger | Next step |
|---|---|---|---|
| `INVALID_REQUEST`, `OUTPUT_EXISTS` | bad input, or the output folder exists | nothing reserved | fix the command |
| `DUPLICATE`, `CAP` | identical earlier request, or `--max-calls` / an opt-in session cap reached | nothing reserved | reuse it, or ask the user |
| `NOT_INSTALLED`, `NOT_VERIFIED` | no native CLI; `--route auto` or a batch with no VERIFIED route | nothing reserved | install, or verify once with consent |
| `SPAWN_FAILED` | the CLI could not start | `not_sent` | check the install |
| `AUTH_REQUIRED`, `RATE_LIMIT`, `MODERATION` | sign-in, quota or content policy | `failed` | the user logs in, waits, or rewrites |
| `UNEXPECTED_TOOL`, `TOOL_LIMIT`, `PERMISSION_MISMATCH` | the CLI tried something not authorised; it was stopped | `failed` | report it; do not retry blindly |
| `TOOL_UNAVAILABLE`, `GENERATION_FAILED` | the sign-in has no such tool, or the tool failed (a failed `image_to_video` call's own reason follows the code, scrubbed) | `failed` | read the reason; another route |
| `ARTIFACT_MISSING`, `ARTIFACT_COUNT`, `ARTIFACT_PATH_REJECTED`, `ARTIFACT_STALE`, `ARTIFACT_INVALID` | the output failed a provenance check (when Codex made no image, its answer follows, scrubbed) | `failed` | inspect; `adopt --file` only for a file you checked |
| `TIMEOUT`, `OUTPUT_LIMIT`, `PROTOCOL_ERROR`, `PROVIDER_ERROR`, `PUBLISH_FAILED`, `INTERRUPTED` | outcome unknown; the CLI may have produced something | `unknown` | `resume --run <id>`, then `--adopt` |
A mistyped option exits 2 with the usage line; every other failure prints one `error:` line (a
typed `CODE: message`, or `internal error (<Type>: <message>)` for a bug) and exits 1 (130 on Ctrl+C).
## What is verified
The recipes come from the owner's verified runs (Codex CLI 0.153.4 image, Grok image and ACP
video, September 2026) and are tested here only against fake CLIs. CLI flags and event formats
change between versions: the first run of each route on a new version is its verification, which
is why proofs are version-keyed. Outputs are raw media: process and check them with the sprite,
video or map skill.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |