gooseworks-ai/goose-skills / skills/video/render-cartoon-music-video
render-cartoon-music-video
VerifiedAssemble a cartoon / animated / hand-crafted music-video ad from a config — a sung song carries the whole narrative while N per-bar i2v clips (one recurring animated character, one look pack) are each cut to their BAR window from librosa beat-tracking and hard-concatenated on the bar, VEED-whisper white bold-sans captions in the BOTTOM third (Alignment 2, above the logo bug, no pill) burned from the song's word timings re-spelled against the locked lyrics, a persistent brand logo bug held over the body (suppressed on the end card), and closed on a solid-brand-color PIL end card with the song still playing under it — never AI-rendered text. This is the FREE deterministic assembly stage (cut-to-bar + hard concat + logo bug + captions + end card + song mux); the song, character, keyframes, and clips come from create-music-elevenlabs / create-image-fal / create-video-fal. Use for the cartoon-music-video format.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 6.1 KB |
| scripts/PIPELINE.md | markdown | 8.4 KB |
| scripts/README.md | markdown | 4.5 KB |
| scripts/config.example.json | config | 21.7 KB |
| skill.meta.json | config | 181 B |
| tests/smoke-test.md | markdown | 1.0 KB |
scripts/README.md
View on GitHub# render-cartoon-music-video scripts — the FREE assembly
`render-cartoon-music-video` is the **deterministic, free assembly stage** of the cartoon
music-video format. The paid stages (the sung song, the character lock, the N per-bar keyframes,
the N Seedance i2v clips) are separate capabilities — `create-music-elevenlabs`,
`create-image-fal`, `create-video-fal`. This capability spends nothing: it takes the song +
`word-timestamps.json` + `bars.json` + one clip per bar + the brand wordmark SVG and stitches the
finished master. Re-cuts (new caption chunking, a swapped end card, re-timed windows, a logo-bug
toggle) reuse the existing song / keyframes / clips and spend nothing.
`config.example.json` is the worked example (Sudsabout "Fresh by morning", ~55s 1080×1920); its felt look,
character, story and song are that demo's answers to the recipe choices — never defaults).
`PIPELINE.md` maps every config block to its source step. This README documents the FREE assembly
pieces that `render-cartoon-music-video` owns.
## 1. Captions — from the song's word timings, re-spelled against the locked lyrics
Captions come from the song's `word-timestamps.json` **re-spelled against the locked lyrics**
(`align_to_lyrics`) — Whisper mishears shouted accents (e.g. "FRESH" → "Flesh", "BACK" → "Black"), so
the timed tokens are re-spelled against the locked lyric file (never edit the lyrics to match
Whisper). Feed a `lyrics-plain.md` (lyric text only, no bar-grid table) so the parser doesn't
ingest hundreds of markdown-table "words". It chunks ~4–5 words per cue and renders VEED-whisper
style — clean white **bold sans** in the **BOTTOM third** (Alignment 2, `margin_v` above the
bottom-left logo bug so they don't collide, NO pill, 6px outline), ≥0.9s on screen — and STOPS
captions at the end-card boundary so the brand frame breathes. Do **not** place captions mid-frame
(Alignment 5) — it covers the character (fixed 2026-07). Matches the `ugc-walk-and-talk` recipe's
`add-captions-veed-fal --preset whisper --position bottom` treatment.
## 2. Cut-to-bar + hard-concat on the bar
The song's BAR GRID (librosa beat-track, 4/4) sets the timeline — one bar = one shot (default).
Assembly cuts each body clip to its bar window from `bars.json` and hard-concats **on the bar**
(the shipped cut used hard cuts — a tested 0.3s xfade read less punchy). No dissolves. The climax
clip is timed so the payoff line lands on the drop.
## 3. Logo bug + end card — cairosvg + PIL from the real wordmark, no AI text
- **Logo bug:** cairosvg renders the brand wordmark SVG → recolored white via PIL → the
persistent bottom-left bug burned over the body bars, **suppressed on the end card**.
- **End card:** cairosvg white wordmark + PIL subhead on a solid brand-color card → a silent ~3s
end-card mp4. On macOS pick a font with the em-dash / middle-dot glyph (use ` · `).
The brand text is **never** AI-rendered — a diffusion model garbles a wordmark.
## 4. FFmpeg composite
FFmpeg stitches the master: cut each body clip to its bar window, hard-concat on the bar, burn the
logo bug (bottom-left) + the captions, append the end card holding ~3s, mux the song OVER the whole
video including the end card with a 0.5s `afade` at the tail (no silent tail), and `loudnorm I=-14`.
Captions burn via libass **if present**; on a host without libass/drawtext (common — Homebrew ffmpeg),
render each caption cue AND the logo bug as timed **PIL PNG overlays** (`overlay=x:y:enable='between(t,st,en)'`)
at the same placement. The sung song IS the bed — no separate VO. Output is a 1080×1920 h264 + aac
master. Deterministic, no paid calls, no keys.
## 5. QC per scene before publish (the two content failure modes)
The assembly is faithful, but the upstream keyframe/i2v can slip two defects that a sparse-still
watch misses in a ~55s master:
- **Character drift off the chosen look** (in the felt demo: felt → smooth-3D "man") partway through (lives in the KEYFRAME; regenerate the
drifted bar's keyframe, don't re-cut).
- **Hallucinated hands** — realistic fingers in a hand macro, a pointing finger on a "tap the
phone" shot, or a disembodied hand from the frame edge.
Extract a **2 fps** contact sheet across the whole master + a per-bar **FACE** crop and **HAND**
crop (across each clip's full duration); audit ALL bars at head-crop resolution to find the true
drift boundary; then re-extract frames from the **served** bytes (download the published file), not the local
file, after publish. (cartoon-music-video demo run, 2026-07.)
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |