Skip to content

gooseworks-ai/goose-skills / skills/video/render-song-mv

render-song-mv

Verified

Assemble a song-driven music-video ad from a config — a generated sung track carries the whole narration across N tableaux (one keyframe -> one i2v clip per lyric beat) with NO separate voiceover, captions synced to the song's OWN word timings (script-window, never Whisper) and the hook word landing on the chorus drop, closed on a PIL brand end card. This is the FREE deterministic assembly stage (clip cut-to-timeline + captions + end card + FFmpeg composite); the song, keyframes, and clips come from create-music-elevenlabs / create-image-fal / create-video-fal. Use for the song-driven-music-video format.

FileKindSize
SKILL.mdskill md4.8 KB
scripts/PIPELINE.mdmarkdown5.5 KB
scripts/README.mdmarkdown3.4 KB
scripts/config.example.jsonconfig16.5 KB
skill.meta.jsonconfig169 B
tests/smoke-test.mdmarkdown1.4 KB

scripts/README.md

View on GitHub
# render-song-mv scripts — the FREE assembly

`render-song-mv` is the **deterministic, free assembly stage** of the song-driven
music-video format. The three paid stages (the sung song, the N keyframes, the N i2v
clips) are separate capabilities — `create-music-elevenlabs`, `create-image-fal`,
`create-video-fal`. This capability spends nothing: it takes the delivered song +
`words.json` + one clip per tableau and stitches the finished master. Re-cuts (new
caption chunking, a swapped end card, re-timed windows) reuse the existing song / keyframes
/ clips and spend nothing — only the paid capabilities spend.

`config.example.json` is one worked example (Fernhollow "Bring The Green Back Home", 28s
paper-craft 9:16). Its visual style, song, vocalist, mood, protagonist and setting are the demo's
answers to the recipe's `choices` — never copy them as defaults. `PIPELINE.md` maps every config block to its source step. This README
documents the four FREE assembly pieces that `render-song-mv` owns.

## 1. Lyric-synced captions — from the song's OWN word timings (script-window, NOT Whisper)

Captions come from `audio/words.json` — the word-level timestamps the music model returns
**with** the song — never from Whisper. Whisper on a sung track returns "🎵 Music Playing 🎵",
so it cannot time captions to lyrics; the script-window approach reads the song's own words
instead. The builder hand-chunks ~3 words at natural lyric-phrase boundaries (`captions.chunk_words`),
times each caption event to its first/last word, and colors the `captions.accent_words` in
`accent_color` against `base_color` (demo: warm glow on cream) (lower-third serif italic) → an ASS
subtitle file. The hero/hook chunk is timed so the payoff word (`song.hook_word`) lands on
the chorus drop; the outro line is intentionally left uncaptioned so it doesn't double-stack
with the end-card tagline.

## 2. Per-scene clip assembly to the song timeline

The song sets the timeline. Each tableau boundary in `timeline.json` was snapped to a
lyric-phrase edge in the returned word timings, so assembly cuts each per-tableau clip to
its lyric window and hard-concats the clips **on the beat** (one optional match-cut into the
hook-hero reveal). No dissolves. The N clips + their windows are a pure function of the song,
so the whole cut is deterministic and repeatable.

## 3. PIL end card — from the real brand asset, no AI text

The brand lockup is composited with **PIL** from the brand's REAL asset (e.g. a logo mark from
the brand kit, or an app icon from the iTunes Search API): brand-color gradient (from the brand kit) + the circular
mark with a soft halo (the demo added paper leaves to match its style) + wordmark + tagline + CTA → a PNG overlaid on the final window
(`end_card.overlay_window_sec`). The brand text is **never** AI-rendered — a diffusion model
garbles a wordmark, so the lockup is drawn deterministically from the real
asset every time.

## 4. FFmpeg composite

FFmpeg stitches the whole master: cut each clip to its lyric window, hard-concat on the beat,
burn the caption ASS via libass, overlay the PIL end-card PNG on the final window, mux
`audio/music.mp3` (the sung track IS the bed — no separate VO), boost the climax beat
(`audio_mix.climax_boost_db` on `audio_mix.climax_beat_id`), and loudnorm to `audio_mix.loudness_lufs` (−14 LUFS). Output
is a 1080×1920 h264+aac master. Deterministic, no paid calls, no keys.
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall