gooseworks-ai/goose-skills / skills/video/render-song-mv
render-song-mv
VerifiedAssemble a song-driven music-video ad from a config — a generated sung track carries the whole narration across N tableaux (one keyframe -> one i2v clip per lyric beat) with NO separate voiceover, captions synced to the song's OWN word timings (script-window, never Whisper) and the hook word landing on the chorus drop, closed on a PIL brand end card. This is the FREE deterministic assembly stage (clip cut-to-timeline + captions + end card + FFmpeg composite); the song, keyframes, and clips come from create-music-elevenlabs / create-image-fal / create-video-fal. Use for the song-driven-music-video format.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 4.8 KB |
| scripts/PIPELINE.md | markdown | 5.5 KB |
| scripts/README.md | markdown | 3.4 KB |
| scripts/config.example.json | config | 16.5 KB |
| skill.meta.json | config | 169 B |
| tests/smoke-test.md | markdown | 1.4 KB |
SKILL.md
View on GitHub---
name: render-song-mv
description: Assemble a song-driven music-video ad from a config — a generated sung track carries the whole narration across N tableaux (one keyframe -> one i2v clip per lyric beat) with NO separate voiceover, captions synced to the song's OWN word timings (script-window, never Whisper) and the hook word landing on the chorus drop, closed on a PIL brand end card. This is the FREE deterministic assembly stage (clip cut-to-timeline + captions + end card + FFmpeg composite); the song, keyframes, and clips come from create-music-elevenlabs / create-image-fal / create-video-fal. Use for the song-driven-music-video format.
status: active
---
# render-song-mv
Assemble a song-driven music-video ad from a config: a purpose-written, **sung** song is
the entire narration (no separate voiceover), and every visual beat is timed to the lyrics.
The delivered song sets the timeline; N tableaux (one keyframe → one image-to-video clip per
lyric beat, all in a single look pack) are cut to their lyric windows and hard-concatenated
on the beat, captions are built from the song's OWN word timings with the hook line landing
on the chorus drop, and the spot closes on a PIL brand end card. It reads like a tiny animated
music video, not a demo. `scripts/config.example.json` is one worked example (Fernhollow "Bring The
Green Back Home", 28s paper-craft 9:16) — its style, song, vocalist, mood, protagonist and
setting are that demo's answers, not defaults; `scripts/PIPELINE.md` maps every config block
to its step and `scripts/README.md` documents the free assembly.
## Choices
The creative calls are made upstream by the user (the recipe's `choices`) and arrive in the config;
this assembly never picks them.
- **visual_style** → `look_pack`, `clip_engine.motion_opener`. The demo used a paper-craft diorama
on a rainy morning.
- **song_genre** → `song.prompt` / `song.bpm`. The demo used breezy bedroom-pop at ~80 BPM.
- **vocalist** → `song.prompt`. The demo used a warm, airy male lead.
- **mood** → `song.prompt`, the lyrics, `tableaux`. The demo went grey and stuck → fresh and hopeful.
- **protagonist** → `look_pack.style_opener`. The demo used a young-man paper-doll.
- **setting** → `tableaux[].keyframe_prompt`. The demo went grey apartment → paper indoor jungle.
## Run
This is the **FREE, deterministic** assembly stage — it spends nothing. The three paid
inputs are separate capabilities: the sung song (`create-music-elevenlabs`, music_v1,
force_instrumental FALSE — the lyrics ARE the script, returns mp3 + `words.json`), one
keyframe per tableau (`create-image-fal`), and one Kling 3.0 i2v clip per tableau
(`create-video-fal`). Given the delivered song + `words.json` + one clip per beat,
`render-song-mv` cuts each clip to its lyric window, hard-concats on the beat, builds the
lyric-synced captions, composites the PIL end card, and muxes → the master. Re-cuts reuse
the existing song / keyframes / clips and spend nothing.
## Contract (the free assembly)
- **The sung song carries the narration — no separate VO.** The generated ElevenLabs track
IS the bed and the script (`force_instrumental` false); do not add a spoken voiceover or a
second music bed.
- **Plan the timeline AROUND the delivered song.** The song is generated first and reshapes/
overshoots length; snap every tableau boundary to the lyric-phrase edges in the returned
word timings (`timeline.json`) — never trim the song to a pre-planned grid.
- **Captions from the song's OWN word timings, not Whisper (script-window).** Chunk
`audio/words.json` (~3 words at lyric boundaries); accent words get `captions.accent_color`.
Whisper on sung audio returns "🎵 Music Playing 🎵", so it can't caption lyrics.
- **Land the hook on the chorus drop.** Exactly ONE hero tableau (`is_hook`) is timed so the
payoff word (`song.hook_word`) sits on the chorus drop; accent that word in the captions.
- **One look pack for consistency.** A single `style_opener` + `negative_tail` + palette drives
every keyframe so N beats read as one film; no morph within a clip.
- **Hard cuts on the beat.** Cut each clip to its lyric window and hard-concat — no dissolves
(one optional match-cut into the hero reveal).
- **PIL end card from the brand's real asset (e.g. a logo mark or app icon) — never AI-render brand text.** The lockup is
composited deterministically (brand gradient + circular logo mark or app icon + wordmark + tagline + CTA)
from the brand's real asset; a diffusion model garbles a wordmark.
- **FFmpeg composite, deterministic, FREE.** Burn the caption ASS, overlay the end-card PNG on
the final window, mux the song, boost the climax beat (`audio_mix.climax_beat_id` — set it to
this run's hook tableau; the demo's `T08` is example-only), loudnorm to −14 LUFS → 1080×1920
h264+aac. No paid calls, no keys.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |