Skip to content

gooseworks-ai/goose-skills / skills/video/render-narrated-ugc-wardrobe-stitch

render-narrated-ugc-wardrobe-stitch

Verified

Assemble a narrated-UGC "stitch reply" ad from a config: one voiceover carries a verbatim testimonial while about 30 short clips (one creator across about 5 outfits and 3 settings, plus product B-roll) are trimmed to windows cut from the voiceover's word timings and joined. The voiceover sits over a ducked music bed, word-by-word captions run throughout, a landing-page scroll is animated from a screenshot, and the brand's real end card closes it (never AI-rendered text). Free, deterministic assembly using the shared stitch-videos-ffmpeg helper; the voiceover, creator stills and clips come from create-vo-elevenlabs, create-image-gpt-image-fal, create-image-fal and create-video-fal. Use for the narrated-ugc-wardrobe-stitch format.

FileKindSize
SKILL.mdskill md6.6 KB
scripts/PIPELINE.mdmarkdown6.8 KB
scripts/README.mdmarkdown8.8 KB
scripts/config.example.jsonconfig12.3 KB
skill.meta.jsonconfig257 B
tests/smoke-test.mdmarkdown2.3 KB

scripts/config.example.json

View on GitHub
{
  "_comment": "Worked example (the fictional Sunnook 'Don't buy Sunnook Tan Mousse' demo). Creative fields — character.descriptor, character.name, vo.voice_id, vo.settings, vo.hook_line, vo.payoff_line, vo.script_md / vo.sentences, worlds.briefs, audio_mix.music_brief (plus brand_name/title/product/landing_page/end_card, which come from the brand) — come from the recipe's choices; never copy them as defaults. Copy to config.json and edit. A ~37s (34.8s body + ~2s end card) fast-cut narrated UGC 'stitch reply' where a single synthetic VO carries a verbatim ~13-sentence testimonial (this demo: a 'don't buy X... here's why you SHOULD' reversal hook; the angle is choices.hook_angle) across ONE creator in 5 wardrobes + ~3 rooms, interspersed with product B-roll (mousse macro, unboxing, landing-page scroll). Pipeline: (1) lock the VO FIRST (ElevenLabs v3 + Whisper word-align — the word boundaries set the cut grid); (2) build a ~30-cut role-tagged EDL from the word boundaries; (3) lock the creator (gpt-image-2 anchor + 5 wardrobe edits chained off the anchor) + 3 world wides; (4) one start-frame per cut (gpt-image-2 creator + product composites + a Playwright landing-page); (5) one Veo 3.1 i2v clip per cut (verb-led, ~4s); (6) trim + filter_complex concat, VO+music sidechain-ducked mix, karaoke-pop captions throughout, brand end-card append. Master 1080x1920 h264+aac, ~36.8s. See scripts/PIPELINE.md for the source scripts.",
  "brand_name": "Sunnook",
  "campaign": "Don't buy (demo)",
  "title": "Don't buy Sunnook Tan Mousse",
  "width": 1080,
  "height": 1920,
  "fps": 30,
  "aspect_ratio": "9:16",
  "duration_sec": 36.8,
  "body_end_s": 34.8,
  "end_card_hold_s": 2.0,
  "vo": {
    "_comment": "Locked FIRST — the VO + its Whisper WORD BOUNDARIES set the cut grid. voice_id/settings/hook_line/payoff_line/sentences are the DEMO values — take them from choices.voice + choices.hook_angle. The demo's locked testimonial script. ElevenLabs v3 (Professional Speaker) reads slow; atempo ~1.24x clamps to ~32s. Keep creator-native spellings ('I'ma') verbatim; lock the brand token ('Sunnook') over Whisper's mishearings. Payoff line 'and just look at my legs.' lands the payoff-hold beat.",
    "provider": "elevenlabs",
    "model": "eleven_v3",
    "voice_id": "Fc5CaIGWKvLHapoOSM2K",
    "script_md": "script/script-locked.md",
    "hook_line": "Don't buy Sunnook Tan Mousse.",
    "payoff_line": "and just look at my legs.",
    "target_duration_s": 30,
    "target_wpm": 180,
    "atempo_expected": 1.24,
    "settings": { "stability": 0.35, "similarity_boost": 0.75, "style": 0.55, "use_speaker_boost": true },
    "outputs": {
      "audio": "audio/vo-final.mp3",
      "word_timings": "audio/vo-final.words.json"
    },
    "sentences": [
      { "n": "S01", "t_in": 0.0, "t_out": 1.8, "role": "hook · pattern-interrupt", "text": "Don't buy Sunnook Tan Mousse." },
      { "n": "S02", "t_in": 1.8, "t_out": 4.8, "role": "feature", "text": "They promised a streak-free glow that lasts all week." },
      { "n": "S03", "t_in": 4.8, "t_out": 7.4, "role": "feature", "text": "Fine, but honestly nobody mentioned it fully develops in under an hour." },
      { "n": "S04", "t_in": 7.4, "t_out": 10.5, "role": "feature · b-roll-insert", "text": "I've been using one pump of this foam every other night," },
      { "n": "S05", "t_in": 10.5, "t_out": 12.8, "role": "payoff-hold", "text": "and just look at my legs." },
      { "n": "S06", "t_in": 12.8, "t_out": 14.8, "role": "reaction-insert", "text": "Plus my arms finally match my face again." },
      { "n": "S07", "t_in": 14.8, "t_out": 18.0, "role": "feature · b-roll-insert", "text": "The whipped coconut-water mousse in here dries super fast." },
      { "n": "S08", "t_in": 18.0, "t_out": 20.5, "role": "feature", "text": "And I really figured it would look kind of orange at first," },
      { "n": "S09", "t_in": 20.5, "t_out": 22.5, "role": "feature", "text": "but it reads like a real beach tan." },
      { "n": "S10", "t_in": 22.5, "t_out": 25.5, "role": "reaction-insert", "text": "Y'all keep chasing tanning beds," },
      { "n": "S11", "t_in": 25.5, "t_out": 26.5, "role": "feature", "text": "I'ma keep using my Sunnook." },
      { "n": "S12", "t_in": 26.5, "t_out": 30.0, "role": "b-roll-insert · landing-page", "text": "Oh, and this week there's a bundle deal that throws in a free mitt and travel size." },
      { "n": "S13", "t_in": 30.0, "t_out": 32.5, "role": "feature · bundle unboxing", "text": "I dropped the link right here — grab a set before the big summer rush." }
    ]
  },
  "character": {
    "_comment": "ONE recurring UGC creator, locked once. name/descriptor below are the DEMO creator — take them from choices.creator. `descriptor` threads VERBATIM (byte-identical block) into every creator start-frame; the anchor is passed as the ref (--anchor) on EVERY wardrobe/pose edit so identity holds across all 5 wardrobe changes. Chain every wardrobe off the CLEAN anchor.",
    "name": "marisol",
    "method": "anchor-ref",
    "max_drift": 0.05,
    "descriptor": "31-year-old Latina woman, petite build, 5'3, shoulder-length dark brown curly hair with a side part, natural un-retouched skin with visible pores and a few faint sun spots, slightly asymmetrical features, thick natural brows, minimal makeup. Thin gold hoop earrings.",
    "framing": "iPhone 14 front-cam selfie video still, slightly grainy and slightly soft, handheld with slight natural motion blur, real iPhone color science, slight wide-angle edge distortion, warm natural light, NOT sharp NOT studio NOT glam, photojournalistic UGC.",
    "anchor": "generated/character-lock/anchor-portrait.png",
    "wardrobes": [
      "generated/character-lock/wardrobes/w1.png",
      "generated/character-lock/wardrobes/w2.png",
      "generated/character-lock/wardrobes/w3.png",
      "generated/character-lock/wardrobes/w4.png",
      "generated/character-lock/wardrobes/w5.png"
    ],
    "wardrobe_count": 5,
    "_note_w2": "W2 (white tank + denim shorts, full-length mirror MS, leg-forward pose) is the payoff-hold legs-reveal wardrobe (cut s11)."
  },
  "worlds": {
    "_comment": "3 world wides, NO creator — the establishing rooms the creator start-frames composite into. briefs are the DEMO worlds — take them from choices.worlds.",
    "count": 3,
    "briefs": ["bedroom / mirror room", "sunlit balcony", "bathroom / vanity"],
    "outputs": [
      "generated/world-lock/world1/world1-1-establishing.png",
      "generated/world-lock/world2/world2-1-establishing.png",
      "generated/world-lock/world3/world3-1-establishing.png"
    ]
  },
  "product": {
    "_comment": "The brand's real bottle hero drives the B-roll composites (foam-on-mitt macro, pump close-up, label, unboxing flatlay). Ground on the real hero — never an AI-hallucinated bottle.",
    "hero_png": "../../brand-assets/product-photos/sunnook-tan-mousse-bottle.png",
    "unboxing_ref": "../../brand-assets/product-photos/sunnook-bundle-unboxing.png"
  },
  "landing_page": {
    "_comment": "The sale/CTA scroll cuts (s24-s26) are a Playwright render of the brand's real landing page (2160x3840 @ 2x DSR) -> FFmpeg zoompan. NOT i2v. Zoom targets: wide -> bundle price card -> Order-now button.",
    "url": "https://www.sunnook.example/",
    "render_png": "assets/overlays/landing-page.png",
    "method": "playwright + ffmpeg-zoompan"
  },
  "keyframe_engine": {
    "creator_model": "gpt-image-2",
    "broll_model": "nano-banana",
    "provider": "fal",
    "aspect_ratio": "9:16",
    "batch_size": 3,
    "character_ref": "pass the locked anchor + the matching wardrobe as media refs on every creator start-frame"
  },
  "clip_engine": {
    "provider": "fal",
    "model": "veo3_1",
    "alternative": "seedance_2_0",
    "duration_sec": 4,
    "resolution": "1080p",
    "batch_size": 3,
    "motion_opener": "VERB-LED (never camera-led): the creator/product does a specific action, THEN any secondary motion. Stable start pose, action in the prompt. NO camera 'slow push-in' opener (reads static), NO morphing, single person only.",
    "_note": "Veo 3.1 via FAL @1080p, ~4s/clip. Cuts 24-26 (landing-page scroll) are FFmpeg zoompan, not i2v. Re-roll any drifted clip off its clean start-frame (create-video-fal)."
  },
  "edl": {
    "_comment": "30 role-tagged cuts built from the VO word boundaries (montage.py edl from stitch-videos-ffmpeg: one montage.json clip per cut with a word_range -> edl.json; see README.md section 0). archetype reaction-montage-explainer, caption_family karaoke-pop, pacing_profile front-load-hold-decelerate. The payoff-hold (s11) is the held reveal beat (~3x mean shot length). A representative subset is inlined here; the full 30-cut grid is edl.json.",
    "schema_version": "1.0",
    "cut_count": 30,
    "hook_type": "claim-caption",
    "caption_family": "karaoke-pop",
    "pacing_profile": "front-load-hold-decelerate",
    "payoff_hold_id": "s11-payoff-legs-reveal",
    "source": "edl.json",
    "timeline_sample": [
      { "id": "s01-hook-bottle-mcu", "role": "hook", "t_in": 0.03, "t_out": 0.39, "source": "generate", "image_refs": ["anchor", "world1-establishing", "product-hero"] },
      { "id": "s02-hook-hand-bottle-ecu", "role": "hook", "t_in": 0.39, "t_out": 2.27, "source": "generate", "image_refs": ["product-hero"] },
      { "id": "s05-they-promised-w4-hands", "role": "feature", "t_in": 3.99, "t_out": 5.29, "source": "generate", "image_refs": ["anchor", "w4", "world2-establishing"] },
      { "id": "s08-foam-mitt-ecu", "role": "b-roll-insert", "t_in": 10.73, "t_out": 11.37, "source": "generate", "image_refs": ["product-hero"] },
      { "id": "s11-payoff-legs-reveal", "role": "payoff-hold", "t_in": 14.21, "t_out": 15.65, "source": "generate", "image_refs": ["anchor", "w2", "world1-establishing"] },
      { "id": "s21-beach-tan-mirror-3q", "role": "feature", "t_in": 25.95, "t_out": 28.27, "source": "generate", "image_refs": ["anchor", "w3", "world1-establishing"] },
      { "id": "s24-sale-landingpage-ws", "role": "landing-page", "t_in": 31.49, "t_out": 33.03, "source": "landing-page", "image_refs": ["landing-page-png"] },
      { "id": "s25-sale-bundle-zoom", "role": "landing-page", "t_in": 33.03, "t_out": 34.69, "source": "landing-page", "image_refs": ["landing-page-png"] },
      { "id": "s27-link-unboxing-flatlay", "role": "b-roll-insert", "t_in": 36.81, "t_out": 37.53, "source": "generate", "image_refs": ["unboxing-ref"] }
    ]
  },
  "captions": {
    "_comment": "Karaoke-pop captions on EVERY word, throughout (VEED Whisper preset, bold yellow). Built from vo-final.words.json. Re-spell brand tokens Whisper mishears against the locked script: 'Sunnook' (not 'Sunook'/'Sunnuk'); keep 'I'ma' verbatim. If VEED falls back to a wrong spelling on S11, hand-patch that sentence with local ASS karaoke.",
    "style": "karaoke-pop",
    "preset": "veed-whisper",
    "position": "center",
    "base_color": "#FFFFFF",
    "accent_color": "#FFE800",
    "font": "bold",
    "source": "audio/vo-final.words.json",
    "on_every_word": true,
    "throughout": true,
    "respell_tokens": { "Sunook": "Sunnook", "Sunnuk": "Sunnook" }
  },
  "audio_mix": {
    "_comment": "The VO is the narration bed; the whole ad is cut to it. An instrumental music bed is sidechain-ducked UNDER the VO (-20dB, 20:1), dropping in at 14.21s (the payoff-hold). VO stays clearly on top. End card appended after the body.",
    "vo": "audio/vo-final.mp3",
    "music": "audio/music/bed.mp3",
    "music_optional": true,
    "music_brief": "optional ducked instrumental bed (demo value; from choices.music — 'no music' turns the bed off)",
    "ducking": "sidechain-20:1",
    "music_gain_db": -20,
    "music_drop_s": 14.21,
    "loudness_lufs": -14
  },
  "end_card": {
    "_comment": "The brand's real end-card PNG appended ~2s on the tail — NEVER AI-rendered text. Captions suppressed over the card.",
    "brand_png": "../../brand-assets/sunnook-end-card.png",
    "hold_sec": 2.0,
    "suppress_captions": true
  },
  "post_production": {
    "vo": { "default": "on", "note": "the synthetic VO IS the narration; the whole ad is cut to its word timings" },
    "music": { "default": "on", "note": "instrumental bed sidechain-ducked under the VO (-20dB, 20:1), VO clearly on top" },
    "captions": { "default": "on", "note": "karaoke-pop captions on every word, throughout, re-spelled against the locked script" },
    "end_card": { "default": "on", "note": "the brand's real end-card PNG appended ~2s on the tail, captions suppressed, never AI-rendered" }
  }
}
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall