Skip to content

roedyrustam/cinematic-motion-engine / skills/cme-audio-reactive-foley

cme-audio-reactive-foley

Verified

Procedural sound design, motion-synchronized foley (whoosh, slam, click, riser), and 60fps audio FFT envelope compilation / Desain suara prosedural, foley tersinkronisasi gerakan, dan kompilasi kurva amplop FFT audio 60fps.

CME Audio-Reactive & Procedural Foley Studio (v3.0)

English | Bahasa Indonesia


English

Overview & Capabilities

cme-audio-reactive-foley is the sound design and audio-intelligence sub-skill of the Cinematic Motion Engine. It eliminates silent motion graphics and external sound library dependencies by programmatically generating custom procedural soundtracks, synthesizing tactile motion foley SFX (whip-pan whooshes, sub-bass slams, UI clicks), and compiling voiceover audio into frame-quantized 60fps FFT envelopes.

1. The Audio Toolset Architecture

  1. Procedural Soundtrack Synthesis (scripts/generate-audio.mjs): Generates a full synthesized soundtrack .wav file matching the timeline BPM, duration, mood (warm, cyber, editorial, corporate), and custom drop timestamps.
  2. Motion Foley Sound Designer (scripts/generate-foley.mjs): Synthesizes individual sound effects or multi-event timeline foley tracks in pure Node.js 16-bit PCM:
    • --type=whoosh: Exponential frequency-swept filtered noise for camera whip-pans.
    • --type=impact: 50Hz sub-bass sine drop with soft-clip saturation for text slams.
    • --type=click: High-frequency decaying tick for numbers and UI markers.
    • --type=riser: Monotonic pitch swell for dramatic builds.
  3. Headless Audio/VO Analyzer (scripts/analyze-audio.mjs): Processes voiceover files (.wav, .mp3, .m4a) to extract speech pause boundaries (SEG), paragraph blocks (PARA), and 60fps AUDIO_FRAMES [bass, mid, high, onset].

2. Implementation Recipes

A. Generating Timeline-Synced Foley Effects

# Generate a whip-pan whoosh for camera transitions
node scripts/generate-foley.mjs --type=whoosh --out=whoosh.wav --duration=0.35

# Generate a sub-bass slam for title reveals
node scripts/generate-foley.mjs --type=impact --out=slam.wav --duration=0.65

# Render an entire timeline of mixed foley events
node scripts/generate-foley.mjs --timeline=foley-beats.json --out=foley-master.wav --totalDuration=10.0

B. Driving Visuals from 60fps Audio Envelopes

In client code (starter-*.html), read quantized frequency bands dynamically without runtime Web Audio overhead:

// Sample 60fps audio data at current timeline second t
tl.to({}, {
  duration: DURATION,
  onUpdate: () => {
    const t = tl.time();
    const { bass, mid, high, onset } = CME.sampleAudio(t);

    // Pulse background grid from bass
    gridMesh.scale.setScalar(1.0 + bass * 0.12);

    // Accentuate lighting on beat drop onset
    if (onset > 0.8) {
      glowElement.style.opacity = '1.0';
    } else {
      glowElement.style.opacity = '0.2';
    }
  }
}, 0);

Bahasa Indonesia

Ikhtisar & Kemampuan

cme-audio-reactive-foley menyediakan modul sintesis audio prosedural deterministik (WAV 44.1kHz), generator efek suara foley taktil (whoosh kamera, dentuman sub-bass, klik UI), dan analisis amplop FFT audio 60fps untuk menggerakkan visual reaktif.

Panduan Desain Suara:

  • Selalu sinkronkan efek foley whoosh dengan momen awal akselerasi kamera (into).
  • Pasangkan efek foley impact/slam saat teks judul jatuh menghentak kanvas (CME.text.slam).
brainstormingobra/superpowersYou MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or planning anything new, in software or out of it (a talk, a business, a renovation).Stars: 322kUpdated Claude CodeCodexVerifiedInstall
brand-guidelinesanthropics/skillsApplies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply.Stars: 198kUpdated Claude CodeCodexVerifiedInstall
frontend-designanthropics/skillsGuidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults.Stars: 198kUpdated Claude CodeCodexVerifiedInstall
mcp-builderanthropics/skillsGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK).Stars: 198kUpdated Claude CodeCodexVerifiedInstall