roedyrustam/cinematic-motion-engine / skills/cme-audio-reactive-foley
cme-audio-reactive-foley
VerifiedProcedural sound design, motion-synchronized foley (whoosh, slam, click, riser), and 60fps audio FFT envelope compilation / Desain suara prosedural, foley tersinkronisasi gerakan, dan kompilasi kurva amplop FFT audio 60fps.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 3.5 KB |
SKILL.md
View on GitHub---
name: cme-audio-reactive-foley
description: "Procedural sound design, motion-synchronized foley (whoosh, slam, click, riser), and 60fps audio FFT envelope compilation / Desain suara prosedural, foley tersinkronisasi gerakan, dan kompilasi kurva amplop FFT audio 60fps."
author: "Roedy Rustam"
version: "5.0.0"
---
# CME Audio-Reactive & Procedural Foley Studio (v3.0)
[English](#english) | [Bahasa Indonesia](#bahasa-indonesia)
---
<a name="english"></a>
## English
### Overview & Capabilities
`cme-audio-reactive-foley` is the sound design and audio-intelligence sub-skill of the **Cinematic Motion Engine**. It eliminates silent motion graphics and external sound library dependencies by programmatically generating custom procedural soundtracks, synthesizing tactile motion foley SFX (whip-pan whooshes, sub-bass slams, UI clicks), and compiling voiceover audio into frame-quantized 60fps FFT envelopes.
### 1. The Audio Toolset Architecture
1. **Procedural Soundtrack Synthesis (`scripts/generate-audio.mjs`)**:
Generates a full synthesized soundtrack `.wav` file matching the timeline BPM, duration, mood (`warm`, `cyber`, `editorial`, `corporate`), and custom drop timestamps.
2. **Motion Foley Sound Designer (`scripts/generate-foley.mjs`)**:
Synthesizes individual sound effects or multi-event timeline foley tracks in pure Node.js 16-bit PCM:
- `--type=whoosh`: Exponential frequency-swept filtered noise for camera whip-pans.
- `--type=impact`: 50Hz sub-bass sine drop with soft-clip saturation for text slams.
- `--type=click`: High-frequency decaying tick for numbers and UI markers.
- `--type=riser`: Monotonic pitch swell for dramatic builds.
3. **Headless Audio/VO Analyzer (`scripts/analyze-audio.mjs`)**:
Processes voiceover files (`.wav`, `.mp3`, `.m4a`) to extract speech pause boundaries (`SEG`), paragraph blocks (`PARA`), and 60fps `AUDIO_FRAMES` `[bass, mid, high, onset]`.
---
### 2. Implementation Recipes
#### A. Generating Timeline-Synced Foley Effects
```bash
# Generate a whip-pan whoosh for camera transitions
node scripts/generate-foley.mjs --type=whoosh --out=whoosh.wav --duration=0.35
# Generate a sub-bass slam for title reveals
node scripts/generate-foley.mjs --type=impact --out=slam.wav --duration=0.65
# Render an entire timeline of mixed foley events
node scripts/generate-foley.mjs --timeline=foley-beats.json --out=foley-master.wav --totalDuration=10.0
```
#### B. Driving Visuals from 60fps Audio Envelopes
In client code (`starter-*.html`), read quantized frequency bands dynamically without runtime Web Audio overhead:
```javascript
// Sample 60fps audio data at current timeline second t
tl.to({}, {
duration: DURATION,
onUpdate: () => {
const t = tl.time();
const { bass, mid, high, onset } = CME.sampleAudio(t);
// Pulse background grid from bass
gridMesh.scale.setScalar(1.0 + bass * 0.12);
// Accentuate lighting on beat drop onset
if (onset > 0.8) {
glowElement.style.opacity = '1.0';
} else {
glowElement.style.opacity = '0.2';
}
}
}, 0);
```
---
<a name="bahasa-indonesia"></a>
## Bahasa Indonesia
### Ikhtisar & Kemampuan
`cme-audio-reactive-foley` menyediakan modul sintesis audio prosedural deterministik (WAV 44.1kHz), generator efek suara foley taktil (whoosh kamera, dentuman sub-bass, klik UI), dan analisis amplop FFT audio 60fps untuk menggerakkan visual reaktif.
### Panduan Desain Suara:
- Selalu sinkronkan efek foley *whoosh* dengan momen awal akselerasi kamera (`into`).
- Pasangkan efek foley *impact/slam* saat teks judul jatuh menghentak kanvas (`CME.text.slam`).
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| brainstormingobra/superpowersYou MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or planning anything new, in software or out of it (a talk, a business, a renovation). | Stars: 323k | Updated | Claude CodeCodex | Verified | Install |
| brand-guidelinesanthropics/skillsApplies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| frontend-designanthropics/skillsGuidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| mcp-builderanthropics/skillsGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK). | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |