Skip to content

Makkov-design/makkov-harness / skills/media-use

media-use

Verified

Get or make any media for a HyperFrames video - music, sound effects, images, icons, logos, voiceover, avatar and generated video, transcripts, cutouts, colour grades and looks - with HeyGen or free local tools, and mix placed audio. Also for footage that looks dark, flat or dull, or should be stylized or hidden.

FileKindSize
.gitignoreother17 B
LICENSEother10.5 KB
SKILL.mdskill md5.9 KB
audio/assets/sfx/CREDITS.mdmarkdown1.2 KB
audio/assets/sfx/chime.mp3binary26.7 KB
audio/assets/sfx/click-soft.mp3binary11.4 KB
audio/assets/sfx/click.mp3binary11.4 KB
audio/assets/sfx/error.mp3binary50.6 KB
audio/assets/sfx/glitch-1.mp3binary82.4 KB
audio/assets/sfx/glitch-2.mp3binary109.5 KB
audio/assets/sfx/glitch-3.mp3binary96.8 KB
audio/assets/sfx/impact-bass-1.mp3binary66.1 KB
audio/assets/sfx/impact-bass-2.mp3binary81.0 KB
audio/assets/sfx/key-press.mp3binary3.8 KB
audio/assets/sfx/manifest.jsonconfig3.6 KB
audio/assets/sfx/notification.mp3binary76.7 KB
audio/assets/sfx/ping.mp3binary25.8 KB
audio/assets/sfx/pop.mp3binary22.5 KB
audio/assets/sfx/riser.mp3binary313.5 KB
audio/assets/sfx/sparkle.mp3binary56.3 KB
audio/assets/sfx/typing.mp3binary26.2 KB
audio/assets/sfx/whoosh-cinematic.mp3binary173.3 KB
audio/assets/sfx/whoosh-short.mp3binary18.0 KB
audio/assets/sfx/whoosh.mp3binary18.0 KB
audio/references/bgm.mdmarkdown7.9 KB
audio/references/captions/authoring.mdmarkdown9.2 KB
audio/references/captions/motion.mdmarkdown5.4 KB
audio/references/captions/transcript-handling.mdmarkdown5.3 KB
audio/references/remove-background.mdmarkdown8.3 KB
audio/references/requirements.mdmarkdown4.4 KB
audio/references/sfx.mdmarkdown6.4 KB
audio/references/transcribe.mdmarkdown2.8 KB
audio/references/tts-to-captions.mdmarkdown1.7 KB
audio/references/tts.mdmarkdown13.7 KB
audio/scripts/audio.mjsscript13.1 KB
audio/scripts/audio.test.mjsscript5.9 KB
audio/scripts/carve.mjsscript23.3 KB
audio/scripts/carve.test.mjsscript11.5 KB
audio/scripts/extract-audio-data.pyscript7.0 KB
audio/scripts/gemini-pipeline.test.mjsscript5.0 KB
audio/scripts/heygen-tts.mjsscript4.3 KB
audio/scripts/heygen-tts.test.mjsscript1.4 KB
audio/scripts/heygen-voice.mjsscript3.8 KB
audio/scripts/heygen-voice.test.mjsscript8.3 KB
audio/scripts/lib/audio-meta.mjsscript1.1 KB
audio/scripts/lib/audio-meta.test.mjsscript4.5 KB
audio/scripts/lib/bgm-volume.mjsscript236 B
audio/scripts/lib/bgm.mjsscript11.3 KB
audio/scripts/lib/bgm.test.mjsscript2.6 KB
audio/scripts/lib/concurrency.mjsscript527 B
audio/scripts/lib/concurrency.test.mjsscript1.6 KB
audio/scripts/lib/gemini-auth.mjsscript1.6 KB
audio/scripts/lib/gemini-auth.pyscript1.9 KB
audio/scripts/lib/gemini-auth.test.mjsscript3.0 KB
audio/scripts/lib/gemini-auth_test.pyscript4.3 KB
audio/scripts/lib/gemini-tts.mjsscript5.0 KB
audio/scripts/lib/gemini-tts.test.mjsscript9.2 KB
audio/scripts/lib/heygen.mjsscript12.6 KB
audio/scripts/lib/heygen.test.mjsscript14.8 KB
audio/scripts/lib/main-module.mjsscript479 B
audio/scripts/lib/media-record.mjsscript4.1 KB
audio/scripts/lib/media-record.test.mjsscript7.7 KB
audio/scripts/lib/openverse.mjsscript7.8 KB
audio/scripts/lib/openverse.test.mjsscript4.3 KB
audio/scripts/lib/python.mjsscript3.2 KB
audio/scripts/lib/python.test.mjsscript5.2 KB
audio/scripts/lib/sfx.mjsscript7.2 KB
audio/scripts/lib/sfx.test.mjsscript11.6 KB
audio/scripts/lib/tts.cleanup.test.mjsscript6.6 KB
audio/scripts/lib/tts.mjsscript17.3 KB
audio/scripts/lib/tts.spawn.test.mjsscript5.1 KB
audio/scripts/lib/tts.test.mjsscript8.1 KB
audio/scripts/lyria-recipe.pyscript4.9 KB
audio/scripts/wait-bgm.mjsscript5.7 KB
audio/scripts/wait-bgm.test.mjsscript3.3 KB
luts/README.mdmarkdown1.1 KB
luts/index.jsonconfig2.0 KB
references/audio.mdmarkdown2.4 KB
references/grading.mdmarkdown7.0 KB
references/heygen.mdmarkdown8.5 KB
references/local.mdmarkdown2.6 KB
references/media-treatment-recipes.mdmarkdown35.0 KB
references/media-treatments.mdmarkdown13.8 KB
references/memory.mdmarkdown3.7 KB
references/meta.mdmarkdown6.8 KB
references/mixing.mdmarkdown4.5 KB
references/operations.mdmarkdown15.7 KB
references/resolve.mdmarkdown9.5 KB
references/setup-providers.mdmarkdown9.3 KB
references/telemetry-dashboard.mdmarkdown4.1 KB
scripts/audio-duck.mjsscript4.0 KB
scripts/compatibility.test.mjsscript1.6 KB
scripts/dither.mjsscript9.7 KB
scripts/dither.test.mjsscript4.6 KB
scripts/eval.mjsscript14.5 KB
scripts/lib/config-lock.mjsscript1.5 KB
scripts/lib/cutlist.mjsscript6.2 KB
scripts/lib/duck.mjsscript3.8 KB
scripts/lib/error-diffusion.mjsscript6.5 KB
scripts/lib/hyperframes-pin.mjsscript1.8 KB
scripts/lib/hyperframes-pin.test.mjsscript1.0 KB
scripts/lib/index-gen.mjsscript1.9 KB
scripts/lib/manifest.mjsscript9.2 KB
scripts/lib/media-fetch.mjsscript2.8 KB
scripts/lib/media-home.mjsscript730 B
scripts/lib/npx-sync.mjsscript2.3 KB
scripts/lib/parakeet-words.mjsscript1.1 KB
scripts/lib/prefs-store.mjsscript6.8 KB
scripts/lib/recipe-store.mjsscript13.0 KB
scripts/lib/telemetry.mjsscript8.8 KB
scripts/lib/telemetry.test.mjsscript2.8 KB
scripts/lib/transcriptCutFade.mjsscript911 B
scripts/lib/words.mjsscript728 B
scripts/prefs.mjsscript2.3 KB
scripts/recipe.mjsscript3.8 KB
scripts/resolve-plugin.test.mjsscript2.5 KB
scripts/resolve.mjsscript1.3 KB
scripts/transcribe.mjsscript7.5 KB
scripts/transcribe.test.mjsscript4.0 KB
scripts/transcript-cut.mjsscript10.0 KB
scripts/transcript-cut.test.mjsscript9.6 KB

audio/scripts/extract-audio-data.py

View on GitHub
#!/usr/bin/env python3
"""
Extract per-frame audio visualization data from an audio or video file.

Outputs JSON with RMS amplitude and frequency band data at the target FPS,
ready to embed in a HyperFrames composition.

Usage:
    python extract-audio-data.py input.mp3 -o audio-data.json
    python extract-audio-data.py input.mp4 --fps 30 --bands 16 -o audio-data.json

Requirements:
    - Python 3.9+
    - ffmpeg (for decoding audio)
    - numpy (pip install numpy)
"""

import argparse
import json
import subprocess
import sys

import numpy as np

# Windows sizes stdio to the ANSI code page (cp1252). These scripts emit UTF-8 on
# every platform; say so rather than depending on the console's code page. Carry
# `errors` across: reconfigure() resets it to "strict", and CPython deliberately gives
# stderr "backslashreplace" so the diagnostic path can never itself raise.
for _stream in (sys.stdout, sys.stderr):
    if hasattr(_stream, "reconfigure"):
        _stream.reconfigure(encoding="utf-8", errors=_stream.errors)

# ---------------------------------------------------------------------------
# FFT parameters
#
# A 4096-sample window gives ~10.8 Hz per bin at 44100Hz — enough to resolve
# low-frequency bands cleanly. The per-frame audio slice (44100/30 = 1470
# samples at 30fps) is too small and causes low bands to map to the same bins.
#
# Frequency range 30Hz–16kHz covers the useful range for music. Below 30Hz is
# sub-bass most speakers can't reproduce; above 16kHz is noise/harmonics that
# don't contribute to perceived rhythm or melody.
# ---------------------------------------------------------------------------

SAMPLE_RATE = 44100
FFT_SIZE = 4096
MIN_FREQ = 30.0
MAX_FREQ = 16000.0


def decode_audio(path: str) -> np.ndarray:
    """Decode audio to mono float32 samples via ffmpeg."""
    cmd = [
        "ffmpeg", "-i", path,
        "-vn", "-ac", "1", "-ar", str(SAMPLE_RATE),
        "-f", "s16le", "-acodec", "pcm_s16le",
        "-loglevel", "error",
        "pipe:1",
    ]
    result = subprocess.run(cmd, capture_output=True)
    if result.returncode != 0:
        # Decoding ffmpeg's diagnostics strictly makes the reporter the thing that
        # crashes: a Windows ffmpeg emits cp1252 bytes, and UnicodeDecodeError here
        # would bury the actual failure it was trying to report.
        print(f"ffmpeg error: {result.stderr.decode('utf-8', errors='replace')}", file=sys.stderr)
        sys.exit(1)
    return np.frombuffer(result.stdout, dtype=np.int16).astype(np.float32) / 32768.0


def compute_band_edges(n_bands: int) -> np.ndarray:
    """Logarithmically-spaced frequency band edges from MIN_FREQ to MAX_FREQ."""
    return np.array([
        MIN_FREQ * (MAX_FREQ / MIN_FREQ) ** (i / n_bands)
        for i in range(n_bands + 1)
    ])


def compute_fft_bands(
    windowed: np.ndarray, freq_per_bin: float, n_bins: int,
    band_edges: np.ndarray, n_bands: int,
) -> np.ndarray:
    """Compute peak magnitude in logarithmically-spaced frequency bands."""
    magnitudes = np.abs(np.fft.rfft(windowed))

    bands = np.zeros(n_bands)
    for b in range(n_bands):
        low_bin = max(0, int(band_edges[b] / freq_per_bin))
        high_bin = min(n_bins, int(band_edges[b + 1] / freq_per_bin))
        if high_bin <= low_bin:
            high_bin = low_bin + 1
        # Clamp to valid range to avoid empty slices
        low_bin = min(low_bin, n_bins - 1)
        high_bin = min(high_bin, n_bins)
        bands[b] = np.max(magnitudes[low_bin:high_bin])

    return bands


def extract(path: str, fps: int, n_bands: int) -> dict:
    """Extract per-frame audio data."""
    print(f"Decoding audio from {path}...", file=sys.stderr)
    samples = decode_audio(path)
    duration = len(samples) / SAMPLE_RATE
    frame_step = SAMPLE_RATE // fps
    total_frames = int(duration * fps)

    print(f"Duration: {duration:.1f}s, {total_frames} frames at {fps}fps", file=sys.stderr)
    print(f"FFT window: {FFT_SIZE} samples ({SAMPLE_RATE / FFT_SIZE:.1f} Hz/bin)", file=sys.stderr)
    print(f"Frequency range: {MIN_FREQ:.0f}-{MAX_FREQ:.0f} Hz, {n_bands} bands", file=sys.stderr)

    # Precompute constants
    hann = np.hanning(FFT_SIZE)
    band_edges = compute_band_edges(n_bands)
    freq_per_bin = SAMPLE_RATE / FFT_SIZE
    n_bins = FFT_SIZE // 2 + 1
    half_fft = FFT_SIZE // 2

    # Pass 1: extract raw values
    rms_values = np.zeros(total_frames)
    band_values = np.zeros((total_frames, n_bands))

    for f in range(total_frames):
        # RMS from the frame's audio slice
        rms_start = f * frame_step
        rms_end = rms_start + frame_step
        frame_slice = samples[rms_start:min(rms_end, len(samples))]
        if len(frame_slice) > 0:
            rms_values[f] = np.sqrt(np.mean(frame_slice ** 2))

        # FFT from a centered 4096-sample window
        center = rms_start + frame_step // 2
        win_start = center - half_fft
        win_end = center + half_fft

        if win_start >= 0 and win_end <= len(samples):
            window = samples[win_start:win_end] * hann
        else:
            # Zero-pad at edges
            padded = np.zeros(FFT_SIZE)
            src_start = max(0, win_start)
            src_end = min(len(samples), win_end)
            dst_start = src_start - win_start
            dst_end = dst_start + (src_end - src_start)
            padded[dst_start:dst_end] = samples[src_start:src_end]
            window = padded * hann

        band_values[f] = compute_fft_bands(window, freq_per_bin, n_bins, band_edges, n_bands)

    # Pass 2: normalize
    peak_rms = rms_values.max() if total_frames > 0 else 1.0
    if peak_rms > 0:
        rms_values /= peak_rms

    # Per-band normalization so treble is visible alongside louder bass
    band_peaks = band_values.max(axis=0)
    band_peaks[band_peaks == 0] = 1.0
    band_values /= band_peaks

    # Build output
    frames = []
    for f in range(total_frames):
        frames.append({
            "time": round(f / fps, 4),
            "rms": round(float(rms_values[f]), 4),
            "bands": [round(float(b), 4) for b in band_values[f]],
        })

    return {
        "duration": round(duration, 4),
        "fps": fps,
        "bands": n_bands,
        "totalFrames": total_frames,
        "frames": frames,
    }


def main():
    parser = argparse.ArgumentParser(description="Extract per-frame audio visualization data")
    parser.add_argument("input", help="Audio or video file")
    parser.add_argument("-o", "--output", default="audio-data.json", help="Output JSON path")
    parser.add_argument("--fps", type=int, default=30, help="Frames per second (default: 30)")
    parser.add_argument("--bands", type=int, default=16, help="Number of frequency bands (default: 16)")
    args = parser.parse_args()

    if args.fps < 1:
        parser.error("--fps must be at least 1")
    if args.bands < 1:
        parser.error("--bands must be at least 1")

    data = extract(args.input, args.fps, args.bands)

    with open(args.output, "w", encoding="utf-8") as f:
        json.dump(data, f)

    print(f"Wrote {args.output} ({data['totalFrames']} frames, {data['bands']} bands)", file=sys.stderr)


if __name__ == "__main__":
    main()
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall