Skip to content

JaimeJunr/claude-code-frontend-skills / plugins/hyperframes/skills/media-use

media-use

Verified

Get or make any media for a HyperFrames video - music, sound effects, images, icons, logos, voiceover, avatar and generated video, transcripts, cutouts, colour grades and looks - with HeyGen or free local tools, and mix placed audio. Also for footage that looks dark, flat or dull, or should be stylized or hidden.

FileKindSize
.gitignoreother17 B
SKILL.mdskill md5.3 KB
audio/assets/sfx/CREDITS.mdmarkdown1.2 KB
audio/assets/sfx/chime.mp3binary26.7 KB
audio/assets/sfx/click-soft.mp3binary11.4 KB
audio/assets/sfx/click.mp3binary11.4 KB
audio/assets/sfx/error.mp3binary50.6 KB
audio/assets/sfx/glitch-1.mp3binary82.4 KB
audio/assets/sfx/glitch-2.mp3binary109.5 KB
audio/assets/sfx/glitch-3.mp3binary96.8 KB
audio/assets/sfx/impact-bass-1.mp3binary66.1 KB
audio/assets/sfx/impact-bass-2.mp3binary81.0 KB
audio/assets/sfx/key-press.mp3binary3.8 KB
audio/assets/sfx/manifest.jsonconfig3.6 KB
audio/assets/sfx/notification.mp3binary76.7 KB
audio/assets/sfx/ping.mp3binary25.8 KB
audio/assets/sfx/pop.mp3binary22.5 KB
audio/assets/sfx/riser.mp3binary313.5 KB
audio/assets/sfx/sparkle.mp3binary56.3 KB
audio/assets/sfx/typing.mp3binary26.2 KB
audio/assets/sfx/whoosh-cinematic.mp3binary173.3 KB
audio/assets/sfx/whoosh-short.mp3binary18.0 KB
audio/assets/sfx/whoosh.mp3binary18.0 KB
audio/references/bgm.mdmarkdown7.9 KB
audio/references/captions/authoring.mdmarkdown9.2 KB
audio/references/captions/motion.mdmarkdown5.4 KB
audio/references/captions/transcript-handling.mdmarkdown5.3 KB
audio/references/remove-background.mdmarkdown8.3 KB
audio/references/requirements.mdmarkdown4.7 KB
audio/references/sfx.mdmarkdown4.0 KB
audio/references/transcribe.mdmarkdown2.8 KB
audio/references/tts-to-captions.mdmarkdown1.7 KB
audio/references/tts.mdmarkdown13.9 KB
audio/scripts/audio.mjsscript15.2 KB
audio/scripts/audio.test.mjsscript8.4 KB
audio/scripts/carve.mjsscript20.1 KB
audio/scripts/carve.test.mjsscript12.2 KB
audio/scripts/extract-audio-data.pyscript7.1 KB
audio/scripts/gemini-pipeline.test.mjsscript4.8 KB
audio/scripts/heygen-tts.mjsexecutablescript4.3 KB
audio/scripts/heygen-tts.test.mjsscript1.4 KB
audio/scripts/heygen-voice.mjsscript3.8 KB
audio/scripts/heygen-voice.test.mjsscript8.3 KB
audio/scripts/lib/audio-carve.mjsscript16.6 KB
audio/scripts/lib/audio-meta.mjsscript1.1 KB
audio/scripts/lib/audio-meta.test.mjsscript4.5 KB
audio/scripts/lib/bgm-volume.mjsscript236 B
audio/scripts/lib/bgm.mjsscript11.5 KB
audio/scripts/lib/bgm.test.mjsscript4.7 KB
audio/scripts/lib/concurrency.mjsscript527 B
audio/scripts/lib/concurrency.test.mjsscript1.6 KB
audio/scripts/lib/gemini-auth.mjsscript1.6 KB
audio/scripts/lib/gemini-auth.pyscript1.9 KB
audio/scripts/lib/gemini-auth.test.mjsscript3.0 KB
audio/scripts/lib/gemini-auth_test.pyscript4.3 KB
audio/scripts/lib/gemini-tts.mjsscript5.0 KB
audio/scripts/lib/gemini-tts.test.mjsscript9.2 KB
audio/scripts/lib/heygen.mjsscript14.3 KB
audio/scripts/lib/heygen.test.mjsscript22.9 KB
audio/scripts/lib/main-module.mjsscript479 B
audio/scripts/lib/media-record.mjsscript5.1 KB
audio/scripts/lib/media-record.test.mjsscript12.6 KB
audio/scripts/lib/openverse.mjsscript4.9 KB
audio/scripts/lib/project-path.mjsscript2.2 KB
audio/scripts/lib/project-path.test.mjsscript3.0 KB
audio/scripts/lib/python.mjsscript4.6 KB
audio/scripts/lib/python.test.mjsscript7.8 KB
audio/scripts/lib/recording.mjsscript4.4 KB
audio/scripts/lib/sfx.mjsscript7.2 KB
audio/scripts/lib/sfx.test.mjsscript11.6 KB
audio/scripts/lib/tts.cleanup.test.mjsscript7.0 KB
audio/scripts/lib/tts.mjsscript18.6 KB
audio/scripts/lib/tts.spawn.test.mjsscript6.0 KB
audio/scripts/lib/tts.test.mjsscript10.2 KB
audio/scripts/lib/voice-credit.mjsscript686 B
audio/scripts/lib/voice-credit.test.mjsscript946 B
audio/scripts/lyria-recipe.pyscript4.9 KB
audio/scripts/recording.test.mjsscript9.2 KB
audio/scripts/trusted-program.test.mjsscript3.4 KB
audio/scripts/trusted_program.pyscript2.8 KB
audio/scripts/wait-bgm.mjsscript6.1 KB
audio/scripts/wait-bgm.test.mjsscript8.0 KB
luts/README.mdmarkdown1.1 KB
luts/index.jsonconfig2.0 KB
references/audio.mdmarkdown3.5 KB
references/grading.mdmarkdown7.0 KB
references/heygen.mdmarkdown11.8 KB
references/local.mdmarkdown2.6 KB
references/media-treatment-recipes.mdmarkdown35.0 KB
references/media-treatments.mdmarkdown13.8 KB
references/memory.mdmarkdown3.7 KB
references/meta.mdmarkdown6.4 KB
references/mixing.mdmarkdown4.5 KB
references/operations.mdmarkdown15.8 KB
references/resolve.mdmarkdown9.9 KB
references/setup-providers.mdmarkdown9.1 KB
references/telemetry-dashboard.mdmarkdown4.1 KB
scripts/audio-duck.mjsscript4.0 KB
scripts/compatibility.test.mjsscript1.6 KB
scripts/dither.mjsscript9.8 KB
scripts/dither.test.mjsscript4.6 KB
scripts/eval.mjsscript14.6 KB
scripts/lib/config-lock.mjsscript1.5 KB
scripts/lib/credit-limit.mjsscript2.0 KB
scripts/lib/cutlist.mjsscript6.2 KB
scripts/lib/duck.mjsscript3.8 KB
scripts/lib/error-diffusion.mjsscript6.5 KB
scripts/lib/index-gen.mjsscript2.0 KB
scripts/lib/manifest.mjsscript10.6 KB
scripts/lib/media-fetch.mjsscript2.8 KB
scripts/lib/media-home.mjsscript730 B
scripts/lib/npx-sync.mjsscript3.2 KB
scripts/lib/parakeet-words.mjsscript1.1 KB
scripts/lib/prefs-store.mjsscript6.8 KB
scripts/lib/recipe-store.mjsscript13.0 KB
scripts/lib/telemetry.mjsscript8.8 KB
scripts/lib/telemetry.test.mjsscript3.0 KB
scripts/lib/transcriptCutFade.mjsscript911 B
scripts/lib/windows-exe-search.mjsscript640 B
scripts/lib/words.mjsscript728 B
scripts/prefs.mjsscript2.3 KB
scripts/recipe.mjsscript3.8 KB
scripts/resolve-plugin.test.mjsscript3.2 KB
scripts/resolve.mjsscript1.4 KB
scripts/transcribe.mjsscript8.0 KB
scripts/transcribe.test.mjsscript7.7 KB
scripts/transcript-cut.mjsscript10.1 KB
scripts/transcript-cut.test.mjsscript9.6 KB

audio/scripts/lib/media-record.test.mjs

View on GitHub
import { strict as assert } from "node:assert";
import { test } from "node:test";
import {
  existsSync,
  lstatSync,
  mkdirSync,
  mkdtempSync,
  readdirSync,
  readFileSync,
  rmSync,
  symlinkSync,
  writeFileSync,
} from "node:fs";
import { dirname, join } from "node:path";
import { tmpdir } from "node:os";
import { AGENT_SOURCES, findByPrompt, readManifest } from "../../../scripts/lib/manifest.mjs";
import { agentWritePath, recordInManifest, voicePaths, writtenAssets } from "./media-record.mjs";

const noBgm = { bgm: null, bgmFields: { bgm_pending: false } };

function project(t) {
  const dir = mkdtempSync(join(tmpdir(), "mu-record-"));
  t.after(() => rmSync(dir, { recursive: true, force: true }));
  return dir;
}

test("a voice run leaves a manifest entry marked generated", (t) => {
  const dir = project(t);
  const assets = writtenAssets({
    only: new Set(["tts"]),
    lines: [{ id: "01", text: "Welcome to the launch" }],
    voices: [{ id: "01", path: "assets/voice/01.wav", duration_s: 2.34 }],
    ttsProvider: "kokoro",
    sfx: [],
    ...noBgm,
  });

  assert.deepEqual(recordInManifest(dir, assets), []);

  assert.deepEqual(
    readManifest(dir).map(({ path, type, source, description, duration, provenance }) => ({
      path,
      type,
      source,
      description,
      duration,
      provenance,
    })),
    [
      {
        path: "assets/voice/01.wav",
        type: "voice",
        source: "generated",
        description: "Welcome to the launch",
        duration: 2.3,
        provenance: { provider: "kokoro", prompt: "Welcome to the launch" },
      },
    ],
  );
});

const voiceLine = (intent, duration) => [
  { path: "assets/voice/01.wav", type: "voice", source: "generated", intent, duration },
];

test("a rerun that writes the same take keeps one record, and a new length is a new take", (t) => {
  const dir = project(t);

  recordInManifest(dir, voiceLine("Hello world", 1.25));
  recordInManifest(dir, voiceLine("Hello world", 1.25));
  assert.equal(readManifest(dir).length, 1);

  recordInManifest(dir, voiceLine("Hello world", 2));
  assert.deepEqual(
    readManifest(dir).map(({ duration }) => duration),
    [1.3, 2],
  );
});

test("a rerun with new text records the new take, and the old text no longer finds the file", (t) => {
  const dir = project(t);

  recordInManifest(dir, voiceLine("Hello world", 1.25));
  recordInManifest(dir, voiceLine("Welcome back to the show", 3.5));

  assert.deepEqual(
    readManifest(dir).map(({ description, duration }) => [description, duration]),
    [
      ["Hello world", 1.3],
      ["Welcome back to the show", 3.5],
    ],
  );
  assert.equal(findByPrompt(dir, "Hello world", "voice"), null);
  const index = readFileSync(join(dir, ".media/index.md"), "utf8");
  assert.match(index, /Welcome back to the show/);
  assert.doesNotMatch(index, /Hello world/);
  assert.equal(findByPrompt(dir, "Welcome back to the show", "voice")?.path, "assets/voice/01.wav");
});

test("music and sound effects are marked by where they came from", () => {
  const assets = writtenAssets({
    only: new Set(["bgm", "sfx"]),
    lines: [],
    voices: [{ id: "01", path: "assets/voice/01.wav" }],
    bgm: { path: "assets/bgm/track.mp3", query: "calm" },
    bgmFields: { bgm_pending: false, bgm_mode: "retrieve" },
    sfx: [
      { file: "assets/sfx/whoosh.mp3", name: "whoosh", source: "local" },
      { file: "assets/sfx/whoosh.mp3", name: "whoosh", source: "local" },
      { file: "assets/sfx/glass.mp3", name: "glass", source: "openverse" },
    ],
  });

  assert.deepEqual(
    assets.map(({ path, source, provider }) => [path, source, provider]),
    [
      ["assets/bgm/track.mp3", "search", undefined],
      ["assets/sfx/whoosh.mp3", "bundled", "bundled.sfx"],
      ["assets/sfx/glass.mp3", "search", "openverse.audio"],
    ],
  );
});

test("a rerun of an Openverse sound effect writes over its own file, not a numbered copy", (t) => {
  const dir = project(t);
  mkdirSync(join(dir, "assets/sfx"), { recursive: true });
  const anomalies = [];
  for (let run = 0; run < 3; run++) {
    const file = agentWritePath(dir, "assets/sfx/door-knock.mp3", { anomalies });
    writeFileSync(join(dir, file), "knock");
    const sfx = [{ file, name: "door knock", source: "openverse", duration_s: 1 }];
    recordInManifest(
      dir,
      writtenAssets({ only: new Set(["sfx"]), lines: [], voices: [], sfx, ...noBgm }),
    );
  }

  assert.deepEqual(readdirSync(join(dir, "assets/sfx")), ["door-knock.mp3"]);
  assert.deepEqual(anomalies, []);
  assert.equal(readManifest(dir).length, 1);
});

test("music made locally is marked generated once it is ready, not while pending", () => {
  const written = (bgm_pending) =>
    writtenAssets({
      only: new Set(["bgm"]),
      lines: [],
      voices: [],
      sfx: [],
      bgm: { path: "assets/bgm/track.wav" },
      bgmFields: { bgm_pending, bgm_mode: "detached-single" },
    }).map(({ source }) => source);

  assert.deepEqual(written(true), []);
  assert.deepEqual(written(false), ["generated"]);
});

test("a file that cannot be recorded becomes an anomaly, not a failure", (t) => {
  const dir = project(t);
  writeFileSync(join(dir, ".media"), "a file where the media folder should be");

  const anomalies = recordInManifest(dir, [
    { path: "assets/voice/01.wav", type: "voice", source: "generated" },
  ]);

  assert.equal(anomalies.length, 1);
  assert.match(anomalies[0], /^assets\/voice\/01\.wav: not recorded in the media manifest/);
});

test("the engine writes over only its own files, else the next free name", (t) => {
  const dir = project(t);
  mkdirSync(join(dir, "assets/sfx"), { recursive: true });
  const names = ["mine", "made", "adopted", "twice", "twice-2", "kept", "kept-2"];
  for (const name of names) writeFileSync(join(dir, `assets/sfx/${name}.mp3`), name);
  for (const path of ["assets/sfx/made.mp3", "assets/sfx/kept-2.mp3"])
    recordInManifest(dir, [{ path, type: "sfx", source: "search" }]);
  recordInManifest(dir, [{ path: "assets/sfx/adopted.mp3", type: "sfx", source: "existing" }]);
  const anomalies = [];
  const at = (name, reusable) =>
    agentWritePath(dir, `assets/sfx/${name}.mp3`, { anomalies, reusable });

  assert.equal(at("new"), "assets/sfx/new.mp3");
  assert.equal(at("made"), "assets/sfx/made.mp3");
  assert.equal(
    at("mine", (path) => path === "assets/sfx/mine.mp3"),
    "assets/sfx/mine.mp3",
  );
  assert.deepEqual(anomalies, []);
  assert.equal(at("mine"), "assets/sfx/mine-2.mp3");
  assert.equal(at("adopted"), "assets/sfx/adopted-2.mp3");
  assert.equal(at("twice"), "assets/sfx/twice-3.mp3");
  assert.equal(at("kept"), "assets/sfx/kept-2.mp3");
  assert.equal(anomalies.length, 4);
  assert.match(
    anomalies[0],
    /^assets\/sfx\/mine\.mp3: kept, .* writing assets\/sfx\/mine-2\.mp3 instead/,
  );
});

test("two spoken lines never share a file when one's name is taken by the person", (t) => {
  const dir = project(t);
  mkdirSync(join(dir, "assets/voice"), { recursive: true });
  writeFileSync(join(dir, "assets/voice/hook.wav"), "the person's own hook");
  const anomalies = [];

  const paths = voicePaths(
    dir,
    [
      { id: "hook", text: "First" },
      { id: "hook-2", text: "Second" },
      { id: "blank", text: " " },
    ],
    anomalies,
  );

  assert.deepEqual(Object.fromEntries(paths), {
    hook: "assets/voice/hook-2.wav",
    "hook-2": "assets/voice/hook-2-2.wav",
  });
  assert.equal(anomalies.length, 2);
});

test("a line id that is not a plain file name stops the run before any file is picked", (t) => {
  const dir = project(t);
  for (const id of ["../../x", "a/b", "a\\b", "C:x", "..", "."]) {
    assert.throws(() => voicePaths(dir, [{ id, text: "Hello" }], []), /must be a plain name/, id);
  }
  assert.equal(existsSync(join(dirname(dir), "x.wav")), false);
  assert.equal(existsSync(join(dir, "assets")), false);
});

test("the ids the skill writes keep their voice file names", (t) => {
  const dir = project(t);
  const ids = ["01", "intro", "s1-hook", "scene_2", "3.1"];
  const paths = voicePaths(
    dir,
    ids.map((id) => ({ id, text: "Hello" })),
    [],
  );
  assert.deepEqual(
    [...paths.values()],
    ids.map((id) => `assets/voice/${id}.wav`),
  );
});

test("a voice folder that links out of the project is never written", (t) => {
  const dir = project(t);
  const outside = mkdtempSync(join(tmpdir(), "mu-record-outside-"));
  t.after(() => rmSync(outside, { recursive: true, force: true }));
  mkdirSync(join(dir, "assets"));
  symlinkSync(outside, join(dir, "assets/voice"));
  assert.throws(
    () => voicePaths(dir, [{ id: "01", text: "Hello" }], []),
    /assets\/voice leads outside the project folder/,
  );
});

test("a link where a voice file goes is not written through, whatever the manifest says", (t) => {
  const dir = project(t);
  const outside = mkdtempSync(join(tmpdir(), "mu-record-outside-"));
  t.after(() => rmSync(outside, { recursive: true, force: true }));
  writeFileSync(join(outside, "theirs.wav"), "another project's voice");
  mkdirSync(join(dir, "assets/voice"), { recursive: true });
  symlinkSync(join(outside, "theirs.wav"), join(dir, "assets/voice/01.wav"));
  recordInManifest(dir, [{ path: "assets/voice/01.wav", type: "voice", source: "generated" }]);
  const anomalies = [];
  const paths = voicePaths(dir, [{ id: "01", text: "Hello" }], anomalies);
  assert.equal(paths.get("01"), "assets/voice/01-2.wav");
  assert.equal(anomalies.length, 1);
});

test("a record never takes the id of a download still in flight", (t) => {
  const dir = project(t);
  mkdirSync(join(dir, ".media/audio/bgm"), { recursive: true });
  writeFileSync(join(dir, ".media/audio/bgm/bgm_001.mp3"), "");

  recordInManifest(dir, [{ path: "assets/bgm/track.wav", type: "bgm", source: "generated" }]);

  assert.deepEqual(
    readManifest(dir).map(({ id }) => id),
    ["bgm_002"],
  );
});

// An engine-written copy stays an agent source, or every rerun would write a numbered copy beside it
// (AGENT_SOURCES, manifest.mjs); what says it is the person's own voice is the provider and intent.
test("a recording line is recorded as your own recording, still an engine-written file", () => {
  const [asset] = writtenAssets({
    only: new Set(["tts"]),
    lines: [{ id: "01", audio: "take.m4a" }],
    voices: [{ id: "01", path: "assets/voice/01.wav", duration_s: 2, source: "recording" }],
    ttsProvider: "recording",
  });

  assert.equal(asset.provider, "recording");
  assert.equal(asset.intent, "your own recording");
  assert.ok(AGENT_SOURCES.includes(asset.source));
});

// Links planted in a received project's .media must not carry manifest or index writes outside it.
function outsideFile(t, content) {
  const outside = mkdtempSync(join(tmpdir(), "mu-record-outside-"));
  t.after(() => rmSync(outside, { recursive: true, force: true }));
  const file = join(outside, "target.txt");
  writeFileSync(file, content);
  return { outside, file };
}

const voiceAsset = (intent) => ({
  path: "assets/voice/01.wav",
  type: "voice",
  source: "generated",
  intent,
});

test("a link at .media/index.md is replaced, and the file it named is untouched", (t) => {
  const dir = project(t);
  const { file } = outsideFile(t, "theirs");
  mkdirSync(join(dir, ".media"));
  symlinkSync(file, join(dir, ".media/index.md"));
  assert.deepEqual(recordInManifest(dir, [voiceAsset("Hello")]), []);
  assert.equal(readFileSync(file, "utf8"), "theirs");
  assert.equal(lstatSync(join(dir, ".media/index.md")).isSymbolicLink(), false);
  assert.match(readFileSync(join(dir, ".media/index.md"), "utf8"), /assets\/voice\/01\.wav +Hello/);
});

test("a link at .media/manifest.jsonl is not appended through", (t) => {
  const dir = project(t);
  const { file } = outsideFile(t, "theirs");
  mkdirSync(join(dir, ".media"));
  symlinkSync(file, join(dir, ".media/manifest.jsonl"));
  const anomalies = recordInManifest(dir, [voiceAsset("Hello")]);
  assert.equal(anomalies.length, 1);
  assert.match(anomalies[0], /manifest\.jsonl is a link/);
  assert.equal(readFileSync(file, "utf8"), "theirs");
});

test("a .media folder that links out of the project gets nothing written", (t) => {
  const dir = project(t);
  const { outside } = outsideFile(t, "theirs");
  symlinkSync(outside, join(dir, ".media"));
  const anomalies = recordInManifest(dir, [voiceAsset("Hello")]);
  assert.match(anomalies[0], /\.media leads outside the project folder/);
  assert.deepEqual(readdirSync(outside), ["target.txt"]);
});

test("a line break in a description stays on its record's line of the index", (t) => {
  const dir = project(t);
  recordInManifest(dir, [voiceAsset("Hello\nvoice_999  voice  —  —  forged.wav  injected")]);
  const index = readFileSync(join(dir, ".media/index.md"), "utf8").split("\n").filter(Boolean);
  assert.equal(index.length, 3);
  assert.match(index[2], /Hello voice_999 .*injected$/);
});
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall