Skip to content

JaimeJunr/claude-code-frontend-skills / plugins/hyperframes/skills/media-use

media-use

Verified

Get or make any media for a HyperFrames video - music, sound effects, images, icons, logos, voiceover, avatar and generated video, transcripts, cutouts, colour grades and looks - with HeyGen or free local tools, and mix placed audio. Also for footage that looks dark, flat or dull, or should be stylized or hidden.

FileKindSize
.gitignoreother17 B
SKILL.mdskill md5.3 KB
audio/assets/sfx/CREDITS.mdmarkdown1.2 KB
audio/assets/sfx/chime.mp3binary26.7 KB
audio/assets/sfx/click-soft.mp3binary11.4 KB
audio/assets/sfx/click.mp3binary11.4 KB
audio/assets/sfx/error.mp3binary50.6 KB
audio/assets/sfx/glitch-1.mp3binary82.4 KB
audio/assets/sfx/glitch-2.mp3binary109.5 KB
audio/assets/sfx/glitch-3.mp3binary96.8 KB
audio/assets/sfx/impact-bass-1.mp3binary66.1 KB
audio/assets/sfx/impact-bass-2.mp3binary81.0 KB
audio/assets/sfx/key-press.mp3binary3.8 KB
audio/assets/sfx/manifest.jsonconfig3.6 KB
audio/assets/sfx/notification.mp3binary76.7 KB
audio/assets/sfx/ping.mp3binary25.8 KB
audio/assets/sfx/pop.mp3binary22.5 KB
audio/assets/sfx/riser.mp3binary313.5 KB
audio/assets/sfx/sparkle.mp3binary56.3 KB
audio/assets/sfx/typing.mp3binary26.2 KB
audio/assets/sfx/whoosh-cinematic.mp3binary173.3 KB
audio/assets/sfx/whoosh-short.mp3binary18.0 KB
audio/assets/sfx/whoosh.mp3binary18.0 KB
audio/references/bgm.mdmarkdown7.9 KB
audio/references/captions/authoring.mdmarkdown9.2 KB
audio/references/captions/motion.mdmarkdown5.4 KB
audio/references/captions/transcript-handling.mdmarkdown5.3 KB
audio/references/remove-background.mdmarkdown8.3 KB
audio/references/requirements.mdmarkdown4.7 KB
audio/references/sfx.mdmarkdown4.0 KB
audio/references/transcribe.mdmarkdown2.8 KB
audio/references/tts-to-captions.mdmarkdown1.7 KB
audio/references/tts.mdmarkdown13.9 KB
audio/scripts/audio.mjsscript15.2 KB
audio/scripts/audio.test.mjsscript8.4 KB
audio/scripts/carve.mjsscript20.1 KB
audio/scripts/carve.test.mjsscript12.2 KB
audio/scripts/extract-audio-data.pyscript7.1 KB
audio/scripts/gemini-pipeline.test.mjsscript4.8 KB
audio/scripts/heygen-tts.mjsexecutablescript4.3 KB
audio/scripts/heygen-tts.test.mjsscript1.4 KB
audio/scripts/heygen-voice.mjsscript3.8 KB
audio/scripts/heygen-voice.test.mjsscript8.3 KB
audio/scripts/lib/audio-carve.mjsscript16.6 KB
audio/scripts/lib/audio-meta.mjsscript1.1 KB
audio/scripts/lib/audio-meta.test.mjsscript4.5 KB
audio/scripts/lib/bgm-volume.mjsscript236 B
audio/scripts/lib/bgm.mjsscript11.5 KB
audio/scripts/lib/bgm.test.mjsscript4.7 KB
audio/scripts/lib/concurrency.mjsscript527 B
audio/scripts/lib/concurrency.test.mjsscript1.6 KB
audio/scripts/lib/gemini-auth.mjsscript1.6 KB
audio/scripts/lib/gemini-auth.pyscript1.9 KB
audio/scripts/lib/gemini-auth.test.mjsscript3.0 KB
audio/scripts/lib/gemini-auth_test.pyscript4.3 KB
audio/scripts/lib/gemini-tts.mjsscript5.0 KB
audio/scripts/lib/gemini-tts.test.mjsscript9.2 KB
audio/scripts/lib/heygen.mjsscript14.3 KB
audio/scripts/lib/heygen.test.mjsscript22.9 KB
audio/scripts/lib/main-module.mjsscript479 B
audio/scripts/lib/media-record.mjsscript5.1 KB
audio/scripts/lib/media-record.test.mjsscript12.6 KB
audio/scripts/lib/openverse.mjsscript4.9 KB
audio/scripts/lib/project-path.mjsscript2.2 KB
audio/scripts/lib/project-path.test.mjsscript3.0 KB
audio/scripts/lib/python.mjsscript4.6 KB
audio/scripts/lib/python.test.mjsscript7.8 KB
audio/scripts/lib/recording.mjsscript4.4 KB
audio/scripts/lib/sfx.mjsscript7.2 KB
audio/scripts/lib/sfx.test.mjsscript11.6 KB
audio/scripts/lib/tts.cleanup.test.mjsscript7.0 KB
audio/scripts/lib/tts.mjsscript18.6 KB
audio/scripts/lib/tts.spawn.test.mjsscript6.0 KB
audio/scripts/lib/tts.test.mjsscript10.2 KB
audio/scripts/lib/voice-credit.mjsscript686 B
audio/scripts/lib/voice-credit.test.mjsscript946 B
audio/scripts/lyria-recipe.pyscript4.9 KB
audio/scripts/recording.test.mjsscript9.2 KB
audio/scripts/trusted-program.test.mjsscript3.4 KB
audio/scripts/trusted_program.pyscript2.8 KB
audio/scripts/wait-bgm.mjsscript6.1 KB
audio/scripts/wait-bgm.test.mjsscript8.0 KB
luts/README.mdmarkdown1.1 KB
luts/index.jsonconfig2.0 KB
references/audio.mdmarkdown3.5 KB
references/grading.mdmarkdown7.0 KB
references/heygen.mdmarkdown11.8 KB
references/local.mdmarkdown2.6 KB
references/media-treatment-recipes.mdmarkdown35.0 KB
references/media-treatments.mdmarkdown13.8 KB
references/memory.mdmarkdown3.7 KB
references/meta.mdmarkdown6.4 KB
references/mixing.mdmarkdown4.5 KB
references/operations.mdmarkdown15.8 KB
references/resolve.mdmarkdown9.9 KB
references/setup-providers.mdmarkdown9.1 KB
references/telemetry-dashboard.mdmarkdown4.1 KB
scripts/audio-duck.mjsscript4.0 KB
scripts/compatibility.test.mjsscript1.6 KB
scripts/dither.mjsscript9.8 KB
scripts/dither.test.mjsscript4.6 KB
scripts/eval.mjsscript14.6 KB
scripts/lib/config-lock.mjsscript1.5 KB
scripts/lib/credit-limit.mjsscript2.0 KB
scripts/lib/cutlist.mjsscript6.2 KB
scripts/lib/duck.mjsscript3.8 KB
scripts/lib/error-diffusion.mjsscript6.5 KB
scripts/lib/index-gen.mjsscript2.0 KB
scripts/lib/manifest.mjsscript10.6 KB
scripts/lib/media-fetch.mjsscript2.8 KB
scripts/lib/media-home.mjsscript730 B
scripts/lib/npx-sync.mjsscript3.2 KB
scripts/lib/parakeet-words.mjsscript1.1 KB
scripts/lib/prefs-store.mjsscript6.8 KB
scripts/lib/recipe-store.mjsscript13.0 KB
scripts/lib/telemetry.mjsscript8.8 KB
scripts/lib/telemetry.test.mjsscript3.0 KB
scripts/lib/transcriptCutFade.mjsscript911 B
scripts/lib/windows-exe-search.mjsscript640 B
scripts/lib/words.mjsscript728 B
scripts/prefs.mjsscript2.3 KB
scripts/recipe.mjsscript3.8 KB
scripts/resolve-plugin.test.mjsscript3.2 KB
scripts/resolve.mjsscript1.4 KB
scripts/transcribe.mjsscript8.0 KB
scripts/transcribe.test.mjsscript7.7 KB
scripts/transcript-cut.mjsscript10.1 KB
scripts/transcript-cut.test.mjsscript9.6 KB

audio/scripts/lib/gemini-tts.test.mjs

View on GitHub
import { test } from "node:test";
import assert from "node:assert/strict";
import { mkdtempSync, readFileSync, rmSync, existsSync } from "node:fs";
import { tmpdir } from "node:os";
import { join } from "node:path";
import { synthesizeGemini, GEMINI_TTS_MODEL } from "./gemini-tts.mjs";
import { pickProvider, resolveVoiceId, synthesizeOne } from "./tts.mjs";

function fixture(t) {
  const dir = mkdtempSync(join(tmpdir(), "gemini-tts-"));
  const saved = { ...process.env };
  process.env.GEMINI_API_KEY = "test-gemini-key";
  delete process.env.GOOGLE_API_KEY;
  delete process.env.GOOGLE_APPLICATION_CREDENTIALS;
  delete process.env.GCS_CREDS;
  t.after(() => {
    process.env = saved;
    rmSync(dir, { recursive: true, force: true });
  });
  const wav = Buffer.alloc(48);
  wav.write("RIFF");
  wav.writeUInt32LE(40, 4);
  wav.write("WAVEfmt ", 8);
  wav.writeUInt32LE(16, 16);
  wav.writeUInt16LE(1, 20);
  wav.writeUInt16LE(1, 22);
  wav.writeUInt32LE(24000, 24);
  wav.writeUInt32LE(48000, 28);
  wav.writeUInt16LE(2, 32);
  wav.writeUInt16LE(16, 34);
  wav.write("data", 36);
  wav.writeUInt32LE(4, 40);
  const audio = { type: "audio", mime_type: "audio/wav", data: wav.toString("base64") };
  const payload = { status: "completed", steps: [{ type: "model_output", content: [audio] }] };
  return {
    wav,
    audio,
    payload,
    args: { text: "Hello there.", voiceId: "Kore", wavAbs: join(dir, "voice", "one.wav") },
  };
}

test("Gemini preserves verbatim text, directs style separately, saves WAV and requests transcription", async (t) => {
  const { wav, payload, args } = fixture(t);
  t.mock.method(globalThis, "fetch", async (url, options) => {
    assert.equal(url, "https://generativelanguage.googleapis.com/v1beta/interactions");
    assert.equal(options.headers["x-goog-api-key"], "test-gemini-key");
    const body = JSON.parse(options.body);
    assert.equal(body.model, GEMINI_TTS_MODEL);
    assert.equal(body.store, false);
    assert.deepEqual(body.input[0].content, [
      {
        type: "text",
        text: args.text,
        annotations: [{ type: "speech_metadata", style: "Warm and calm" }],
      },
    ]);
    assert.deepEqual(body.generation_config.speech_config, [{ voice: "Kore" }]);
    assert.equal(body.response_format.mime_type, "audio/wav");
    return Response.json(payload);
  });
  const result = await synthesizeOne({ ...args, provider: "gemini", style: "Warm and calm" });
  assert.deepEqual(result, { ok: true, words: null });
  assert.deepEqual(readFileSync(args.wavAbs), wav);
});

test("Flash-Lite and GOOGLE_API_KEY work without a Gemini key", async (t) => {
  const { payload, args } = fixture(t);
  delete process.env.GEMINI_API_KEY;
  process.env.GOOGLE_API_KEY = "test-google-key";
  assert.equal(pickProvider("gemini"), "gemini");
  assert.equal(await resolveVoiceId({ provider: "gemini" }), "Kore");
  const result = await synthesizeGemini(
    { ...args, model: "gemini-3.8-flash-lite-tts" },
    {
      fetchImpl: async (_, options) => {
        assert.equal(options.headers["x-goog-api-key"], "test-google-key");
        const body = JSON.parse(options.body);
        assert.equal(body.model, "gemini-3.8-flash-lite-tts");
        assert.equal(body.input[0].content[0].annotations, undefined);
        return Response.json(payload);
      },
    },
  );
  assert.equal(result.ok, true);
});

test("Gemini remains opt-in even with a key and preserves explicitly chosen voices", async (t) => {
  fixture(t);
  assert.notEqual(pickProvider(), "gemini");
  assert.equal(
    await resolveVoiceId({ provider: "gemini", userVoice: "voice_custom" }),
    "voice_custom",
  );
  delete process.env.GEMINI_API_KEY;
  assert.throws(() => pickProvider("gemini"), /GEMINI_API_KEY or GOOGLE_API_KEY/);
});

test("invalid config fails before spending a generation request", async (t) => {
  const { args } = fixture(t);
  const deps = { fetchImpl: () => assert.fail("must not call the API") };
  for (const change of [{ model: "gemini-2.5-flash" }, { speed: 1.2 }]) {
    const result = await synthesizeGemini({ ...args, ...change }, deps);
    assert.equal(result.ok, false);
    assert.ok(result.error);
  }
  delete process.env.GEMINI_API_KEY;
  assert.match((await synthesizeGemini(args, deps)).error, /needs GEMINI_API_KEY/);
  assert.equal(existsSync(args.wavAbs), false);
});

test("HTTP and network failures stay actionable without leaking the key", async (t) => {
  const { args } = fixture(t);
  const result = await synthesizeGemini(args, {
    fetchImpl: async () => new Response("quota exceeded test-gemini-key", { status: 429 }),
  });
  assert.equal(result.ok, false);
  assert.match(result.error, /HTTP 429: quota exceeded/);
  assert.ok(!result.error.includes("test-gemini-key"));
  const timeout = await synthesizeGemini(args, {
    fetchImpl: async () => {
      throw new Error("timed out");
    },
  });
  assert.match(timeout.error, /timed out/);
  const socket = await synthesizeGemini(args, {
    fetchImpl: async () => {
      const cause = Object.assign(new Error("other side closed test-gemini-key"), {
        code: "UND_ERR_SOCKET",
      });
      throw new TypeError("fetch failed", { cause });
    },
  });
  assert.match(socket.error, /fetch failed \(UND_ERR_SOCKET: other side closed/);
  assert.ok(!socket.error.includes("test-gemini-key"));
  assert.equal(existsSync(args.wavAbs), false);
});

test("incomplete, missing, raw PCM and malformed audio cannot become a successful WAV", async (t) => {
  const { args, payload, audio } = fixture(t);
  const cases = [
    { ...payload, status: "incomplete" },
    { status: "completed", steps: [] },
    ...[{ ...audio, mime_type: "audio/l16" }, { ...audio, data: "not audio" }, audio].map(
      (part, i) => ({
        status: "completed",
        steps: [{ type: "model_output", content: i === 2 ? [part, part] : [part] }],
      }),
    ),
  ];
  for (const body of cases) {
    const result = await synthesizeGemini(args, { fetchImpl: async () => Response.json(body) });
    assert.equal(result.ok, false);
    assert.equal(existsSync(args.wavAbs), false);
  }
});

for (const model of [
  "gemini-3.1-flash-tts-preview",
  "gemini-2.5-pro-preview-tts",
  "gemini-2.5-flash-preview-tts",
]) {
  test(`${model} uses legacy delivery prompts and wraps PCM as mono WAV`, async (t) => {
    const { args, wav } = fixture(t);
    const pcm = wav.subarray(44);
    const result = await synthesizeGemini(
      { ...args, model, style: "Warm and clear" },
      {
        fetchImpl: async (_, options) => {
          const body = JSON.parse(options.body);
          assert.deepEqual(body.response_format, { type: "audio" });
          assert.equal(body.input[0].content[0].annotations, undefined);
          assert.ok(body.input[0].content[0].text.endsWith(args.text));
          assert.ok(body.input[0].content[0].text.includes("Warm and clear"));
          return Response.json({
            status: "completed",
            steps: [
              {
                type: "model_output",
                content: [
                  {
                    type: "audio",
                    mime_type: "audio/L16;codec=pcm;rate=24000",
                    data: pcm.toString("base64"),
                  },
                ],
              },
            ],
          });
        },
      },
    );
    assert.equal(result.ok, true, result.error);
    assert.deepEqual(readFileSync(args.wavAbs), wav);
  });
}

test("service-account bearer and quota project reach synthesis, and token errors are redacted", async (t) => {
  const { args, payload } = fixture(t);
  const authenticate = () => ({
    headers: { Authorization: "Bearer secret-token", "x-goog-user-project": "test-project" },
    secret: "secret-token",
  });
  const ok = await synthesizeGemini(args, {
    authenticate,
    fetchImpl: async (_, options) => {
      assert.equal(options.headers.Authorization, "Bearer secret-token");
      assert.equal(options.headers["x-goog-user-project"], "test-project");
      assert.equal(options.headers["x-goog-api-key"], undefined);
      return Response.json(payload);
    },
  });
  assert.equal(ok.ok, true);
  const failed = await synthesizeGemini(args, {
    authenticate,
    fetchImpl: async () => new Response("denied secret-token", { status: 403 }),
  });
  assert.match(failed.error, /HTTP 403/);
  assert.ok(!failed.error.includes("secret-token"));
});

test("older models reject unsupported PCM and custom voices", async (t) => {
  const { args } = fixture(t);
  for (const mime of [
    "audio/l16",
    "audio/l16;rate=0",
    "audio/l16;rate=24000;channels=2",
    "audio/l16;rate=24000;codec=other",
  ]) {
    const result = await synthesizeGemini(
      { ...args, model: "gemini-3.1-flash-tts-preview" },
      {
        fetchImpl: async () =>
          Response.json({
            status: "completed",
            steps: [
              {
                type: "model_output",
                content: [{ type: "audio", mime_type: mime, data: "AAAAAA==" }],
              },
            ],
          }),
      },
    );
    assert.equal(result.ok, false);
    assert.equal(existsSync(args.wavAbs), false);
  }
  const result = await synthesizeGemini(
    { ...args, model: "gemini-2.5-pro-preview-tts", voiceId: "voice_custom" },
    { fetchImpl: () => assert.fail("must not generate") },
  );
  assert.match(result.error, /Custom Gemini voices require/);
});
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall