Skip to content

Diogenesoftoronto/keating / video/keating-surface-tour/.agents/skills/media-use

media-use

Flagged

Agent Media OS, the single skill for every media need in a HyperFrames project. Resolve BGM, SFX, image, icon, brand logo, voice, color grade, or LUT into a frozen local file or paste-ready block + ledger record (one verb, `resolve`); generate via TTS / music / image models when the catalog misses; produce voiceover, transcription, captions, and background removal through one shared audio engine; operate on media (cut / reframe / transform); and reuse assets across projects. Also use for vague feedback that real footage looks dark, flat, boring, should feel retro/camcorder/print/ASCII, needs privacy, or needs a media reveal.

FileKindSize
.gitignoreother17 B
SKILL.mdskill md7.8 KB
audio/assets/sfx/CREDITS.mdmarkdown1.2 KB
audio/assets/sfx/chime.mp3binary26.7 KB
audio/assets/sfx/click-soft.mp3binary11.4 KB
audio/assets/sfx/click.mp3binary11.4 KB
audio/assets/sfx/error.mp3binary50.6 KB
audio/assets/sfx/glitch-1.mp3binary82.4 KB
audio/assets/sfx/glitch-2.mp3binary109.5 KB
audio/assets/sfx/glitch-3.mp3binary96.8 KB
audio/assets/sfx/impact-bass-1.mp3binary66.1 KB
audio/assets/sfx/impact-bass-2.mp3binary81.0 KB
audio/assets/sfx/key-press.mp3binary3.8 KB
audio/assets/sfx/manifest.jsonconfig3.6 KB
audio/assets/sfx/notification.mp3binary76.7 KB
audio/assets/sfx/ping.mp3binary25.8 KB
audio/assets/sfx/pop.mp3binary22.5 KB
audio/assets/sfx/riser.mp3binary313.5 KB
audio/assets/sfx/sparkle.mp3binary56.3 KB
audio/assets/sfx/typing.mp3binary26.2 KB
audio/assets/sfx/whoosh-cinematic.mp3binary173.3 KB
audio/assets/sfx/whoosh-short.mp3binary18.0 KB
audio/assets/sfx/whoosh.mp3binary18.0 KB
audio/references/bgm.mdmarkdown7.8 KB
audio/references/captions/authoring.mdmarkdown8.8 KB
audio/references/captions/motion.mdmarkdown5.5 KB
audio/references/captions/transcript-handling.mdmarkdown5.3 KB
audio/references/remove-background.mdmarkdown8.3 KB
audio/references/requirements.mdmarkdown4.2 KB
audio/references/sfx.mdmarkdown3.4 KB
audio/references/transcribe.mdmarkdown2.7 KB
audio/references/tts-to-captions.mdmarkdown1.2 KB
audio/references/tts.mdmarkdown8.6 KB
audio/scripts/audio.mjsscript12.5 KB
audio/scripts/audio.test.mjsscript1.9 KB
audio/scripts/heygen-tts.mjsexecutablescript4.2 KB
audio/scripts/lib/bgm.mjsscript11.3 KB
audio/scripts/lib/bgm.test.mjsscript1.2 KB
audio/scripts/lib/concurrency.mjsscript527 B
audio/scripts/lib/concurrency.test.mjsscript1.6 KB
audio/scripts/lib/heygen.mjsscript6.9 KB
audio/scripts/lib/heygen.test.mjsscript3.5 KB
audio/scripts/lib/python.mjsscript2.5 KB
audio/scripts/lib/python.test.mjsscript2.6 KB
audio/scripts/lib/sfx.mjsscript5.3 KB
audio/scripts/lib/sfx.test.mjsscript2.8 KB
audio/scripts/lib/tts.mjsscript16.1 KB
audio/scripts/lib/tts.spawn.test.mjsscript5.1 KB
audio/scripts/lib/tts.test.mjsscript6.0 KB
audio/scripts/lyria-recipe.pyscript4.4 KB
audio/scripts/wait-bgm.mjsscript5.4 KB
luts/README.mdmarkdown1.1 KB
luts/index.jsonconfig2.0 KB
references/audio.mdmarkdown1.7 KB
references/grading.mdmarkdown6.6 KB
references/media-treatment-recipes.mdmarkdown35.0 KB
references/media-treatments.mdmarkdown13.6 KB
references/memory.mdmarkdown3.3 KB
references/meta.mdmarkdown6.6 KB
references/operations.mdmarkdown14.1 KB
references/resolve.mdmarkdown8.8 KB
references/setup-providers.mdmarkdown7.1 KB
references/telemetry-dashboard.mdmarkdown4.1 KB
scripts/audio-duck.mjsscript3.9 KB
scripts/dither.mjsscript9.7 KB
scripts/dither.test.mjsscript4.6 KB
scripts/eval.mjsscript14.5 KB
scripts/lib/adopt.mjsscript4.3 KB
scripts/lib/adopt.test.mjsscript2.7 KB
scripts/lib/bgm-provider.mjsscript650 B
scripts/lib/brand-provider.mjsscript1.6 KB
scripts/lib/bundled-sfx-provider.mjsscript3.5 KB
scripts/lib/bundled-sfx-provider.test.mjsscript3.1 KB
scripts/lib/cache.mjsscript4.8 KB
scripts/lib/candidates.mjsscript4.0 KB
scripts/lib/candidates.test.mjsscript5.9 KB
scripts/lib/codex-provider.mjsscript6.5 KB
scripts/lib/codex-provider.test.mjsscript1.3 KB
scripts/lib/coverage.test.mjsscript5.6 KB
scripts/lib/cube-build.mjsscript5.7 KB
scripts/lib/cube-build.test.mjsscript2.7 KB
scripts/lib/cube-validate.mjsscript5.9 KB
scripts/lib/cube-validate.test.mjsscript3.2 KB
scripts/lib/cutlist.mjsscript6.0 KB
scripts/lib/cutlist.test.mjsscript4.0 KB
scripts/lib/duck.mjsscript3.0 KB
scripts/lib/duck.test.mjsscript3.4 KB
scripts/lib/error-diffusion.mjsscript6.5 KB
scripts/lib/error-diffusion.test.mjsscript3.4 KB
scripts/lib/freeze.mjsscript3.0 KB
scripts/lib/freeze.test.mjsscript1.9 KB
scripts/lib/grade-analyzer.mjsscript8.6 KB
scripts/lib/grade-analyzer.test.mjsscript7.7 KB
scripts/lib/heygen-cli.mjsscript7.3 KB
scripts/lib/heygen-cli.test.mjsscript10.0 KB
scripts/lib/heygen-search.mjsscript1.8 KB
scripts/lib/heygen-search.test.mjsscript1.8 KB
scripts/lib/heygen-video-provider.mjsscript3.6 KB
scripts/lib/heygen-video-provider.test.mjsscript12.0 KB
scripts/lib/image-provider.mjsscript1.4 KB
scripts/lib/index-gen.mjsscript1.9 KB
scripts/lib/local-models.mjsscript13.3 KB
scripts/lib/local-models.test.mjsscript5.6 KB
scripts/lib/local-run.mjsscript2.2 KB
scripts/lib/local-run.test.mjsscript1.7 KB
scripts/lib/logo-provider.mjsscript7.0 KB
scripts/lib/logo-provider.test.mjsscript5.7 KB
scripts/lib/ltx-video-provider.mjsscript1.9 KB
scripts/lib/ltx-video-provider.test.mjsscript3.8 KB
scripts/lib/lut-preset-provider.mjsscript8.5 KB
scripts/lib/lut-preset-provider.test.mjsscript6.3 KB
scripts/lib/manifest.mjsscript7.0 KB
scripts/lib/manifest.test.mjsscript11.6 KB
scripts/lib/match.mjsscript1.4 KB
scripts/lib/mflux-provider.mjsscript3.2 KB
scripts/lib/misses.mjsscript1.2 KB
scripts/lib/misses.test.mjsscript2.5 KB
scripts/lib/npx-sync.mjsscript1.3 KB
scripts/lib/npx-sync.test.mjsscript2.0 KB
scripts/lib/parakeet-words.mjsscript1.1 KB
scripts/lib/parakeet-words.test.mjsscript1.4 KB
scripts/lib/prefs-store.mjsscript6.4 KB
scripts/lib/prefs-store.test.mjsscript7.2 KB
scripts/lib/probe.mjsscript1.3 KB
scripts/lib/probe.test.mjsscript1.6 KB
scripts/lib/providers.mjsscript327 B
scripts/lib/recipe-store.mjsscript12.7 KB
scripts/lib/recipe-store.test.mjsscript12.5 KB
scripts/lib/registry.mjsscript9.5 KB
scripts/lib/registry.test.mjsscript9.6 KB
scripts/lib/search.mjsscript906 B
scripts/lib/search.test.mjsscript1.2 KB
scripts/lib/sfx-provider.mjsscript700 B
scripts/lib/specs.mjsscript3.2 KB
scripts/lib/specs.test.mjsscript2.7 KB
scripts/lib/stats.mjsscript3.7 KB
scripts/lib/stats.test.mjsscript5.4 KB
scripts/lib/telemetry.mjsscript8.3 KB
scripts/lib/telemetry.test.mjsscript13.1 KB
scripts/lib/tts-local-provider.mjsscript3.7 KB
scripts/lib/tts-local-provider.test.mjsscript2.6 KB
scripts/lib/usage.mjsscript1.8 KB
scripts/lib/usage.test.mjsscript1.7 KB
scripts/lib/voice-provider.mjsscript1.7 KB
scripts/lib/voice-provider.test.mjsscript1.9 KB
scripts/lib/words.mjsscript764 B
scripts/prefs.mjsscript2.4 KB
scripts/recipe.mjsscript4.0 KB
scripts/resolve.mjsscript43.2 KB
scripts/resolve.test.mjsscript35.8 KB
scripts/transcribe.mjsscript6.5 KB
scripts/transcript-cut.mjsscript7.1 KB

scripts/lib/manifest.test.mjs

View on GitHub
import { strict as assert } from "node:assert";
import {
  mkdtempSync,
  rmSync,
  readFileSync,
  writeFileSync,
  mkdirSync,
  existsSync,
  readdirSync,
} from "node:fs";
import { join } from "node:path";
import { tmpdir } from "node:os";
import {
  readManifest,
  appendRecord,
  findByPrompt,
  findByEntity,
  nextId,
  allocateId,
  withReservedFileSync,
  normalizePrompt,
  manifestPath,
  mediaDir,
  typeDirPath,
  typeSubdir,
} from "./manifest.mjs";
import { regenerateIndex, generateIndexContent } from "./index-gen.mjs";
import {
  contentHash,
  cachePut,
  cacheGet,
  cacheGetByEntity,
  importFromCache,
  promote,
} from "./cache.mjs";

let tmp;

function setup() {
  tmp = mkdtempSync(join(tmpdir(), "mu-test-"));
}

function cleanup() {
  if (tmp) rmSync(tmp, { recursive: true, force: true });
}

function makeRecord(overrides = {}) {
  return {
    id: "bgm_001",
    type: "bgm",
    path: ".media/audio/bgm/bgm_001.wav",
    source: "search",
    description: "soft minimal ambient",
    duration: 11,
    provenance: { provider: "heygen.audio.sounds", prompt: "subtle tech" },
    ...overrides,
  };
}

function runTests() {
  const tests = [];

  function test(name, fn) {
    tests.push({ name, fn });
  }

  // --- manifest.mjs ---

  test("readManifest returns empty array when no manifest exists", () => {
    setup();
    const result = readManifest(tmp);
    assert.deepStrictEqual(result, []);
    cleanup();
  });

  test("appendRecord writes valid JSONL and readManifest parses it back", () => {
    setup();
    const record = makeRecord();
    appendRecord(tmp, record);
    const records = readManifest(tmp);
    assert.equal(records.length, 1);
    assert.deepStrictEqual(records[0], record);
    cleanup();
  });

  test("appendRecord creates .media/ and type subdirs on first write", () => {
    setup();
    appendRecord(tmp, makeRecord());
    assert.ok(existsSync(mediaDir(tmp)));
    assert.ok(existsSync(typeDirPath(tmp, "bgm")));
    cleanup();
  });

  test("lut and grade artifacts use the shared .media/luts subdir", () => {
    assert.equal(typeSubdir("lut"), "luts");
    assert.equal(typeSubdir("grade"), "luts");

    setup();
    const allocated = allocateId(tmp, "lut", ".cube");
    assert.equal(allocated.localPath, ".media/luts/lut_001.cube");
    assert.ok(existsSync(join(tmp, allocated.localPath)));
    cleanup();
  });

  test("appendRecord appends multiple records", () => {
    setup();
    appendRecord(tmp, makeRecord({ id: "bgm_001" }));
    appendRecord(tmp, makeRecord({ id: "bgm_002", provenance: { prompt: "energetic" } }));
    const records = readManifest(tmp);
    assert.equal(records.length, 2);
    assert.equal(records[0].id, "bgm_001");
    assert.equal(records[1].id, "bgm_002");
    cleanup();
  });

  test("findByPrompt returns exact-match record", () => {
    setup();
    appendRecord(tmp, makeRecord());
    const found = findByPrompt(tmp, "subtle tech", "bgm");
    assert.ok(found);
    assert.equal(found.id, "bgm_001");
    cleanup();
  });

  test("findByPrompt returns null on miss", () => {
    setup();
    appendRecord(tmp, makeRecord());
    assert.equal(findByPrompt(tmp, "nonexistent", "bgm"), null);
    cleanup();
  });

  test("findByPrompt filters by type", () => {
    setup();
    appendRecord(tmp, makeRecord({ type: "sfx" }));
    assert.equal(findByPrompt(tmp, "subtle tech", "bgm"), null);
    assert.ok(findByPrompt(tmp, "subtle tech", "sfx"));
    cleanup();
  });

  test("findByPrompt matches across case and whitespace variants", () => {
    setup();
    appendRecord(tmp, makeRecord({ provenance: { provider: "x", prompt: "calm ambient piano" } }));
    assert.ok(findByPrompt(tmp, "Calm Ambient Piano", "bgm"), "case-insensitive");
    assert.ok(findByPrompt(tmp, "  calm   ambient  piano ", "bgm"), "whitespace-insensitive");
    assert.equal(findByPrompt(tmp, "calm ambient guitar", "bgm"), null, "still a real miss");
    cleanup();
  });

  test("normalizePrompt trims, lowercases, collapses whitespace", () => {
    assert.equal(normalizePrompt("  Upbeat   Tech  Launch "), "upbeat tech launch");
    assert.equal(normalizePrompt(null), "");
  });

  test("allocateId reserves the id on disk so a pre-append caller can't reuse it (MU-23)", () => {
    setup();
    const a = allocateId(tmp, "bgm", ".wav");
    assert.equal(a.id, "bgm_001");
    assert.ok(existsSync(join(tmp, a.localPath)), "placeholder reserved on disk");
    // Second allocation BEFORE any manifest append (the download window) must not
    // hand back bgm_001 again, even with a different extension.
    const b = allocateId(tmp, "bgm", ".mp3");
    assert.equal(b.id, "bgm_002");
    assert.notEqual(a.localPath, b.localPath);
    // Lock file is released (not left behind).
    assert.ok(!existsSync(join(tmp, ".media", ".lock")), "lock released");
    cleanup();
  });

  test("allocateId continues past the highest manifest id", () => {
    setup();
    appendRecord(tmp, makeRecord({ id: "bgm_005" }));
    assert.equal(allocateId(tmp, "bgm", ".wav").id, "bgm_006");
    cleanup();
  });

  test("failed reservation rollback preserves another completed reservation", () => {
    setup();
    const kept = withReservedFileSync(tmp, "bgm", ".wav", (reservation) => {
      writeFileSync(reservation.fullPath, "completed asset");
      return reservation;
    });

    assert.throws(
      () =>
        withReservedFileSync(tmp, "bgm", ".wav", () => {
          throw new Error("populate failed");
        }),
      /populate failed/,
    );

    assert.equal(kept.id, "bgm_001");
    assert.equal(readFileSync(kept.fullPath, "utf8"), "completed asset");
    assert.deepStrictEqual(readdirSync(typeDirPath(tmp, "bgm")), ["bgm_001.wav"]);
    assert.equal(allocateId(tmp, "bgm", ".wav").id, "bgm_002");
    cleanup();
  });

  test("empty reservation result releases the placeholder", () => {
    setup();
    assert.equal(
      withReservedFileSync(tmp, "image", ".jpg", () => null),
      null,
    );
    assert.deepStrictEqual(readdirSync(typeDirPath(tmp, "image")), []);
    cleanup();
  });

  test("findByEntity matches case-insensitively", () => {
    setup();
    appendRecord(tmp, makeRecord({ entity: "GitHub", type: "icon" }));
    assert.ok(findByEntity(tmp, "github"));
    assert.ok(findByEntity(tmp, "GITHUB"));
    assert.equal(findByEntity(tmp, "gitlab"), null);
    cleanup();
  });

  test("nextId generates sequential ids", () => {
    setup();
    assert.equal(nextId(tmp, "bgm"), "bgm_001");
    appendRecord(tmp, makeRecord({ id: "bgm_001" }));
    assert.equal(nextId(tmp, "bgm"), "bgm_002");
    appendRecord(tmp, makeRecord({ id: "bgm_002" }));
    assert.equal(nextId(tmp, "bgm"), "bgm_003");
    cleanup();
  });

  // --- index-gen.mjs ---

  test("regenerateIndex produces plain-column table", () => {
    setup();
    appendRecord(tmp, makeRecord());
    regenerateIndex(tmp);
    const content = readFileSync(join(tmp, ".media", "index.md"), "utf8");
    assert.ok(content.includes("# .media · 1 asset"));
    assert.ok(content.includes("bgm_001"));
    assert.ok(content.includes("soft minimal ambient"));
    assert.ok(content.includes("11s"));
    cleanup();
  });

  test("regenerateIndex handles empty manifest", () => {
    setup();
    mkdirSync(join(tmp, ".media"), { recursive: true });
    writeFileSync(manifestPath(tmp), "");
    regenerateIndex(tmp);
    const content = readFileSync(join(tmp, ".media", "index.md"), "utf8");
    assert.ok(content.includes("# .media · 0 assets"));
    cleanup();
  });

  test("generateIndexContent includes dims for images", () => {
    const records = [
      makeRecord({ id: "img_001", type: "image", width: 1920, height: 1080, duration: null }),
    ];
    const content = generateIndexContent(records);
    assert.ok(content.includes("1920×1080"));
    assert.ok(content.includes("img_001"));
  });

  test("regenerateIndex matches manifest content after multiple writes", () => {
    setup();
    appendRecord(tmp, makeRecord({ id: "bgm_001" }));
    appendRecord(
      tmp,
      makeRecord({ id: "sfx_001", type: "sfx", description: "whoosh", duration: 3 }),
    );
    regenerateIndex(tmp);
    const content = readFileSync(join(tmp, ".media", "index.md"), "utf8");
    assert.ok(content.includes("# .media · 2 assets"));
    assert.ok(content.includes("bgm_001"));
    assert.ok(content.includes("sfx_001"));
    assert.ok(content.includes("whoosh"));
    cleanup();
  });

  // --- cache.mjs ---

  test("cacheGet returns null when cache is empty", () => {
    const result = cacheGet("nonexistent prompt", "bgm");
    assert.equal(result, null);
  });

  test("cachePut + cacheGet round-trip", () => {
    setup();
    const filePath = join(tmp, "test.wav");
    writeFileSync(filePath, "fake audio bytes for testing");
    const record = makeRecord({ provenance: { prompt: "cache test" } });

    const { sha } = cachePut(filePath, record);
    assert.ok(sha);
    assert.equal(sha.length, 64);

    const found = cacheGet("cache test", "bgm");
    assert.ok(found);
    assert.equal(found.reusable, true);
    assert.equal(found.sha, sha);

    // cross-project reuse must survive trivial prompt variation, not just
    // byte-identical intents (the whole point of normalizePrompt).
    assert.ok(cacheGet("  Cache   Test ", "bgm"), "cacheGet is case/whitespace-insensitive");
    cleanup();
  });

  test("cacheGetByEntity finds cached asset", () => {
    setup();
    const filePath = join(tmp, "logo.png");
    writeFileSync(filePath, "fake png bytes");
    const record = makeRecord({
      type: "icon",
      entity: "TestCorp",
      provenance: { prompt: "TestCorp logo" },
    });

    cachePut(filePath, record);
    const found = cacheGetByEntity("testcorp");
    assert.ok(found);
    assert.equal(found.entity, "TestCorp");
    cleanup();
  });

  test("contentHash is deterministic", () => {
    setup();
    const filePath = join(tmp, "det.bin");
    writeFileSync(filePath, "deterministic content");
    const h1 = contentHash(filePath);
    const h2 = contentHash(filePath);
    assert.equal(h1, h2);
    cleanup();
  });

  test("promote copies project asset to global cache", () => {
    setup();
    const record = makeRecord();
    appendRecord(tmp, record);
    const filePath = join(tmp, record.path);
    mkdirSync(join(filePath, ".."), { recursive: true });
    writeFileSync(filePath, "promotable audio data");

    const { sha } = promote(tmp, "bgm_001");
    assert.ok(sha);

    const cached = cacheGet("subtle tech", "bgm");
    assert.ok(cached);
    assert.equal(cached.sha, sha);
    cleanup();
  });

  test("importFromCache copies cached file into project", () => {
    setup();
    const filePath = join(tmp, "source.wav");
    writeFileSync(filePath, "importable audio");
    const record = makeRecord({ provenance: { prompt: "import test" } });
    const { sha } = cachePut(filePath, record);

    const cached = cacheGet("import test", "bgm");
    const projectDir = mkdtempSync(join(tmpdir(), "mu-import-"));
    const imported = importFromCache(cached, projectDir, "bgm_001", ".media/audio/bgm/bgm_001.wav");

    assert.ok(imported);
    assert.equal(imported.id, "bgm_001");
    assert.equal(imported.provenance.imported_from, sha);
    assert.ok(existsSync(join(projectDir, ".media/audio/bgm/bgm_001.wav")));

    rmSync(projectDir, { recursive: true, force: true });
    cleanup();
  });

  // --- run ---

  let passed = 0;
  let failed = 0;
  for (const { name, fn } of tests) {
    try {
      fn();
      passed++;
      console.log(`  \x1b[32m✓\x1b[0m ${name}`);
    } catch (err) {
      failed++;
      console.log(`  \x1b[31m✗\x1b[0m ${name}`);
      console.log(`    ${err.message}`);
    }
  }
  console.log(`\n${passed} passed, ${failed} failed`);
  if (failed > 0) process.exit(1);
}

console.log("media-use · manifest/index/cache tests\n");
runTests();
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall