Skip to content

Diogenesoftoronto/keating / video/keating-surface-tour/.agents/skills/media-use

media-use

Flagged

Agent Media OS, the single skill for every media need in a HyperFrames project. Resolve BGM, SFX, image, icon, brand logo, voice, color grade, or LUT into a frozen local file or paste-ready block + ledger record (one verb, `resolve`); generate via TTS / music / image models when the catalog misses; produce voiceover, transcription, captions, and background removal through one shared audio engine; operate on media (cut / reframe / transform); and reuse assets across projects. Also use for vague feedback that real footage looks dark, flat, boring, should feel retro/camcorder/print/ASCII, needs privacy, or needs a media reveal.

FileKindSize
.gitignoreother17 B
SKILL.mdskill md7.8 KB
audio/assets/sfx/CREDITS.mdmarkdown1.2 KB
audio/assets/sfx/chime.mp3binary26.7 KB
audio/assets/sfx/click-soft.mp3binary11.4 KB
audio/assets/sfx/click.mp3binary11.4 KB
audio/assets/sfx/error.mp3binary50.6 KB
audio/assets/sfx/glitch-1.mp3binary82.4 KB
audio/assets/sfx/glitch-2.mp3binary109.5 KB
audio/assets/sfx/glitch-3.mp3binary96.8 KB
audio/assets/sfx/impact-bass-1.mp3binary66.1 KB
audio/assets/sfx/impact-bass-2.mp3binary81.0 KB
audio/assets/sfx/key-press.mp3binary3.8 KB
audio/assets/sfx/manifest.jsonconfig3.6 KB
audio/assets/sfx/notification.mp3binary76.7 KB
audio/assets/sfx/ping.mp3binary25.8 KB
audio/assets/sfx/pop.mp3binary22.5 KB
audio/assets/sfx/riser.mp3binary313.5 KB
audio/assets/sfx/sparkle.mp3binary56.3 KB
audio/assets/sfx/typing.mp3binary26.2 KB
audio/assets/sfx/whoosh-cinematic.mp3binary173.3 KB
audio/assets/sfx/whoosh-short.mp3binary18.0 KB
audio/assets/sfx/whoosh.mp3binary18.0 KB
audio/references/bgm.mdmarkdown7.8 KB
audio/references/captions/authoring.mdmarkdown8.8 KB
audio/references/captions/motion.mdmarkdown5.5 KB
audio/references/captions/transcript-handling.mdmarkdown5.3 KB
audio/references/remove-background.mdmarkdown8.3 KB
audio/references/requirements.mdmarkdown4.2 KB
audio/references/sfx.mdmarkdown3.4 KB
audio/references/transcribe.mdmarkdown2.7 KB
audio/references/tts-to-captions.mdmarkdown1.2 KB
audio/references/tts.mdmarkdown8.6 KB
audio/scripts/audio.mjsscript12.5 KB
audio/scripts/audio.test.mjsscript1.9 KB
audio/scripts/heygen-tts.mjsexecutablescript4.2 KB
audio/scripts/lib/bgm.mjsscript11.3 KB
audio/scripts/lib/bgm.test.mjsscript1.2 KB
audio/scripts/lib/concurrency.mjsscript527 B
audio/scripts/lib/concurrency.test.mjsscript1.6 KB
audio/scripts/lib/heygen.mjsscript6.9 KB
audio/scripts/lib/heygen.test.mjsscript3.5 KB
audio/scripts/lib/python.mjsscript2.5 KB
audio/scripts/lib/python.test.mjsscript2.6 KB
audio/scripts/lib/sfx.mjsscript5.3 KB
audio/scripts/lib/sfx.test.mjsscript2.8 KB
audio/scripts/lib/tts.mjsscript16.1 KB
audio/scripts/lib/tts.spawn.test.mjsscript5.1 KB
audio/scripts/lib/tts.test.mjsscript6.0 KB
audio/scripts/lyria-recipe.pyscript4.4 KB
audio/scripts/wait-bgm.mjsscript5.4 KB
luts/README.mdmarkdown1.1 KB
luts/index.jsonconfig2.0 KB
references/audio.mdmarkdown1.7 KB
references/grading.mdmarkdown6.6 KB
references/media-treatment-recipes.mdmarkdown35.0 KB
references/media-treatments.mdmarkdown13.6 KB
references/memory.mdmarkdown3.3 KB
references/meta.mdmarkdown6.6 KB
references/operations.mdmarkdown14.1 KB
references/resolve.mdmarkdown8.8 KB
references/setup-providers.mdmarkdown7.1 KB
references/telemetry-dashboard.mdmarkdown4.1 KB
scripts/audio-duck.mjsscript3.9 KB
scripts/dither.mjsscript9.7 KB
scripts/dither.test.mjsscript4.6 KB
scripts/eval.mjsscript14.5 KB
scripts/lib/adopt.mjsscript4.3 KB
scripts/lib/adopt.test.mjsscript2.7 KB
scripts/lib/bgm-provider.mjsscript650 B
scripts/lib/brand-provider.mjsscript1.6 KB
scripts/lib/bundled-sfx-provider.mjsscript3.5 KB
scripts/lib/bundled-sfx-provider.test.mjsscript3.1 KB
scripts/lib/cache.mjsscript4.8 KB
scripts/lib/candidates.mjsscript4.0 KB
scripts/lib/candidates.test.mjsscript5.9 KB
scripts/lib/codex-provider.mjsscript6.5 KB
scripts/lib/codex-provider.test.mjsscript1.3 KB
scripts/lib/coverage.test.mjsscript5.6 KB
scripts/lib/cube-build.mjsscript5.7 KB
scripts/lib/cube-build.test.mjsscript2.7 KB
scripts/lib/cube-validate.mjsscript5.9 KB
scripts/lib/cube-validate.test.mjsscript3.2 KB
scripts/lib/cutlist.mjsscript6.0 KB
scripts/lib/cutlist.test.mjsscript4.0 KB
scripts/lib/duck.mjsscript3.0 KB
scripts/lib/duck.test.mjsscript3.4 KB
scripts/lib/error-diffusion.mjsscript6.5 KB
scripts/lib/error-diffusion.test.mjsscript3.4 KB
scripts/lib/freeze.mjsscript3.0 KB
scripts/lib/freeze.test.mjsscript1.9 KB
scripts/lib/grade-analyzer.mjsscript8.6 KB
scripts/lib/grade-analyzer.test.mjsscript7.7 KB
scripts/lib/heygen-cli.mjsscript7.3 KB
scripts/lib/heygen-cli.test.mjsscript10.0 KB
scripts/lib/heygen-search.mjsscript1.8 KB
scripts/lib/heygen-search.test.mjsscript1.8 KB
scripts/lib/heygen-video-provider.mjsscript3.6 KB
scripts/lib/heygen-video-provider.test.mjsscript12.0 KB
scripts/lib/image-provider.mjsscript1.4 KB
scripts/lib/index-gen.mjsscript1.9 KB
scripts/lib/local-models.mjsscript13.3 KB
scripts/lib/local-models.test.mjsscript5.6 KB
scripts/lib/local-run.mjsscript2.2 KB
scripts/lib/local-run.test.mjsscript1.7 KB
scripts/lib/logo-provider.mjsscript7.0 KB
scripts/lib/logo-provider.test.mjsscript5.7 KB
scripts/lib/ltx-video-provider.mjsscript1.9 KB
scripts/lib/ltx-video-provider.test.mjsscript3.8 KB
scripts/lib/lut-preset-provider.mjsscript8.5 KB
scripts/lib/lut-preset-provider.test.mjsscript6.3 KB
scripts/lib/manifest.mjsscript7.0 KB
scripts/lib/manifest.test.mjsscript11.6 KB
scripts/lib/match.mjsscript1.4 KB
scripts/lib/mflux-provider.mjsscript3.2 KB
scripts/lib/misses.mjsscript1.2 KB
scripts/lib/misses.test.mjsscript2.5 KB
scripts/lib/npx-sync.mjsscript1.3 KB
scripts/lib/npx-sync.test.mjsscript2.0 KB
scripts/lib/parakeet-words.mjsscript1.1 KB
scripts/lib/parakeet-words.test.mjsscript1.4 KB
scripts/lib/prefs-store.mjsscript6.4 KB
scripts/lib/prefs-store.test.mjsscript7.2 KB
scripts/lib/probe.mjsscript1.3 KB
scripts/lib/probe.test.mjsscript1.6 KB
scripts/lib/providers.mjsscript327 B
scripts/lib/recipe-store.mjsscript12.7 KB
scripts/lib/recipe-store.test.mjsscript12.5 KB
scripts/lib/registry.mjsscript9.5 KB
scripts/lib/registry.test.mjsscript9.6 KB
scripts/lib/search.mjsscript906 B
scripts/lib/search.test.mjsscript1.2 KB
scripts/lib/sfx-provider.mjsscript700 B
scripts/lib/specs.mjsscript3.2 KB
scripts/lib/specs.test.mjsscript2.7 KB
scripts/lib/stats.mjsscript3.7 KB
scripts/lib/stats.test.mjsscript5.4 KB
scripts/lib/telemetry.mjsscript8.3 KB
scripts/lib/telemetry.test.mjsscript13.1 KB
scripts/lib/tts-local-provider.mjsscript3.7 KB
scripts/lib/tts-local-provider.test.mjsscript2.6 KB
scripts/lib/usage.mjsscript1.8 KB
scripts/lib/usage.test.mjsscript1.7 KB
scripts/lib/voice-provider.mjsscript1.7 KB
scripts/lib/voice-provider.test.mjsscript1.9 KB
scripts/lib/words.mjsscript764 B
scripts/prefs.mjsscript2.4 KB
scripts/recipe.mjsscript4.0 KB
scripts/resolve.mjsscript43.2 KB
scripts/resolve.test.mjsscript35.8 KB
scripts/transcribe.mjsscript6.5 KB
scripts/transcript-cut.mjsscript7.1 KB

scripts/lib/codex-provider.mjs

View on GitHub
import { execFileSync } from "node:child_process";
import { copyFileSync, existsSync, readdirSync, statSync, unlinkSync } from "node:fs";
import { homedir, tmpdir } from "node:os";
import { join } from "node:path";

// Image generation via the OpenAI Codex CLI's built-in image tool (gpt-image-2)
// on the user's ChatGPT subscription: the codex CLI owns auth, media-use holds
// no key (CLI-only). The image UPSELL behind local mflux; skipped by --local-only.
//
// Retrieval mirrors illo-skill rather than trusting the model to save a file:
// `--enable image_generation` makes the built-in tool drop the rendered artifact
// into $CODEX_HOME/generated_images/, and we fetch the freshest file that
// postdates this run. The save-to-path instruction is only a best-effort
// verify-first.
//
// The flag was called `imagegenext` until Codex CLI ~0.145, which renamed it to
// `image_generation` and dropped the old row from `codex features list`. Both
// the gate below and the --enable arg track the new name, with a fallback to
// the old one so older CLIs keep working.

const TIMEOUT_MS = 600000; // codex exec round-trips the sub; first-run tool spin-up is slow
const MTIME_SKEW_MS = 2000; // tolerate mtime granularity / clock skew (illo uses 2s)

function codexGeneratedDir() {
  // Codex relocates CODEX_HOME on some hosts, so resolve it at run time.
  return join(process.env.CODEX_HOME || join(homedir(), ".codex"), "generated_images");
}

// Newest artifact that postdates `sinceMs` (minus skew), so a stale prior render
// or a concurrent session's file can't be mistaken for this run's output.
function freshestGeneratedImage(sinceMs) {
  const dir = codexGeneratedDir();
  if (!existsSync(dir)) return null;
  const floor = sinceMs - MTIME_SKEW_MS;
  let best = null;
  for (const name of readdirSync(dir)) {
    let st;
    try {
      st = statSync(join(dir, name));
    } catch {
      continue;
    }
    if (!st.isFile() || st.mtimeMs < floor) continue;
    if (!best || st.mtimeMs > best.mtimeMs) best = { path: join(dir, name), mtimeMs: st.mtimeMs };
  }
  return best?.path ?? null;
}

// Short `codex` subcommand → combined stdout+stderr, or null if it can't run.
function codexRun(args) {
  try {
    return execFileSync("codex", args, {
      encoding: "utf8",
      stdio: ["ignore", "pipe", "pipe"],
      timeout: 10000,
    });
  } catch (err) {
    return `${err.stdout?.toString() ?? ""}${err.stderr?.toString() ?? ""}` || null;
  }
}

// Name of the feature flag this CLI uses for the extended image tool, or null if
// it exposes neither. Newer CLIs list only `image_generation`; older ones list
// `imagegenext` alongside it and reject the new name on --enable.
export function imageGenFlag(feats) {
  if (/\bimagegenext\b/.test(feats)) return "imagegenext";
  if (/\bimage_generation\b/.test(feats)) return "image_generation";
  return null;
}

// Fail-fast host check (mirrors illo): don't burn a minutes-long exec when Codex
// isn't usable. Returns { flag } when ready, else { reason }. The flag ships
// default-disabled, so we check the ROW is present (the capability signal) — the
// exec enables it per-render with --enable.
function codexUnavailableReason() {
  try {
    const which = process.platform === "win32" ? "where" : "which";
    execFileSync(which, ["codex"], { stdio: ["ignore", "ignore", "ignore"], timeout: 5000 });
  } catch {
    // A shell alias (e.g. `codex → /Applications/Codex.app/...`) is NOT enough:
    // aliases live only in the interactive shell, so a spawned subprocess's PATH
    // lookup can't see them. Symlink the real binary onto PATH.
    return {
      reason:
        'codex CLI not reachable on PATH (a shell alias won\'t work — spawned processes can\'t see aliases; symlink the real binary onto PATH, e.g. ln -s "$(readlink -f "$(command -v codex)")" ~/.local/bin/codex)',
    };
  }
  // Auth marker: presence of the credentials file, NOT `codex login status`.
  // That command prints "Logged in using ChatGPT" only to a human stream
  // (stderr / TTY) and exits 0, so its piped stdout — how media-use spawns it —
  // is empty, and the gate falsely reported "not logged in", blocking codex
  // image gen in every headless / CI / agent run even when fully authed.
  // auth.json is the durable, TTY-independent signal; token validity is proven
  // by the exec itself, which fails cleanly if the login is stale.
  const authPath = join(process.env.CODEX_HOME || join(homedir(), ".codex"), "auth.json");
  if (!existsSync(authPath)) return { reason: "codex not logged in (run: codex login)" };
  const feats = codexRun(["features", "list"]);
  if (feats == null) return { reason: "could not read `codex features list`" };
  const flag = imageGenFlag(feats);
  if (!flag) return { reason: "codex image generation feature unavailable (upgrade Codex CLI)" };
  return { flag };
}

export async function codexImageGenerate(intent) {
  const { reason, flag } = codexUnavailableReason();
  if (reason) {
    console.error(`media-use: codex image upsell unavailable: ${reason}`);
    return null;
  }
  const outPath = join(tmpdir(), `media-use-codex-${process.pid}-${Date.now()}.png`);
  const prompt =
    `${intent}\n\n` +
    `Use your built-in image generation tool to render this, then save the image ` +
    `to ${outPath} (overwrite if it exists). Do not ask for confirmation. ` +
    `If you have no built-in image tool, do nothing (no PIL/matplotlib/SVG substitute).`;
  try {
    unlinkSync(outPath); // clear any prior file so verify-first can't accept a stale render
  } catch {
    /* no prior file */
  }
  const started = Date.now();
  try {
    execFileSync(
      "codex",
      [
        "exec",
        "--cd",
        tmpdir(),
        "-s",
        "workspace-write",
        "--skip-git-repo-check",
        "--enable",
        flag,
        "-",
      ],
      { input: prompt, encoding: "utf8", timeout: TIMEOUT_MS, stdio: ["pipe", "pipe", "pipe"] },
    );
  } catch (err) {
    console.error(
      `media-use: \`codex exec\` image generation failed: ${err.stderr?.toString().trim().slice(-200) || err.message}`,
    );
    return null;
  }
  // Verify-first (save-to-path may have worked), else fetch the image-tool artifact.
  const produced =
    existsSync(outPath) && statSync(outPath).size > 0 ? outPath : freshestGeneratedImage(started);
  if (!produced) return null;
  if (produced !== outPath) {
    try {
      copyFileSync(produced, outPath);
    } catch {
      return null;
    }
  }
  return {
    localPath: outPath,
    ext: ".png",
    source: "generated",
    metadata: { description: intent, provider: "codex.image_gen", provenance: { prompt: intent } },
  };
}
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 471kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall