zoltanmaric/coppersushi / .agents/skills/job-supervision
job-supervision
VerifiedLaunches and supervises long-running commands — solves, workflows, downloads, builds — detached with a log, PID and exit sentinel, then tells stuck from slow and kills verifiably. Use before running anything that may exceed a minute, for nohup or background launches, and when a run hangs, shows no output, or timed out.
Job supervision
The gate — answer before launching
- Success artifact: which file or remote state proves success? Poll that, not the client process.
- Birth signal: what shows the run alive by ~30 s — CPU accruing, a log or lock file created, a socket open? Not stdout: healthy jobs are often pipe-buffered silent.
- Progress: what emits progress, at what cadence, against known phase durations? If unknown, measuring them is this run's job.
- Silence budget: after how long without progress is it failed? An armed timer, not a vibe. On any exit, verify the artifact — silence is not success.
Preflight every fallible precondition before the expensive phase: credentials that expire, connectivity, config validation (snakemake -n), disk space.
On Docker build ENOSPC (No space left on device), compare host and Docker disk usage, inspect docker system df, reclaim unused build cache with docker builder prune --force, verify reclaimed space, and retry once. Limit automatic cleanup to build cache; report insufficient space if the retry still fails.
Launch recipe
- Detach from the tool's timeout in its own process group, keep the PID and the exit status: a background tool call is capped, and a plain
nohup … &shares the tool shell's group. Launch asnohup perl -MPOSIX -e 'POSIX::setsid(); exec @ARGV' bash -c '<cmd>; echo "EXIT $?"' </dev/null >> <logdir>/<name>.log 2>&1 & echo $! > <logdir>/<name>.pid, then, after a second, confirmps -o pgid= -p $(cat <name>.pid)prints the PID. - Never pipe a long-runner through
tail/head. Log to a file, read the tail on demand. - Arm the watcher at once on the log, filtering for progress and every terminal state:
Traceback|Error|Exiting|EXIT|Killed. - Verify downloads by size or checksum before relying on them.
Stuck vs. slow
Check: process alive (pgrep -f); CPU time accruing (ps -o time -p <pid>, two samples 20 s apart — not %CPU); the tool's own artifacts growing (fresh mtimes); lsof -p <pid> — a lone TCP connection in CLOSE_WAIT with flat CPU is a dead client. Flat on all → stuck. Then kill.
Verified kill
Kill the launched process group, not a command-line pattern: kill -- -$(cat <name>.pid), wait, pgrep -g $(cat <name>.pid) shows nothing; then remove stale locks (Snakemake: .snakemake/locks/) and relaunch. A kill is done when the process tree is confirmed gone.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |