Skip to content

momo-land/PHD-management-skills / skills/phd-reproduce

phd-reproduce

Verified

对照论文和代码核对复现条件,执行有范围的复现实验,逐项比较结果与差异来源

FileKindSize
SKILL.en.mdmarkdown2.1 KB
SKILL.mdskill md2.0 KB
agents/openai.yamlconfig342 B

SKILL.en.md

View on GitHub
---
name: phd-reproduce
description: Compare a paper with its code, establish reproducibility conditions, run scoped reproductions and explain measured discrepancies.
---

# Paper reproduction

## Workflow

1. Fix the paper version, target figure/metric, repository commit, dataset version and authorized scope. Distinguish rerunning authors' code, independent implementation and inspecting reported results.
2. Map paper claims to code, configurations, splits and metric implementations. Check preprocessing, seeds, repeats, hyperparameters, checkpoints and evaluation data.
3. Inspect setup scripts before necessary authorized execution. Check available tools and compute; state expected resources and stopping conditions. With no budget, begin with a small verification rather than long training or huge downloads.
4. Save commands, versions, logs, exit status and raw metrics in isolated output directories. Validate data and a minimal example before full runs within budget; retain failed logs.
5. Compare identical units and estimands, reporting absolute/relative differences, variability and comparability. Label possible causes as hypotheses until tested.
6. Record completion through [experiments](../phd-experiment/SKILL.en.md) only with genuine results and evidence. Installation, generated code, launched processes and small smoke tests are not a complete reproduction.

## Deliverable

Provide a conditions matrix, run evidence, result comparison and next diagnostic step. Identify missing code, data, tools or budget precisely and complete feasible portions without inventing agreement.

## Saving and workspace updates

Read the [local workflow](../phd-manager/references/local-workflow.en.md). Save artifacts to the requested location or repository `outputs/` without overwriting source material. Only when recording/updating is requested, use `node cli.mjs` to read current records and versions, validate required batches, save and read back; preserve `PHD_DATA_DIR`. Label AI plans with `origin: "ai"` and retain external provenance. Creating an artifact does not automatically increase paper progress or complete experiments.
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 196kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 196kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 196kUpdated Claude CodeCodexVerifiedInstall