joshua-zyy/academic-paper-writer / skills/academic-experiments
academic-experiments
VerifiedAudit, run, or verify experimental evidence for CS/AI/ML papers. Produces Evidence Inventory with evidence_type annotations (newly_run/preexisting_artifact/user_claim) and Protocol Risk assessments. Use when: checking if experiment results are reproducible, auditing existing experiment artifacts, running minimal reproducible commands, evaluating checkpoints without full retraining, documenting protocol risks like data leakage or missing baselines. Triggers on: 复核实验, run experiments, 实验结果, experiment evidence, verify results, 实验验证, evidence inventory, protocol risk, 跑实验, check results, reproduce experiments, 实验审计.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 3.1 KB |
| agents/experiment_agent.md | markdown | 5.9 KB |
| manifest.yaml | config | 1.2 KB |
| references/evidence-inventory.md | markdown | 1.7 KB |
| references/protocol-risks.md | markdown | 1.8 KB |
| references/run-strategy.md | markdown | 1.4 KB |
| scripts/evidence_scanner.py | script | 4.2 KB |
| static/core/anti-patterns.md | markdown | 571 B |
| static/core/output-contract.md | markdown | 906 B |
| static/core/red-lines.md | markdown | 477 B |
| static/core/stance.md | markdown | 2.5 KB |
static/core/output-contract.md
View on GitHub# Experiment Output Contract
## experiment-evidence-pass
```
## Experiment Evidence
(逐条记录:Status, Evidence Type, Command, Workdir, Environment, Inputs, Key Config, Output Artifacts, Metrics Used In Draft, Protocol Risks, Claim Readiness)
## Protocol Risks
(数据泄漏 / 验证集调参 / baseline 缺失 / 无独立测试集 / 单次运行 / 指标定义模糊 / 图表溯源不明)
## Results / Setup Draft
(可用实验事实写成的草稿段落,缺证据处用占位符)
## Remaining Blockers
(无法运行的实验、缺失的数据/环境/依赖)
```
## evidence-inventory-only
- 实验产物清单(不执行任何命令)
## minimal-reproducible-run
- 运行记录 + Evidence Inventory 条目
## Claim Readiness
每个结果标注:`paper_ready` / `weaken_claim` / `blocked` / `author_input_needed`
Schema: `skills/shared/schemas/evidence-inventory.md`
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |