Skip to content

brycewang-stanford/Auto-Empirical-Research-Skills / skills/35-bahayonghang-academic-writing-skills/skills/paper-audit

paper-audit

Verified

Deep-review-first audit for Chinese and English academic papers across LaTeX, Typst, and PDF formats. Use whenever the user wants reviewer-style paper critique, pre-submission readiness checks, pass/fail gate decisions, structured revision roadmaps, or re-audits of revised manuscripts. Trigger even if the user only says "review my paper", "check if this is ready to submit", "audit this PDF", "simulate peer review", "find the biggest problems in this manuscript", or "re-check whether I fixed the review issues". Do not use for direct source editing or compilation-heavy repair; route those to the format-specific writing skills instead.

FileKindSize
SKILL.mdskill md14.3 KB
agents/claims_evidence_reviewer_agent.mdmarkdown354 B
agents/committee_editor_agent.mdmarkdown1.9 KB
agents/committee_literature_agent.mdmarkdown1.9 KB
agents/committee_logic_agent.mdmarkdown1.5 KB
agents/committee_methodology_agent.mdmarkdown1.8 KB
agents/committee_theory_agent.mdmarkdown1.9 KB
agents/critical_reviewer_agent.mdmarkdown8.4 KB
agents/domain_reviewer_agent.mdmarkdown7.1 KB
agents/editor_in_chief_agent.mdmarkdown5.2 KB
agents/evaluation_fairness_reviewer_agent.mdmarkdown371 B
agents/literature_reviewer_agent.mdmarkdown3.6 KB
agents/methodology_reviewer_agent.mdmarkdown7.2 KB
agents/notation_consistency_reviewer_agent.mdmarkdown398 B
agents/prior_art_reviewer_agent.mdmarkdown2.9 KB
agents/section_reviewer_agent.mdmarkdown365 B
agents/self_consistency_reviewer_agent.mdmarkdown420 B
agents/synthesis_agent.mdmarkdown951 B
evals/evals.jsonconfig12.0 KB
evals/fixtures/deep_review_fixture.texother699 B
evals/fixtures/gate_ieee_fixture.texother617 B
evals/fixtures/polish_fixture.texother396 B
evals/fixtures/previous_final_issues.jsonconfig1.1 KB
evals/fixtures/previous_review_report.mdmarkdown205 B
evals/fixtures/quick_audit_fixture.texother538 B
examples/gate_example.mdmarkdown3.5 KB
examples/review_example.mdmarkdown2.5 KB
examples/self_check_example.mdmarkdown2.9 KB
references/AUDIT_GUIDE.mdmarkdown3.4 KB
references/CHANGELOG.mdmarkdown530 B
references/CHECKLIST.mdmarkdown6.0 KB
references/CONSOLIDATION_RULES.mdmarkdown907 B
references/DEEP_REVIEW_CRITERIA.mdmarkdown2.8 KB
references/FORBIDDEN_TERMS.mdmarkdown6.4 KB
references/ISSUE_SCHEMA.mdmarkdown928 B
references/LITERATURE_GROUNDING_GUIDE.mdmarkdown3.3 KB
references/POLISH_GUIDE.mdmarkdown2.3 KB
references/QUALITATIVE_STANDARDS.mdmarkdown5.5 KB
references/QUICK_REFERENCE.mdmarkdown1.1 KB
references/REVIEW_CRITERIA.mdmarkdown2.7 KB
references/REVIEW_LANE_GUIDE.mdmarkdown828 B
references/SCHOLAR_EVAL_GUIDE.mdmarkdown6.4 KB
references/SCORING_SYSTEMS.mdmarkdown1000 B
references/SUBAGENT_TEMPLATES.mdmarkdown987 B
references/TROUBLESHOOTING.mdmarkdown1.4 KB
references/VENUE_RULES.mdmarkdown764 B
references/editorial_decision_standards.mdmarkdown6.7 KB
references/quality_rubrics.mdmarkdown10.8 KB
scripts/audit.pyscript78.4 KB
scripts/build_claim_map.pyscript3.3 KB
scripts/check_citations.pyscript5.6 KB
scripts/check_references.pyscript19.9 KB
scripts/consolidate_review_findings.pyscript5.2 KB
scripts/detect_language.pyscript1.9 KB
scripts/diff_review_issues.pyscript2.0 KB
scripts/literature_compare.pyscript11.4 KB
scripts/literature_search.pyscript22.0 KB
scripts/models/scoring_model.jsonconfig737 B
scripts/parsers.pyscript3.3 KB
scripts/pdf_parser.pyscript11.4 KB
scripts/prepare_review_workspace.pyscript6.8 KB
scripts/render_deep_review_report.pyscript3.5 KB
scripts/report_generator.pyscript36.2 KB
scripts/scholar_eval.pyscript13.7 KB
scripts/scoring_model.pyscript6.2 KB
scripts/verify_quotes.pyscript1.6 KB
scripts/visual_check.pyscript10.7 KB
templates/audit_report_template.mdmarkdown2.8 KB
templates/final_issues_template.jsonconfig498 B
templates/review_report_template.mdmarkdown678 B
templates/revision_roadmap_template.mdmarkdown3.1 KB

examples/gate_example.md

View on GitHub
# Gate Mode Example Output

Example outputs from `uv run python -B "$SKILL_DIR/scripts/audit.py" paper.tex --mode gate --venue ieee`.

---

## Example 1: FAIL

# Quality Gate Report

**File**: `paper.tex` | **Language**: EN | **Mode**: gate
**Generated**: 2026-03-11T14:45:00 | **Venue**: ieee

---

## Verdict: FAIL

**2 blocking issue(s) and 3 failed checklist item(s) prevent submission.**

---

## Blocking Issues (must fix)

| # | Module | Line | Issue |
|---|--------|------|-------|
| 1 | REFERENCES | — | Undefined reference: `tab:comparison` referenced but no `\label{tab:comparison}` found |
| 2 | PSEUDOCODE | 144 | IEEE-safe pseudocode should not use floating algorithm environments; wrap algorithmic content in a figure instead. |

---

## Pre-Submission Checklist

- [x] No placeholder text (TODO, FIXME, XXX)
- [x] All figures referenced in text
- [ ] All tables referenced in text — Unreferenced: {'tab:hyperparams'}
- [x] Anonymous submission (blind review check)
- [x] Consistent math notation
- [x] Acronyms defined on first use
- [ ] Abstract word limit (250 words for IEEE) — Abstract has 287 words (limit: 250)
- [x] [IEEE] Keywords section present
- [ ] [IEEE] No floating pseudocode environment used — IEEE-safe pseudocode should not use floating algorithm environments; wrap algorithmic content in a figure instead.
- [ ] [IEEE] Pseudocode blocks have caption and label — Pseudocode figure is missing a caption. IEEE-style algorithm blocks should carry a figure caption.
- [x] [IEEE] Pseudocode blocks are referenced before appearing

---

## Non-Blocking Issues (informational)

| # | Module | Line | Severity | Issue |
|---|--------|------|----------|-------|
| 1 | BIB | — | Major | Entry `wang2024` has mismatched year (bib: 2024, cited text mentions 2023) |
| 2 | FORMAT | 89 | Minor | Inconsistent figure caption style: some end with period, others don't |
| 3 | FIGURES | — | Minor | Figure 3 resolution below 300 DPI (estimated 220 DPI) |
| 4 | PSEUDOCODE | 151 | Minor | Line numbers were not detected. They are recommended for IEEE-like review but not required. |

---

*Gate verdict: resolve all blocking issues and failed checklist items before submission.*

---

---

## Example 2: PASS

# Quality Gate Report

**File**: `paper_v2.tex` | **Language**: EN | **Mode**: gate
**Generated**: 2026-03-11T15:00:00 | **Venue**: ieee

---

## Verdict: PASS

**No blocking issues. All checklist items passed. Paper is ready for submission.**

---

## Pre-Submission Checklist

- [x] No placeholder text (TODO, FIXME, XXX)
- [x] All figures referenced in text
- [x] All tables referenced in text
- [x] Anonymous submission (blind review check)
- [x] Consistent math notation
- [x] Acronyms defined on first use
- [x] Abstract word limit (250 words for IEEE) — Abstract has 231 words
- [x] Keywords count (3-5 for IEEE) — Found 4 keywords
- [x] [IEEE] Keywords section present
- [x] [IEEE] No floating pseudocode environment used
- [x] [IEEE] Pseudocode blocks have caption and label
- [x] [IEEE] Pseudocode blocks are referenced before appearing

---

## Non-Blocking Issues (informational)

| # | Module | Line | Severity | Issue |
|---|--------|------|----------|-------|
| 1 | FORMAT | 156 | Minor | Widow line at top of page 6 |
| 2 | BIB | — | Minor | Entry `chen2023` missing optional `doi` field |
| 3 | PSEUDOCODE | 188 | Minor | Line numbers were not detected. They are recommended for IEEE-like review but not required. |

---

*Gate verdict: PASS. 2 non-blocking minor issues noted for optional improvement.*
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 194kUpdated Claude CodeCodexVerifiedInstall