Skip to content

brycewang-stanford/Auto-Empirical-Research-Skills / skills/35-bahayonghang-academic-writing-skills/skills/paper-audit

paper-audit

Verified

Deep-review-first audit for Chinese and English academic papers across LaTeX, Typst, and PDF formats. Use whenever the user wants reviewer-style paper critique, pre-submission readiness checks, pass/fail gate decisions, structured revision roadmaps, or re-audits of revised manuscripts. Trigger even if the user only says "review my paper", "check if this is ready to submit", "audit this PDF", "simulate peer review", "find the biggest problems in this manuscript", or "re-check whether I fixed the review issues". Do not use for direct source editing or compilation-heavy repair; route those to the format-specific writing skills instead.

FileKindSize
SKILL.mdskill md14.3 KB
agents/claims_evidence_reviewer_agent.mdmarkdown354 B
agents/committee_editor_agent.mdmarkdown1.9 KB
agents/committee_literature_agent.mdmarkdown1.9 KB
agents/committee_logic_agent.mdmarkdown1.5 KB
agents/committee_methodology_agent.mdmarkdown1.8 KB
agents/committee_theory_agent.mdmarkdown1.9 KB
agents/critical_reviewer_agent.mdmarkdown8.4 KB
agents/domain_reviewer_agent.mdmarkdown7.1 KB
agents/editor_in_chief_agent.mdmarkdown5.2 KB
agents/evaluation_fairness_reviewer_agent.mdmarkdown371 B
agents/literature_reviewer_agent.mdmarkdown3.6 KB
agents/methodology_reviewer_agent.mdmarkdown7.2 KB
agents/notation_consistency_reviewer_agent.mdmarkdown398 B
agents/prior_art_reviewer_agent.mdmarkdown2.9 KB
agents/section_reviewer_agent.mdmarkdown365 B
agents/self_consistency_reviewer_agent.mdmarkdown420 B
agents/synthesis_agent.mdmarkdown951 B
evals/evals.jsonconfig12.0 KB
evals/fixtures/deep_review_fixture.texother699 B
evals/fixtures/gate_ieee_fixture.texother617 B
evals/fixtures/polish_fixture.texother396 B
evals/fixtures/previous_final_issues.jsonconfig1.1 KB
evals/fixtures/previous_review_report.mdmarkdown205 B
evals/fixtures/quick_audit_fixture.texother538 B
examples/gate_example.mdmarkdown3.5 KB
examples/review_example.mdmarkdown2.5 KB
examples/self_check_example.mdmarkdown2.9 KB
references/AUDIT_GUIDE.mdmarkdown3.4 KB
references/CHANGELOG.mdmarkdown530 B
references/CHECKLIST.mdmarkdown6.0 KB
references/CONSOLIDATION_RULES.mdmarkdown907 B
references/DEEP_REVIEW_CRITERIA.mdmarkdown2.8 KB
references/FORBIDDEN_TERMS.mdmarkdown6.4 KB
references/ISSUE_SCHEMA.mdmarkdown928 B
references/LITERATURE_GROUNDING_GUIDE.mdmarkdown3.3 KB
references/POLISH_GUIDE.mdmarkdown2.3 KB
references/QUALITATIVE_STANDARDS.mdmarkdown5.5 KB
references/QUICK_REFERENCE.mdmarkdown1.1 KB
references/REVIEW_CRITERIA.mdmarkdown2.7 KB
references/REVIEW_LANE_GUIDE.mdmarkdown828 B
references/SCHOLAR_EVAL_GUIDE.mdmarkdown6.4 KB
references/SCORING_SYSTEMS.mdmarkdown1000 B
references/SUBAGENT_TEMPLATES.mdmarkdown987 B
references/TROUBLESHOOTING.mdmarkdown1.4 KB
references/VENUE_RULES.mdmarkdown764 B
references/editorial_decision_standards.mdmarkdown6.7 KB
references/quality_rubrics.mdmarkdown10.8 KB
scripts/audit.pyscript78.4 KB
scripts/build_claim_map.pyscript3.3 KB
scripts/check_citations.pyscript5.6 KB
scripts/check_references.pyscript19.9 KB
scripts/consolidate_review_findings.pyscript5.2 KB
scripts/detect_language.pyscript1.9 KB
scripts/diff_review_issues.pyscript2.0 KB
scripts/literature_compare.pyscript11.4 KB
scripts/literature_search.pyscript22.0 KB
scripts/models/scoring_model.jsonconfig737 B
scripts/parsers.pyscript3.3 KB
scripts/pdf_parser.pyscript11.4 KB
scripts/prepare_review_workspace.pyscript6.8 KB
scripts/render_deep_review_report.pyscript3.5 KB
scripts/report_generator.pyscript36.2 KB
scripts/scholar_eval.pyscript13.7 KB
scripts/scoring_model.pyscript6.2 KB
scripts/verify_quotes.pyscript1.6 KB
scripts/visual_check.pyscript10.7 KB
templates/audit_report_template.mdmarkdown2.8 KB
templates/final_issues_template.jsonconfig498 B
templates/review_report_template.mdmarkdown678 B
templates/revision_roadmap_template.mdmarkdown3.1 KB

examples/self_check_example.md

View on GitHub
# Self-Check Example Output

Example output from `uv run python -B "$SKILL_DIR/scripts/audit.py" paper.tex --mode self-check --venue neurips`.

---

# Paper Audit Report

**File**: `paper.tex` | **Language**: EN | **Mode**: self-check
**Generated**: 2026-03-11T14:30:00 | **Venue**: neurips

---

## Executive Summary

Found **14 issues** (2 Critical, 4 Major, 8 Minor).
Overall score: **3.83/6.0** (Borderline Accept).

---

## Scores

| Dimension | Score | Issues (C/M/m) | Label |
|-----------|-------|-----------------|-------|
| Quality (30%) | 4.50/6.0 | 0/2/0 | Accept |
| Clarity (30%) | 2.50/6.0 | 2/1/5 | Borderline Reject |
| Significance (20%) | 5.25/6.0 | 0/1/0 | Accept |
| Originality (20%) | 4.50/6.0 | 0/0/3 | Accept |
| **Overall** | **3.83/6.0** | | **Borderline Accept** |

---

## Issues

### Critical (P0) — Must Fix

| # | Module | Line | Issue |
|---|--------|------|-------|
| 1 | FORMAT | 142 | Overfull hbox (32pt too wide) in paragraph at line 142 |
| 2 | REFERENCES | — | Undefined reference: `fig:ablation` referenced on line 89 but no corresponding `\label{fig:ablation}` |

### Major (P1) — Should Fix

| # | Module | Line | Issue |
|---|--------|------|-------|
| 1 | GRAMMAR | 67 | Subject-verb disagreement: "the results shows" should be "the results show" |
| 2 | LOGIC | 198 | Claim lacks supporting evidence: "our method significantly outperforms" but no statistical significance test provided |
| 3 | LOGIC | 234 | Causal claim without controlled experiment: "X causes Y" stated without ruling out confounders |
| 4 | BIB | — | Entry `smith2023` missing required `pages` field |

### Minor (P2) — Nice to Fix

| # | Module | Line | Issue |
|---|--------|------|-------|
| 1 | SENTENCES | 34 | Sentence too long (68 words, recommended max 60) |
| 2 | SENTENCES | 112 | Sentence too long (63 words) |
| 3 | GRAMMAR | 156 | Repeated word: "the the" |
| 4 | FORMAT | 78 | Inconsistent spacing before citation |
| 5 | DEAI | 45 | Potentially AI-generated phrasing: "It is worth noting that" |
| 6 | DEAI | 89 | Potentially AI-generated phrasing: "In the realm of" |
| 7 | DEAI | 201 | Potentially AI-generated phrasing: "plays a crucial role" |
| 8 | FORMAT | 256 | Widow line detected at top of page 8 |

---

## Pre-Submission Checklist

- [x] No placeholder text (TODO, FIXME, XXX)
- [x] All figures referenced in text
- [x] All tables referenced in text
- [x] Anonymous submission (blind review check)
- [x] Consistent math notation
- [ ] Acronyms defined on first use — Potentially undefined: ['SOTA', 'MLP']
- [x] Page limit (9 pages for NEURIPS) — Estimated ~8 pages
- [x] Double-blind compliance (NEURIPS)
- [x] [NEURIPS] Paper checklist appendix present
- [x] [NEURIPS] Broader impact statement present
- [x] [NEURIPS] Reproducibility statement present

---

*Report generated by paper-audit v2.0. Scores are automated indicators — see quality_rubrics.md for interpretation.*
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 194kUpdated Claude CodeCodexVerifiedInstall