Skip to content

brycewang-stanford/Auto-Empirical-Research-Skills / skills/35-bahayonghang-academic-writing-skills/skills/paper-audit

paper-audit

Verified

Deep-review-first audit for Chinese and English academic papers across LaTeX, Typst, and PDF formats. Use whenever the user wants reviewer-style paper critique, pre-submission readiness checks, pass/fail gate decisions, structured revision roadmaps, or re-audits of revised manuscripts. Trigger even if the user only says "review my paper", "check if this is ready to submit", "audit this PDF", "simulate peer review", "find the biggest problems in this manuscript", or "re-check whether I fixed the review issues". Do not use for direct source editing or compilation-heavy repair; route those to the format-specific writing skills instead.

FileKindSize
SKILL.mdskill md14.3 KB
agents/claims_evidence_reviewer_agent.mdmarkdown354 B
agents/committee_editor_agent.mdmarkdown1.9 KB
agents/committee_literature_agent.mdmarkdown1.9 KB
agents/committee_logic_agent.mdmarkdown1.5 KB
agents/committee_methodology_agent.mdmarkdown1.8 KB
agents/committee_theory_agent.mdmarkdown1.9 KB
agents/critical_reviewer_agent.mdmarkdown8.4 KB
agents/domain_reviewer_agent.mdmarkdown7.1 KB
agents/editor_in_chief_agent.mdmarkdown5.2 KB
agents/evaluation_fairness_reviewer_agent.mdmarkdown371 B
agents/literature_reviewer_agent.mdmarkdown3.6 KB
agents/methodology_reviewer_agent.mdmarkdown7.2 KB
agents/notation_consistency_reviewer_agent.mdmarkdown398 B
agents/prior_art_reviewer_agent.mdmarkdown2.9 KB
agents/section_reviewer_agent.mdmarkdown365 B
agents/self_consistency_reviewer_agent.mdmarkdown420 B
agents/synthesis_agent.mdmarkdown951 B
evals/evals.jsonconfig12.0 KB
evals/fixtures/deep_review_fixture.texother699 B
evals/fixtures/gate_ieee_fixture.texother617 B
evals/fixtures/polish_fixture.texother396 B
evals/fixtures/previous_final_issues.jsonconfig1.1 KB
evals/fixtures/previous_review_report.mdmarkdown205 B
evals/fixtures/quick_audit_fixture.texother538 B
examples/gate_example.mdmarkdown3.5 KB
examples/review_example.mdmarkdown2.5 KB
examples/self_check_example.mdmarkdown2.9 KB
references/AUDIT_GUIDE.mdmarkdown3.4 KB
references/CHANGELOG.mdmarkdown530 B
references/CHECKLIST.mdmarkdown6.0 KB
references/CONSOLIDATION_RULES.mdmarkdown907 B
references/DEEP_REVIEW_CRITERIA.mdmarkdown2.8 KB
references/FORBIDDEN_TERMS.mdmarkdown6.4 KB
references/ISSUE_SCHEMA.mdmarkdown928 B
references/LITERATURE_GROUNDING_GUIDE.mdmarkdown3.3 KB
references/POLISH_GUIDE.mdmarkdown2.3 KB
references/QUALITATIVE_STANDARDS.mdmarkdown5.5 KB
references/QUICK_REFERENCE.mdmarkdown1.1 KB
references/REVIEW_CRITERIA.mdmarkdown2.7 KB
references/REVIEW_LANE_GUIDE.mdmarkdown828 B
references/SCHOLAR_EVAL_GUIDE.mdmarkdown6.4 KB
references/SCORING_SYSTEMS.mdmarkdown1000 B
references/SUBAGENT_TEMPLATES.mdmarkdown987 B
references/TROUBLESHOOTING.mdmarkdown1.4 KB
references/VENUE_RULES.mdmarkdown764 B
references/editorial_decision_standards.mdmarkdown6.7 KB
references/quality_rubrics.mdmarkdown10.8 KB
scripts/audit.pyscript78.4 KB
scripts/build_claim_map.pyscript3.3 KB
scripts/check_citations.pyscript5.6 KB
scripts/check_references.pyscript19.9 KB
scripts/consolidate_review_findings.pyscript5.2 KB
scripts/detect_language.pyscript1.9 KB
scripts/diff_review_issues.pyscript2.0 KB
scripts/literature_compare.pyscript11.4 KB
scripts/literature_search.pyscript22.0 KB
scripts/models/scoring_model.jsonconfig737 B
scripts/parsers.pyscript3.3 KB
scripts/pdf_parser.pyscript11.4 KB
scripts/prepare_review_workspace.pyscript6.8 KB
scripts/render_deep_review_report.pyscript3.5 KB
scripts/report_generator.pyscript36.2 KB
scripts/scholar_eval.pyscript13.7 KB
scripts/scoring_model.pyscript6.2 KB
scripts/verify_quotes.pyscript1.6 KB
scripts/visual_check.pyscript10.7 KB
templates/audit_report_template.mdmarkdown2.8 KB
templates/final_issues_template.jsonconfig498 B
templates/review_report_template.mdmarkdown678 B
templates/revision_roadmap_template.mdmarkdown3.1 KB

references/AUDIT_GUIDE.md

View on GitHub
# Audit Guide

How to use the paper-audit skill and interpret its results.

## Quick Start

```bash
# Basic quick audit
python scripts/audit.py paper.tex --mode quick-audit

# Deep review
python scripts/audit.py paper.tex --mode deep-review

# Quality gate (pass/fail)
python scripts/audit.py paper.pdf --mode gate --pdf-mode enhanced

# Chinese thesis
python scripts/audit.py thesis.tex --lang zh --venue thesis-zh
```

## Mode Selection Guide

| Scenario | Recommended Mode | Why |
|----------|-----------------|-----|
| "Is my paper ready to submit?" | `quick-audit` | Fast readiness analysis |
| "What would reviewers say?" | `deep-review` | Reviewer-style issue bundle and roadmap |
| "Can my student submit this?" | `gate` | Fast pass/fail check |
| "Quick sanity check before deadline" | `gate` | Fastest, checks essentials only |
| "I want detailed feedback" | `deep-review` | Most comprehensive output |

## Understanding the Report

### Quick-Audit Report

The quick-audit report contains:

1. **Executive Summary**: Overall score and issue count at a glance
2. **Scores Table**: Per-dimension scores with issue counts (Critical/Major/Minor)
3. **Issues List**: All findings sorted by severity
4. **Pre-Submission Checklist**: Pass/fail for each checklist item

**How to read scores**:
- **5.0+**: Excellent — minor polish only
- **4.0-5.0**: Good — address Major issues
- **3.0-4.0**: Needs work — significant revisions required
- **< 3.0**: Major concerns — consider restructuring

### Deep Review Report

The deep review report adds:
- **Overall Assessment**: short calibrated reviewer summary
- **Major / Moderate / Minor Issues**: quote-anchored structured findings
- **Revision Roadmap**: prioritized fix list
- **Recommendation**: score summary, if requested

### Gate Report

Binary verdict:
- **PASS**: All mandatory checks passed, no critical issues
- **FAIL**: Blocking issues found — must fix before submission

## PDF Input Considerations

PDF mode has inherent limitations:

| Feature | LaTeX/Typst | PDF Basic | PDF Enhanced |
|---------|-------------|-----------|-------------|
| Section detection | Exact | Heuristic | Good |
| Math verification | Full | Unavailable | Unavailable |
| Format checking | Full | Skipped | Skipped |
| Figure references | Full | Skipped | Skipped |
| Grammar analysis | Full | Good | Good |
| Logic analysis | Full | Good | Good |
| Bibliography | Full | Skipped | Skipped |

**Recommendation**: Use source files (.tex/.typ) whenever possible for maximum accuracy. Use PDF mode for quick reviews when source is unavailable.

## Addressing Issues

### Priority Order
1. **Critical (P0)**: Must fix — these will likely cause rejection
2. **Major (P1)**: Should fix — these weaken the paper significantly
3. **Minor (P2)**: Nice to fix — these improve polish

### Common Critical Issues
- Missing figure/table references
- Compilation errors
- Placeholder text (TODO/FIXME)
- Author names in blind submission

### Common Major Issues
- Long, convoluted sentences
- Logic gaps in methodology
- Missing baselines or ablations
- AI-trace patterns in writing

### Common Minor Issues
- Minor grammar issues
- Inconsistent notation
- Style guide violations

## Re-auditing After Fixes

After addressing issues, re-run the audit to verify improvements:

```bash
# Before fixes
python scripts/audit.py paper.tex -o report_before.md

# After fixes
python scripts/audit.py paper.tex -o report_after.md
```

Compare scores to track improvement.
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 196kUpdated Claude CodeCodexVerifiedInstall