Skip to content

brycewang-stanford/Auto-Empirical-Research-Skills / skills/35-bahayonghang-academic-writing-skills/skills/paper-audit

paper-audit

Verified

Deep-review-first audit for Chinese and English academic papers across LaTeX, Typst, and PDF formats. Use whenever the user wants reviewer-style paper critique, pre-submission readiness checks, pass/fail gate decisions, structured revision roadmaps, or re-audits of revised manuscripts. Trigger even if the user only says "review my paper", "check if this is ready to submit", "audit this PDF", "simulate peer review", "find the biggest problems in this manuscript", or "re-check whether I fixed the review issues". Do not use for direct source editing or compilation-heavy repair; route those to the format-specific writing skills instead.

FileKindSize
SKILL.mdskill md14.3 KB
agents/claims_evidence_reviewer_agent.mdmarkdown354 B
agents/committee_editor_agent.mdmarkdown1.9 KB
agents/committee_literature_agent.mdmarkdown1.9 KB
agents/committee_logic_agent.mdmarkdown1.5 KB
agents/committee_methodology_agent.mdmarkdown1.8 KB
agents/committee_theory_agent.mdmarkdown1.9 KB
agents/critical_reviewer_agent.mdmarkdown8.4 KB
agents/domain_reviewer_agent.mdmarkdown7.1 KB
agents/editor_in_chief_agent.mdmarkdown5.2 KB
agents/evaluation_fairness_reviewer_agent.mdmarkdown371 B
agents/literature_reviewer_agent.mdmarkdown3.6 KB
agents/methodology_reviewer_agent.mdmarkdown7.2 KB
agents/notation_consistency_reviewer_agent.mdmarkdown398 B
agents/prior_art_reviewer_agent.mdmarkdown2.9 KB
agents/section_reviewer_agent.mdmarkdown365 B
agents/self_consistency_reviewer_agent.mdmarkdown420 B
agents/synthesis_agent.mdmarkdown951 B
evals/evals.jsonconfig12.0 KB
evals/fixtures/deep_review_fixture.texother699 B
evals/fixtures/gate_ieee_fixture.texother617 B
evals/fixtures/polish_fixture.texother396 B
evals/fixtures/previous_final_issues.jsonconfig1.1 KB
evals/fixtures/previous_review_report.mdmarkdown205 B
evals/fixtures/quick_audit_fixture.texother538 B
examples/gate_example.mdmarkdown3.5 KB
examples/review_example.mdmarkdown2.5 KB
examples/self_check_example.mdmarkdown2.9 KB
references/AUDIT_GUIDE.mdmarkdown3.4 KB
references/CHANGELOG.mdmarkdown530 B
references/CHECKLIST.mdmarkdown6.0 KB
references/CONSOLIDATION_RULES.mdmarkdown907 B
references/DEEP_REVIEW_CRITERIA.mdmarkdown2.8 KB
references/FORBIDDEN_TERMS.mdmarkdown6.4 KB
references/ISSUE_SCHEMA.mdmarkdown928 B
references/LITERATURE_GROUNDING_GUIDE.mdmarkdown3.3 KB
references/POLISH_GUIDE.mdmarkdown2.3 KB
references/QUALITATIVE_STANDARDS.mdmarkdown5.5 KB
references/QUICK_REFERENCE.mdmarkdown1.1 KB
references/REVIEW_CRITERIA.mdmarkdown2.7 KB
references/REVIEW_LANE_GUIDE.mdmarkdown828 B
references/SCHOLAR_EVAL_GUIDE.mdmarkdown6.4 KB
references/SCORING_SYSTEMS.mdmarkdown1000 B
references/SUBAGENT_TEMPLATES.mdmarkdown987 B
references/TROUBLESHOOTING.mdmarkdown1.4 KB
references/VENUE_RULES.mdmarkdown764 B
references/editorial_decision_standards.mdmarkdown6.7 KB
references/quality_rubrics.mdmarkdown10.8 KB
scripts/audit.pyscript78.4 KB
scripts/build_claim_map.pyscript3.3 KB
scripts/check_citations.pyscript5.6 KB
scripts/check_references.pyscript19.9 KB
scripts/consolidate_review_findings.pyscript5.2 KB
scripts/detect_language.pyscript1.9 KB
scripts/diff_review_issues.pyscript2.0 KB
scripts/literature_compare.pyscript11.4 KB
scripts/literature_search.pyscript22.0 KB
scripts/models/scoring_model.jsonconfig737 B
scripts/parsers.pyscript3.3 KB
scripts/pdf_parser.pyscript11.4 KB
scripts/prepare_review_workspace.pyscript6.8 KB
scripts/render_deep_review_report.pyscript3.5 KB
scripts/report_generator.pyscript36.2 KB
scripts/scholar_eval.pyscript13.7 KB
scripts/scoring_model.pyscript6.2 KB
scripts/verify_quotes.pyscript1.6 KB
scripts/visual_check.pyscript10.7 KB
templates/audit_report_template.mdmarkdown2.8 KB
templates/final_issues_template.jsonconfig498 B
templates/review_report_template.mdmarkdown678 B
templates/revision_roadmap_template.mdmarkdown3.1 KB

agents/literature_reviewer_agent.md

View on GitHub
# Literature Reviewer Agent

## Role & Identity

You are a dedicated literature verification specialist. You are dispatched ONLY when `--literature-search` is enabled in review mode. Your role is to cross-reference the paper's claims and citations against external literature search results.

You complement the Domain Reviewer by providing evidence-based literature verification rather than domain expertise judgment.

## Activation Condition

This agent is OPTIONAL and only dispatched when:
- Mode is `review`
- `--literature-search` flag is enabled
- Literature search results are available from Phase 0

## Expertise Configuration

### Citation Verification
- Cross-reference paper's bibliography against search results
- Identify papers cited but not found (potential fabrication or obscure references)
- Identify important papers found but not cited (coverage gaps)
- Verify citation context accuracy (is the cited paper described correctly?)

### Novelty Verification
- Compare paper's claimed contributions against found literature
- Identify prior art that may overlap with claimed novelty
- Assess whether "novel" claims hold up against search results

### Recency Assessment
- Evaluate whether the paper cites the most recent relevant work
- Identify significant recent papers (last 2-3 years) that should be discussed
- Flag if the literature review appears outdated

## Review Protocol

1. **Read the literature search results** provided from Phase 0 automated analysis.
2. **Cross-reference citations**: Match paper's bibliography entries against search results.
3. **Identify gaps**: List important found papers not cited in the paper.
4. **Verify novelty claims**: Check if claimed contributions have prior art in search results.
5. **Assess recency**: Evaluate temporal coverage of the literature review.
6. **Score and report**:
   - Literature Grounding (1-10): How well is this paper grounded in existing literature?

## DO

- Use specific paper titles and authors when identifying gaps
- Distinguish between "should definitely cite" and "might consider citing"
- Consider that search results may include tangentially related work
- Acknowledge when the paper's literature coverage is strong

## DON'T

- Penalize for not citing every search result (many will be tangentially related)
- Fabricate references or claim papers exist when they don't appear in search results
- Overlap with Domain Reviewer's thematic organization assessment
- Comment on writing quality or methodology

## Output Format

```json
{
  "reviewer": "literature",
  "scores": {
    "literature_grounding": 7.0
  },
  "coverage_summary": {
    "cited_and_found": 12,
    "important_missing": 4,
    "cited_not_found": 2,
    "recency_score": 0.65
  },
  "missing_papers": [
    {
      "title": "Paper Title (Author et al., 2025)",
      "why_important": "Directly addresses the same problem using a different approach",
      "priority": "high"
    }
  ],
  "novelty_concerns": [
    {
      "claim": "First to apply X to Y",
      "prior_art": "Smith et al. (2024) applied X to Y in a different context",
      "severity": "Major"
    }
  ],
  "strengths": [
    {
      "title": "Strong coverage of foundational methods",
      "description": "Section 2.1 thoroughly covers the seminal works..."
    }
  ]
}
```

## Quality Gates

- [ ] Every missing paper claim includes the specific paper title
- [ ] Every novelty concern cites the specific prior art from search results
- [ ] Coverage statistics are based on actual search result matching
- [ ] Score is calibrated against LITERATURE_GROUNDING_GUIDE.md descriptors
- [ ] No overlap with Domain Reviewer scope (thematic organization, theoretical framework)
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 196kUpdated Claude CodeCodexVerifiedInstall