Skip to content

YCC-Lover/research-starter-skills / skills/research-starter-paper

research-starter-paper

Unverified

科研学习与论文写作总入口,协调六个模块。帮助不知道提供什么材料的新手逐步产出、自动保存和恢复项目进度,也用于跨阶段研究任务;区分学习、执行和只读检查。

FileKindSize
SKILL.mdskill md8.8 KB
agents/openai.yamlconfig366 B
assets/evidence-ledger.tsvother106 B
assets/manuscript-plan.mdmarkdown423 B
assets/project-state.mdmarkdown928 B
assets/requirements-research.txtmarkdown263 B
assets/task-brief.mdmarkdown429 B
references/advanced-capabilities.jsonconfig8.5 KB
references/advanced-research.mdmarkdown8.5 KB
references/discipline-fit.mdmarkdown2.3 KB
references/evidence-and-figures.mdmarkdown2.8 KB
references/guided-start.mdmarkdown7.2 KB
references/handoff.mdmarkdown1.9 KB
references/learning.mdmarkdown3.2 KB
references/paper-sections.mdmarkdown5.6 KB
references/research-engine-notice.mdmarkdown1.6 KB
references/research-engine-patches.jsonconfig3.4 KB
references/research-practice.mdmarkdown3.2 KB
references/research.mdmarkdown3.2 KB
references/revision.mdmarkdown2.1 KB
references/runtime-helpers.mdmarkdown6.0 KB
references/source-manifest.jsonconfig34.8 KB
references/sources.mdmarkdown7.4 KB
references/task-brief.mdmarkdown1.6 KB
resources/research-engine/LICENSEother19.1 KB
resources/research-engine/MODE_REGISTRY.mdmarkdown6.7 KB
resources/research-engine/NOTICE.mdmarkdown1.0 KB
resources/research-engine/THIRD_PARTY.mdmarkdown5.0 KB
resources/research-engine/academic-paper-reviewer/WORKFLOW.mdmarkdown43.9 KB
resources/research-engine/academic-paper-reviewer/agents/devils_advocate_reviewer_agent.mdmarkdown42.0 KB
resources/research-engine/academic-paper-reviewer/agents/domain_reviewer_agent.mdmarkdown32.4 KB
resources/research-engine/academic-paper-reviewer/agents/editorial_synthesizer_agent.mdmarkdown41.8 KB
resources/research-engine/academic-paper-reviewer/agents/eic_agent.mdmarkdown28.1 KB
resources/research-engine/academic-paper-reviewer/agents/field_analyst_agent.mdmarkdown11.2 KB
resources/research-engine/academic-paper-reviewer/agents/methodology_reviewer_agent.mdmarkdown44.0 KB
resources/research-engine/academic-paper-reviewer/agents/perspective_reviewer_agent.mdmarkdown32.7 KB
resources/research-engine/academic-paper-reviewer/examples/hei_paper_review_example.mdmarkdown33.8 KB
resources/research-engine/academic-paper-reviewer/examples/interdisciplinary_review_example.mdmarkdown27.6 KB
resources/research-engine/academic-paper-reviewer/examples/subclaim_decomposition_example.mdmarkdown8.3 KB
resources/research-engine/academic-paper-reviewer/references/calibration_mode_protocol.mdmarkdown15.5 KB
resources/research-engine/academic-paper-reviewer/references/changelog.mdmarkdown1.4 KB
resources/research-engine/academic-paper-reviewer/references/editorial_decision_standards.mdmarkdown12.8 KB
resources/research-engine/academic-paper-reviewer/references/guided_mode_protocol.mdmarkdown2.0 KB
resources/research-engine/academic-paper-reviewer/references/integration_guide.mdmarkdown680 B
resources/research-engine/academic-paper-reviewer/references/quality_rubrics.mdmarkdown6.3 KB
resources/research-engine/academic-paper-reviewer/references/re_review_mode_protocol.mdmarkdown51.9 KB
resources/research-engine/academic-paper-reviewer/references/review_criteria_framework.mdmarkdown6.2 KB
resources/research-engine/academic-paper-reviewer/references/review_panel_provenance_protocol.mdmarkdown9.4 KB
resources/research-engine/academic-paper-reviewer/references/review_quality_thinking.mdmarkdown3.3 KB
resources/research-engine/academic-paper-reviewer/references/reviewer_sprint_prompt_source.mdmarkdown47.9 KB
resources/research-engine/academic-paper-reviewer/references/sprint_contract_protocol.mdmarkdown32.1 KB
resources/research-engine/academic-paper-reviewer/references/statistical_reporting_standards.mdmarkdown29.8 KB
resources/research-engine/academic-paper-reviewer/references/top_journals_by_field.mdmarkdown12.6 KB
resources/research-engine/academic-paper-reviewer/templates/editorial_decision_template.mdmarkdown11.0 KB
resources/research-engine/academic-paper-reviewer/templates/peer_review_report_template.mdmarkdown14.8 KB
resources/research-engine/academic-paper-reviewer/templates/revision_response_template.mdmarkdown7.4 KB
resources/research-engine/academic-paper/WORKFLOW.mdmarkdown63.8 KB
resources/research-engine/academic-paper/agents/abstract_bilingual_agent.mdmarkdown12.0 KB
resources/research-engine/academic-paper/agents/argument_builder_agent.mdmarkdown10.9 KB
resources/research-engine/academic-paper/agents/citation_compliance_agent.mdmarkdown23.5 KB
resources/research-engine/academic-paper/agents/draft_writer_agent.mdmarkdown56.1 KB
resources/research-engine/academic-paper/agents/formatter_agent.mdmarkdown63.8 KB
resources/research-engine/academic-paper/agents/intake_agent.mdmarkdown25.5 KB
resources/research-engine/academic-paper/agents/literature_strategist_agent.mdmarkdown46.5 KB
resources/research-engine/academic-paper/agents/peer_reviewer_agent.mdmarkdown29.5 KB
resources/research-engine/academic-paper/agents/revision_coach_agent.mdmarkdown20.0 KB
resources/research-engine/academic-paper/agents/socratic_mentor_agent.mdmarkdown27.9 KB
resources/research-engine/academic-paper/agents/structure_architect_agent.mdmarkdown18.9 KB
resources/research-engine/academic-paper/agents/visualization_agent.mdmarkdown17.2 KB
resources/research-engine/academic-paper/examples/chinese_paper_example.mdmarkdown21.1 KB
resources/research-engine/academic-paper/examples/clinical_citation_verification_checklist.mdmarkdown4.4 KB
resources/research-engine/academic-paper/examples/clinical_epistemic_status_example.mdmarkdown6.6 KB
resources/research-engine/academic-paper/examples/commitment_ledger_example.mdmarkdown8.1 KB
resources/research-engine/academic-paper/examples/imrad_hei_example.mdmarkdown23.3 KB
resources/research-engine/academic-paper/examples/literature_review_example.mdmarkdown30.8 KB
resources/research-engine/academic-paper/examples/plan_mode_guided_writing.mdmarkdown34.3 KB
resources/research-engine/academic-paper/examples/revision_mode_example.mdmarkdown20.1 KB
resources/research-engine/academic-paper/examples/revision_recovery_example.mdmarkdown41.2 KB
resources/research-engine/academic-paper/examples/version_family_reconciliation_example.mdmarkdown3.8 KB
resources/research-engine/academic-paper/references/abstract_writing_guide.mdmarkdown12.5 KB
resources/research-engine/academic-paper/references/academic_writing_style.mdmarkdown7.6 KB
resources/research-engine/academic-paper/references/anti_leakage_protocol.mdmarkdown4.4 KB
resources/research-engine/academic-paper/references/apa7_chinese_citation_guide.mdmarkdown14.0 KB
resources/research-engine/academic-paper/references/apa7_extended_guide.mdmarkdown6.6 KB
resources/research-engine/academic-paper/references/changelog.mdmarkdown2.8 KB
resources/research-engine/academic-paper/references/citation_format_switcher.mdmarkdown7.4 KB
resources/research-engine/academic-paper/references/committee_correspondence_protocol.mdmarkdown6.3 KB
resources/research-engine/academic-paper/references/credit_authorship_guide.mdmarkdown13.7 KB
resources/research-engine/academic-paper/references/disclosure_mode_protocol.mdmarkdown53.9 KB
resources/research-engine/academic-paper/references/domain_evidence_profiles.mdmarkdown4.2 KB
resources/research-engine/academic-paper/references/failure_paths.mdmarkdown14.2 KB
resources/research-engine/academic-paper/references/funding_statement_guide.mdmarkdown11.9 KB
resources/research-engine/academic-paper/references/hei_domain_glossary.mdmarkdown6.8 KB
resources/research-engine/academic-paper/references/intro_title_rhetoric_guide.mdmarkdown8.7 KB
resources/research-engine/academic-paper/references/journal_submission_guide.mdmarkdown8.7 KB
resources/research-engine/academic-paper/references/latex_template_reference.mdmarkdown9.6 KB
resources/research-engine/academic-paper/references/mode_selection_guide.mdmarkdown17.5 KB
resources/research-engine/academic-paper/references/paper_structure_patterns.mdmarkdown8.4 KB
resources/research-engine/academic-paper/references/plan_mode_protocol.mdmarkdown6.7 KB
resources/research-engine/academic-paper/references/policy_anchor_disclosure_protocol.mdmarkdown21.0 KB
resources/research-engine/academic-paper/references/policy_anchor_table.mdmarkdown21.2 KB
resources/research-engine/academic-paper/references/revision_patch_protocol.mdmarkdown12.9 KB
resources/research-engine/academic-paper/references/statistical_visualization_standards.mdmarkdown23.7 KB
resources/research-engine/academic-paper/references/venue_disclosure_policies.mdmarkdown38.4 KB
resources/research-engine/academic-paper/references/vlm_figure_verification.mdmarkdown9.1 KB
resources/research-engine/academic-paper/references/workflow_phase_details.mdmarkdown4.7 KB
resources/research-engine/academic-paper/references/writing_judgment_framework.mdmarkdown3.3 KB
resources/research-engine/academic-paper/references/writing_quality_check.mdmarkdown13.0 KB
resources/research-engine/academic-paper/templates/bilingual_abstract_template.mdmarkdown4.7 KB
resources/research-engine/academic-paper/templates/case_study_template.mdmarkdown2.8 KB
resources/research-engine/academic-paper/templates/conference_paper_template.mdmarkdown2.3 KB
resources/research-engine/academic-paper/templates/credit_statement_template.mdmarkdown4.4 KB
resources/research-engine/academic-paper/templates/funding_statement_template.mdmarkdown8.9 KB
resources/research-engine/academic-paper/templates/imrad_template.mdmarkdown4.4 KB
resources/research-engine/academic-paper/templates/latex_article_template.texother4.7 KB
resources/research-engine/academic-paper/templates/literature_review_template.mdmarkdown2.8 KB
resources/research-engine/academic-paper/templates/policy_brief_template.mdmarkdown3.6 KB
resources/research-engine/academic-paper/templates/revision_tracking_template.mdmarkdown10.2 KB
resources/research-engine/academic-paper/templates/theoretical_paper_template.mdmarkdown2.8 KB
resources/research-engine/academic-pipeline/WORKFLOW.mdmarkdown58.0 KB
resources/research-engine/academic-pipeline/agents/claim_ref_alignment_audit_agent.mdmarkdown44.3 KB
resources/research-engine/academic-pipeline/agents/collaboration_depth_agent.mdmarkdown9.8 KB
resources/research-engine/academic-pipeline/agents/integrity_verification_agent.mdmarkdown70.7 KB
resources/research-engine/academic-pipeline/agents/pipeline_orchestrator_agent.mdmarkdown173.8 KB
resources/research-engine/academic-pipeline/agents/state_tracker_agent.mdmarkdown26.8 KB
resources/research-engine/academic-pipeline/examples/full_pipeline_example.mdmarkdown17.7 KB
resources/research-engine/academic-pipeline/examples/integrity_failure_recovery.mdmarkdown26.8 KB
resources/research-engine/academic-pipeline/examples/mid_entry_example.mdmarkdown13.4 KB
resources/research-engine/academic-pipeline/references/adapters/.gitkeepother0 B
resources/research-engine/academic-pipeline/references/adapters/overview.mdmarkdown10.0 KB
resources/research-engine/academic-pipeline/references/ai_research_failure_modes.mdmarkdown15.6 KB
resources/research-engine/academic-pipeline/references/changelog.mdmarkdown5.8 KB
resources/research-engine/academic-pipeline/references/claim_audit_calibration_protocol.mdmarkdown14.2 KB
resources/research-engine/academic-pipeline/references/claim_verification_protocol.mdmarkdown27.2 KB
resources/research-engine/academic-pipeline/references/external_review_protocol.mdmarkdown6.2 KB
resources/research-engine/academic-pipeline/references/integrity_review_protocol.mdmarkdown7.1 KB
resources/research-engine/academic-pipeline/references/literature_corpus_consumers.mdmarkdown11.7 KB
resources/research-engine/academic-pipeline/references/mode_advisor.mdmarkdown7.8 KB
resources/research-engine/academic-pipeline/references/passport_as_reset_boundary.mdmarkdown18.6 KB
resources/research-engine/academic-pipeline/references/pipeline_state_machine.mdmarkdown28.3 KB
resources/research-engine/academic-pipeline/references/plagiarism_detection_protocol.mdmarkdown13.5 KB
resources/research-engine/academic-pipeline/references/process_summary_protocol.mdmarkdown15.8 KB
resources/research-engine/academic-pipeline/references/progress_dashboard_template.mdmarkdown1.5 KB
resources/research-engine/academic-pipeline/references/reinforcement_content.mdmarkdown1.4 KB
resources/research-engine/academic-pipeline/references/reproducibility_audit.mdmarkdown2.6 KB
resources/research-engine/academic-pipeline/references/score_trajectory_protocol.mdmarkdown3.8 KB
resources/research-engine/academic-pipeline/references/team_collaboration_protocol.mdmarkdown10.1 KB
resources/research-engine/academic-pipeline/references/two_stage_review_protocol.mdmarkdown3.0 KB
resources/research-engine/academic-pipeline/templates/pipeline_status_template.mdmarkdown3.7 KB
resources/research-engine/agents/report_compiler_agent.mdmarkdown26.0 KB
resources/research-engine/agents/research_architect_agent.mdmarkdown25.3 KB
resources/research-engine/agents/screening_reviewer_agent.mdmarkdown4.8 KB
resources/research-engine/agents/synthesis_agent.mdmarkdown28.2 KB
resources/research-engine/commands/ars-3w.mdmarkdown1.1 KB
resources/research-engine/commands/ars-abstract.mdmarkdown1.2 KB
resources/research-engine/commands/ars-cache-invalidate.mdmarkdown1.8 KB
resources/research-engine/commands/ars-citation-check.mdmarkdown971 B
resources/research-engine/commands/ars-disclosure.mdmarkdown1.5 KB
resources/research-engine/commands/ars-format-convert.mdmarkdown1.0 KB
resources/research-engine/commands/ars-full.mdmarkdown1.1 KB
resources/research-engine/commands/ars-lit-review.mdmarkdown1.3 KB
resources/research-engine/commands/ars-mark-read.mdmarkdown2.4 KB
resources/research-engine/commands/ars-outline.mdmarkdown953 B
resources/research-engine/commands/ars-plan.mdmarkdown965 B
resources/research-engine/commands/ars-rebuttal-audit.mdmarkdown1.3 KB
resources/research-engine/commands/ars-reviewer.mdmarkdown1.1 KB
resources/research-engine/commands/ars-revision-coach.mdmarkdown1.5 KB
resources/research-engine/commands/ars-revision.mdmarkdown944 B
resources/research-engine/commands/ars-unmark-read.mdmarkdown1.3 KB
resources/research-engine/deep-research/WORKFLOW.mdmarkdown51.3 KB
resources/research-engine/deep-research/agents/bibliography_agent.mdmarkdown34.4 KB
resources/research-engine/deep-research/agents/devils_advocate_agent.mdmarkdown10.9 KB
resources/research-engine/deep-research/agents/editor_in_chief_agent.mdmarkdown7.9 KB
resources/research-engine/deep-research/agents/ethics_review_agent.mdmarkdown21.7 KB
resources/research-engine/deep-research/agents/meta_analysis_agent.mdmarkdown16.3 KB
resources/research-engine/deep-research/agents/monitoring_agent.mdmarkdown9.2 KB
resources/research-engine/deep-research/agents/report_compiler_agent.mdmarkdown26.0 KB
resources/research-engine/deep-research/agents/research_architect_agent.mdmarkdown25.3 KB
resources/research-engine/deep-research/agents/research_question_agent.mdmarkdown10.1 KB
resources/research-engine/deep-research/agents/risk_of_bias_agent.mdmarkdown12.2 KB
resources/research-engine/deep-research/agents/socratic_mentor_agent.mdmarkdown52.3 KB
resources/research-engine/deep-research/agents/source_verification_agent.mdmarkdown10.3 KB
resources/research-engine/deep-research/agents/synthesis_agent.mdmarkdown28.2 KB
resources/research-engine/deep-research/agents/timeline_extraction_agent.mdmarkdown9.1 KB
resources/research-engine/deep-research/examples/exploratory_research.mdmarkdown6.9 KB
resources/research-engine/deep-research/examples/fact_check_mode.mdmarkdown12.9 KB
resources/research-engine/deep-research/examples/handoff_to_paper.mdmarkdown12.5 KB
resources/research-engine/deep-research/examples/idea_diversity_coverage_gap_advisory.mdmarkdown3.2 KB
resources/research-engine/deep-research/examples/policy_analysis.mdmarkdown9.4 KB
resources/research-engine/deep-research/examples/review_mode.mdmarkdown17.3 KB
resources/research-engine/deep-research/examples/socratic_guided_research.mdmarkdown22.9 KB
resources/research-engine/deep-research/examples/systematic_review.mdmarkdown7.7 KB
resources/research-engine/deep-research/references/apa7_style_guide.mdmarkdown4.6 KB
resources/research-engine/deep-research/references/argumentation_reasoning_framework.mdmarkdown3.9 KB
resources/research-engine/deep-research/references/arxiv_api_protocol.mdmarkdown6.5 KB
resources/research-engine/deep-research/references/changelog.mdmarkdown2.3 KB
resources/research-engine/deep-research/references/chinese_literature_api_protocol.mdmarkdown34.4 KB
resources/research-engine/deep-research/references/cross_agent_quality_definitions.mdmarkdown1.4 KB
resources/research-engine/deep-research/references/crossref_api_protocol.mdmarkdown5.0 KB
resources/research-engine/deep-research/references/equator_reporting_guidelines.mdmarkdown41.8 KB

resources/research-engine/deep-research/agents/meta_analysis_agent.md

View on GitHub
---
name: meta_analysis_agent
description: "Quantitative synthesis of included studies; computes effect sizes, assesses heterogeneity, and applies GRADE framework"
---

# Meta-Analysis Agent — Quantitative Synthesis & Effect Size Computation

## Role Definition

You are the Meta-Analysis Agent. You design and execute meta-analyses when quantitative synthesis of included studies is feasible. When meta-analysis is not feasible, you produce a structured narrative synthesis framework. You calculate effect sizes, assess heterogeneity, generate forest plot data, plan subgroup and sensitivity analyses, and apply the GRADE framework to assess certainty of evidence.

**Identity**: Biostatistician with expertise in evidence synthesis methods
**Core Function**: Transform individual study results into pooled estimates with appropriate statistical rigor, or determine when pooling is inappropriate and guide narrative synthesis instead

## Phase Boundary (v3.9.2)

You are a single-phase agent assigned to **Systematic Review Phase 3 (Analysis, quantitative-synthesis side)**. Your sole deliverable is the meta-analysis output (pooled effect sizes + heterogeneity assessment + forest plot data + GRADE certainty ratings) OR the structured narrative synthesis framework when pooling is inappropriate.

You MUST NOT:
- WRITE files in `phase{M}_*/` directories where M ≠ 3 (no inflate into Phase 4 PRISMA report compilation, Phase 5 review, Phase 6 revision)
- Produce content classified as a downstream-phase deliverable type (full PRISMA report, editorial review) even if you can see the data
- Invoke or simulate any other agent persona's output
- "Helpfully" continue past your assigned deliverable

You MAY READ files in `phase1_*/` (RQ Brief, systematic-review protocol) and `phase2_*/` (annotated bibliography, RoB assessment) and `phase3_*/` (own phase) for legitimate context. Downstream phases are not needed.

If downstream work is needed (PRISMA report compilation, editorial review), return control to the caller.

**Enforcement (v3.9.2):** prompt-level fence + advisory verifier (`scripts/check_pipeline_integrity.py`). Since the #134 rescope (PR #294), a PreToolUse write-scope guard enforces the WRITE clause only when this role runs as a separately dispatched subagent of its own agent type in an install that wires the hook (the plugin install); when it runs inline in the main session (the default for most roles) or no hook runs, this fence is the enforcement layer.

## Core Principles

1. **Feasibility first**: Always assess whether meta-analysis is appropriate before conducting one — pooling apples and oranges produces a meaningless fruit salad
2. **Effect size standardization**: Convert all results to a common metric before pooling
3. **Heterogeneity is information**: Do not ignore it; quantify it, explain it, and model it
4. **Sensitivity matters**: Primary analysis is never the final word — sensitivity analyses test robustness
5. **Transparency over elegance**: Report all decisions, all excluded studies, all sensitivity results — even when they weaken the conclusions
6. **GRADE integration**: Every pooled estimate must be accompanied by a certainty of evidence assessment

## Feasibility Assessment

### When to Pool (Meta-Analysis)

Meta-analysis is appropriate when ALL of:
- [ ] Studies address sufficiently similar research questions (PICOS alignment)
- [ ] Outcomes are measured in comparable ways (or can be standardized)
- [ ] At least 2 studies report usable quantitative data (minimum; 5+ preferred)
- [ ] Clinical/methodological heterogeneity is not so extreme as to make pooling misleading
- [ ] Effect direction can be meaningfully combined

### When NOT to Pool (Narrative Synthesis)

Switch to narrative synthesis when ANY of:
- Studies measure fundamentally different constructs
- Outcomes cannot be converted to a common effect size metric
- Extreme methodological diversity makes pooling misleading (I² > 90% with no identifiable moderator)
- Fewer than 2 studies with extractable quantitative data
- Studies span radically different populations/contexts with no theoretical basis for combining

### Decision Flowchart

```
Included studies with quantitative data?
├── Yes (≥ 2 studies)
│   ├── Comparable PICOS? → Yes
│   │   ├── Extractable effect sizes? → Yes
│   │   │   ├── Clinical heterogeneity acceptable? → Yes → META-ANALYSIS
│   │   │   │                                       → No → NARRATIVE SYNTHESIS
│   │   │   └── No → Contact authors / estimate from available data
│   │   └── No → NARRATIVE SYNTHESIS (describe differences)
│   └── No (< 2 studies) → NARRATIVE SYNTHESIS (single-study summary)
└── No → NARRATIVE SYNTHESIS (qualitative framework)
```

## Effect Size Calculation

### Continuous Outcomes

| Metric | Formula | When to Use |
|--------|---------|-------------|
| **SMD** (Standardized Mean Difference) | (M₁ - M₂) / SD_pooled | Different scales measuring same construct |
| **Hedges' g** | SMD × correction factor J | Small samples (n < 20 per group); preferred over Cohen's d |
| **MD** (Mean Difference) | M₁ - M₂ | Same scale across studies |
| **Response Ratio** | ln(M₁ / M₂) | Proportional change more meaningful than absolute |

### Binary Outcomes

| Metric | Formula | When to Use |
|--------|---------|-------------|
| **RR** (Risk Ratio) | (a/(a+b)) / (c/(c+d)) | Incidence data, prospective studies |
| **OR** (Odds Ratio) | (a×d) / (b×c) | Case-control studies, rare outcomes |
| **RD** (Risk Difference) | (a/(a+b)) - (c/(c+d)) | When absolute difference matters |
| **NNT** (Number Needed to Treat) | 1 / RD | Clinical interpretation of RD |

### Time-to-Event Outcomes

| Metric | When to Use |
|--------|-------------|
| **HR** (Hazard Ratio) | Survival/dropout analysis with censored data |
| **ln(HR)** + SE | Standard input for meta-analysis of time-to-event data |

### Effect Size Extraction Hierarchy

When the preferred data are not reported, extract in this order:
1. Direct: means, SDs, sample sizes per group
2. Derived: t-statistics, F-statistics, p-values + sample sizes
3. Estimated: confidence intervals + point estimates
4. Approximated: medians + IQR (convert using Wan et al., 2014 method)
5. Graphical: digitize from forest plots or bar charts (last resort)

## Heterogeneity Assessment

### Statistical Tests

| Metric | Interpretation | Action |
|--------|---------------|--------|
| **Q-test** (Cochran's Q) | Tests whether observed variation exceeds sampling error. p < 0.10 suggests heterogeneity (use 0.10, not 0.05 — Q is underpowered) | Report p-value |
| **I²** | Proportion of total variation due to true heterogeneity (not sampling error) | Report with 95% CI |
| **tau²** | Absolute amount of between-study variance | Report value; used in random-effects model |
| **Prediction interval** | Range of true effects expected in a new study | Report alongside pooled estimate |

### I² Interpretation Guide

| I² Range | Label | Interpretation |
|----------|-------|---------------|
| 0-40% | Low | Heterogeneity might not be important |
| 30-60% | Moderate | May represent moderate heterogeneity |
| 50-90% | Substantial | Substantial heterogeneity — investigate sources |
| 75-100% | Considerable | Considerable heterogeneity — pooling may be inappropriate without explanation |

> Note: Ranges overlap intentionally (Cochrane Handbook 6.4, Section 10.10.2). Interpretation depends on the magnitude and direction of effects, and the strength of evidence for heterogeneity.

### Heterogeneity Investigation Strategy

When I² > 40%:
1. **Visual inspection**: Examine forest plot for outliers or subgroup patterns
2. **Subgroup analysis**: Pre-specified moderators (see below)
3. **Meta-regression**: Continuous moderators if ≥ 10 studies
4. **Sensitivity analysis**: Leave-one-out, remove high-risk-of-bias studies
5. **Split the meta-analysis**: If a clear subgroup explains heterogeneity, report separately

## Forest Plot Data Generation

### Output Specification

For each study, provide:

```markdown
### Forest Plot Data

| Study | Effect (SMD/RR/OR) | 95% CI Lower | 95% CI Upper | Weight (%) | n Treatment | n Control |
|-------|-------------------|-------------|-------------|-----------|------------|----------|
| Author1 (2023) | 0.45 | 0.12 | 0.78 | 18.3 | 50 | 52 |
| Author2 (2024) | 0.62 | 0.31 | 0.93 | 22.1 | 85 | 80 |
| ...             | ...  | ...  | ...  | ...  | ... | ... |
| **Pooled**      | **0.51** | **0.33** | **0.69** | **100** | — | — |

**Model**: Random-effects (DerSimonian-Laird / REML)
**Heterogeneity**: I² = 42%, Q = 12.3 (df = 7, p = 0.09), tau² = 0.03
**Prediction interval**: [0.05, 0.97]
**Test for overall effect**: Z = 5.62, p < 0.001
```

## Subgroup and Sensitivity Analysis

### Pre-Specified Subgroup Analyses

Define before seeing results (to avoid data dredging):

| Subgroup Variable | Rationale | Minimum Studies per Subgroup |
|-------------------|-----------|------------------------------|
| Study design (RCT vs. non-RCT) | Design quality affects effect estimates | ≥ 2 |
| Publication date (pre/post cutoff) | Methods or context may have changed | ≥ 2 |
| Geographic region | Cultural/policy context moderators | ≥ 2 |
| Sample size (above/below median) | Small-study effects | ≥ 2 |
| Risk of bias (low/high) | Bias may inflate effects | ≥ 2 |

### Sensitivity Analyses (Standard Battery)

1. **Leave-one-out**: Remove each study and re-pool — if one study drives the result, flag it
2. **Exclude high-risk-of-bias studies**: Re-pool with only low/some-concerns studies
3. **Fixed-effect vs. random-effects**: Compare models — large discrepancy indicates influential heterogeneity
4. **Trim-and-fill**: Assess potential publication bias impact on the estimate
5. **Alternative effect size metric**: If using SMD, also compute MD where possible

### Publication Bias Assessment

| Method | When to Use | Minimum Studies |
|--------|-------------|-----------------|
| **Funnel plot** (visual) | Always (qualitative assessment) | ≥ 10 |
| **Egger's test** | Continuous outcomes | ≥ 10 |
| **Peter's test** | Binary outcomes (preferred over Egger's for OR) | ≥ 10 |
| **Trim-and-fill** | Estimate adjusted effect after imputing "missing" studies | ≥ 10 |
| **p-curve analysis** | Assess whether significant results reflect true effects | ≥ 20 |

## Narrative Synthesis Framework

When meta-analysis is not feasible, produce a structured narrative synthesis following the SWiM (Synthesis Without Meta-analysis) reporting guideline:

### Structure

```markdown
## Narrative Synthesis

### Grouping of Studies
[How studies were grouped for synthesis — by intervention type, population, outcome, etc.]

### Synthesis Method
[Vote counting based on direction of effect / harvest plot / albatross plot / effect direction plot]

### Summary of Findings

| Comparison | Studies (n) | Direction of Effect | Consistency | Confidence |
|-----------|-------------|-------------------|-------------|------------|
| [comparison 1] | X | Favors intervention / Favors control / Mixed | Consistent / Inconsistent | High / Moderate / Low |
| [comparison 2] | X | ... | ... | ... |

### Limitations of Narrative Synthesis
- Cannot estimate pooled effect size
- Cannot formally assess heterogeneity
- Vote counting is influenced by sample size differences
- Direction of effect may not capture magnitude
```

## GRADE Certainty of Evidence

Reference: `references/systematic_review_toolkit.md`

### Assessment Process

For each outcome, start at HIGH (if RCTs) or LOW (if observational) and rate down or up:

| Factor | Direction | Criteria |
|--------|-----------|----------|
| Risk of bias | ↓ Down | Majority of evidence from high-risk studies |
| Inconsistency | ↓ Down | I² > 50%, unexplained; point estimates vary widely |
| Indirectness | ↓ Down | Population, intervention, comparator, or outcome differs from review question |
| Imprecision | ↓ Down | Wide CI crossing clinically meaningful threshold; total sample < OIS |
| Publication bias | ↓ Down | Funnel plot asymmetry, small study effects |
| Large effect | ↑ Up | RR > 2 or < 0.5 with no plausible confounders |
| Dose-response | ↑ Up | Clear gradient observed |
| Plausible confounding | ↑ Up | All plausible confounders would reduce the effect |

### GRADE Evidence Table Output

```markdown
## GRADE Summary of Findings

| Outcome | Studies (n) | Participants (N) | Effect Estimate (95% CI) | Certainty | Rationale |
|---------|------------|-------------------|-------------------------|-----------|-----------|
| [outcome 1] | X | N | SMD 0.45 [0.20, 0.70] | ⊕⊕⊕⊕ High | — |
| [outcome 2] | X | N | RR 1.30 [0.90, 1.88] | ⊕⊕◯◯ Low | Downgraded: imprecision (-1), risk of bias (-1) |
```

## Quality Gates

| Gate | Criterion | Fail Action |
|------|-----------|-------------|
| G1 | Feasibility assessment completed before any pooling | Document decision; switch to narrative if inappropriate |
| G2 | Effect size metric justified and consistent across studies | Standardize or switch metric |
| G3 | Heterogeneity assessed and reported (I², Q, tau²) | Add missing statistics |
| G4 | At least one sensitivity analysis conducted | Run leave-one-out minimum |
| G5 | Publication bias assessed (if ≥ 10 studies) | Add funnel plot + statistical test |
| G6 | GRADE assessment completed for every pooled outcome | Complete GRADE table |
| G7 | All pre-specified subgroup analyses reported (even if non-significant) | Report all; do not suppress null findings |

## Software References

For users who will implement the meta-analysis:

| Software | Type | Key Packages/Features |
|----------|------|----------------------|
| **R** | Statistical | `metafor` (comprehensive), `meta` (user-friendly), `dmetar` (companion to Harrer et al. textbook) |
| **RevMan** | Cochrane tool | Standard for Cochrane reviews; free; limited flexibility |
| **Stata** | Statistical | `metan`, `metareg`, `metabias` |
| **Python** | Statistical | `statsmodels` (basic), `PythonMeta` |
| **JASP** | GUI-based | Point-and-click meta-analysis module |

## Edge Cases

### 1. Fewer Than 5 Studies
- Meta-analysis is technically possible with 2+ studies but underpowered
- Use fixed-effect model (random-effects estimates tau² poorly with few studies)
- Report with strong caveats about limited evidence
- Do not conduct subgroup analyses or meta-regression

### 2. Zero Events in One or Both Arms
- Add continuity correction (0.5) for studies with zero events in one arm
- Exclude studies with zero events in both arms from standard meta-analysis
- Consider Peto OR method for rare events
- Report the number of zero-event studies separately

### 3. Studies Report Only p-values (No Effect Sizes)
- Convert p-value + sample size to approximate effect size (see Borenstein et al., 2009)
- Flag these conversions in the data extraction table
- Conduct sensitivity analysis excluding approximated effect sizes

### 4. Mixed Study Designs (RCTs + Observational)
- Pool separately by design type first
- If pooling across designs: start with observational evidence at LOW GRADE, RCT evidence at HIGH
- Report design-stratified and combined estimates
- Clearly state the rationale for combining or separating

### 5. Education-Specific Considerations
- Many education studies use cluster designs (students nested in classrooms) — check whether the original analysis accounts for clustering
- If clustering is ignored, the effective sample size is smaller than reported — apply design effect correction
- Student achievement outcomes often use different standardized tests — SMD (Hedges' g) is the default metric

## Collaboration with Other Agents

### risk_of_bias_agent
- Receives per-study risk of bias assessments
- Uses bias ratings for sensitivity analyses (exclude high-risk studies) and GRADE assessment

### bibliography_agent
- Receives the list of included studies and their extracted data
- May request additional data extraction for studies with incomplete reporting

### synthesis_agent
- When meta-analysis is feasible: meta_analysis_agent handles quantitative synthesis; synthesis_agent handles qualitative themes and interpretation
- When meta-analysis is not feasible: synthesis_agent takes the lead on narrative synthesis using the framework provided by meta_analysis_agent

### report_compiler_agent
- Provides forest plot data, GRADE tables, and heterogeneity statistics for the report
- Provides the narrative synthesis section if meta-analysis was not conducted
add-product-e2e-evalpaperclipai/paperclipAdd or extend a Paperclip full-stack runner E2E workflow, fixture, matcher, or report evidence path for local or Daytona execution.Stars: 115kUpdated Claude CodeCodexVerifiedInstall
add-runner-evalpaperclipai/paperclipAdd or extend a Paperclip Runner protocol evaluation definition, roster, assertion, or report fixture with provenance and narrow validation.Stars: 115kUpdated Claude CodeCodexVerifiedInstall
diagnose-why-work-stoppedpaperclipai/paperclipCompatibility entry point for failed, stalled, looping, or over-recovered Paperclip work. Use fix-failed-paperclip-run for the full diagnosis, regression, repair, real verification, and green-PR workflow; honor an explicitly requested diagnosis-only scope.Stars: 115kUpdated Claude CodeCodexVerifiedInstall
fix-failed-paperclip-runpaperclipai/paperclipDiagnose and fix failed, stuck, slow, or incorrectly blocked Paperclip tasks and runs. Use with a task/run URL or failure report to trace the root cause, prove a regression red then green, check second-order effects, verify the real workflow, and deliver a PR with passing checks.Stars: 115kUpdated Claude CodeCodexVerifiedInstall