DAAF-Contribution-Community/daaf / .claude/skills/literature-review
literature-review
VerifiedMethodology for literature reviews in DAAF, organized by three levels the researcher picks at the start: quick scan (abstracts and a short memo of pointers), standard review (full reads of key papers, page-checked claims, a stated weight per paper, calibrated wording) and formal or systematic review (researcher-led protocol, second screener, checklist guides for RoB 2, ROBINS-I V2, ROBINS-E, WWC, AMSTAR 2, JBI and CASP, GRADE-style certainty). Covers choosing a review type and level, screening, per-paper notes, citation snowballing, synthesis without pooling or vote counting, labeled descriptive summaries, the certainty phrase table (certainty-language.yaml) and the gap register. Use when planning, screening, appraising, synthesizing or reporting a literature review, or wording what a body of evidence shows. Not for running searches (scholarly-search), reading PDFs (pdf-reading), causal verbs for one's own results (data-scientist), or lay audiences (science-communication).
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 26.9 KB |
| references/certainty-language.yaml | config | 12.3 KB |
| references/certainty-of-evidence.md | markdown | 15.3 KB |
| references/formal-review.md | markdown | 10.3 KB |
| references/gaps-and-saturation.md | markdown | 8.2 KB |
| references/guide-descriptive.md | markdown | 5.7 KB |
| references/guide-education-wwc.md | markdown | 5.3 KB |
| references/guide-nonrandomized.md | markdown | 11.4 KB |
| references/guide-qualitative.md | markdown | 6.0 KB |
| references/guide-randomized.md | markdown | 8.2 KB |
| references/guide-reviews.md | markdown | 5.0 KB |
| references/guide-theory.md | markdown | 2.9 KB |
| references/lit-corpus.md | markdown | 67.2 KB |
| references/lit-verify-report.md | markdown | 62.3 KB |
| references/paper-notes.md | markdown | 10.7 KB |
| references/quick-scan.md | markdown | 13.7 KB |
| references/review-types-and-levels.md | markdown | 17.8 KB |
| references/screening.md | markdown | 7.9 KB |
| references/standard-review.md | markdown | 18.5 KB |
| references/synthesis-methods.md | markdown | 11.9 KB |
references/guide-education-wwc.md
View on GitHub# Guide: Education Effect Studies (WWC v5.0 Lens)
A formal-level guide to the What Works Clearinghouse (WWC) standards as an
**optional lens** for education effect studies. It is recorded beside the
risk-of-bias guide for the design (`guide-randomized.md`,
`guide-nonrandomized.md`), never instead of it. A WWC rating is a judgment about
one study finding's design, not a certainty rating for a body of evidence. The
researcher makes every judgment; DAAF computes nothing.
## Contents
- [Version and source](#version-and-source)
- [Ratings](#ratings)
- [Attrition (randomized trials)](#attrition-randomized-trials)
- [Baseline equivalence](#baseline-equivalence)
- [Rating ceilings](#rating-ceilings)
- [Regression discontinuity standards](#regression-discontinuity-standards)
- [Single-case designs](#single-case-designs)
- [WWC and ESSA labels are not certainty](#wwc-and-essa-labels-are-not-certainty)
- [How DAAF and the researcher use it](#how-daaf-and-the-researcher-use-it)
- [Not verified](#not-verified)
## Version and source
"Current Standards Version 5.0, August 2022 (Revised December 2022)", per
https://ies.ed.gov/ncee/wwc/handbooks (fetched 2026-10-30; no newer version
listed). Handbook PDF: ERIC ED621928. Guide id `wwc5`.
## Ratings
Applied per finding (Handbook Table 3):
| Rating | Meaning (quoted) |
|---|---|
| Meets WWC Standards Without Reservations | "highest degree of confidence that the intervention caused the observed effect" |
| Meets WWC Standards With Reservations | evidence that does "not sufficiently rule out that something other than the intervention caused the observed effect" |
| Does Not Meet WWC Standards | — |
## Attrition (randomized trials)
- "High attrition is defined as potential bias ≥ 0.05 standard deviation"; low
attrition is below 0.05 SD.
- The boundary between low and high depends on overall and differential
attrition together, in the Handbook's Appendix C tables (not transcribed:
look the pair up there).
- Optimistic versus cautious boundary: "If review teams… cannot defensibly
choose… they should use the cautious assumptions."
## Baseline equivalence
For "all QEDs and compromised RCTs" (Table 10), using the absolute effect size
of the baseline difference:
| Baseline \|ES\| | Result |
|---|---|
| 0.00 to 0.05 | "Satisfies" |
| above 0.05, up to 0.25 | "Requires statistical adjustment" |
| above 0.25 | "Does not satisfy" |
## Rating ceilings
- "Highest possible rating for QEDs is Meets WWC Standards With Reservations".
- Individual RCTs with high attrition are capped at With Reservations.
- A study with a confounding factor (for example an N = 1
confound) gets Does Not Meet.
## Regression discontinuity standards
Table 14 lists five standards: integrity of the forcing variable; attrition and
baseline equivalence; continuity; functional form and bandwidth; fuzzy RDD.
"Completely satisfy" all five earns Without Reservations; "partially satisfy"
earns With Reservations.
## Single-case designs
v5.0 needs "at least six data points in the initial baseline phases" for
Without Reservations, with an exception for "three or more data points and zero
within-phase variance", and adds a nonoverlap-of-all-pairs "limit risk of bias"
step. Single-case designs are rarely central to DAAF reviews; use the Handbook
directly if they are.
## WWC and ESSA labels are not certainty
- A WWC rating expresses confidence in one study finding's design, not the
certainty of a body of evidence (DAAF's reading). Use it to inform a study's risk-of-bias
note and weight, never as a finding's certainty.
- Evidence for ESSA's "Strong" level requires "a statistically significant
positive effect on at least one major measure". That is a significance-based
classification, not a certainty rating, and treating it as one is a form of
vote counting (DAAF's reading). Do not use ESSA levels as quality or
certainty.
## How DAAF and the researcher use it
1. Decide in the protocol whether the WWC lens applies (education effect
studies only) and whether the optimistic or cautious attrition boundary is
used.
2. The reader records, with quotes and numbers: the design (`rct`, `crct`,
`qed`, `rdd`, `scd`), overall and differential attrition, the baseline
effect size per outcome and whether the analysis adjusts for it, any
confounding factor, and for RD each of the five standards.
3. Each item backed by a quoted passage is an appraisal claim (guide `wwc5`;
item, e.g. `baseline-es`, `attrition-overall`, `rdd-continuity`; answer,
e.g. `0.12`, `adjusted`, `partial`); numbers go in the claim's `numbers` so
they are page-checked. An item the paper does not report (attrition not
given, say) goes in the card's Appraisal prose with its reason, not in a
claim (`formal-review.md` § Recording checklist answers).
4. The researcher looks up the attrition boundary, applies the thresholds and
ceilings above, and states the WWC rating; the record quotes them.
## Not verified
- The Appendix C attrition boundary tables were not read; they are needed to
call attrition low or high.
- The Handbook's full design standards beyond the items above were not read in
full.
Sources: WWC Procedures and Standards Handbook v5.0 (ED621928); the WWC
handbooks page; the Evidence for ESSA standards PDF. Read for DAAF's 2026-10-30
appraisal survey.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| canvas-designanthropics/skillsCreate beautiful visual art in .png and .pdf documents using design philosophy. You should use this skill when the user asks to create a poster, piece of art, design, or other static piece. Create original visual designs, never copying existing artists' work to avoid copyright violations. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| docxanthropics/skillsUse this skill whenever the user wants to create, read, edit, or manipulate Word documents (.docx files) or Word templates (.dotx files). Triggers include: any mention of 'Word doc', 'word document', '.docx', '.dotx', or requests to produce professional documents with formatting like tables of contents, headings, page numbers, or letterheads. Also use when extracting or reorganizing content from .docx or .dotx files, inserting or replacing images in documents, performing find-and-replace in Word files, working with tracked changes or comments, or converting content into a polished Word document. If the user asks for a 'report', 'memo', 'letter', 'template', or similar deliverable as a Word or .docx file, use this skill. Do NOT use for PDFs, spreadsheets, Google Docs, or general coding tasks unrelated to document generation. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| pdfanthropics/skillsUse this skill whenever the user wants to do anything with PDF files. This includes reading or extracting text/tables from PDFs, combining or merging multiple PDFs into one, splitting PDFs apart, rotating pages, adding watermarks, creating new PDFs, filling PDF forms, encrypting/decrypting PDFs, extracting images, and OCR on scanned PDFs to make them searchable. If the user mentions a .pdf file or asks to produce one, use this skill. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| pptxanthropics/skillsUse this skill any time a .pptx or .potx file is involved in any way — as input, output, or both. This includes: creating slide decks, pitch decks, or presentations; reading, parsing, or extracting text from any .pptx or .potx file (even if the extracted content will be used elsewhere, like in an email or summary); editing, modifying, or updating existing presentations; combining or splitting slide files; working with templates (.potx), layouts, speaker notes, or comments. Trigger whenever the user mentions "deck," "slides," "presentation," or references a .pptx or .potx filename, regardless of what they plan to do with the content afterward. If a .pptx or .potx file needs to be opened, created, or touched, use this skill. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |