Skip to content

DAAF-Contribution-Community/daaf / .claude/skills/education-data-source-meps

education-data-source-meps

Unverified

MEPS — Urban Institute modeled school-level poverty (% at 100% FPL) for public schools. MEPS 2.0 (released 2025-12-11) covers school years 2009-10 through 2022-23 and is planned for annual updates; Portal year 2022 returned rows while 2023 was empty on 2026-08-06 (re-probed). Use when FRPL is unreliable due to CEP and for consistent cross-state measurement.

MEPS Data Source Reference

Model Estimates of Poverty in Schools (MEPS) — Urban Institute modeled estimates of school-level poverty (% students at or below 100% FPL) for public schools. MEPS 2.0, released 2025-12-11, covers school years 2009-10 through 2022-23 and says updates will occur annually. In the Portal, year 2022 returned rows (count 94,941) while year 2023 returned an empty result (count 0), re-probed 2026-08-06. Use when analyzing school poverty rates, comparing poverty across states, or when FRPL data is unreliable due to CEP enrollment. Treat the present gap as a publication-vintage observation, not as a documented fixed methodological lag or as a proven consequence of CCD/SAIPE timing.

School-level poverty measure from the Urban Institute that is comparable across states and time, unlike Free/Reduced-Price Lunch (FRPL) data.

CRITICAL: Value Encoding

The Education Data Portal returns MEPS data with integer-encoded categorical and identifier columns. This differs from some external documentation:

ColumnPortal TypeExample ValueNotes
fipsInt646State FIPS as integer (California = 6)
ncesschInt641000020027712-digit NCES school ID as integer
leaidInt641000027-digit district ID as integer
gleaidInt64100013Geographic LEA ID as integer
yearInt642018Academic year (fall semester)

Missing values: Unlike CCD, MEPS uses native nulls rather than negative coded values (-1, -2, -3). While the codebook lists these codes, actual Portal data contains nulls for missing values.

See ./references/variable-definitions.md for complete encoding tables.

What is MEPS?

MEPS is a modeled estimate of the share of students from households with incomes at or below 100% of the Federal Poverty Level (FPL).

  • Purpose: Provide consistent school poverty measurement across all US states
  • Key advantage: Comparable across states (unlike FRPL which varies by state policy)
  • Data level: School-level (individual schools)
  • Coverage: MEPS 2.0 school years 2009-10 through 2022-23; Portal year values 2009-2022, with rows in 2022 and an empty 2023 response re-probed 2026-08-06
  • Release cadence: MEPS 2.0 was released 2025-12-11 and states that updates will occur annually; no fixed methodological lag is documented
  • Source: Urban Institute, using CCD, SAIPE, and MEPS 2.0 inputs documented in the methodology
  • Primary identifier: ncessch (12-digit NCES school ID)
  • Public schools only: Does not cover private schools

Reference File Structure

FilePurposeWhen to Read
methodology.mdHow MEPS estimates are calculatedUnderstanding the model, research validation
comparison-to-frpl.mdDetailed FRPL vs MEPS comparisonDeciding which measure to use
data-sources.mdInput data (CCD, SAIPE, ISP)Understanding data provenance
variable-definitions.mdMEPS variables and codesBuilding queries, interpreting results
data-quality.mdLimitations, uncertainty, appropriate usesResearch design, caveats

Decision Trees

Should I use MEPS or FRPL?

What is your research goal?
├─ Compare poverty across states → Use MEPS
│   └─ FRPL varies by state policy, MEPS is standardized
├─ Track poverty over time (post-2010) → Use MEPS
│   └─ CEP adoption makes FRPL inconsistent
├─ Study CEP/universal meals impact → Use both
│   └─ Compare MEPS (true poverty) vs FRPL (program participation)
├─ Match historical research (pre-2010) → Consider FRPL
│   └─ MEPS 2.0 begins in 2009-10; FRPL was more reliable before CEP
├─ Need 185% FPL threshold → Use FRPL with caveats
│   └─ MEPS only measures 100% FPL
└─ Federal funding formulas → Check formula requirements
    └─ Some formulas mandate FRPL; note limitations

Which MEPS variable should I use?

Which estimate type?
├─ Standard analysis → `meps_poverty_pct`
│   └─ Original modeled estimate
├─ District totals must match adjusted SAIPE → `meps_mod_poverty_pct`
│   └─ Modified MEPS reallocates modeled poor students up or down to match
│      adjusted SAIPE; Urban suggests it for analyses limited to large districts
├─ Need confidence bounds → `meps_poverty_se`
│   └─ Standard error for uncertainty analysis
└─ Categorical analysis → Derive from `meps_poverty_pct`
    └─ Create quartiles/quintiles as needed

How do I access MEPS data?

Access method?
├─ Mirror download (recommended) → See "Data Access" section below
└─ Join with other data → Use `ncessch` as join key

Quick Reference: MEPS Variables

Data Access: MEPS data is fetched from mirrors (parquet/CSV). See datasets-reference.md for canonical paths, mirrors.yaml for mirror configuration, and fetch-patterns.md for fetch code patterns.

Portal Field Names

The Portal field names differ from some external MEPS documentation:

External DocumentationPortal Field Name
meps / school_povertymeps_poverty_pct
meps_modmeps_mod_poverty_pct
meps_semeps_poverty_se

Variable Reference

All ID and categorical columns use integer encoding in Portal data:

VariableDescriptionTypeRange/Notes
ncesschNCES school ID (12-digit)Int64e.g., 10000200277
ncessch_numNCES school ID (numeric duplicate)Int64Same as ncessch
yearSchool year (fall)Int642009-2022 (actual data range)
fipsState FIPS codeInt641-56
leaidDistrict ID (7-digit)Int64e.g., 100002
gleaidGeographic LEA IDInt64e.g., 100013
meps_poverty_pctEstimated share in poverty (100% FPL)Float640.0-60.5% (actual range)
meps_mod_poverty_pctModified MEPS estimateFloat640.0-100.0%
meps_poverty_seStandard error of estimateFloat640.5-3.8 (typical range)
meps_poverty_ptlNational percentile (enrollment-weighted)Int641-100
meps_mod_poverty_ptlModified percentile (enrollment-weighted)Int641-100

Key Identifiers

IDFormatLevelExampleNotes
ncesschInt64 (12-digit)School10000200277Primary join key for school-level joins
leaidInt64 (7-digit)District100002Use for district-level joins (e.g., with SAIPE)
gleaidInt64Geographic LEA100013Geographic LEA ID
fipsInt64State6State FIPS code

Missing Data Codes

CodeMeaningWhen Used
nullMissing / Not availableAll missing values — MEPS uses native nulls, not negative coded values

Important: Unlike CCD and most other Portal sources, MEPS does not use -1, -2, -3 coded values. Use null checks:

# Correct
valid_data = df.filter(pl.col("meps_poverty_pct").is_not_null())

# Wrong (MEPS doesn't use -1, -2, -3 coded values)
# df.filter(pl.col("meps_poverty_pct") >= 0)  # Unnecessary
library(dplyr)

# Correct
valid_data <- df |> filter(!is.na(meps_poverty_pct))

# Wrong (MEPS doesn't use -1, -2, -3 coded values)
# df |> filter(meps_poverty_pct >= 0)  # Unnecessary

Data Access

Datasets for MEPS are available via the mirror system. See datasets-reference.md for canonical paths, mirrors.yaml for mirror configuration, and fetch-patterns.md for fetch code patterns.

DatasetTypeYearsPathCodebook
School PovertySingle2009-2022meps/schools_mepsmeps/codebook_schools_meps

Codebooks are .xls files co-located with data in all mirrors. Use get_codebook_url() from fetch-patterns.md to construct download URLs:

url = get_codebook_url("meps/codebook_schools_meps")
# get_codebook_url() is a Python helper; in R, build the URL from the mirror root.
# Mirror failover: see `education-data-query/references/fetch-patterns.md` (R pattern)
mirror <- yaml::read_yaml("mirrors.yaml")$mirrors[[1]]
url <- paste0(mirror$root_url, "/", mirror$vintage$hf_revision, "/", "meps/codebook_schools_meps", ".xls")

Truth Hierarchy: When interpreting variable values, apply this priority:

  1. Actual data file (what you observe in the parquet/CSV) -- this IS the truth
  2. Live codebook (.xls in mirror) -- authoritative documentation, may lag
  3. This skill documentation -- convenient summary, may drift from codebook

If this documentation contradicts the codebook, trust the codebook. If the codebook contradicts observed data, trust the data and investigate.

Current Publication Vintage

  • Urban MEPS 2.0 release (2025-12-11): https://www.urban.org/research/publication/model-estimates-poverty-schools-20
  • Portal 2022 probe: https://educationdata.urban.org/api/v1/schools/meps/2022/ — returned rows (count 94,941) on 2026-08-06
  • Portal 2023 probe: https://educationdata.urban.org/api/v1/schools/meps/2023/ — returned an empty result (count 0) on 2026-08-06

MEPS 2.0 covers school years 2009-10 through 2022-23 and states that updates will occur annually. Describe any current-year gap as the observed publication vintage. Do not assert a fixed production lag or attribute it causally to CCD or SAIPE without separate evidence.

Filtering

# Filter to valid poverty estimates only (drop nulls)
df = df.filter(pl.col("meps_poverty_pct").is_not_null())

# High-poverty schools (top quartile nationally)
high_poverty = df.filter(pl.col("meps_poverty_ptl") >= 75)

# Prefer Modified MEPS (SAIPE-matched) where present, else original.
# Modified MEPS is missing where the district has no SAIPE value; Urban
# suggests original MEPS for analyses that include small districts.
df = df.with_columns(
    pl.when(pl.col("meps_mod_poverty_pct").is_not_null())
    .then(pl.col("meps_mod_poverty_pct"))
    .otherwise(pl.col("meps_poverty_pct"))
    .alias("poverty_pct_best")
)
library(dplyr)

# Filter to valid poverty estimates only (drop nulls)
df <- df |> filter(!is.na(meps_poverty_pct))

# High-poverty schools (top quartile nationally)
high_poverty <- df |> filter(meps_poverty_ptl >= 75)

# Prefer Modified MEPS (SAIPE-matched) where present, else original.
# Modified MEPS is missing where the district has no SAIPE value; Urban
# suggests original MEPS for analyses that include small districts.
# (coalesce = take modified estimate when present, else original)
df <- df |> mutate(
  poverty_pct_best = coalesce(meps_mod_poverty_pct, meps_poverty_pct)
)

Common Pitfalls

PitfallIssueSolution
Using negative value filtersFiltering >= 0 to remove missing values; MEPS uses nulls, not -1/-2/-3Use .is_not_null() instead of >= 0
Confusing MEPS with FRPL thresholdsMEPS measures 100% FPL; FRPL uses 130-185% FPL — rates are not comparableState clearly which measure and threshold; never mix in same analysis
Using wrong field namesDocumentation says meps but actual Portal field is meps_poverty_pctAlways use Portal field names: meps_poverty_pct, meps_mod_poverty_pct, meps_poverty_se
Ignoring standard errorsTreating MEPS as exact counts; they are modeled estimates with uncertaintyUse meps_poverty_se for close comparisons; flag when SE exceeds meaningful difference
Including private schoolsMEPS only covers public schools; joining with datasets containing private schools inflates nullsFilter to public schools before joining
Treating vintage as a fixed lagThe current terminal year is a publication-vintage observation, not a documented fixed methodological delayRecord the MEPS release date and covered school years; probe the Portal year needed before planning analysis

Why MEPS Instead of FRPL?

IssueFRPL ProblemMEPS Solution
CEP schoolsMay report all students as free-lunch eligible regardless of income (NCES)Models free-lunch or direct-certification shares against adjusted SAIPE poverty instead of using them as poverty rates
State variationDifferent states use different eligibility criteriaStandardized 100% FPL threshold nationwide
Direct certificationVaries by state program participationModel fit to adjusted Census SAIPE district poverty, with state random slopes
Income threshold130-185% FPL (varies)Consistent 100% FPL
Time consistencyPolicy changes affect comparability over timeSame model framework each year (re-estimated annually; some covariates dropped in 2022-23)

Critical insight: CEP grew from 14,184 schools in SY 2014-15 to 55,362 in SY 2025-26 (FRAC), roughly 14% → 56% of U.S. public schools (DAAF calculation). Universal-meal waivers covered all schools in SY 2020-21 and 2021-22. FRPL is therefore an increasingly unreliable poverty proxy (see references/comparison-to-frpl.md).

Key Methodological Points

  1. Model-based: MEPS 2.0 fits a multilevel (mixed-effects) linear regression of adjusted SAIPE district poverty on district-aggregated free-lunch (or direct-certification) shares, with state random intercepts and slopes and district covariates, then applies the parameters to school-level data (Gutierrez & Blagg 2025). It is an estimate, not a direct count
  2. SAIPE-anchored: Only Modified MEPS is adjusted so district aggregates match adjusted SAIPE. Original MEPS is a model prediction
  3. School-specific: Reflects enrolled students, not neighborhood demographics
  4. 100% FPL threshold: Lower than FRPL (185%) - captures deeper poverty
  5. Public schools only: Does not cover private schools

Common Use Cases

Use CaseRecommended Approach
School poverty rankingsUse meps_poverty_pct, note meps_poverty_se for close comparisons
State-level aggregationSum weighted by enrollment
Poverty-achievement gapsJoin MEPS with EDFacts assessments on ncessch
Resource allocation analysisJoin MEPS with CCD finance on leaid
CEP impact researchCompare MEPS vs FRPL trends over time
Title I targeting or other resource allocationNot for allocating resources within a state or district (Urban). Use for cross-state and longitudinal research.

Joining MEPS with Other Data

SourceJoin KeyUse Case
CCD Directoryncessch, yearAdd school characteristics
CCD Enrollmentncessch, yearGet enrollment for weighting
CRDCncessch, yearDiscipline, AP courses + poverty
EDFactsncessch, yearAchievement + poverty analysis
SAIPE (district)leaid, yearValidate against Census estimates

Limitations

  • Years available: 2009-2022 (actual Portal data range)
  • Public schools only: No private school coverage
  • Modeled estimates: Subject to estimation error (use meps_poverty_se)
  • 100% FPL only: Does not capture near-poverty (100-185% FPL)
  • Publication vintage: MEPS 2.0 (released 2025-12-11) ends with school year 2022-23; check the latest release and Portal response rather than assuming a fixed lag

Related Data Sources

SourceRelationshipWhen to Use
education-data-source-saipeDistrict-level poverty (Census)District-level analysis; adjusted SAIPE is the MEPS model outcome
education-data-source-ccdSchool/district characteristicsJoin for enrollment, demographics, finance
education-data-source-crdcCivil rights/discipline dataJoin on ncessch for poverty + discipline analysis
education-data-source-edfactsState assessment dataJoin on ncessch for poverty + achievement analysis
education-data-explorerParent discovery skillRouting questions to mirror dataset files
education-data-queryData fetchingDownloading MEPS parquet/CSV files

Topic Index

TopicReference File
Multilevel (mixed-effects) regression model./references/methodology.md
SAIPE as model outcome./references/methodology.md
Modified MEPS./references/methodology.md
Validation evidence./references/methodology.md
CEP impact on FRPL./references/comparison-to-frpl.md
Direct certification./references/comparison-to-frpl.md
State policy variation./references/comparison-to-frpl.md
CCD data inputs./references/data-sources.md
SAIPE data inputs./references/data-sources.md
ISP data (MEPS 2.0)./references/data-sources.md
Variable definitions./references/variable-definitions.md
Poverty thresholds./references/variable-definitions.md
Standard errors./references/data-quality.md
Appropriate uses./references/data-quality.md
Known limitations./references/data-quality.md
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 196kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 192kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 192kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 192kUpdated Claude CodeCodexVerifiedInstall