Skip to content

DAAF-Contribution-Community/daaf / .claude/skills/education-data-source-crdc

education-data-source-crdc

Unverified

CRDC — OCR civil rights collection for U.S. public schools; Portal families have topic-specific coverage, with year labels from 2011 through 2023 (Portal year = fall of the school year, so 2020 = 2020-21). Discipline, course access, harassment, restraint/seclusion by race/sex/disability/EL. Use for civil rights and equity analysis. OCR documents every collection since 2011-12 as a universe collection; 2020-21 (Portal year 2020) is COVID-impacted.

CRDC Data Source Reference

Civil Rights Data Collection (CRDC) — mandatory OCR collection measuring educational opportunity and civil rights compliance in U.S. public schools. Portal dataset families have topic-specific coverage, with year labels from 2011 through 2023; a Portal year is the fall (starting) year of the school year, so 2020 = 2020-21. Use them for school discipline disparities, course access equity, harassment, restraint/seclusion, or chronic absenteeism by race, sex, disability, and English learner status. OCR documents every collection since 2011-12 as a universe collection (the 2013-14 collection covered 16,758 districts and 95,507 schools). The 2020-21 collection (Portal year 2020) is COVID-impacted and not directly comparable to ordinary years.

The Civil Rights Data Collection is a mandatory survey of all U.S. public schools, often described as biennial but with no odd/even-year rule (2020-21 and 2021-22 are consecutive collections; see Cadence and year labels below), measuring educational opportunity and civil rights compliance. It is the only national source for school-level discipline disparities, course access equity, harassment, and restraint/seclusion data disaggregated by race, sex, disability, and English learner status.

CRITICAL: Value Encoding

The Education Data Portal uses integer codes, not the string codes shown in OCR documentation. Always filter using integers.

VariableString Code (Raw)Portal Integer
Race: WhiteWH1
Race: BlackBL2
Race: HispanicHI3
Sex: MaleM1
Sex: FemaleF2

See ./references/variable-definitions.md for complete encoding tables.

What is CRDC?

The Civil Rights Data Collection is a mandatory OCR collection of public schools and districts that measures educational opportunity and civil rights compliance:

  • Collector: U.S. Department of Education, Office for Civil Rights (OCR)
  • Purpose: Enforce civil rights laws, identify discrimination, monitor equity
  • Coverage: Universe. OCR documents every modern collection (2011-12, 2013-14, 2015-16, 2017-18, 2020-21, 2021-22, 2023-24) as a universe collection. Collections from 1968 to 2010 were samples, except 1976 and 2000.
  • Cadence: Usually organized by school-year collection cycles, historically often biennial, but not governed by an odd/even parity rule; 2020-21 and 2021-22 are consecutive collections
  • Disaggregation: Race/ethnicity, sex, disability status, English learner status
  • History: Collected since 1968; administered as the Elementary and Secondary School Civil Rights Report before the 2004 CRDC
  • Portal coverage (v2 mirror, build validated 2026-08-06): Topic-specific families spanning 2011 through 2022 (content-based year range confirmed in the v2 build); year availability differs by topic. The live Portal catalog (checked 2026-10-15) also lists year 2023 (2023-24) for the offerings endpoint, so the live API can be ahead of the mirror
  • Available through: Education Data Portal mirrors

Reference File Structure

FilePurposeWhen to Read
civil-rights-context.mdLegal framework (Title VI, IX, Section 504, IDEA)Understanding why data is collected
data-elements.mdAll data categories and what's collectedPlanning analysis, identifying variables
collection-methodology.mdSampling, universe, timeline, reportingUnderstanding coverage limitations
variable-definitions.mdKey variables, codes, disaggregation categoriesCoding data, interpreting values
data-quality.mdKnown issues, suppression, state variationsAddressing limitations in analysis
historical-changes.mdEvolution across collection yearsTime series analysis, year comparison

Decision Trees

What CRDC data do I need?

Research topic?
├─ School discipline
│   ├─ Suspensions (ISS/OSS) → ./references/data-elements.md#discipline
│   ├─ Expulsions → ./references/data-elements.md#discipline
│   ├─ Referrals to law enforcement → ./references/data-elements.md#discipline
│   ├─ School-related arrests → ./references/data-elements.md#discipline
│   └─ Preschool suspensions → ./references/data-elements.md#discipline
├─ Restraint and seclusion
│   └─ Physical restraint, mechanical, seclusion → ./references/data-elements.md#restraint-and-seclusion
├─ Harassment and bullying
│   ├─ Allegations by type → ./references/data-elements.md#harassment-and-bullying
│   └─ Disciplined for harassment → ./references/data-elements.md#harassment-and-bullying
├─ Course access and enrollment
│   ├─ AP/IB courses → ./references/data-elements.md#advanced-courses-apibgifted
│   ├─ Gifted/talented → ./references/data-elements.md#advanced-courses-apibgifted
│   ├─ Math/science courses → ./references/data-elements.md#course-access-and-offerings
│   └─ Computer science → ./references/data-elements.md#course-access-and-offerings
├─ Chronic absenteeism
│   └─ Students missing 15+ days → ./references/data-elements.md#chronic-absenteeism
├─ Special populations
│   ├─ Students with disabilities (IDEA) → ./references/data-elements.md#students-with-disabilities
│   ├─ English learners → ./references/data-elements.md#english-learners
│   └─ Preschool enrollment → ./references/data-elements.md#preschool
├─ School staffing
│   ├─ Teacher experience/certification → ./references/data-elements.md#staffing
│   └─ Counselors, nurses, etc. → ./references/data-elements.md#staffing
└─ School safety
    └─ Offenses, violence, weapons → ./references/data-elements.md#school-offenses

Understanding the legal context?

Civil rights law question?
├─ Race/ethnicity discrimination → ./references/civil-rights-context.md#title-vi-of-the-civil-rights-act-of-1964
├─ Sex/gender discrimination → ./references/civil-rights-context.md#title-ix-of-the-education-amendments-of-1972
├─ Disability discrimination → ./references/civil-rights-context.md#section-504-of-the-rehabilitation-act-of-1973
├─ Special education services → ./references/civil-rights-context.md#idea-individuals-with-disabilities-education-act
├─ Age discrimination → ./references/civil-rights-context.md#age-discrimination-act-of-1975
└─ OCR enforcement process → ./references/civil-rights-context.md#ocr-enforcement-process

Data quality concerns?

Data quality issue?
├─ Missing or suppressed data → ./references/data-quality.md#suppression-rules
├─ Definition inconsistencies → ./references/data-quality.md#definition-variation
├─ Year-to-year comparability → ./references/historical-changes.md
├─ COVID-19 impact (2020-21, Portal year 2020) → ./references/data-quality.md#covid-19-impact-2020-21
├─ Underreporting concerns → ./references/data-quality.md#underreporting-concerns
└─ State-level variations → ./references/data-quality.md#state-variations

Quick Reference: CRDC Data Categories

Collection Years

School YearCoverage statusScale / Portal noteKey Notes
2011-12UniverseAll public schools and districts (response: 98.4% of districts, 99.2% of schools, 99.6% of students); Portal year 2011OCR's 2011-12 Data Snapshot: "included all public schools and public school districts"
2013-14Universe16,758 districts; 95,507 schools (First Look figure; the revised target population was 95,958 schools); Portal year 2013Chronic absenteeism first collected
2015-16Universe collection96,440 schools (final target); Portal year 2015Chronic absenteeism collected again; items optional in 2013-14 became required
2017-18Universe collection~97,600 schools (17,637 LEAs final target); Portal year 2017Expanded variables; Puerto Rico added; chronic absenteeism now taken from EDFacts
2020-21Universe collection~97,500 schools; Portal year 2020COVID-impacted year
2021-22Universe collection~98,000 schools; Portal year 2021Consecutive collection after 2020-21
2023-24Universe collection17,591 LEAs; 97,094 schools; Portal exposes year 2023 for some topics (e.g., offerings, verified 2026-10-15); check per familyPublic-use file and user's manual released August 31, 2026

Cadence and year labels: CRDC is organized by school-year collection cycles and is often described as biennial, but there is no valid odd/even-year rule. Portal CRDC year labels are the fall (starting) year of the school year: 2011=2011-12, 2013=2013-14, 2015=2015-16, 2017=2017-18, 2020=2020-21 (COVID-impacted), 2021=2021-22, 2023=2023-24. This matches the Portal-wide convention in education-data-context (year=2020 means the 2020-21 school year). 2020 and 2021 are consecutive collection labels. The chronic-absenteeism endpoints also list year 2022 (a 2026-08-06 probe of chronic-absenteeism/2022/race/sex/ returned rows); 2022 = 2022-23, which is not a CRDC collection year, so these rows most likely come from EDFacts, OCR's source for chronic absenteeism since 2017-18 (inference, not verified). Probes of year 2024 on 2026-08-06/07 returned no rows (HTTP 500, then HTTP 404 for https://educationdata.urban.org/api/v1/schools/crdc/enrollment/2024/); under the fall convention 2024 would be 2024-25, not a CRDC collection, so those probes do not bear on 2023-24.

Source verification (accessed 2026-07-21; First Look PDF fetched 2026-10-15): Official 2013-14 First Look, Portal endpoint catalog, and Portal bulk manifest.

Data Categories

CategoryDescriptionDisaggregation
EnrollmentStudent counts by grade levelRace, sex, disability, LEP
DisciplineSuspensions, expulsions, arrestsRace, sex, disability, LEP
Restraint/SeclusionPhysical/mechanical restraint, seclusionRace, sex, disability
HarassmentAllegations and discipline by typeRace, sex, disability
Course AccessAP, IB, math, science, CS offeringsSchool-level, enrollment by race/sex
Chronic Absenteeism15+ days missedRace, sex, disability, LEP
StaffingTeachers, counselors, nurses, etc.FTE counts, qualifications
OffensesViolence, weapons, drugs at schoolType of offense
RetentionStudents retained in gradeRace, sex, disability

Key Identifiers

IDFormatLevelExampleNotes
crdc_id12-digit stringSchool010000201705Primary CRDC identifier; always present
ncessch12-digit stringSchool010000201705NCES school ID, joins to CCD; may be null for some entries
leaid7-digit stringDistrict0100002NCES district ID, joins to CCD; always present

Note: The OCR-internal combokey (e.g., AL-0010-00002) does NOT appear as a column in Portal data. Use crdc_id or ncessch for school-level identification.

WARNING: String Type Override Required. When reading CRDC data from CSV, ncessch, leaid, and crdc_id must be read as String (pl.Utf8) via schema_overrides. Polars infers these as Int64, silently destroying leading zeros for ~19% of rows (FIPS 01-09 states: AL, AK, AZ, AR, CA, CO, CT). In R, readr::read_csv() has the identical failure mode — apply the same guard with col_types = cols(ncessch = col_character(), leaid = col_character(), crdc_id = col_character()). Parquet files preserve whatever dtype the file was written with — and that dtype is not uniformly String across CRDC files. A 2026-08-07 per-file audit found id typing is heterogeneous even within the 2020 vintage (e.g. school_characteristics all String, but enrollment_k12_2020 crdc_id and harass_bully_students_2020 all three ids are Int64). Do not assume a parquet read yields String ids — inspect the schema and normalize/cast on read. See references/data-quality.md § Identifier Typing for the per-file evidence.

Race/Ethnicity (Portal Integer Codes)

CodeCategory
1White
2Black or African American
3Hispanic/Latino of any race
4Asian
5American Indian or Alaska Native
6Native Hawaiian or Other Pacific Islander
7Two or more races
99Total

Empirically observed values: Codes 1-7 and 99 appear in CRDC data. Additional codes (8 Nonresident alien, 9 Unknown, 20 Other) are defined in the codebook but are not observed in practice for K-12 CRDC datasets. See variable-definitions.md for the full codebook listing.

Sex (Portal Integer Codes)

CodeCategory
1Male
2Female
3Gender Not-Identified (Portal dictionary label; populated only in the 2021 enrollment file, where most sex-3 rows carry -2; see references/variable-definitions.md)
99Total

Disability Status (Portal Integer Codes)

CodeCategory
0Students without disabilities
1Students with disabilities (served under IDEA)
2Students with Section 504 only
3Students not served under IDEA (includes 504-only and non-disabled)
4Students with disabilities (combined: IDEA + Section 504)
99Total

Note: Not all disability codes appear in every dataset. Enrollment data typically has [1, 2, 99]; discipline data has [0, 1, 2, 4, 99]. Verify codes against the live codebook for your specific dataset.

English Learner Status (Portal Integer Codes)

CodeCategory
1English learner (EL/LEP)
99All students

Missing Data Codes

CodeMeaningWhen Used
-1MissingData not reported by school/district
-2Not applicableItem doesn't apply to this entity
-3SuppressedData suppressed for privacy (small cell sizes)
-9Skip patternQuestion not asked in this collection year (rare; check codebook)
nullNot availableValue absent from dataset (e.g., ncessch is null for some schools)

Verify these codes against the live codebook for your specific dataset. Use get_codebook_url() from fetch-patterns.md.

Data Access

Datasets for CRDC are available via the Education Data Portal mirror system. See datasets-reference.md for canonical paths, mirrors.yaml for mirror configuration, and fetch-patterns.md for fetch code patterns including fetch_from_mirrors() and fetch_yearly_from_mirrors().

Portal bulk family inventory observed 2026-07-21 (24 families: 10 year-sharded, 14 multi-year/single-file):

Dataset familyPathTypeCodebook
Disciplinecrdc/schools_crdc_discipline_k12_{year}Yearlycrdc/codebook_schools_crdc_discipline
AP/IB Enrollmentcrdc/schools_crdc_apib_enrollSinglecrdc/codebook_schools_crdc_ap-ib-enrollment
Enrollmentcrdc/schools_crdc_enrollment_k12_{year}Yearlycrdc/codebook_schools_crdc_enrollment
Chronic Absenteeismcrdc/schools_crdc_chronic_absenteeism_{year}Yearlycrdc/codebook_schools_crdc_chronic-absenteeism
Harassment/Bullyingcrdc/schools_crdc_harass_bully_students_{year}Yearlycrdc/codebook_schools_crdc_harrassment-bullying-students
Restraint/Seclusioncrdc/schools_crdc_restraint_seclusion_students_{year}Yearlycrdc/codebook_schools_crdc_restraint-seclusion-students
Algebracrdc/schools_crdc_algebra_{year}Yearlycrdc/codebook_schools_crdc_algebra-1
AP Examscrdc/schools_crdc_ap_exams_{year}Yearlycrdc/codebook_schools_crdc_ap-exams
Retentioncrdc/schools_crdc_retention_{year}Yearlycrdc/codebook_schools_crdc_retention
SAT/ACT Participationcrdc/schools_crdc_sat_and_act_participation_{year}Yearlycrdc/codebook_schools_crdc_sat-act-participation
COVID Indicatorscrdc/schools_crdc_covid_indicatorsSinglecrdc/codebook_schools_crdc_covid_indicators
Credit Recoverycrdc/schools_crdc_credit_recoverySinglecrdc/codebook_schools_crdc_credit-recovery
Directory/Characteristicscrdc/schools_crdc_school_characteristicsSinglecrdc/codebook_schools_crdc_directory
Discipline Instancescrdc/schools_crdc_disciplineinstancesSinglecrdc/codebook_schools_crdc_discipline_instances
Dual Enrollmentcrdc/schools_crdc_dual_enrollmentSinglecrdc/codebook_schools_crdc_dual_enrollment
Harassment/Bullying Allegationscrdc/schools_crdc_harass_bully_allegationsSinglecrdc/codebook_schools_crdc_harrassment-bullying-allegations
Internet Accesscrdc/schools_crdc_internet_accessSinglecrdc/codebook_schools_crdc_internet_access
Math and Sciencecrdc/schools_crdc_mathandscienceSinglecrdc/codebook_schools_crdc_math-and-science
Offensescrdc/schools_crdc_offensesSinglecrdc/codebook_schools_crdc_offenses
Offeringscrdc/schools_crdc_offeringsSinglecrdc/codebook_schools_crdc_offerings
Restraint/Seclusion Instancescrdc/schools_crdc_restraint_seclusion_instancesSinglecrdc/codebook_schools_crdc_restraint-seclusion-instances
School Financecrdc/schools_crdc_financeSinglecrdc/codebook_schools_crdc_finance
Suspensions (Days)crdc/schools_crdc_suspensionsSinglecrdc/codebook_schools_crdc_suspensions_days
Teachers/Staffcrdc/schools_crdc_teacherSinglecrdc/codebook_schools_crdc_teachers_staff

The 24 count is the deduplicated Urban bulk family inventory, not a year, row count, or API endpoint count. The live Portal catalog separately exposed 50 CRDC endpoint templates because topic/disaggregation routes split more finely than bulk files. Family-specific year coverage varies; neither number implies CRDC 2024 data.

CRDC naming note: Some data file paths use concatenated names (e.g., disciplineinstances, mathandscience) while their codebook counterparts use underscored names (e.g., discipline_instances, math_and_science). Always use the exact paths from datasets-reference.md.

Codebooks are .xls files co-located with data in all mirrors. Use get_codebook_url() from fetch-patterns.md to construct download URLs:

from fetch_patterns import get_codebook_url
url = get_codebook_url("crdc/codebook_schools_crdc_discipline")
# get_codebook_url() is a Python helper; in R, construct the codebook URL from the
# mirror root in mirrors.yaml (codebooks are .xls files co-located with the data).
# Mirror failover: see `education-data-query/references/fetch-patterns.md` (R pattern).
config <- yaml::read_yaml("mirrors.yaml")
mirror <- config$mirrors[[1]]
url <- paste0(mirror$root_url, "/", mirror$vintage$hf_revision, "/", "crdc/codebook_schools_crdc_discipline", ".xls")

Truth Hierarchy: When interpreting variable values, apply this priority:

  1. Actual data file (what you observe in the parquet/CSV) -- this IS the truth
  2. Live codebook (.xls in mirror) -- authoritative documentation, may lag
  3. This skill documentation -- convenient summary, may drift from codebook

If this documentation contradicts the codebook, trust the codebook. If the codebook contradicts observed data, trust the data and investigate.

Filtering

import polars as pl

# Filter to a single state (California) and disaggregated race groups
df = df.filter(
    (pl.col("fips") == 6) &       # California
    (pl.col("race") < 99)          # Exclude totals row
)

# Filter to specific demographic intersection
df = df.filter(
    (pl.col("race") == 2) &        # Black students
    (pl.col("sex") == 99) &         # Both sexes (total)
    (pl.col("disability") == 99)    # All disability statuses
)
library(dplyr)

# Filter to a single state (California) and disaggregated race groups
df <- df |> filter(
    (fips == 6) &       # California
    (race < 99)          # Exclude totals row
)

# Filter to specific demographic intersection
df <- df |> filter(
    (race == 2) &        # Black students
    (sex == 99) &         # Both sexes (total)
    (disability == 99)    # All disability statuses
)

Common Pitfalls

PitfallIssueSolution
Using string codesPortal uses integers, not stringsrace == 2 not race == "BL"
Raw countsDifferent enrollment sizesUse rates per 100/1000 students
Collection cadenceAssuming annual data or applying an odd/even parity ruleCheck topic-specific collection labels; 2020 and 2021 are consecutive
Year labelReading Portal year as the spring (terminal) yearPortal year is the fall year: 2020 = 2020-21, 2021 = 2021-22
COVID year2020-21 (Portal year 2020) not comparableFlag or exclude from trends
SuppressionSmall cell suppressionCheck suppression rates first
Coverage historyAssuming the early modern collections were samplesOCR documents every collection since 2011-12 as universe; 1968-2010 collections were samples, except 1976 and 2000
Definition driftVariables change over timeCheck codebooks for each year
Forgetting code 99Including totals in calculationsFilter race < 99 for disaggregated analysis
CSV type inferencePolars and readr infer ncessch/leaid/crdc_id as integer, destroying leading zerosPython: schema_overrides={"ncessch": pl.Utf8, "leaid": pl.Utf8, "crdc_id": pl.Utf8}; R: readr::read_csv(..., col_types = cols(ncessch = col_character(), leaid = col_character(), crdc_id = col_character()))

Equity Analysis Framework

CRDC data is designed for civil rights analysis. Key analytical approaches:

Disparity Ratios

import polars as pl

# Calculate discipline disparity using Portal integer codes
def discipline_disparity(df, discipline_var, group_a, group_b):
    """
    Calculate risk ratio between two groups.
    Value > 1 indicates group_a has higher rate.

    Args:
        df: DataFrame with CRDC data
        discipline_var: Column with discipline counts
        group_a: Integer race code (e.g., 2 for Black)
        group_b: Integer race code (e.g., 1 for White)

    Example:
        # Black vs White OSS disparity
        disparity = discipline_disparity(df, 'students_susp_out_sch_single', 2, 1)
    """
    # Filter to each group (using integer codes)
    df_a = df.filter(pl.col('race') == group_a)
    df_b = df.filter(pl.col('race') == group_b)

    # Calculate rates
    rate_a = df_a.select(pl.col(discipline_var).sum()).item() / \
             df_a.select(pl.col('enrollment_crdc').sum()).item()
    rate_b = df_b.select(pl.col(discipline_var).sum()).item() / \
             df_b.select(pl.col('enrollment_crdc').sum()).item()

    return rate_a / rate_b

# Example: Black (race=2) vs White (race=1) disparity
# disparity = discipline_disparity(df, 'students_susp_out_sch_single', 2, 1)
library(dplyr)

# Calculate discipline disparity using Portal integer codes.
# Risk ratio between two groups; value > 1 indicates group_a has a higher rate.
# Example: Black (race=2) vs White (race=1) OSS disparity
discipline_var <- "students_susp_out_sch_single"
group_a <- 2  # Black
group_b <- 1  # White

# Filter to each group (using integer codes)
df_a <- df |> filter(race == group_a)
df_b <- df |> filter(race == group_b)

# Calculate rates
rate_a <- sum(df_a[[discipline_var]], na.rm = TRUE) /
  sum(df_a$enrollment_crdc, na.rm = TRUE)
rate_b <- sum(df_b[[discipline_var]], na.rm = TRUE) /
  sum(df_b$enrollment_crdc, na.rm = TRUE)

disparity <- rate_a / rate_b

Composition vs. Representation

  • Composition: What share of suspended students are Black?
  • Representation: Are Black students suspended at higher rates than enrollment share?

Risk Ratios

  • Compare discipline/outcome rates across groups
  • Adjust for school-level factors when appropriate

Related Data Sources

SourceRelationshipWhen to Use
education-data-source-ccdSchool/district characteristicsLinking CRDC to school demographics, locale, Title I status (join on ncessch or leaid)
education-data-source-edfactsAssessment outcomesComparing discipline patterns to academic outcomes
education-data-explorerParent discovery skillRouting questions to mirror CRDC dataset files and variables
education-data-queryData fetchingDownloading CRDC parquet/CSV files from mirrors
education-data-contextGeneral interpretationEducation data interpretation and citation generation

Topic Index

TopicReference File
Title VI (race)./references/civil-rights-context.md
Title IX (sex)./references/civil-rights-context.md
Section 504 (disability)./references/civil-rights-context.md
IDEA./references/civil-rights-context.md
OCR enforcement./references/civil-rights-context.md
Discipline data./references/data-elements.md
Restraint/seclusion./references/data-elements.md
Harassment./references/data-elements.md
Course access./references/data-elements.md
AP/IB/Gifted./references/data-elements.md
Chronic absenteeism./references/data-elements.md
Staffing./references/data-elements.md
Preschool./references/data-elements.md
Sampling approach./references/collection-methodology.md
Collection timeline./references/collection-methodology.md
Variable codes./references/variable-definitions.md
Suppression rules./references/data-quality.md
COVID impact./references/data-quality.md
Year changes./references/historical-changes.md
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 319kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 319kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 319kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 196kUpdated Claude CodeCodexVerifiedInstall