Skip to content

DAAF-Contribution-Community/daaf / .claude/skills/education-data-source-eada

education-data-source-eada

Verified

EADA — college athletics gender equity (~2,000+ institutions, 2002-2021). Participation, coaching, salaries, expenses, revenues, athletic aid by gender. Not Title IX compliance data. No sector column; join IPEDS on unitid for institution type.

references/fetch-patterns.md

View on GitHub
# EADA Data Access

EADA data is fetched from mirrors via the `education-data-query` skill. All fetching uses `fetch_from_mirrors()` from `fetch-patterns.md`, with mirror configuration in `mirrors.yaml` and canonical paths in `datasets-reference.md`.

## Dataset Path

| Dataset | Path | Codebook |
|---------|------|----------|
| Institutional Characteristics | `eada/colleges_eada_inst_characteristics` | `eada/codebook_colleges_eada_inst-characteristics` |

> **EADA naming note:** The data path uses `inst_characteristics` (underscores) while the codebook path uses `inst-characteristics` (hyphens). Always use the exact paths from `datasets-reference.md`.

## Example Fetch

```python
import polars as pl

# Fetch EADA institutional data via unified mirror system
DATASET_PATH = "eada/colleges_eada_inst_characteristics"
df = fetch_from_mirrors(DATASET_PATH)

# Filter by year and state
df = df.filter(
    (pl.col("year") == 2021) &
    (pl.col("fips") == 6)  # California
)

print(f"Shape: {df.shape}")
print(f"Columns: {len(df.columns)}")
```

```r
library(arrow)
library(dplyr)

# fetch_from_mirrors() is a Python helper; in R, build the URL from the mirror
# root in mirrors.yaml and read directly.
# Mirror failover: see `education-data-query/references/fetch-patterns.md` (R pattern).
config <- yaml::read_yaml("mirrors.yaml")
mirror <- config$mirrors[[1]]
dataset_path <- "eada/colleges_eada_inst_characteristics"
url <- paste0(mirror$root_url, "/", mirror$vintage$hf_revision, "/", dataset_path, ".", mirror$format)
# NOTE: illustrative only — mirror parquet files are Polars-written and may
# declare string_view columns, so a plain read can fail under R arrow
# ("cannot handle Array of type <utf8_view>"). Real fetch scripts must use the
# view-safe parquet read from `education-data-query/references/fetch-patterns.md`.
df <- arrow::read_parquet(url)

# Filter by year and state
df <- df |> filter(
  year == 2021,
  fips == 6  # California
)

cat(sprintf("Shape: %d x %d\n", nrow(df), ncol(df)))
cat(sprintf("Columns: %d\n", ncol(df)))
```

## Available Years

2002-2021 (institutional characteristics). 165 columns, ~40,600 rows total.

## Key Columns

The Portal uses different column names than EADA source documentation. Key mappings:

| Category | Portal Columns |
|----------|---------------|
| Participation | `undup_athpartic_men`, `undup_athpartic_women`, `athpartic_men`, `athpartic_women` |
| Coaching | `men_fthdcoach_male`, `women_fthdcoach_fem`, `men_ftascoach_male`, etc. |
| Salaries | `hdcoach_salary_men`, `hdcoach_salary_women`, `ascoach_salary_men`, `ascoach_salary_women` |
| Expenses | `ath_exp_men`, `ath_exp_women`, `ath_opexp_perpart_men`, `ath_opexp_perpart_women` |
| Revenues | `ath_rev_men`, `ath_rev_women`, `ath_grnd_total_rev` |
| Student Aid | `ath_stuaid_men`, `ath_stuaid_women`, `ath_stuaid_total` |
| Recruiting | `recruitexp_men`, `recruitexp_women`, `recruitexp_total` |
| Enrollment | `enrollment_men`, `enrollment_women`, `enrollment_total` |
| Classification | `ath_classification_code`, `ath_classification_name` |

See `variable-definitions.md` for complete column documentation.

## Missing Values

EADA data uses **both** null values AND integer coded missing values (`-1`, `-2`, `-3`). The coded values are widespread -- many columns have hundreds of rows with `-1` (missing/not reported), `-2` (not applicable), or `-3` (suppressed). Coed-related columns have particularly high rates of `-1`/`-2` codes (~85% of rows) since most institutions do not have coed teams.

```python
import polars as pl

# Filter out BOTH nulls AND coded missing values
missing_codes = [-1, -2, -3]

valid = df.filter(
    pl.col("ath_exp_men").is_not_null() &
    ~pl.col("ath_exp_men").is_in(missing_codes)
)
```

```r
library(dplyr)

# Filter out BOTH nulls AND coded missing values
missing_codes <- c(-1, -2, -3)

valid <- df |> filter(
  !is.na(ath_exp_men),
  !(ath_exp_men %in% missing_codes)
)
```

## Codebook Access

```python
# Get the codebook URL for manual reference
codebook_url = get_codebook_url("eada/codebook_colleges_eada_inst-characteristics")
print(f"Codebook: {codebook_url}")
```

```r
# Get the codebook URL for manual reference.
# get_codebook_url() is a Python helper; in R, construct the codebook URL from
# the mirror root in mirrors.yaml (codebooks are .xls files co-located with data).
# Mirror failover: see `education-data-query/references/fetch-patterns.md` (R pattern).
config <- yaml::read_yaml("mirrors.yaml")
mirror <- config$mirrors[[1]]
codebook_url <- paste0(mirror$root_url, "/", mirror$vintage$hf_revision, "/", "eada/codebook_colleges_eada_inst-characteristics", ".xls")
cat(sprintf("Codebook: %s\n", codebook_url))
```

## Important Notes

- **No `sector` column:** EADA data does not include institutional sector. Join with IPEDS directory on `unitid` if sector filtering is needed.
- **Single-file dataset:** All years are in one file. Filter locally with `pl.col("year").is_in(years)` (Python) or `filter(year %in% years)` (R).
- **165 columns:** The dataset is wide. Use column selection to reduce memory usage for focused analyses.
- **Early years sparse:** Some columns are null for 2002 (e.g., `opeid`, `num_sports`, `_all` aggregates).
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 197kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall