Skip to content

brycewang-stanford/Auto-Empirical-Research-Skills / skills/17-DAAF-Contribution-Community-daaf/dot-claude/skills/education-data-context

education-data-context

Verified

Interpretation guidance for Urban Institute Portal datasets. Coded values (-1/-2/-3), year definitions, grade encoding, suppression, licensing, cross-source joins. Use when interpreting Portal data before analysis. Routes to source-specific skills.

references/ipeds-context.md

View on GitHub
# Integrated Postsecondary Education Data System (IPEDS) Context

IPEDS is the primary source for data on colleges, universities, and other postsecondary institutions in the United States. In this system, IPEDS data is accessed through the Urban Institute Education Data Portal, which standardizes variable names to lowercase, applies integer encoding to categorical variables, and provides a curated subset of the full IPEDS survey universe.

## Source Overview

| Attribute | Value |
|-----------|-------|
| Collector | National Center for Education Statistics (NCES) |
| Respondents | All Title IV participating institutions |
| Coverage | ~6,500 postsecondary institutions |
| Frequency | Annual (multiple survey components) |
| Available Years | 1980-present (varies by component) |
| Mandate | Required for Title IV participation |

### Survey Components

| Component | Collection Period | Content |
|-----------|------------------|---------|
| Institutional Characteristics | Fall | Basic institution info, tuition, fees |
| Fall Enrollment | Fall | Student counts by level, demographics |
| 12-Month Enrollment | Fall | Full academic year enrollment |
| Completions | Fall | Degrees/certificates awarded |
| Graduation Rates | Winter | Cohort completion outcomes |
| Student Financial Aid | Winter | Aid types, amounts, recipients |
| Finance | Spring | Revenues, expenditures, assets |
| Human Resources | Spring | Employees, salaries |
| Academic Libraries | Spring | Library resources (biennial) |

## Coverage

### What IPEDS Includes

- All institutions participating in Title IV federal student aid programs
- Public, private nonprofit, and for-profit institutions
- 2-year, 4-year, and less-than-2-year institutions
- Main campuses and branch campuses (separate UNITIDs)

### What IPEDS Excludes

| Excluded | Alternative |
|----------|-------------|
| Non-Title IV institutions | No comprehensive federal data |
| Some religious institutions | May self-exclude from aid programs |
| Non-degree vocational schools | Some included if Title IV |
| International students' home country institutions | N/A |

### Institutional Changes

Institutions can:
- **Change sector**: For-profit to nonprofit (common in recent years)
- **Merge**: Creates new UNITID for combined entity
- **Close**: Check institution status variables
- **Add/drop branches**: Each branch may have separate UNITID

## Graduation Rate Caveats

**CRITICAL**: IPEDS graduation rates have significant limitations that are often misunderstood.

### Who Is Tracked

IPEDS graduation rates track ONLY:
- **First-time students**: Never attended college before
- **Full-time students**: Enrolled full-time in their first term
- **Degree/certificate seeking**: Enrolled in a program
- **Started in fall term**: No spring, summer, or mid-year starts

### Who Is NOT Tracked

| Excluded Group | Size of Gap |
|----------------|-------------|
| Transfer students | ~40% of undergraduates |
| Part-time students | ~40% of undergraduates |
| Spring/summer starts | Varies by institution type |
| Returning adults | Large at community colleges |
| Students who transfer OUT | Not counted as completers |

### What This Means

For many institutions, especially community colleges:
- IPEDS graduation rate may represent <25% of students
- Students who transfer to complete elsewhere count as non-completers
- Part-time students (majority at many schools) are invisible

### Transfer-Out Rates

IPEDS reports transfer-out rates separately:
- Students known to have transferred to another institution
- Does NOT track whether they completed at new institution
- Transfer-out ≠ failure to complete higher education

### Time to Completion

| Institution Type | "On Time" | 150% Time | 200% Time |
|-----------------|-----------|-----------|-----------|
| 4-year | 4 years | 6 years | 8 years |
| 2-year | 2 years | 3 years | 4 years |
| Less-than-2-year | <2 years | Varies | Varies |

Most reported rates use 150% time (6 years for 4-year schools).

### Calculating a More Complete Picture

```python
# IPEDS grad rate alone is incomplete
ipeds_grad_rate = completers_150pct / first_time_full_time_cohort

# Consider also examining:
# - Transfer-out rate
# - 200% graduation rate
# - Pell recipient graduation rate (for equity)
# - Part-time student outcomes (from Scorecard if available)
```

## Enrollment Data

### Fall Enrollment vs. 12-Month Enrollment

| Metric | Fall Enrollment | 12-Month Enrollment |
|--------|-----------------|---------------------|
| Timing | Point-in-time (fall census) | Full academic year |
| Use case | Comparing institution size | Unduplicated headcount |
| FTE calculation | Fall only | Full year |

### Full-Time Equivalent (FTE)

FTE calculations differ by sector:
- **Public**: May use state-specific definitions
- **Private**: Generally federal definition
- **For-profit**: Program-based calculations

**Do not directly compare FTE across sectors without understanding methodology.**

### Enrollment Categories

| Category | Definition |
|----------|------------|
| First-time | Never attended any college |
| Transfer-in | Previously attended another institution |
| Continuing | Enrolled in prior year at same institution |
| Returning | Previously enrolled, skipped time |
| Graduate | Enrolled in master's, doctoral, professional |

## Finance Data

### GASB vs. FASB Accounting

**CRITICAL**: Public and private institutions use different accounting standards.

| Standard | Institution Type | Key Differences |
|----------|-----------------|-----------------|
| GASB | Public | Government accounting rules |
| FASB | Private nonprofit | Business accounting rules |
| FASB | Private for-profit | Business accounting rules |

**Implications:**
- Revenue and expense categories differ
- Direct comparisons across sectors are problematic
- Within-sector comparisons are valid

### Finance Categories

| Category | Public (GASB) | Private (FASB) |
|----------|---------------|----------------|
| Tuition revenue | Tuition and fees | Tuition and fees |
| State appropriations | Operating or non-operating | Not applicable |
| Federal grants | By source | By purpose |
| Endowment | Complex treatment | Net assets |

### Finance Data Lag

Finance data typically has a 1-2 year lag:
- Institutions report after fiscal year close
- Audited figures may be delayed
- Most recent year often incomplete

## Student Financial Aid

### Key Distinctions

| Population | Definition | Use |
|------------|------------|-----|
| First-time full-time | New students, full load | Comparable across institutions |
| All undergraduates | Everyone | Larger but heterogeneous |
| Full-time undergrads | Full load only | Middle ground |

### Net Price

Net price = Cost of attendance - Grant aid received

Reported by income bracket:
- $0-$30,000
- $30,001-$48,000
- $48,001-$75,000
- $75,001-$110,000
- $110,001+

**Caveats:**
- Based on first-time full-time students receiving aid
- Excludes students not receiving any Title IV aid
- Institutional aid varies significantly

### Aid Types

| Type | What It Includes |
|------|------------------|
| Federal grants | Pell, SEOG, other federal |
| State/local grants | State need-based, merit, etc. |
| Institutional grants | School-funded scholarships |
| Federal loans | Subsidized, unsubsidized, PLUS |

## Institutional Identifiers

### UNITID

- **Unique identifier** for each IPEDS reporting unit
- Assigned by NCES
- Generally one per campus
- Changes when: institution merges, closes/reopens, significant restructuring

### OPEID

- **Office of Postsecondary Education ID**
- Used for Title IV administration
- One OPEID may cover multiple UNITIDs (main + branches)

### OPEID6

- First 6 digits of OPEID
- Identifies institution family (main campus)
- 8-digit OPEID adds branch suffix

### Linking IPEDS to Other Data

```python
# IPEDS to Scorecard: both use UNITID
ipeds_data = fetch("college-university/ipeds/directory/2020")
scorecard_data = fetch("college-university/scorecard/earnings/2014")
merged = ipeds_data.join(scorecard_data, on="unitid", how="left")

# Note: Not all institutions in both sources
# Check for nulls after merge
```

## Cohort Timing

Understanding when data refers to:

| Data Type | Year Field Meaning |
|-----------|-------------------|
| Institutional characteristics | As of fall of indicated year |
| Fall enrollment | As of fall census date |
| Completions | Awarded during indicated academic year |
| Graduation rates | **Cohort entered** in indicated year (outcomes measured later) |
| Student financial aid | For indicated academic year |
| Finance | Fiscal year ending in indicated year |

### Graduation Rate Timing Example

For `year=2015` graduation rate data:
- Cohort entered in fall 2015
- 150% completion measured in 2021 (4-year) or 2018 (2-year)
- Data released ~2022

## Common Analysis Mistakes

### Do Not:

1. **Use IPEDS grad rates as institutional quality measure**
   - Affected by student population, not just institution

2. **Compare grad rates across institution types**
   - Community colleges have different student populations

3. **Compare finance data across sectors**
   - GASB vs. FASB not directly comparable

4. **Assume net price is what students pay**
   - Based on aid recipients only; full-pay students excluded

5. **Use IPEDS to track transfer student outcomes**
   - Transfers counted as non-completers at origin

### Do:

1. **Compare within sector** (4-year public to 4-year public)
2. **Use cohort-appropriate benchmarks**
3. **Supplement with Scorecard** for outcomes of non-traditional students
4. **Note IPEDS limitations** in any analysis
5. **Check institutional status** before including (closed, merged, etc.)

## Data Quality Checks

```python
def ipeds_quality_check(df, institution_type="4-year"):
    checks = []
    
    # Check for plausible graduation rates
    if "graduation_rate_150" in df.columns:
        implausible = df.filter(
            (pl.col("graduation_rate_150") > 100) | 
            (pl.col("graduation_rate_150") < 0)
        )
        if implausible.height > 0:
            checks.append(f"Implausible grad rates: {implausible.height}")
    
    # Check enrollment consistency
    if all(c in df.columns for c in ["enrollment_ft", "enrollment_pt", "enrollment_total"]):
        inconsistent = df.filter(
            pl.col("enrollment_ft") + pl.col("enrollment_pt") != pl.col("enrollment_total")
        )
        if inconsistent.height > 0:
            checks.append(f"Enrollment inconsistencies: {inconsistent.height}")
    
    return checks
```

## Related Data Sources

| Source | Use When |
|--------|----------|
| College Scorecard | Need outcomes for non-traditional students |
| NSLDS | Need federal loan-level data |
| Census | Need local area demographics |
| BLS | Need labor market outcomes by field |
| State systems | Need state-specific details |

## Quick Reference Card

| Task | Guidance |
|------|----------|
| Comparing graduation rates | Within-sector only; note population limits |
| Analyzing finance | Keep GASB/FASB separate |
| Using net price | Note income bracket; aid recipients only |
| Linking institutions | Use UNITID; check OPEID for branches |
| Time series | Check for institutional changes, mergers |
| Understanding enrollment | Note FT vs. PT, fall vs. 12-month |
| Cohort graduation data | Year = cohort entry, not completion |
| Transfer analysis | IPEDS doesn't track transfer outcomes |
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 323kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 323kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 323kUpdated Claude CodeCodexVerifiedInstall