DAAF-Contribution-Community/daaf / .claude/skills/pyfixest
pyfixest
VerifiedFast high-dimensional fixed effects: OLS, Poisson, IV with multi-way FE; DiD (TWFE, did2s, Sun-Abraham); clustered SEs; etable/coefplot/iplot. Use for FE regressions or DiD. For panel RE/between use linearmodels; for GLM without FE use statsmodels. R equivalent: fixest (use when execution language is R).
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 16.4 KB |
| references/advanced-inference.md | markdown | 10.8 KB |
| references/difference-in-differences.md | markdown | 12.1 KB |
| references/fixed-effects.md | markdown | 10.6 KB |
| references/gotchas.md | markdown | 14.5 KB |
| references/instrumental-variables.md | markdown | 10.0 KB |
| references/integration.md | markdown | 13.6 KB |
| references/quickstart.md | markdown | 6.9 KB |
| references/tables-and-plots.md | markdown | 9.6 KB |
references/quickstart.md
View on GitHub# pyfixest Quickstart
## Contents
- [Installation](#installation)
- [Your First Regression](#your-first-regression)
- [Switching Standard Errors After Estimation](#switching-standard-errors-after-estimation)
- [Formula Syntax Overview](#formula-syntax-overview)
- [Quick Comparison: pyfixest vs statsmodels vs R fixest](#quick-comparison-pyfixest-vs-statsmodels-vs-r-fixest)
- [Using pyfixest with Polars DataFrames](#using-pyfixest-with-polars-dataframes)
## Installation
No installation needed in DAAF: `pyfixest` (0.60.0) is pre-installed in the
container, along with `wildboottest`, `marginaleffects`, `maketables` (the table
rendering backend since 0.50), and `great-tables` (which maketables uses to render
`etable(type="gt")` output; `great-tables` is pinned independently in DAAF's
Dockerfile). Since 0.60 the default FE demeaning backend is a compiled Rust
extension shipped in the wheel, so no numba JIT warm-up is needed for the default
path; `numba` is now an optional extra but is present transitively in the DAAF
image (transitively, e.g. via wildboottest), so `MapDemeaner(backend="numba")` and fast
randomization inference still work here. Runtime installs are blocked in DAAF
(`pip install`/`uv add` are refused both at the command line and inside executed
scripts — see CLAUDE.md § Runtime Package Installation). If an extra that is not
pre-installed (e.g., `pyfixest[jax]` for the JAX backend, or `lets-plot`) is
genuinely required, escalate to the user to add it to the Dockerfile (user
additions block near the end) and rebuild.
### Verify Installation
```python
import pyfixest as pf
print(pf.__version__) # DAAF ships 0.60.0
```
## Your First Regression
### Basic OLS (No Fixed Effects)
```python
import pyfixest as pf
import pandas as pd
# Load example data
data = pf.get_data()
# Simple OLS
fit = pf.feols("Y ~ X1 + X2", data=data)
fit.summary()
```
### OLS with Fixed Effects
```python
# One-way FE: absorb entity-level intercepts
fit = pf.feols("Y ~ X1 | f1", data=data)
fit.summary()
# Two-way FE: entity + time fixed effects
fit = pf.feols("Y ~ X1 | f1 + f2", data=data)
fit.summary()
```
### Reading the Summary Output
The `.summary()` output displays:
- **Dep. var.**: The outcome variable
- **Observations**: Sample size (after dropping singletons if applicable)
- **S.E. type**: Standard error type used (e.g., iid, hetero, CRV1)
- **Coefficient table**: Estimate, Std. Error, t value, Pr(>|t|), confidence interval
- **R2 / R2 Within / R2 Adj.**: Model fit statistics
- **Fixed effects info**: Number of levels absorbed for each FE
### Switching Standard Errors After Estimation
A key workflow pattern: estimate once, try different SE assumptions without re-estimating.
```python
fit = pf.feols("Y ~ X1 | f1", data=data)
# IID (default in v0.40+)
fit.summary()
# Heteroskedasticity-robust
fit.vcov("hetero").summary()
# Clustered by f1
fit.vcov({"CRV1": "f1"}).summary()
# Two-way clustered
fit.vcov({"CRV1": "f1+f2"}).summary()
```
This works because SE computation is independent of point estimation under OLS — changing the variance estimator only affects standard errors, not coefficients.
## Formula Syntax Overview
pyfixest uses a three-part formula separated by `|`:
```
depvar ~ exogenous_vars | fixed_effects | endogenous ~ instruments
```
### Part 1: Dependent Variable and Exogenous Regressors
```python
# Basic regressors
"Y ~ X1 + X2"
# Interaction with main effects
"Y ~ X1 * X2" # equivalent to X1 + X2 + X1:X2
# Interaction only (no main effects)
"Y ~ X1:X2"
# Categorical variable
"Y ~ C(state)"
# Transformations (via formulaic)
"Y ~ np.log(X1) + X2"
```
### Part 2: Fixed Effects (After First `|`)
```python
# One-way FE
"Y ~ X1 | entity"
# Two-way FE
"Y ~ X1 | entity + year"
# Three-way FE
"Y ~ X1 | entity + year + industry"
# Interacted FE (entity-by-year)
"Y ~ X1 | entity ^ year"
```
### Part 3: Instrumental Variables (After Second `|`)
```python
# IV: endogenous ~ instrument
"Y ~ X_exog | fe | X_endog ~ Z_instrument"
# IV with no FE (use 0 for empty FE)
"Y ~ X_exog | 0 | X_endog ~ Z1 + Z2"
# Multiple instruments
"Y ~ 1 | fe | X_endog ~ Z1 + Z2"
```
### The `i()` Operator for Interactions and Categoricals
```python
# Categorical with reference level
"Y ~ i(year, ref=2000) | entity"
# Numeric interaction with categorical
"Y ~ i(group, X1, ref='control')"
# Two categoricals interacted
"Y ~ i(race, gender, ref='white', ref2='male')"
# Binning levels
"Y ~ i(age, bin={'young': [18,19,20], 'old': [60,61,62]})"
```
`i()` is especially important for event study specifications — see `difference-in-differences.md`.
## Quick Comparison: pyfixest vs statsmodels vs R fixest
| Task | pyfixest | statsmodels | R fixest |
|------|----------|-------------|----------|
| OLS | `pf.feols("Y ~ X", data)` | `smf.ols("Y ~ X", data).fit()` | `feols(Y ~ X, data)` |
| OLS + FE | `pf.feols("Y ~ X \| fe", data)` | Manual dummies | `feols(Y ~ X \| fe, data)` |
| Clustered SE | `fit.vcov({"CRV1": "g"})` | `smf.ols("Y ~ X", data).fit(cov_type="cluster", cov_kwds={"groups": data["g"]}, use_t=True)` | `vcov = ~g` |
| Poisson + FE | `pf.fepois("Y ~ X \| fe", data)` | Not available with FE | `fepois(Y ~ X \| fe, data)` |
| IV + FE | `pf.feols("Y ~ 1 \| fe \| X ~ Z", data)` | `IV2SLS` (no FE) | `feols(Y ~ 1 \| fe \| X ~ Z, data)` |
| Regression table | `pf.etable([fit1, fit2])` | Manual construction | `etable(fit1, fit2)` |
pyfixest syntax is nearly identical to R fixest, making cross-language work straightforward.
## Using pyfixest with Polars DataFrames
DAAF pipelines use Polars for data processing (Stages 5-7), but pyfixest expects a **pandas DataFrame** as input. Convert before estimation:
```python
import polars as pl
import pyfixest as pf
# Load processed data (Polars DataFrame from earlier pipeline stages)
df_polars = pl.read_parquet("data/processed/analysis_data.parquet")
# Convert to pandas for pyfixest
df = df_polars.to_pandas()
# Now estimate
fit = pf.feols("Y ~ X1 + X2 | entity + year", data=df)
```
Post-estimation results (`.tidy()`, `.coef()`, etc.) return pandas objects. If you need to rejoin results with Polars data downstream, convert back with `pl.from_pandas()`.
pyfixest also accepts PyArrow-backed pandas DataFrames, but explicit `.to_pandas()` conversion is the most reliable approach.
## Next Steps
- Learn about fixed effects and standard error types → `fixed-effects.md`
- Set up instrumental variables → `instrumental-variables.md`
- Run difference-in-differences designs → `difference-in-differences.md`
- Create publication tables and plots → `tables-and-plots.md`
## References and Further Reading
- Bergé, L., Butts, K., and McDermott, G. (2026). "Fast and User-Friendly Econometrics Estimations: The R Package fixest." arXiv:2601.21749. https://arxiv.org/abs/2601.21749
- pyfixest documentation: https://pyfixest.org
- pyfixest GitHub: https://github.com/py-econometrics/pyfixest
- R fixest documentation: https://lrberge.github.io/fixest/
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 197k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |