pedrohcgs/claude-code-my-workflow / .claude/skills/challenge
challenge
VerifiedStress-test a finding against the choices you did not make. Enumerates the discrete forks a competent analyst could have taken (measure definition, sample filter, control set, clustering level, weighting, functional form), runs the specification grid, and reports the distribution rather than a point estimate — then attacks the identifying assumption with named, computable sensitivity statistics. Use when the user says "is this robust", "challenge this result", "specification curve", "multiverse", "how sensitive is this", "what if I'd used a different measure", "stress-test my estimate", or before a result becomes a headline claim. NOT a reviewer of prose or code — it challenges the CLAIM.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 7.6 KB |
| evals/marker.txt | markdown | 93 B |
| references/fork-catalog.md | markdown | 2.0 KB |
| references/sensitivity-statistics.md | markdown | 2.8 KB |
references/sensitivity-statistics.md
View on GitHub# Named sensitivity statistics — turning "challenge the assumption" into a number
An identifying assumption cannot be tested. It can be **bounded**. Each statistic below answers
a specific question, has a defensible reference implementation, and should be reported with the
benchmark that makes it interpretable — a robustness value with no comparison is decoration.
**Never reimplement these.** Drive the canonical package. A hand-rolled sensitivity statistic
is an unqualified check.
---
## Unobserved confounding
### E-value
**Question:** how strong would an unmeasured confounder's associations with both treatment and
outcome have to be, on the risk-ratio scale, to explain away the estimate?
**Report:** the E-value for the point estimate **and** for the CI limit nearest the null. The
second is the one that matters — an E-value of 2.1 with a CI-limit E-value of 1.02 is fragile.
**Implementation:** closed form; `EValue` (R).
**Watch:** defined on the risk-ratio scale. Converting a linear-model coefficient requires an
approximation — state which one.
### Cinelli–Hazlett robustness value (RV)
**Question:** what share of residual variance in both treatment and outcome would a confounder
need to explain to bring the estimate to zero (or past a threshold)?
**Report:** `RV_{q=1}`, and the **benchmark** — the RV expressed as a multiple of an observed
covariate's strength ("a confounder 3.2× as strong as region fixed effects").
**Implementation:** `sensemakr` (R), closed form from a t-value and residual df.
**Watch:** RV is about *linear* confounding in the estimated model. It says nothing about
functional-form error.
### Oster δ
**Question:** how large must selection on unobservables be, relative to selection on
observables, to drive the coefficient to zero?
**Report:** δ **with the assumed `R²max`** — δ is meaningless without it. State the rule used —
commonly `R²max = min(1.3 × R̃², 1)`, with Oster's cap, since an R²max above 1 is impossible —
and show sensitivity to it.
**Implementation:** `psacalc` (Stata), `robomit` (R).
**Watch:** assumes proportional selection. Widely reported, frequently reported without its
`R²max`, which makes it uninterpretable.
---
> **Design-specific sections are deliberately absent** for the causal-identification designs
> (unvetted-methods veto): populate them from your field's canonical sources after vetting.
---
## Reporting contract
For each statistic report: **the value**, **the benchmark that makes it interpretable**,
**the implementation and version**, and whether it was `executable-here` or
`describe-and-cite`.
A sensitivity analysis that reports only favourable statistics is not a sensitivity analysis.
If a bound is uncomfortably tight, that is the finding — the strongest sentence in a robustness
section is usually the one that retires the author's own preferred interpretation.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |