Skip to content

brycewang-stanford/Auto-Empirical-Research-Skills / skills/33-Galaxy-Dawn-claude-scholar/skills/results-analysis

results-analysis

Verified

This skill should be used when the user asks to "analyze experimental results", "run strict statistical analysis", "compare model performance", "generate scientific figures", "check significance", "do ablation analysis", or mentions interpreting experiment data with rigorous statistics and visualization. It focuses on strict analysis bundles, not Results-section prose.

examples/example-stats-appendix.md

View on GitHub
# Statistical Appendix

## Primary Metric
- Word Error Rate (WER), lower is better.

## Sample Structure
- Unit of analysis: seed-level run, paired by shared data split and subject pool.
- Number of seeds per condition: 5.

## Descriptive Statistics

| Condition | Mean WER | Std | 95% CI |
|---|---:|---:|---:|
| Full fine-tuning | 31.4 | 1.9 | [29.8, 33.0] |
| Subject Adapter | 33.2 | 1.3 | [32.1, 34.3] |
| Frozen Encoder | 37.0 | 2.1 | [35.1, 38.9] |

## Assumption Checks
- Shapiro-Wilk on paired differences: `p = 0.19`
- No strong evidence against normality for the primary contrast.
- Given small n, interpretation remains conservative.

## Inferential Tests

| Contrast | Test | Statistic | p | Effect size | Correction |
|---|---|---|---:|---:|---|
| Subject Adapter vs Frozen Encoder | paired t-test | `t(4) = -4.11` | 0.014 | Cohen's `d = 1.84` | Holm |
| Full fine-tuning vs Subject Adapter | paired t-test | `t(4) = -2.03` | 0.112 | Cohen's `d = 0.91` | Holm |

## Interpretation Guardrails
- First contrast is supported after correction.
- Second contrast trends in favor of full fine-tuning but is not conclusive at this sample size.

## Blockers / Limits
- No subject-level bootstrap yet.
- No calibration analysis available.
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall