dvy1987/agent-loom / .agents/skills/eval-pipeline
eval-pipeline
VerifiedDesign automated evaluation pipelines for LLM and agent systems — combining deterministic checks, statistical metrics, and LLM-as-judge scoring into repeatable, CI-integrated eval suites. Load when the user asks to set up automated evals, design an eval pipeline, integrate evals into CI/CD, create an eval suite, do eval-driven development, or says "automate my evals", "CI eval integration", "evaluation pipeline", "continuous evaluation", "monitoring eval quality", "set up regression testing for my agent". Sub-skill of eval-output orchestrator.
| File | Kind | Size |
|---|---|---|
| README.md | markdown | 625 B |
| SKILL.md | skill md | 11.0 KB |
| references/examples.md | markdown | 2.2 KB |
| references/harness-regression.md | markdown | 2.2 KB |
README.md
View on GitHub# eval-pipeline
> Design automated evaluation pipelines for LLM and agent systems — deterministic checks, statistical metrics, and LLM-as-judge scoring with CI/CD integration.
## Install
```bash
npx skills eval-pipeline -a codex # Codex
npx skills eval-pipeline -a replit # Replit
cp -r eval-pipeline/ .agents/skills/ # Universal
```
## Usage
Trigger: "set up automated evals", "design an eval pipeline", "CI eval integration", "eval-driven development"
## Platforms
Works with: Codex, Ampcode, Claude Code, Warp, Gemini CLI, GitHub Copilot, Cursor, VS Code, Replit, Factory.ai, Bolt.new
## License
MIT
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |