Skip to content

diegosouzapw/awesome-omni-skill / skills/ai-agents/agent-evals

agent-evals

Verified

Design and implement evaluation frameworks for AI agents. Use when testing agent reasoning quality, building graders, doing error analysis, or establishing regression protection. Framework-agnostic concepts that apply to any SDK.

FileKindSize
SKILL.mdskill md12.6 KB
metadata.jsonconfig1.5 KB

metadata.json

View on GitHub
{
  "name": "agent-evals",
  "description": "Design and implement evaluation frameworks for AI agents. Use when testing agent reasoning quality, building graders, doing error analysis, or establishing regression protection. Framework-agnostic concepts that apply to any SDK.",
  "category": "ai-agents",
  "canonical_category": "ai-agents",
  "repository": "majiayu000/claude-skill-registry",
  "repository_url": "https://github.com/majiayu000/claude-skill-registry",
  "author": "majiayu000",
  "author_avatar": "https://github.com/majiayu000.png",
  "file_path": "skills/data/agent-evals/SKILL.md",
  "source": "github_curated_repos",
  "stars": 95,
  "quality_score": 77,
  "best_practices_score": 65,
  "skill_level": 3,
  "skill_level_label": "resources",
  "has_scripts": true,
  "has_extra_files": false,
  "downloads": 0,
  "content_hash": "f2c3d6adfcf1abd183bd92231053dd573b584c7f36aa87ff67130f0ae707b841",
  "indexed_at": "2026-03-01T01:04:40.418Z",
  "synced_at": "2026-03-01T06:20:30.199Z",
  "omni_registry_url": "https://omni-skill-registry.omniroute.online/#/skill/ec8a38bc63d4a90a0b4b4b664a27546383c0f5da2c8e9ca49ab00d20ce5d0a27",
  "install_command": "mkdir -p .claude/skills/agent-evals && curl -sL \"https://raw.githubusercontent.com/majiayu000/claude-skill-registry/main/skills/data/agent-evals/SKILL.md\" > .claude/skills/agent-evals/SKILL.md",
  "raw_url": "https://raw.githubusercontent.com/majiayu000/claude-skill-registry/main/skills/data/agent-evals/SKILL.md"
}
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 322kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 322kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 322kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 198kUpdated Claude CodeCodexVerifiedInstall