Skip to content

borghei/Claude-Skills / engineering/agentic-evaluation-framework

agentic-evaluation-framework

Verified

Builds LLM and agent evals: weighted rubrics, LLM-as-judge design, inter-rater agreement and pairwise ranking (Elo, Bradley-Terry) from scores you collect. Use when setting up a judge, scoring outputs, or comparing model or prompt variants.

assets/sample_pairwise_matches.json

View on GitHub
{
  "variants": ["prompt-v1", "prompt-v2", "prompt-v3"],
  "matches": [
    {"a": "prompt-v1", "b": "prompt-v2", "winner": "prompt-v2"},
    {"a": "prompt-v2", "b": "prompt-v1", "winner": "prompt-v2"},
    {"a": "prompt-v1", "b": "prompt-v2", "winner": "tie"},
    {"a": "prompt-v1", "b": "prompt-v3", "winner": "prompt-v3"},
    {"a": "prompt-v3", "b": "prompt-v1", "winner": "prompt-v1"},
    {"a": "prompt-v2", "b": "prompt-v3", "winner": "prompt-v2"},
    {"a": "prompt-v3", "b": "prompt-v2", "winner": "prompt-v2"},
    {"a": "prompt-v2", "b": "prompt-v3", "winner": "prompt-v3"},
    {"a": "prompt-v1", "b": "prompt-v3", "winner": "prompt-v3"}
  ]
}
brainstormingobra/superpowersYou MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or planning anything new, in software or out of it (a talk, a business, a renovation).Stars: 322kUpdated Claude CodeCodexVerifiedInstall
brand-guidelinesanthropics/skillsApplies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply.Stars: 198kUpdated Claude CodeCodexVerifiedInstall
frontend-designanthropics/skillsGuidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults.Stars: 198kUpdated Claude CodeCodexVerifiedInstall
mcp-builderanthropics/skillsGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK).Stars: 198kUpdated Claude CodeCodexVerifiedInstall