baneeishaque/ljt-520_openclaw-backup / skills/0x-professor/ml-model-eval-benchmark
ml-model-eval-benchmark
VerifiedCompare model candidates using weighted metrics and deterministic ranking outputs. Use for benchmark leaderboards and model promotion decisions.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 817 B |
| _meta.json | config | 304 B |
| agents/openai.yaml | config | 214 B |
| references/benchmarking-guide.md | markdown | 475 B |
| scripts/benchmark_models.py | script | 3.7 KB |
SKILL.md
View on GitHub---
name: ml-model-eval-benchmark
description: Compare model candidates using weighted metrics and deterministic ranking outputs. Use for benchmark leaderboards and model promotion decisions.
---
# ML Model Eval Benchmark
## Overview
Produce consistent model ranking outputs from metric-weighted evaluation inputs.
## Workflow
1. Define metric weights and accepted metric ranges.
2. Ingest model metrics for each candidate.
3. Compute weighted score and ranking.
4. Export leaderboard and promotion recommendation.
## Use Bundled Resources
- Run `scripts/benchmark_models.py` to generate benchmark outputs.
- Read `references/benchmarking-guide.md` for weighting and tie-break guidance.
## Guardrails
- Keep metric names and scales consistent across candidates.
- Record weighting assumptions in the output.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |