NetFabric/NetFabric.Numerics / .agents/skills/model-selection
model-selection
VerifiedChoose and tune which AI model a custom agent, subagent, or squad node should use. USE FOR: picking a model by task capability tier (general-purpose coding/writing, fast/cheap, deep reasoning/debugging, multimodal); efficiency-first vs. capability-first starting strategies; tuning an effort/reasoning-effort parameter instead of switching models; call cadence vs. provider prompt-cache TTL; cost-tier ranking and cost ceilings; cross-provider or cross-model-family diversity for independent/adversarial review; per-harness model field syntax and resolution order (GitHub Copilot CLI, Claude Code, VS Code custom agents); extending this framework to a new harness. DO NOT USE FOR: authoring the rest of an agent's frontmatter or prompt body (use copilot-cli-custom-agents, claude-code-custom-agents, or the target harness's own skill); designing squad topology (use agent-graph-orchestration); SKILL.md authoring (use create-skill).
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 4.4 KB |
| references/cache-and-cost.md | markdown | 4.0 KB |
| references/harness-mapping.md | markdown | 3.2 KB |
| references/selection-criteria.md | markdown | 4.1 KB |
references/selection-criteria.md
View on GitHub# Selection Criteria
## Task-based capability tiers
Providers group their models into task-oriented tiers rather than a single quality ranking — pick by what the agent actually does, not by "the newest model." The four tiers below recur across every major provider's own model-comparison guidance (verified against GitHub Copilot's and Anthropic's current docs at time of writing):
| Tier | Use when the agent's task is... | Typical traits |
| --- | --- | --- |
| General-purpose coding/writing | Writing or reviewing functions, short files, diffs; generating docs/comments/summaries; explaining errors | Balanced quality, speed, and cost — the default when nothing below applies |
| Fast/cheap | Small utility functions, quick syntax questions, prototyping, repetitive edits, high-volume simple lookups | Lowest latency and cost tier; accept a shallower reasoning depth |
| Deep reasoning/debugging | Multi-file debugging, large refactors, architecture/design tradeoffs, analyzing logs or performance data | Highest capability tier; highest cost and often highest latency |
| Multimodal/visual | Diagrams, screenshots, UI components, visual QA | Requires a model that accepts image input — a capability, not just a tier |
An agent scoped narrowly (see the harness's own agent-authoring skill for scoping guidance) usually maps cleanly to one tier. An agent with a broad, mixed workload may need the deep-reasoning tier even if most of its individual calls are simple, since the occasional hard case sets the floor.
## Two starting strategies
Anthropic's own model-selection guidance frames the starting choice as one of two strategies; the same logic applies across providers:
| Strategy | Approach | Best for |
| --- | --- | --- |
| Efficiency-first | Start on the fast/cheap tier, test the actual use case, upgrade only if evals show a real capability gap | Prototyping, tight latency budgets, cost-sensitive or high-volume agents |
| Capability-first | Start on the deep-reasoning tier, then optimize down (lower effort, cheaper model) once the task is well understood | Complex reasoning, advanced agentic/coding work, tasks where correctness outweighs cost |
Neither strategy is universally correct — pick based on how well-understood the task is and how expensive a wrong answer would be.
## Prefer tuning effort over switching models
Several current model families expose an effort/reasoning-effort parameter that trades intelligence for latency and cost *within the same model*, independent of the harness's own `model:` field:
- This is usually a cheaper, faster lever than swapping to a different model entirely, since it keeps the same weights, training, and (often) prompt cache.
- Start at a model's documented default effort level; step up only for the hardest tasks in the agent's workload and down only once evals confirm quality holds.
- Exact field name and accepted values are harness/model-specific (e.g. a `reasoning-effort` frontmatter field on one harness, an `effort` field on another) → [harness-mapping.md](harness-mapping.md).
## Benchmark before upgrading or downgrading
Don't change an agent's model on intuition alone:
1. Build a small evaluation set specific to this agent's actual task (not a generic benchmark).
2. Run the candidate model(s) against it and compare accuracy, response quality, and edge-case handling.
3. Weigh the measured quality difference against the cost/latency difference before committing to a change.
## Verify against live docs
Model names, tiers, and pricing rotate every few months — a name that was current when a skill or design doc was written can be retired by the time it's read. Before finalizing a `model:` value:
- Check the target provider's current model list/comparison docs (e.g. the harness's own vendor's published model catalog) rather than relying on a memorized or previously-seen name.
- Treat any specific model name in this skill's own examples, or in any other skill's examples, as illustrative only, not as a guarantee that name is still offered.
- If a chosen model has a published retirement date, prefer its listed successor instead of the retiring name.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| brainstormingobra/superpowersYou MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or planning anything new, in software or out of it (a talk, a business, a renovation). | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| brand-guidelinesanthropics/skillsApplies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| frontend-designanthropics/skillsGuidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| mcp-builderanthropics/skillsGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK). | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |