diegosouzapw/awesome-omni-skill / skills/ai-agents/agent-evaluator
agent-evaluator
VerifiedDeterministic custom subagent selection helper. Use when you need a reproducible, auditable decision on which custom subagents to activate for a user query (runs scripts/agent_evaluator.py).
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 1.2 KB |
| metadata.json | config | 1.4 KB |
SKILL.md
View on GitHub---
name: agent-evaluator
description: Deterministic custom subagent selection helper. Use when you need a reproducible, auditable decision on which custom subagents to activate for a user query (runs scripts/agent_evaluator.py).
---
# Agent Evaluator
Evaluate a user query against the workspace's available subagents and return a JSON decision payload (activated/required/suggested agents and scoring).
## Mechanism
Run the evaluator script (located in scripts folder relative this skill file) with the user query as an argument.:
```shell
python scripts/agent_evaluator.py "YOUR_QUERY_HERE"
```
Optional: include a contextual file path as the second argument:
```shell
python scripts/agent_evaluator.py "YOUR_QUERY_HERE" "path/to/file.ext"
```
## Output
- Writes a JSON object to stdout.
- Key fields include:
- `activated_agents`
- `required_agents`
- `suggested_agents`
- `evaluations` (per-agent score + reasoning)
## Examples
Evaluate a query:
```shell
python scripts/agent_evaluator.py "Please help refine our custom instruction file"
```
Evaluate a query with file context:
```shell
python scripts/agent_evaluator.py "Update this instruction" "instructions/agent-forced-eval.instructions.md"
```
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |