Skip to content

richfrem/agent-plugins-skills / plugins/agent-orchestration/.apm/skills/evaluating-agent-outcomes

evaluating-agent-outcomes

Verified

Repository-independent evaluation of delegated agent work: assesses a delivery against a work contract (criterion-level pass/fail/unverified, failure conditions, budget, authorization), checks evidence validity, selects proportionate verification, measures cost with missing data kept unknown, classifies human interventions, and records and retrieves specific lessons. Use when orchestrating-agent-work needs findings after a worker returns, or to gate a benchmark before model calls. Not an orchestrator and never grants authority.

tests/fixtures/sanctuary-contribution-v1.json

View on GitHub
{
  "id": "sanctuary-contribution-v1",
  "description": "Project Sanctuary's five anchored contribution dimensions, each 0-3 (see evaluation-rubric.md). Headline fitness = raw sum / 15. Scores recorded before MISSION-055 keep exactly these meanings.",
  "fitness": "raw_fraction",
  "dimensions": {
    "useful_outcome": {"max": 3, "weight": 1},
    "learning_depth": {"max": 3, "weight": 1},
    "verification_rigor": {"max": 3, "weight": 1},
    "token_economy": {"max": 3, "weight": 1},
    "anti_asch_integrity": {"max": 3, "weight": 1}
  },
  "bloat": {
    "min_weight": 3.0,
    "low_dimensions": {"token_economy": 1, "useful_outcome": 1},
    "message": "CRITICAL: Expensive model '{model}' (weight {weight}x) produced bloated/low-value output without advancing core objectives."
  }
}
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall