Skip to content

notque/vexjoy-agent / skills/meta/toolkit

toolkit

Verified

Toolkit management: create and evaluate skills and agents, manage routing tables, generate Claude.md.

FileKindSize
SKILL.mdskill md15.5 KB
agents/skill-creator/analyzer.mdmarkdown4.8 KB
agents/skill-creator/comparator.mdmarkdown4.7 KB
agents/skill-creator/grader.mdmarkdown3.9 KB
assets/skill-creator/eval_viewer.htmlother57.1 KB
references/agent-comparison.mdmarkdown11.5 KB
references/agent-comparison/benchmark-tasks.mdmarkdown6.8 KB
references/agent-comparison/do-creation-compliance-tasks.jsonconfig8.5 KB
references/agent-comparison/examples-and-errors.mdmarkdown1.0 KB
references/agent-comparison/grading-rubric.mdmarkdown4.3 KB
references/agent-comparison/methodology.mdmarkdown7.4 KB
references/agent-comparison/optimization-guide.mdmarkdown12.0 KB
references/agent-comparison/optimization-tasks.example.jsonconfig853 B
references/agent-comparison/optimize-phase.mdmarkdown9.3 KB
references/agent-comparison/read-only-ops-short-tasks.jsonconfig375 B
references/agent-comparison/report-template.mdmarkdown3.8 KB
references/agent-comparison/socratic-debugging-body-short-tasks.jsonconfig372 B
references/agent-comparison/socratic-debugging-trigger-tasks.jsonconfig2.8 KB
references/agent-creator.mdmarkdown10.9 KB
references/agent-creator/agent-design-patterns.mdmarkdown12.4 KB
references/agent-creator/agent-eval-design.mdmarkdown7.7 KB
references/agent-creator/agent-frontmatter-template.mdmarkdown9.3 KB
references/agent-evaluation.mdmarkdown10.6 KB
references/agent-evaluation/batch-evaluation.mdmarkdown1.6 KB
references/agent-evaluation/common-issues.mdmarkdown2.1 KB
references/agent-evaluation/report-templates.mdmarkdown2.2 KB
references/agent-evaluation/scoring-rubric.mdmarkdown2.4 KB
references/blind-ab-tests.mdmarkdown7.8 KB
references/generate-claudemd.mdmarkdown11.0 KB
references/generate-claudemd/CLAUDEMD_TEMPLATE.mdmarkdown4.1 KB
references/generate-claudemd/examples-and-errors.mdmarkdown7.4 KB
references/github-profile-rules.mdmarkdown7.5 KB
references/github-profile-rules/github-api-patterns.mdmarkdown8.2 KB
references/github-profile-rules/rule-categories.mdmarkdown4.8 KB
references/hook-development.mdmarkdown10.9 KB
references/hook-development/architecture.mdmarkdown3.7 KB
references/hook-development/code-examples.mdmarkdown9.4 KB
references/hook-development/preferred-patterns.mdmarkdown6.5 KB
references/hook-development/telemetry-database.mdmarkdown6.5 KB
references/routing-table-updater.mdmarkdown10.2 KB
references/routing-table-updater/batch-mode.mdmarkdown2.1 KB
references/routing-table-updater/conflict-resolution.mdmarkdown3.8 KB
references/routing-table-updater/error-handling.mdmarkdown1.9 KB
references/routing-table-updater/examples.mdmarkdown4.8 KB
references/routing-table-updater/extraction-patterns.mdmarkdown2.2 KB
references/routing-table-updater/routing-format.mdmarkdown3.6 KB
references/routing-table-updater/skill-examples.mdmarkdown2.7 KB
references/skill-composer.mdmarkdown9.1 KB
references/skill-composer/compatibility-matrix.mdmarkdown13.0 KB
references/skill-composer/composition-patterns.mdmarkdown4.9 KB
references/skill-composer/examples.mdmarkdown17.1 KB
references/skill-composer/skill-patterns.mdmarkdown12.5 KB
references/skill-creator.mdmarkdown28.9 KB
references/skill-creator/agent-template.mdmarkdown18.5 KB
references/skill-creator/artifact-schemas.mdmarkdown8.2 KB
references/skill-creator/bundled-components.mdmarkdown2.3 KB
references/skill-creator/complexity-tiers.mdmarkdown8.0 KB
references/skill-creator/domain-research-targets.mdmarkdown13.2 KB
references/skill-creator/enrichment-workflow.mdmarkdown9.9 KB
references/skill-creator/error-catalog.mdmarkdown9.9 KB
references/skill-creator/preferred-patterns.mdmarkdown11.7 KB
references/skill-creator/progressive-disclosure.mdmarkdown8.5 KB
references/skill-creator/skill-template.mdmarkdown14.6 KB
references/skill-creator/workflow-patterns.mdmarkdown7.6 KB
references/system-upgrade.mdmarkdown11.0 KB
references/system-upgrade/component-audit-checklists.mdmarkdown8.4 KB
references/system-upgrade/upgrade-failure-modes.mdmarkdown8.7 KB
references/system-upgrade/upgrade-signal-parsing.mdmarkdown7.3 KB
references/toolkit-evolution.mdmarkdown14.5 KB
references/toolkit-evolution/diagnose-scripts.mdmarkdown9.5 KB
references/toolkit-evolution/evolution-history.mdmarkdown5.5 KB
references/toolkit-evolution/evolution-report-template.mdmarkdown716 B
references/toolkit-evolution/evolve-preferred-patterns.mdmarkdown6.9 KB
references/toolkit-evolution/evolve-scripts.mdmarkdown3.7 KB
references/toolkit-governance.mdmarkdown16.0 KB
references/toolkit-governance/adr-lifecycle.mdmarkdown10.9 KB
references/toolkit-governance/frontmatter-compliance.mdmarkdown11.1 KB
references/toolkit-governance/hook-standardization.mdmarkdown21.5 KB
references/toolkit-governance/routing-table-patterns.mdmarkdown11.6 KB
references/weak-model-uplift.mdmarkdown10.3 KB
scripts/agent-comparison/compare.pyscript2.3 KB
scripts/agent-comparison/generate_variant.pyscript19.6 KB
scripts/agent-comparison/optimize_loop.pyscript89.3 KB
scripts/agent-comparison/trigger_eval.pyscript19.5 KB
scripts/routing-table-updater/extract_metadata.pyscript10.8 KB
scripts/routing-table-updater/generate_routes.pyscript10.5 KB
scripts/routing-table-updater/scan.pyscript4.7 KB
scripts/routing-table-updater/update_routing.pyscript12.4 KB
scripts/routing-table-updater/validate.pyscript7.3 KB
scripts/skill-composer/build_dag.pyscript12.5 KB
scripts/skill-composer/discover_skills.pyscript12.1 KB
scripts/skill-composer/validate.pyscript12.3 KB
scripts/skill-creator/aggregate_benchmark.pyscript10.0 KB
scripts/skill-creator/eval_compare.pyscript10.2 KB
scripts/skill-creator/optimize_description.pyscript12.5 KB
scripts/skill-creator/package_results.pyscript7.8 KB
scripts/skill-creator/run_eval.pyscript6.3 KB

references/toolkit-evolution/evolution-history.md

View on GitHub
# Evolution History -- Proposal Ledger and Distilled Lessons

> **Scope**: Distilled outcomes from evolution cycles 2026-05-09 through 2026-05-15. Prevents re-proposing failed ideas and preserves the decision criteria they produced. Load this reference during Phase 1 DIAGNOSE (Step 5: check prior outcomes) and Phase 2 PROPOSE (dedup against history).

---

## Distilled Lessons (from failed/shelved proposals)

These are the reusable decision criteria extracted from proposal evaluations. Each was validated by 3-persona critique.

| Lesson | Source | Score |
|--------|--------|-------|
| Skills need active routing triggers to receive traffic; CLAUDE.md guardrails and existing skills cover deployment decisions | execution-risk-manager (WEAK 1.33) |
| Skills need an existing workflow to attach to; unused skills have no adoption path | incident-postmortem-engine (WEAK 1.33) |
| Optimization skills need concrete cost evidence; "might save money" is not justification | prompt-optimization-lab (WEAK 1.0) |
| Timeout investigation needs a reproduction case before logging is the right lever | hook-timeouts-investigation (MODERATE 2.0) |
| Pure doc fixes score low in critique; bundle them with functional fixes in the same PR | fix-routing-guide-dead-ref (MODERATE 1.67) |
| Investigate hook logic before proposing cleanup; stale by date is not stale by reference | cleanup-adr-session-json (WEAK 1.0) |
| Premature documentation of unimplemented systems is derivative, not authoritative; defer until implementation exists | sprite-pipeline-phase1-reference (WEAK 1.33) |
| Improving an existing mechanism beats adding new ones; one-line quality fixes can be the unanimous outlier | hook-solution-field (STRONG 9/9, PR #644) |
| Advisory hooks must not mutate git state; sync enforcement belongs at the commit/push boundary (PreToolUse gate) not the write boundary (PostToolUse side-effect) | hook-auto-stage-index (WEAK 1.33) |
| Before padding triggers to pass a threshold, check whether the threshold itself is wrong for narrow-scope agent helpers | boost-undertriggered-entries (MODERATE 1.67) |

---

## Shelved Proposals -- Reactivation Conditions

Proposals shelved with explicit conditions for re-proposal. Check these before re-proposing the same idea.

| Proposal | Score | Condition for Reactivation |
|----------|-------|---------------------------|
| voice-gate-registration | MODERATE 2.0 | Fix hardcoded path `~/pgh/vexjoy-agent/scripts/scan-ai-patterns.py` to use relative or env-based resolution, validate with smoke-test harness |
| mcp-health-check-registration | WEAK 2/9 | Staging test showing clean backoff/unblock cycles before production registration |
| boost-undertriggered-entries | MODERATE 1.67 | Determine whether trigger minimum threshold should differ for narrow-scope agent helpers (e.g. threshold 3) vs user-facing skills (threshold 5) before adding triggers to avoid routing collisions |
| reference-loading-gate-registration | MODERATE 5/9 | **RESOLVED**: session dedup added, promoted to STRONG 3.0, shipped PR #647 |
| stale-stub-hook-cleanup | WEAK 4/9 | **RESOLVED**: grep confirmed no settings.json refs, stubs deleted, shipped PR #647 |

---

## Rejected Proposals -- Do Not Re-Propose

| Proposal | Reason | Reopen Condition |
|----------|--------|------------------|
| posttool-bash-injection-scan | Unanimous REJECT (0/9). Heuristic misses heredocs/rsync; no injection incidents recorded | Injection incident appears in learning DB |

---

## Cycle Summaries

| Date | Proposals | Built | Winners | Shelved | Focus | PRs |
|------|-----------|-------|---------|---------|-------|-----|
| 2026-05-09 | 5 | 2 | 2 | 3 | general (first cycle) | #618 |
| 2026-05-10 | 5 | 2 | 2 | 3 | general (follow-up) | #630, #631 |
| 2026-05-11 | 5 | 2 | 2 | 3 | hook system + joy-check | #638, #639 |
| 2026-05-14 | 5 | 1 | 1 | 4 | general | #644 |
| 2026-05-15 | 5 | 3 | 3 | 2 | hook harness + cleanup | #646, #647 |
| 2026-05-16 | 3 | 1 | 1 | 2 | infrastructure integrity (INDEX.json sync) | #653 |

**Win rate**: 11 winners / 28 proposals = 39.3%. Average winning score: 2.83/3.0.

---

## Winners Shipped

| Winner | Cycle | Consensus | PR | Impact |
|--------|-------|-----------|----|--------|
| hook-lifecycle-validator | 2026-05-09 | STRONG 3.0 | #618 | Structured [PASS]/[FAIL] output for hook scripts |
| skill-index-automation | 2026-05-09 | STRONG 3.0 | #618 | PostToolUse hook auto-regenerates INDEX.json on SKILL.md edits |
| routing-drift-diag | 2026-05-10 | STRONG 3.0 | #630 | diagnose-scripts.md Step 4 calls check-routing-drift.py |
| skill-index-hook deployment | 2026-05-10 | STRONG 3.0 | #631 | posttooluse-sync-skill-index.py wired into settings.json |
| bound unlimited-timeout hooks | 2026-05-11 | STRONG 3.0 | #638 | 11 hooks given explicit timeout bounds |
| PostToolUse joy-check warn | 2026-05-11 | STRONG 3.0 | #639 | joy-check warning hook on Write/Edit |
| hook solution field improvement | 2026-05-14 | STRONG 9/9 | #644 | Solution includes first 80 chars of error message |
| smoke-test-hooks.py harness | 2026-05-15 | STRONG 3.0 | #646 | Reads hooks from settings.json, fires with mock stdin, asserts exit codes |
| reference-loading-gate session dedup | 2026-05-15 | STRONG 3.0 | #647 | Warns once per component subtree per session |
| stale stub hook deletion | 2026-05-15 | STRONG 2.67 | #647 | 3 stub hooks removed after settings.json verification |
| INDEX.json sync gate + CI wire | 2026-05-16 | STRONG 3.0 (reasoned) | #653 | pretool-index-sync-check.py blocks commit when SKILL.md staged without INDEX.json; validate-index-integrity.py added to CI lint |
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 471kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall