Skip to content

cskwork/supergoal-skill / skills/supergoal

supergoal

Unverified

Route objective-driven development, verification, planning, "teach/explain", codebase learning, and skill evaluation through the Supergoal workflow. Use when Supergoal is requested or an autonomous delivery workflow is needed.

FileKindSize
SKILL.mdskill md12.8 KB
agents/analyst.mdmarkdown1.5 KB
agents/architect.mdmarkdown1.7 KB
agents/code-reviewer.mdmarkdown2.5 KB
agents/db-reader.mdmarkdown2.0 KB
agents/debugger.mdmarkdown2.0 KB
agents/designer.mdmarkdown6.3 KB
agents/executor.mdmarkdown2.8 KB
agents/explore.mdmarkdown2.0 KB
agents/qa-auditor.mdmarkdown4.3 KB
agents/qa-tester.mdmarkdown3.2 KB
agents/security-reviewer.mdmarkdown1.2 KB
agents/skill-forger.mdmarkdown1.6 KB
agents/skill-miner.mdmarkdown1.6 KB
reference/agent-browser.mdmarkdown2.8 KB
reference/arch.mdmarkdown5.1 KB
reference/archify.mdmarkdown3.6 KB
reference/db-access.mdmarkdown2.9 KB
reference/debugging.mdmarkdown6.5 KB
reference/delivery-gate.mdmarkdown6.6 KB
reference/domain-context.mdmarkdown7.8 KB
reference/domain-rules.mdmarkdown1.6 KB
reference/engagement.mdmarkdown3.8 KB
reference/functional-ui.mdmarkdown6.4 KB
reference/harness-eval.mdmarkdown28.7 KB
reference/interview.mdmarkdown7.7 KB
reference/learn-domain.mdmarkdown12.7 KB
reference/market-research.mdmarkdown1.7 KB
reference/observability.mdmarkdown5.0 KB
reference/plan-grounding.mdmarkdown4.3 KB
reference/playwright-cli.mdmarkdown2.6 KB
reference/prototype.mdmarkdown4.5 KB
reference/qa-only.mdmarkdown12.7 KB
reference/qa.mdmarkdown7.9 KB
reference/reporting.mdmarkdown1.5 KB
reference/research.mdmarkdown2.7 KB
reference/review-only.mdmarkdown2.4 KB
reference/role-loop.mdmarkdown26.7 KB
reference/rules.mdmarkdown982 B
reference/skill-mine.mdmarkdown7.6 KB
reference/taste-aesthetics.mdmarkdown7.5 KB
reference/taste-skill-v2.mdmarkdown18.8 KB
reference/taste-sources.mdmarkdown3.0 KB
reference/teach.mdmarkdown28.0 KB
reference/ui-ux.mdmarkdown4.0 KB
reference/vercel-host.mdmarkdown3.6 KB
reference/wayfinder.mdmarkdown7.2 KB
templates/GOAL.mdmarkdown1.3 KB
templates/PLAN.mdmarkdown1.4 KB
templates/QA.mdmarkdown1.2 KB
templates/R-LOOP.mdmarkdown569 B
templates/Z-DONE.mdmarkdown301 B
templates/arch-report.htmlother8.1 KB
templates/commit-gate.shexecutablescript11.6 KB
templates/contrast-gate.mjsexecutablescript4.3 KB
templates/db-access/.env.exampleother451 B
templates/db-access/check-connection.shexecutablescript134 B
templates/db-access/db-access.cmdscript39 B
templates/db-access/db-access.mjsexecutablescript5.2 KB
templates/db-access/read-only-query.shexecutablescript138 B
templates/db-access/schema-summary.shexecutablescript132 B
templates/domain-agent/code-map.mdmarkdown744 B
templates/domain-agent/config.jsonconfig291 B
templates/domain-agent/decisions/README.mdmarkdown270 B
templates/domain-agent/flows/README.mdmarkdown800 B
templates/domain-agent/freshness.mdmarkdown1.2 KB
templates/domain-agent/glossary.mdmarkdown781 B
templates/domain-agent/index.mdmarkdown1.3 KB
templates/domain-agent/invariants.mdmarkdown504 B
templates/domain-agent/qa/README.mdmarkdown879 B
templates/domain-agent/qa/nav-map.mdmarkdown1.2 KB
templates/domain-agent/test-map.mdmarkdown432 B
templates/domain-agent/tickets/README.mdmarkdown204 B
templates/domain-onboarding.htmlother9.2 KB
templates/harness-eval-case.yamlconfig4.4 KB
templates/harness-eval-cases/authored/authored-underspec-001-deepmerge.yamlconfig2.2 KB
templates/harness-eval-cases/authored/authored-underspec-002-csvline.yamlconfig2.0 KB
templates/harness-eval-cases/authored/authored-underspec-003-authz-cache.yamlconfig1.6 KB
templates/harness-eval-cases/fixtures/README.mdmarkdown2.8 KB
templates/harness-eval-cases/fixtures/revfactory-case-002-async-race/package.jsonmanifest124 B
templates/harness-eval-cases/fixtures/revfactory-case-002-async-race/src/cache.mjsscript494 B
templates/harness-eval-cases/fixtures/revfactory-case-002-async-race/test/cache.hidden.test.mjsscript2.2 KB
templates/harness-eval-cases/fixtures/revfactory-case-002-async-race/test/cache.visible.test.mjsscript950 B
templates/harness-eval-cases/fixtures/revfactory-case-003-refactoring/package.jsonmanifest125 B
templates/harness-eval-cases/fixtures/revfactory-case-003-refactoring/src/order.mjsscript1.3 KB
templates/harness-eval-cases/fixtures/revfactory-case-003-refactoring/test/order.hidden.test.mjsscript2.2 KB
templates/harness-eval-cases/fixtures/revfactory-case-003-refactoring/test/order.visible.test.mjsscript1.2 KB
templates/harness-eval-cases/fixtures/underspec-001-deepmerge/package.jsonmanifest124 B
templates/harness-eval-cases/fixtures/underspec-001-deepmerge/src/merge.mjsscript84 B
templates/harness-eval-cases/fixtures/underspec-001-deepmerge/test/merge.hidden.test.mjsscript1013 B
templates/harness-eval-cases/fixtures/underspec-001-deepmerge/test/merge.visible.test.mjsscript276 B
templates/harness-eval-cases/fixtures/underspec-002-csvline/package.jsonmanifest122 B
templates/harness-eval-cases/fixtures/underspec-002-csvline/src/csv.mjsscript77 B
templates/harness-eval-cases/fixtures/underspec-002-csvline/test/csv.hidden.test.mjsscript804 B
templates/harness-eval-cases/fixtures/underspec-002-csvline/test/csv.visible.test.mjsscript240 B
templates/harness-eval-cases/fixtures/underspec-003-authz-cache/package.jsonmanifest126 B
templates/harness-eval-cases/fixtures/underspec-003-authz-cache/src/authorizer.mjsscript601 B
templates/harness-eval-cases/fixtures/underspec-003-authz-cache/test/authorizer.hidden.test.mjsscript3.8 KB
templates/harness-eval-cases/fixtures/underspec-003-authz-cache/test/authorizer.visible.test.mjsscript1.2 KB
templates/harness-eval-cases/revfactory-case-001-rest-api.yamlconfig2.1 KB
templates/harness-eval-cases/revfactory-case-002-bug-fix.yamlconfig2.4 KB
templates/harness-eval-cases/revfactory-case-003-refactoring.yamlconfig2.4 KB
templates/harness-eval-cases/revfactory-case-004-documentation.yamlconfig2.1 KB
templates/harness-eval-cases/revfactory-case-005-complex.yamlconfig2.0 KB
templates/harness-eval-cases/revfactory-case-006-research.yamlconfig2.1 KB
templates/harness-eval-cases/revfactory-case-007-interpreter.yamlconfig2.1 KB
templates/harness-eval-cases/revfactory-case-008-microservice.yamlconfig2.1 KB
templates/harness-eval-cases/revfactory-case-009-sql-engine.yamlconfig2.0 KB
templates/harness-eval-cases/revfactory-case-010-crdt.yamlconfig2.0 KB
templates/harness-eval-cases/revfactory-case-011-raft-kv.yamlconfig2.1 KB
templates/harness-eval-cases/revfactory-case-012-spreadsheet.yamlconfig2.1 KB
templates/harness-eval-cases/revfactory-case-013-bytecode-vm.yamlconfig2.1 KB
templates/harness-eval-cases/revfactory-case-014-event-sourcing.yamlconfig2.1 KB
templates/harness-eval-cases/revfactory-case-015-lsp.yamlconfig2.3 KB
templates/harness-eval-cases/run-local-eval.mjsscript43.3 KB
templates/harness-eval-cases/run-underspec-n3.mjsscript41.1 KB
templates/harness-eval-external/deepswe/README.mdmarkdown9.9 KB
templates/harness-eval-external/deepswe/prepare-supergoal-arm.mjsscript4.4 KB
templates/harness-eval-external/deepswe/run-default-suite.mjsscript6.1 KB
templates/harness-eval-external/deepswe/run-full-cycle.mjsscript25.3 KB
templates/harness-eval-external/deepswe/task-set.yamlconfig12.2 KB
templates/harness-eval-external/featadd/README.mdmarkdown3.9 KB
templates/harness-eval-external/featadd/features.tsvother1.6 KB
templates/harness-eval-external/featadd/gen.shscript4.0 KB
templates/harness-eval-external/featadd/package.pyscript6.2 KB
templates/harness-eval-gate.mjsscript24.9 KB
templates/harness-eval-report.mdmarkdown5.8 KB
templates/harness-eval-result.jsonconfig11.9 KB
templates/harness-eval-runner.mjsscript19.9 KB
templates/harness-eval-stats.mjsscript1.8 KB
templates/learn-grounding-gate.mjsscript6.1 KB
templates/observability/heartbeat.schema.jsonconfig2.5 KB
templates/observability/sg-emit.shexecutablescript5.4 KB
templates/qa-gate.shexecutablescript6.9 KB
templates/qa-only-gate.shexecutablescript5.1 KB
templates/qa-report.mdmarkdown2.8 KB
templates/rules.mdmarkdown301 B
templates/run-state-gate.mjsscript2.2 KB
templates/run-state.jsonconfig474 B
templates/skill-frontmatter-gate.mjsscript3.7 KB
templates/skill-install-audit.mjsexecutablescript3.7 KB
templates/skill-mine/mine.mjsscript7.8 KB
templates/skill.md.templateother568 B
templates/teach-lesson-gate.mjsscript5.4 KB
templates/teach/README.mdmarkdown4.1 KB
templates/teach/assets/lesson-book.jsscript5.8 KB
templates/teach/assets/lesson-template.htmlother6.1 KB
templates/teach/assets/lesson.cssother11.8 KB
templates/teach/assets/quiz.jsscript3.2 KB

templates/harness-eval-report.md

View on GitHub
# Harness Eval Report

## Summary

Cases:
Runtime adapter:
Case templates:
Pass winner:
Quality winner:
Overall winner:
Claim status:

## External Task Provenance

Use this section for public benchmark tasks such as DeepSWE. If not applicable, state `not applicable`.

| Field | Value |
|---|---|
| Benchmark |  |
| Benchmark URL |  |
| Benchmark repo/ref |  |
| Task ID / URL |  |
| Upstream repo/base commit |  |
| Language/category |  |
| Stop policy |  |
| Process outcome | `completed`, `budget_timeout`, `error`, or `invalid_manual_interrupt` |
| Base task text sha256 |  |
| Harness source sha256 |  |
| Verifier artifacts | `reward.json`, `ctrf.json`, `test-stdout.txt`, `run.log` |

## Pass-Rate Lift

| Task set | Baseline pass rate | Harness pass rate | Absolute percentage-point delta | Relative percent lift | Partial reward delta | Claim |
|---|---:|---:|---:|---:|---:|---|
|  |  |  |  |  |  |  |

Use `Not proven` for n=1, missing paired seeds, missing verifier artifacts, an all-pass ceiling, or
`invalid_manual_interrupt`. Report absolute percentage-point lift before relative percent lift.

## Four-Axis Metrics

| Axis | Metric | Baseline | Harness | Delta | Source / reason |
|---|---|---:|---:|---:|---|
| Correctness |  |  |  |  |  |
| Token/cost |  |  |  |  |  |
| Wall-clock speed |  |  |  |  |  |
| Routing accuracy |  |  |  |  |  |

## Routing Accuracy

| Prompt set | Count | Trials/prompt | Split | Should-trigger rate | Should-not-trigger rate | Held-out accuracy | Near-miss failures |
|---|---:|---:|---|---:|---:|---:|---|

Use at least 20 should-trigger / should-not-trigger near-miss prompts, 3 trials each, and select on the
40% held-out split. If routing is not applicable, state why.

## Case Selection

Default coding A/B pair:

1. `revfactory-case-002-async-race/` (`revfactory-case-002-bug-fix.yaml`) - DEBUG/concurrency.
2. `revfactory-case-003-refactoring/` (`revfactory-case-003-refactoring.yaml`) - LEGACY/brownfield
   preservation.

Do not substitute `underspec-001-deepmerge/`, `underspec-002-csvline/`, or
`underspec-003-authz-cache/` for this default. If both default cases tie, report `Not proven`, record the
runnable-corpus ceiling, and require authored expert runnable fixtures before claiming a stronger
harness win.

Low-effort discriminator:

- `underspec-003-authz-cache/` (`SG_EVAL_CASE=u3`) - security/concurrency latent-correctness probe.

## Eval Intent

Goal:
Constraints:
Tradeoffs:
Rejected approaches:

## Command Manifest

| Command | Source | Used by | Verifies |
|---|---|---|---|

## Verification (harness-native + ground truth)

| Case | Harness verified natively? | Native verifier checks (if any) | Hidden-check REDs | REDs fixed | Visible-only false-GREEN? |
|---|---|---:|---:|---:|---|

Notes: ground truth for BOTH arms is Machine Checks + hidden tests below; the eval does not impose a
verifier/repair loop. For hard cases, `None`/`visible tests only` self-verification still requires the arm
to pass the hidden checks - otherwise `Not proven`.

## Machine Checks

| Case | Run | Check | Status | Evidence |
|---|---|---|---|---|

## Evidence Bundle

| Case | Run | Check | Verifies | Does not verify | Confidence | Artifact |
|---|---|---|---|---|---|---|

## Trajectory Telemetry

| Case | Run | Artifact root | Logs | Commands | Edited files | Turns | Exit | Crash/context |
|---|---|---|---|---|---|---:|---:|---|

## Decision Gates

| ID | Action | Status | Description | Human decision | Recheck |
|---|---|---|---|---|---|

Actions: `auto-fix`, `no-op`, or `ask-user`. A `proven` claim cannot leave `ask-user` unresolved.

## Adapter Fixture Replay

| Status | Adapter event schema | Fixtures | Redaction | Replay command |
|---|---|---|---|---|

Reusable harness claims need recorded, scrubbed fixtures or an explicit `Not proven` reason.

## Quality Score

RevFactory-style scoring: 10 dimensions, each 0-10, total 100.

| Case | Run | Total | Feature | Tests | Code | Errors | Efficiency | Correctness | Architecture | Extensibility | Docs | Dev Env |
|---|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|

Anchors:
- No tests caps `test_coverage` at 3 unless evaluator-only hidden tests are the only tests.
- Single-file monolith caps `architecture` at 4 when the task requires multiple modules.
- Missing major requested features caps `feature_completeness` at 7.
- Failing hidden or machine checks cap `correctness` at 6 unless the failure is explicitly outside scope.

## Bug-Catch Matrix

| Case | Run | Planted/hidden bugs caught | Bugs still shipped | Extra real bugs found | False GREEN? |
|---|---|---:|---:|---:|---|

## Regression Protection

| Case | Run | Fixed REDs | Permanent regression tests | Exception |
|---|---|---:|---:|---|

## Blind Grading

| Case | A | B | Winner | Confidence |
|---|---|---|---|---|

## Statistics

| Method | Inputs | Result | Decision |
|---|---|---|---|
| Sign-flip + BCa | gradient score deltas |  |  |
| McNemar | discordant binary pass/fail pairs after SNR filter |  |  |

Record `discordant_baseline_only`, `discordant_harness_only`, exact two-sided `p`, matched pairs removed
by the SNR filter, and the per-seed vector. Do not use overlapping confidence intervals as the winner gate.

## Cost

| Case | Baseline tokens/time/tool calls | Harness tokens/time/tool calls | Tradeoff |
|---|---|---|---|

## Harness Mutation Contract

| Status | Intended delta | Safety envelope | Rollback | Proof command | Rejected alternatives |
|---|---|---|---|---|---|

## Surface Sync

| Changed surfaces | Proof commands |
|---|---|

## Not Proven

List any reason the harness improvement claim is not proven yet: weak sample size, missing blind grading, different repo snapshot, missing machine checks, quality score tie/loss, or cost overhead larger than quality gain.

## Decision

Use one:

- Adopt harness
- Revise harness
- Reject harness
- Not proven
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall