aipoch/open-science / resources/skills/skill-creator
skill-creator
VerifiedCreate, revise, evaluate, publish, and improve Open-Science Skills through the native JavaScript host.skills composer. Use when the user wants a reusable workflow, an existing Skill changed, test cases or benchmarks for a Skill, or better Skill triggering.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 6.5 KB |
| agents/analyzer.md | markdown | 989 B |
| agents/comparator.md | markdown | 815 B |
| agents/grader.md | markdown | 1.2 KB |
| assets/eval_review.html | other | 3.5 KB |
| eval-viewer/generate-review.js | script | 4.0 KB |
| eval-viewer/viewer.html | other | 4.6 KB |
| package.json | manifest | 25 B |
| references/schemas.md | markdown | 3.7 KB |
| scripts/aggregate-benchmark.js | script | 1.2 KB |
| scripts/generate-report.js | script | 1.4 KB |
| scripts/improve-description.js | script | 1.6 KB |
| scripts/index.js | script | 321 B |
| scripts/quick-validate.js | script | 1.9 KB |
| scripts/run-eval.js | script | 395 B |
| scripts/run-loop.js | script | 793 B |
| scripts/utils.js | script | 1.0 KB |
agents/comparator.md
View on GitHub# Blind Comparator Agent
Compare output A and output B without knowing which Skill configuration produced either one. Judge
task completion and output quality, not presumed implementation quality.
## Process
1. Read the prompt, expectations, and every relevant file in both outputs.
2. Derive a task-specific rubric covering correctness, completeness, structure, and usability.
3. Check the same expectations against A and B.
4. Score both sides using the same rubric and choose a winner. Use a tie only when the outputs are
genuinely equivalent.
5. Write `comparison.json` using the schema in `../references/schemas.md`.
Stay blind. Do not infer or search for which Skill produced an output. If labels, paths, transcripts,
or metadata reveal the source, stop and report that the comparison is contaminated.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |