stark-ai-de/agent-skills / incubator/skills/skill-maintenance/skillopt-setup
skillopt-setup
FlaggedSet up Microsoft SkillOpt for Agent Skills improvement. Use when installing SkillOpt, preparing per-skill train/val/test eval splits, configuring Codex CLI or provider-backed execution, running SkillOpt against SKILL.md bodies, reviewing best_skill.md, or importing optimized skill changes. Do not use for ordinary skill authoring or manual repo validation.
assets/agent-skills-benchmark/README.md
View on GitHub# Agent Skills Benchmark Assets
These files are templates for a local SkillOpt adapter. They are copied into `.agents/tools/SkillOpt/` by `prepare-local-skillopt-adapter.mjs`.
The tracked assets are not a vendored SkillOpt clone. They only describe how this repository's `skill-evals/` cases can be loaded, rolled out, scored, and reflected inside a local SkillOpt checkout.
## Modes
- `config.native-provider.yaml`: provider-backed target, optimizer/reflection, and semantic judge with official-parity defaults.
- `config.hybrid-codex-target.yaml`: Codex CLI target rollout and semantic judge with provider-backed optimizer and locally scaled official-parity defaults.
- `config.codex-cli-all.yaml`: exploratory Codex CLI target, semantic judge, and adapter-managed reflection without provider credentials.
Generated per-skill work configs keep `_base_: ../_base_/default.yaml`; the preparer creates the matching `.agents/skillopt-work/<skill>/_base_/default.yaml` during setup.
Target rollouts are text-only by default. Provider chat targets call installed SkillOpt `chat_target` and fail closed when a visual case remains active. Codex targets always use strict read-isolated permission profiles; cases with `visual_assertions` may additionally use bounded local workspace edits and shell commands for copied helper scripts, draw.io XML, validators, and requested PNG/SVG export. If draw.io Desktop CLI is required but no `drawio`/`diagrams.net` executable is on PATH, the rollout fast-fails with `visual_rollout_blocker` instead of hanging the trainer.
Review `.agents/skillopt-work/<skill>/adapter-manifest.json` after copying templates into a local clone. A legacy copy is also written to `.agents/skillopt-work/adapter-manifest.json` for older tooling.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |