tzachbon/srulik-toolkit / plugins/srulik-toolkit/skills/skill-creator
skill-creator
VerifiedCreate or edit a skill, improve its instructions or triggers, evaluate it on real tasks, or benchmark a revision. Every skill creation or edit uses create-plan and implement-plan, including small changes; evaluation compares actual outputs and includes human review.
| File | Kind | Size |
|---|---|---|
| LICENSE.txt | markdown | 11.1 KB |
| SKILL.md | skill md | 4.2 KB |
| agents/analyzer.md | markdown | 10.3 KB |
| agents/grader.md | markdown | 9.1 KB |
| agents/openai.yaml | config | 118 B |
| assets/eval_review.html | other | 6.8 KB |
| eval-viewer/generate_review.py | script | 7.2 KB |
| eval-viewer/viewer.html | other | 40.7 KB |
| references/authoring.md | markdown | 2.8 KB |
| references/claude-code.md | markdown | 3.9 KB |
| references/codex.md | markdown | 2.1 KB |
| references/evaluation.md | markdown | 3.9 KB |
| references/hosts.md | markdown | 861 B |
| references/oh-my-pi.md | markdown | 1.2 KB |
| references/schemas.md | markdown | 3.9 KB |
| references/t3-code.md | markdown | 2.2 KB |
| scripts/__init__.py | script | 0 B |
| scripts/aggregate_benchmark.py | script | 9.3 KB |
| scripts/generate_report.py | script | 12.5 KB |
| scripts/improve_description.py | script | 11.3 KB |
| scripts/run_eval.py | script | 12.6 KB |
| scripts/run_loop.py | script | 13.9 KB |
| scripts/utils.py | script | 3.0 KB |
scripts/utils.py
View on GitHub# Modified for Srulik Toolkit: portable evaluation contracts, isolated execution, and offline review. Upstream ca45fc496a3436251f191354091d557da31c15b5; Apache-2.0.
"""Shared utilities for skill-creator scripts."""
import json
from pathlib import Path
import re
def parse_skill_md(skill_path: Path) -> tuple[str, str, str]:
"""Parse a SKILL.md file, returning (name, description, full_content)."""
content = (skill_path / "SKILL.md").read_text()
lines = content.split("\n")
if lines[0].strip() != "---":
raise ValueError("SKILL.md missing frontmatter (no opening ---)")
end_idx = None
for i, line in enumerate(lines[1:], start=1):
if line.strip() == "---":
end_idx = i
break
if end_idx is None:
raise ValueError("SKILL.md missing frontmatter (no closing ---)")
name = ""
description = ""
frontmatter_lines = lines[1:end_idx]
i = 0
while i < len(frontmatter_lines):
line = frontmatter_lines[i]
if line.startswith("name:"):
name = line[len("name:"):].strip().strip('"').strip("'")
elif line.startswith("description:"):
value = line[len("description:"):].strip()
# Handle YAML multiline indicators (>, |, >-, |-)
if value in (">", "|", ">-", "|-"):
continuation_lines: list[str] = []
i += 1
while i < len(frontmatter_lines) and (frontmatter_lines[i].startswith(" ") or frontmatter_lines[i].startswith("\t")):
continuation_lines.append(frontmatter_lines[i].strip())
i += 1
description = " ".join(continuation_lines)
continue
else:
description = value.strip('"').strip("'")
i += 1
if not re.fullmatch(r"[a-z0-9]+(?:-[a-z0-9]+)*", name) or len(name) > 64:
raise ValueError("skill name must be a lowercase hyphenated identifier of at most 64 characters")
return name, description, content
def workspace_root(path):
path = Path(path).absolute()
if path.is_symlink() or not path.is_dir():
raise ValueError("workspace must be a real directory")
return path.resolve()
def safe_path(root, path, *, exists=True):
"""Confine reads/writes and reject symlinks below the selected workspace."""
candidate = Path(path).absolute()
resolved = candidate.resolve(strict=exists)
if not resolved.is_relative_to(root):
raise ValueError("path escapes the selected workspace")
for ancestor in (candidate, *candidate.parents):
if ancestor.is_symlink():
raise ValueError("symlink inputs are not supported")
if ancestor.resolve() == root:
break
return resolved
def read_json(root, path):
def reject_constant(_value):
raise ValueError("non-finite JSON is not supported")
return json.loads(safe_path(root, path).read_text(encoding="utf-8"),
parse_constant=reject_constant)
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis. | Stars: 471k | Updated | Claude CodeCodex | Verified | Install |
| diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness. | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependencies | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is available | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |