Skip to content

sb-dev/openquant / .agents/skills/spec-to-code-compliance

spec-to-code-compliance

Verified

Check implementation code against its specification, protocol, whitepaper, or design document. Trace each requirement to evidence, report contradictions and missing or partial enforcement, and find undocumented behavior.

FileKindSize
SKILL.mdskill md7.0 KB
upstream/.claude-plugin/plugin.jsonconfig370 B
upstream/README.mdmarkdown4.1 KB
upstream/agents/spec-compliance-checker.mdmarkdown5.7 KB
upstream/evals/.gitignoreother9 B
upstream/evals/documents-contradict/case.yamlconfig2.0 KB
upstream/evals/documents-contradict/fixture/README.mdmarkdown821 B
upstream/evals/documents-contradict/fixture/SPEC.mdmarkdown1.5 KB
upstream/evals/documents-contradict/fixture/Vault.solother2.8 KB
upstream/evals/documents-contradict/graders/reports-the-contradiction.mdmarkdown1.4 KB
upstream/evals/name-is-not-evidence/case.yamlconfig2.2 KB
upstream/evals/name-is-not-evidence/fixture/SPEC.mdmarkdown1.5 KB
upstream/evals/name-is-not-evidence/fixture/Vault.solother2.8 KB
upstream/evals/name-is-not-evidence/graders/senior-branch-unenforced.mdmarkdown1.5 KB
upstream/evals/name-is-not-evidence/graders/verdict-per-requirement.mdmarkdown1.0 KB
upstream/evals/routes-not-inline/case.yamlconfig2.9 KB
upstream/evals/routes-not-inline/fixture/SPEC.mdmarkdown1.5 KB
upstream/evals/routes-not-inline/fixture/Vault.solother2.8 KB
upstream/evals/routes-not-inline/graders/dispatches-the-workflow.mdmarkdown109 B
upstream/evals/routes-not-inline/graders/invokes-the-skill.mdmarkdown90 B
upstream/skills/spec-to-code-compliance/SKILL.upstream.mdmarkdown7.4 KB
upstream/skills/spec-to-code-compliance/agents/openai.yamlconfig252 B
upstream/skills/spec-to-code-compliance/assets/trail-of-bits-mark.svgother3.0 KB
upstream/skills/spec-to-code-compliance/resources/ANALYSIS_FORMAT.mdmarkdown2.8 KB
upstream/skills/spec-to-code-compliance/resources/DIVERGENCE_RUBRIC.mdmarkdown3.3 KB
upstream/skills/spec-to-code-compliance/resources/DOMAIN_NOTES.mdmarkdown5.7 KB
upstream/skills/spec-to-code-compliance/resources/WORKED_EXAMPLE.mdmarkdown4.1 KB
upstream/workflows/spec-compliance.jsscript28.4 KB

upstream/evals/name-is-not-evidence/graders/verdict-per-requirement.md

View on GitHub
---
type: llm
weight: 0.5
---

The plugin's output shape is one stated verdict per requirement, so a reader can tell which requirements were
checked from which were merely mentioned. Section 3 holds three: §3.1 availability and the zero-redemption
rejection, §3.2 collateral protection, §3.3 the 50 basis point fee.

Pass if each of the three is individually addressed with a stated outcome — a verdict word (`implemented`,
`partial`, `contradicted`, `absent`, `stronger-than-spec`, `undecidable`), a table row, or an unambiguous
sentence such as "the fee is charged as specified". The exact vocabulary does not matter; addressing each
requirement separately does.

Fail if the response covers section 3 as a single narrative that leaves any of the three without a stated
outcome, or if it discusses only the requirement it found a problem with and never says whether the other two
hold.

This grader is about coverage and not about correctness. A wrong verdict on §3.2 still passes here — the
`senior-branch-unenforced` grader is what judges that.
brainstormingobra/superpowersYou MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or planning anything new, in software or out of it (a talk, a business, a renovation).Stars: 322kUpdated Claude CodeCodexVerifiedInstall
brand-guidelinesanthropics/skillsApplies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply.Stars: 198kUpdated Claude CodeCodexVerifiedInstall
frontend-designanthropics/skillsGuidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults.Stars: 198kUpdated Claude CodeCodexVerifiedInstall
mcp-builderanthropics/skillsGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK).Stars: 198kUpdated Claude CodeCodexVerifiedInstall