sb-dev/openquant / .agents/skills/spec-to-code-compliance
spec-to-code-compliance
VerifiedCheck implementation code against its specification, protocol, whitepaper, or design document. Trace each requirement to evidence, report contradictions and missing or partial enforcement, and find undocumented behavior.
Specification to code compliance
This is a local portable entry point adapted from the pinned Trail of Bits plugin.
Attribution: Trail of Bits, https://github.com/trailofbits/skills.
This adapted entry and its upstream resources retain CC-BY-SA-4.0;
see the preserved licence in .claude/third-party/trailofbits/skills/LICENSE.
The complete plugin source is in upstream/.
Use this shared skill directly. A Claude slash command, Workflow tool, and named
plugin agent are not required.
Apply repository instructions and canonical specifications first.
For OpenQuant, distinguish target checkpoint requirements from implemented bootstrap behavior.
This is a development tool, not a deployed research-agent bundle.
Load the full procedure
Read the upstream workflow, including every schema, prompt, evidence rule, failure branch, and report instruction. Read the checker role. Read the analysis format and domain notes. Use the worked examples when a verdict is unclear, and the divergence rubric when assigning severity.
The JavaScript file is a workflow specification for this portable entry point.
It depends on host functions such as agent, parallel, pipeline, and phase.
Do not run it with plain Node or claim those functions exist in another host.
Perform its stages below with the available tools.
The unchanged upstream entry
describes the native plugin; its mandatory slash-command routing is replaced here.
Its measured routing results do not establish results for this port.
Runtime mapping
Resolve baseDir in the checker role to this skill's absolute upstream/ directory.
Map Read, Write, Grep, and Glob to available file and search tools.
Use the current model unless the user requests another available model.
Read each role's complete instructions and the relevant workflow prompt before using it.
If generic delegation is available and permitted, give each requirement its own
fresh agent context with the checker role and complete requirement prompt.
Use two other agents for the code and document refutation lenses.
Give each agent only its task, cited source paths, relevant records, and output path.
Do not depend on spec-to-code-compliance:spec-compliance-checker registration.
Preserve the upstream schemas as record contracts. Check every required field,
its type, enum values, and cited file existence before accepting each record.
Do not describe this manual record check as runtime schema enforcement.
If delegation is unavailable, use sequential role passes and write each analysis
before proceeding. Start each pass from source artifacts, not a remembered summary.
Record execution_mode: sequential-role-passes and state that refutation was not
independent. Keep resulting divergence candidates in unverified; do not describe
self-review as independent confirmation. If context is insufficient, record the
remaining requirements as notChecked rather than compressing their checks.
Portable stages
- Resolve
path, optionalspec, optionallimit, andoutDirfrom the request. Defaultpathto.andoutDirtospec-compliance. Without host budget telemetry, defaultlimitto 10; clamp an explicit limit to 1 through 30. Rank mandatory, recommended, optional, then descriptive requirements as upstream does. Create the output directory andrequirements/. Keep all generated artifacts outside the source inputs. - Discover documents and implementation paths with
DISCOVERY_SCHEMA. Preserve document authority, unreadable documents, and explicit scope. Stop when no readable specification exists. Do not infer requirements from code. - Extract each document with
REQUIREMENTS_SCHEMAand the full extraction prompt. Quote requirements verbatim. Split compound claims. Preserve requirement force. Combine records before applying the selection limit. Resolve ID collisions using the upstream stable suffix procedure. Preserve every deferred requirement. - Run the reverse-direction sweep with
UNDOCUMENTED_SCHEMAand its full prompt. Record failures separately from an empty behavior list. - For each selected requirement, run the checker role and complete alignment prompt.
Write
requirements/<ordinal>-<id>.mdusing the upstream slug and numbering rules. Save a correspondingALIGNMENT_SCHEMAJSON record. Read both files back. Inspect enforcement, callees, callers, and alternate paths. A name is not evidence. Anabsentverdict needs the actual searches and their results. - For every non-
implementedverdict, apply both full refutation prompts from the workflow: one checks code, the other checks the document. Persist bothREFUTATION_SCHEMArecords and any failed attempt. Either refutation drops the candidate. Keep its reason in the report's considered-and-dropped list. Keep corrections and revised verdicts. Name a missing lens explicitly; report both missing lenses as unverified. Sequential self-review is also unverified. - Produce
REPORT.mdusing the entire upstream report prompt andREPORT_SCHEMA. Include the alignment matrix, surviving candidates, undocumented behavior, document problems, considered-and-dropped claims, failed checks, unreadable documents, deferred requirements, and unverified candidates. Separate confirmed divergences from unverified candidates. Assign severity by consequence, with the cited rubric. - Persist the workflow's final summary fields in
summary.json, plus execution mode and refutation-independence status. Never substitute a failed check withimplemented. Never default a missing report path to an expected path. Read the report, analyses, and summary back before reporting completion.
For one requirement, use the same checker, evidence, artifact, and refutation rules without document-wide fan-out. For a whole document, keep per-requirement records; do not collapse the analysis into a narrative review.
Provenance and limits
All original agents, workflow code, resources, metadata, and evaluation fixtures
remain under upstream/ (original skill entries are named SKILL.upstream.md to avoid duplicate discovery). The repository's third-party Trail of Bits
licence applies. This wrapper ports orchestration; it does not preserve the native
runtime's schema enforcement or guarantee independent contexts in sequential mode.
Installation and fixture checks alone do not establish actual project compliance.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| brainstormingobra/superpowersYou MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or planning anything new, in software or out of it (a talk, a business, a renovation). | Stars: 319k | Updated | Claude CodeCodex | Verified | Install |
| brand-guidelinesanthropics/skillsApplies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| frontend-designanthropics/skillsGuidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| mcp-builderanthropics/skillsGuide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-designed tools. Use when building MCP servers to integrate external APIs or services, whether in Python (FastMCP) or Node/TypeScript (MCP SDK). | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |