donaldfilimon/abi / .agents/skills/abi-claims-validator
abi-claims-validator
VerifiedValidate ABI docs and external collateral against repo evidence and docs/contracts/external-claims-audit.mdx. Use when auditing claims, scanning docs for unsupported QPS/sharding/FHE/AES language, checking one claim before publish, or re-confirming the external-claims audit. Agent procedure only — not a CLI or slash command. Pair with abi-doc-claims-sync when editing docs.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 4.7 KB |
SKILL.md
View on GitHub---
name: abi-claims-validator
description: Validate ABI docs and external collateral against repo evidence and docs/contracts/external-claims-audit.mdx. Use when auditing claims, scanning docs for unsupported QPS/sharding/FHE/AES language, checking one claim before publish, or re-confirming the external-claims audit. Agent procedure only — not a CLI or slash command. Pair with abi-doc-claims-sync when editing docs.
---
# ABI Claims Validator
Agent-side procedure to validate documentation, collateral, and public claims
against the repository source of truth (`Cargo.toml`, `src/`, contract tests,
`docs/contracts/external-claims-audit.mdx`). Use before publishing any external
artifact. There is **no** `/abi-claims-validator` binary or slash command — follow
the steps below (or dispatch the `external-claims-auditor` subagent).
For *editing* docs to stay claim-honest, prefer `abi-doc-claims-sync`.
## Procedure (agent actions)
### scan
1. Open the target tree (default `docs/`, plus README/AGENTS/CHANGELOG/walkthrough as needed).
2. Search for claim patterns (table below) with ripgrep or equivalent.
3. For each hit, cross-reference source/tests/`docs/contracts/external-claims-audit.mdx`.
4. In `--strict` mode, treat any unproven number or deployment claim as a fail.
Detects:
- Performance numbers (QPS, latency, throughput, accuracy)
- Deployment claims (Kubernetes, H100, multi-node)
- Implementation language claims (Swift, Python, TensorFlow, PyTorch)
- Security claims (AES-256, RBAC, certifications)
- Distributed claims (sharding, multi-host)
- Benchmark comparisons (SQuAD, CodeSearchNet, GPT)
- Energy/GPU speedup claims
### check-claim
Given one claim string, return `SUPPORTED` | `UNSUPPORTED` | `PARTIAL` plus the
evidence path (source, test, or audit section). Prefer executable evidence over prose.
### audit
Produce a short markdown report of flagged claims vs evidence. The durable
ledger lives in `docs/contracts/external-claims-audit.mdx` — update that file
when the audit changes reality, do not invent a parallel truth source.
## Source of Truth Hierarchy
1. **Executable config**: `Cargo.toml`, `Cargo.toml.zon`, `rust-toolchain.toml`
2. **Source implementation**: `src/`, `tests/golden/`
3. **Contract tests**: `tests/golden/` (surface, mcp_tools, feature_modules, plugin_registry, public_docs)
4. **Explicit claim boundary**: `docs/contracts/external-claims-audit.mdx`
5. **North-star mapping**: `docs/spec/wdbx-north-star.mdx` §2 (Current/Partial/Proposed)
6. **Prose docs**: `README.md`, `docs/*.mdx` — **lowest priority**, must reconcile upward
## Common Claim Patterns to Flag
| Pattern | Likely Status | Check Against |
|---------|---------------|---------------|
| `\d+\s*(QPS|req/s|throughput)` | ❌ Unsupported | `../wdbx/crates/abi-wdbx/tests/` artifact |
| `\d+\s*ms\s*latency` | ❌ Unsupported | `../wdbx/crates/abi-wdbx/tests/` artifact |
| `distributed|sharding|multi-host|cluster` | ⚠️ Partial | `../wdbx/crates/abi-wdbx/src/cluster_rpc.rs` tests |
| `AES|RBAC|encryption|certified` | ❌ Unsupported | `docs/contracts/external-claims-audit.mdx` §2 |
| `Swift|Python|TensorFlow|PyTorch|Kubernetes` | ❌ Unsupported | `Cargo.toml` deps |
| `H100|A100|InfiniBand|NVLink` | ❌ Unsupported | CI config |
| `SQuAD|CodeSearchNet|GPT|benchmark` | ❌ Unsupported | Contract tests |
| `energy|kWh|efficiency|green` | ❌ Unsupported | No measurement artifact |
## Replacement Wording
From `docs/contracts/external-claims-audit.mdx` §Reusable Delta:
> Current ABI repo evidence supports a stable-Rust local AI orchestration framework with deterministic Abbey/Aviva/Abi profile routing, an in-process WDBX vector/key-value/block store, segment checkpoint plus WAL persistence with runtime recovery, a compatibility JSONL snapshot mirror, epoch reclamation helpers, snapshot-persisted temporal/causal graph records, MCP hybrid WDBX query ranking, HNSW-style cosine search, SHA-256-linked conversation blocks, 3D spatial search, feature-off stubs, CLI/MCP contract coverage, explicit connector live-mode boundaries, GPU capability reporting with CPU fallback, and a tested WDBX consensus RPC transport with shared-secret and optional peer-allowlist controls. The repo does not currently prove distributed sharding, production multi-host deployment, AES/RBAC WDBX storage, Swift/Python/TensorFlow implementation claims, Kubernetes/H100 deployment claims, regulatory certifications, QPS/latency/accuracy targets, GPU speedup figures, energy-efficiency metrics, or SQuAD/CodeSearchNet/GPT comparative scores.
## Integration
Pre-publish gate (agent runs the scan procedure after code gates):
```bash
./tools/check.sh
./tools/check.sh
# then: scan docs/ + collateral per Procedure above (--strict)
```
No feature gates — procedural validation against source.Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |