donaldfilimon/abi / .claude/skills/wdbx-bench
wdbx-bench
VerifiedBuild the abi CLI and benchmark the WDBX vector store (in-process insert/search timing), optionally running the abi-wdbx unit-test suite. Use when asked to benchmark WDBX, measure insert/search latency, profile the vector store, or check benchmark output after a storage change.
WDBX moved out of this repository on 2026-08-22. It now lives in the sibling repo
../wdbxtogether withabi-compute,abi-foundation,abi-core, andabi-telemetry;abiconsumes them by relative path. Source paths below therefore read../wdbx/crates/.... Run WDBX-only tests from that repo (./tools/cargo.sh test --locked --manifest-path ../wdbx/Cargo.toml --workspace < /dev/null, run from the abi checkout), andabi's gate (./tools/check.sh) from here.Under the Abbey System Constitution (
docs/superpowers/specs/2026-08-22-abbey-system-constitution.md) WDBX is the provenance-aware episodic substrate, not a vector store. Most of the evidence half of its specification is unimplemented; the measured gap list is indocs/superpowers/specs/2026-08-22-wdbx-conformance-gap-analysis.md. Do not describe an episodic capability as Current on the strength of the vector-store features that do exist.Note for this skill specifically:
bench.sh --suiteruns./tools/cargo.sh test -p abi-wdbx --lib < /dev/nullfrom the abi repo, and that still works after the move — abi-wdbx remains in abi's resolve graph as a path dependency, so-pselection succeeds (verified 2026-08-22: 284 tests, exit 0). It is not a workspace member any more, so--workspacefrom abi will not include it.
wdbx-bench — benchmark the WDBX vector store
Driver: .agents/skills/wdbx-bench/bench.sh (paths relative to repo root).
CLI/timing check — no GUI; evidence is the RESULT: line + the latency table.
These are local, in-memory measurements — not a published throughput claim (the CLI says so itself). Numbers vary by machine and are noisy at low counts.
Prerequisites
- Stable Rust 1.99.1 via
./tools/cargo.sh(never bare Homebrewcargo).
Run (agent path)
.agents/skills/wdbx-bench/bench.sh 50 # build CLI, run `abi wdbx benchmark 50`
.agents/skills/wdbx-bench/bench.sh 50 --suite # also run `./tools/cargo.sh test -p abi-wdbx --lib < /dev/null`
It builds the CLI, runs abi wdbx benchmark <count>, and asserts the markers
benchmark (local, in-memory, inserts:, searches:. Prints
RESULT: PASS — WDBX benchmark ran. (exit 0) or RESULT: FAIL — N check(s) failed.
Gotchas
- Not a throughput claim. Per-op time includes acceleration-kernel dispatch;
the GPU path is the vectorized CPU fallback unless native kernels are linked
(
abi backendsshowsaccelerated=falseon this machine). - Low counts are high-variance — use ≥50 for a stable-ish p50; the suite
(
--suite) runs./tools/cargo.sh test -p abi-wdbx --lib < /dev/null. bench.sh <non-number>→ usage, exit 2.
Troubleshooting
| Symptom | Fix |
|---|---|
build FAIL | Run ./tools/check.sh to see the real error. |
missing inserts:/searches: marker | CLI grammar drifted — check the crates/abi-cli WDBX handler and ../wdbx/crates/abi-wdbx. |
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |