Skip to content

majiayu000/spellbook / skills/codebase-audit

codebase-audit

Verified

全面代码库审计 — 自适应并行深度分析(前后端契约、数据完整性、异常处理/安全、架构/技术债、配置/缓存),结构化 findings + 对抗验证 + 基线对比,输出按严重程度排序的统一报告和修复路线图。支持 quick 快速体检模式。Use when user asks to audit, analyze, or review an entire codebase for design issues, find hidden bugs, check architecture health, or asks '全面审查', '代码库审计', '分析设计问题', 'audit codebase', 'health check', '有哪些问题', '快速体检'. Also trigger when user asks to find silent degradation, data flow breakpoints, type mismatches between frontend and backend, or wants to understand technical debt across a project.

evals/evals.json

View on GitHub
{
  "skill_name": "codebase-audit",
  "notes": "Run against an isolated copy of fixture. Ground truth stays outside the target and is scored only after the agent finishes. Match by file+category; pass >=8/10 must_detect. Evals 1–3 explicitly override default report/ledger writes with no-write requests; eval 4 explicitly authorizes report/ledger persistence in the copy.",
  "evals": [
    {
      "id": 1,
      "prompt": "Use codebase-audit to audit the entire <TARGET_DIR> isolated fixture copy with tests and concurrency dimensions. Do not change any target files. Return the report with source evidence and verification status.",
      "expected_output": "Full-mode backend audit with tests and concurrency dimensions; structured findings; Critical/High conclusions verified or clearly unverified; report returned without source/ledger writes. Recall >=8/10 must_detect findings. Record actual duration and usage/cost if available, target hashes unchanged.",
      "files": []
    },
    {
      "id": 2,
      "prompt": "Use codebase-audit for an explicit quick repository-wide health check of <TARGET_DIR>, the isolated fixture copy. Do not write target files.",
      "expected_output": "Quick mode with Silent Degradation & Security and Data Integrity & Registry local passes; no verify pass; findings labeled unverified. Must catch registry mismatch (#1), except-pass (#2), warning+fallback (#3), hardcoded key location (#5), with file:line and an assignment snippet whose value is replaced by [REDACTED], never the key value.",
      "files": []
    },
    {
      "id": 3,
      "prompt": "对 <TARGET_DIR> 这个完整代码库做全面审计,关注隐藏问题、静默降级和注册表不一致;只读返回结果。",
      "expected_output": "Explicit repository-wide natural-language request activates full-mode audit. Severity-sorted findings and repair roadmap returned; no target changes.",
      "files": []
    },
    {
      "id": 4,
      "prompt": "Use the same isolated <TARGET_DIR> copy for two full codebase-audit runs with tests and concurrency. Explicitly persist each report and .audit/findings.json in that copy; keep the first ledger for the second run. Do not change application code. Save the first report as audit-report-run-1.md and the second as audit-report-run-2.md, overriding the date-only default path. Keep both reports as evidence.",
      "expected_output": "Ledger diff exercised: previously found items classified 'still-open' (ids and first_seen preserved), no false 'resolved' entries. Report contains a 'Delta vs Previous Audit' section.",
      "files": []
    }
  ]
}
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 471kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 471kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 471kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 194kUpdated Claude CodeCodexVerifiedInstall