Skip to content

github/awesome-copilot / skills/audit-integrity

audit-integrity

Verified

Enforce output quality, evidence verification, and quality gates across security audits. Use this skill when you perform SAST, SCA, threat modeling, or security code reviews. Use this skill to verify code locations and taint traces for all findings. Use this skill to prevent the suppression of valid security findings. Use this skill to evaluate reports against quality thresholds (score ≥ 8/10) before delivery.

references/self-reflection-quality-gate.md

View on GitHub
# Self-Reflection Quality Gate

After you complete the analysis, score the output across domain categories on a 1–10 scale.

**Threshold**: Every category must score **≥ 8** to pass. If any category scores < 8, resolve the gaps before you deliver the report (maximum 2 rework iterations).

## Core Scoring Rubric (Universal)

| Category           | Score 9–10                                                                                  | Score 7–8                                                             | Score 5–6                                                           | Score 1–4                                                       |
| ------------------ | ------------------------------------------------------------------------------------------- | --------------------------------------------------------------------- | ------------------------------------------------------------------- | --------------------------------------------------------------- |
| **Completeness**   | All phases, categories, boundaries, and checklists evaluated with explicit evidence         | Minor omissions that do not affect the risk profile                   | Noticeable gaps in coverage; entire sections omitted                | Superficial pass; major sections missing                        |
| **Accuracy**       | Precise file:line references, confirmed CVE IDs, verified taint flows, correct CWE mappings | Minor version ambiguity or indirect references; core findings correct | Plausible findings with unverified details or questionable mappings | Fabricated references, wrong CWE mappings, or hallucinated CVEs |
| **Actionability**  | Concrete remediation code, exact package upgrade targets, step-by-step guidance             | Clear direction but requires human adjustment                         | High-level advice without code or version targets                   | Generic platitudes ("sanitize inputs", "keep packages updated") |
| **Consistency**    | Risk ratings match evidence, framework verdicts align with findings, formatting uniform     | Minor formatting or taxonomy inconsistencies                          | Severity ratings conflict with impact descriptions                  | Contradictory findings or incompatible verdicts                 |
| **Evidence Rigor** | Every claim backed by code, manifest, trace, or threat model element                        | Most findings backed; some secondary claims lack citations            | Assertions made without code citations                              | Speculative findings with zero code or manifest backing         |

## Scoring Threshold

| Final Score                  | Action                                                                    |
| ---------------------------- | ------------------------------------------------------------------------- |
| All categories ≥ 8           | **PASS** — Proceed to final delivery                                      |
| Any category < 8 (attempt 1) | **REWORK** — Address deficiencies and re-score                            |
| Any category < 8 (attempt 2) | **REWORK** — Final attempt to resolve gaps                                |
| Any category < 8 (attempt 3) | **FLAG & DELIVER** — Deliver with explicit quality gap disclosure to user |

## Domain-Specific Rubrics

### SAST/SCA

| Category          | Question                                                                               | Threshold |
| ----------------- | -------------------------------------------------------------------------------------- | :-------: |
| **Completeness**  | Did you evaluate all SAST flaw categories and SCA ecosystems?                          |    ≥ 8    |
| **Accuracy**      | Are findings supported by concrete taint traces and verified CVE IDs?                  |    ≥ 8    |
| **Actionability** | Does each Critical and High finding have a concrete code fix or upgrade step?          |    ≥ 8    |
| **Consistency**   | Are severity ratings, CWE mappings, and policy verdicts consistent across the report?  |    ≥ 8    |
| **Coverage**      | Did you trace all entry points from source to sink and audit all dependency manifests? |    ≥ 8    |

### Threat Modeling and Code Review

| Category         | Question                                                                            | Threshold |
| ---------------- | ----------------------------------------------------------------------------------- | :-------: |
| **Completeness** | Did you evaluate all six STRIDE categories for each trust boundary and data flow?   |    ≥ 8    |
| **Coverage**     | Were all entry points, trust boundaries, and data flows traced from source to sink? |    ≥ 8    |
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 468kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 468kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 468kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 194kUpdated Claude CodeCodexVerifiedInstall