Skip to content

alexgreensh/repo-forensics / skills/repo-forensics

repo-forensics

Flagged

Security forensics for git repos, AI skills, and MCP servers. Audits dependencies, detects prompt injection, credential theft, runtime dynamism, manifest drift, known CVEs, CISA KEV (actively exploited) vulns, and 2026 attack patterns. Not for fixing vulnerabilities or pentesting.

FileKindSize
.gitignoreother193 B
SKILL.mdskill md43.4 KB
checksums.jsonconfig10.8 KB
checksums.json.sigother64 B
data/README.mdmarkdown1.3 KB
data/compromised_versions.jsonconfig188.3 KB
data/rule_ids.csvother35.3 KB
data/rulepacks/.gitkeepother221 B
data/rulepacks/dead_anchors.jsonconfig9.0 KB
data/rulepacks/mcp_security.jsonconfig31.2 KB
data/rulepacks/runtime_dynamism.jsonconfig46.7 KB
data/rulepacks/sast.jsonconfig107.6 KB
data/rulepacks/secrets.jsonconfig30.4 KB
data/rulepacks/shared.jsonconfig4.4 KB
data/rulepacks/skill_threats.jsonconfig95.4 KB
data/runtime_floors.jsonconfig2.3 KB
data/yara/cryptominers.yarother1.8 KB
data/yara/hacktools.yarother2.2 KB
data/yara/malware.yarother2.2 KB
data/yara/manifest.jsonconfig8.0 KB
data/yara/webshells.yarother2.5 KB
references/cursor-hook-contract.mdmarkdown5.6 KB
references/kernel_privesc_sandbox_pack.mdmarkdown5.0 KB
references/mcp-attack-patterns.mdmarkdown8.7 KB
references/research_sources.mdmarkdown8.0 KB
references/threat_patterns.mdmarkdown20.3 KB
scripts/_context_gate.pyscript21.7 KB
scripts/_ed25519.pyscript5.1 KB
scripts/_pyc_unmarshal.pyscript17.1 KB
scripts/_shared_patterns.pyscript4.8 KB
scripts/adjudication.pyscript16.4 KB
scripts/adjudication_bridge.pyscript1.0 KB
scripts/aggregate_json.pyscript69.2 KB
scripts/auto_scan.pyexecutablescript152.1 KB
scripts/corpus_sync.pyscript10.0 KB
scripts/cursor_pre_scan.pyscript22.5 KB
scripts/dast_sandbox.sbother1.6 KB
scripts/dead_anchors_extract.pyscript14.8 KB
scripts/dead_anchors_probe.pyscript27.1 KB
scripts/forensics_core.pyscript176.5 KB
scripts/gen_rule_ids.pyscript8.6 KB
scripts/hook_adapter.pyscript19.4 KB
scripts/ioc_manager.pyscript49.6 KB
scripts/parse_pnpm_lock.pyscript7.9 KB
scripts/pre_scan.pyscript143.5 KB
scripts/pypi_pins.pyscript8.1 KB
scripts/refresh_controller.pyexecutablescript48.4 KB
scripts/refresh_threat_dbs.pyexecutablescript19.4 KB
scripts/rule_loader.pyscript44.8 KB
scripts/rulepack_feed.pyscript26.4 KB
scripts/run_forensics.shexecutablescript20.3 KB
scripts/sarif_export.pyscript18.6 KB
scripts/scan_agent_skills.pyscript33.2 KB
scripts/scan_archive.pyscript29.1 KB
scripts/scan_ast.pyscript44.9 KB
scripts/scan_binary.pyscript10.9 KB
scripts/scan_bytecode.pyscript28.2 KB
scripts/scan_dast.pyscript28.8 KB
scripts/scan_dataflow.pyscript15.4 KB
scripts/scan_dead_anchors.pyscript15.9 KB
scripts/scan_decode.pyscript37.5 KB
scripts/scan_dependencies.pyscript124.5 KB
scripts/scan_devcontainer.pyscript8.5 KB
scripts/scan_entropy.pyscript15.6 KB
scripts/scan_entrypoint.pyscript34.3 KB
scripts/scan_git_config.pyscript96.3 KB
scripts/scan_git_forensics.pyscript24.1 KB
scripts/scan_history.pyscript14.5 KB
scripts/scan_infra.pyscript54.3 KB
scripts/scan_integrity.pyscript41.0 KB
scripts/scan_lifecycle.pyscript65.1 KB
scripts/scan_manifest_drift.pyscript47.0 KB
scripts/scan_mcp_security.pyscript42.3 KB
scripts/scan_oversize.pyscript11.7 KB
scripts/scan_post_incident.pyscript36.9 KB
scripts/scan_provenance.pyscript19.4 KB
scripts/scan_runtime_dynamism.pyscript23.5 KB
scripts/scan_runtime_floors.pyscript33.5 KB
scripts/scan_sast.pyscript59.1 KB
scripts/scan_secrets.pyscript11.9 KB
scripts/scan_skill_threats.pyscript102.4 KB
scripts/scan_splitstream.pyscript29.5 KB
scripts/scan_yara.pyscript19.7 KB
scripts/session_scan.pyscript54.1 KB
scripts/suppressions.pyscript15.4 KB
scripts/validate_manifests.pyscript13.7 KB
scripts/verify_install.pyscript26.2 KB
scripts/vuln_feed.pyscript31.1 KB
tests/conftest.pyscript13.4 KB
tests/corpus/DEAD_ANCHORS_CORPUS.mdmarkdown2.3 KB
tests/corpus/budgets.jsonconfig5.6 KB
tests/cursor_helpers.pyscript12.6 KB
tests/fixtures/legacy_main_blocks.jsonconfig10.3 KB
tests/fixtures/powershell_verdict_corpus.jsonconfig114.9 KB
tests/golden/parity_mcp_security.jsonconfig17.5 KB
tests/golden/parity_runtime_dynamism.jsonconfig31.7 KB
tests/golden/parity_sast.jsonconfig59.8 KB
tests/golden/parity_secrets.jsonconfig18.8 KB
tests/golden/parity_skill_threats.jsonconfig48.8 KB
tests/parity_corpus.pyscript6.3 KB
tests/powershell_hook.pyscript8.2 KB
tests/report_builders.pyscript5.0 KB
tests/schemas/sarif-schema-2.1.0.jsonconfig109.1 KB
tests/shell_compat.pyscript2.2 KB
tests/test_adjudication_bridge.pyscript832 B
tests/test_adjudication_containment.pyscript1.4 KB
tests/test_adjudication_output.pyscript20.0 KB
tests/test_adjudication_suppressions.pyscript18.7 KB
tests/test_advisory_adjudication.pyscript1.3 KB
tests/test_agent_relay_rules.pyscript7.8 KB
tests/test_aggregate_json.pyscript10.0 KB
tests/test_auto_scan_patterns.pyscript10.5 KB
tests/test_benign_corpus.pyscript16.4 KB
tests/test_benign_new_scanners.pyscript6.1 KB
tests/test_build_output_skip.pyscript10.6 KB
tests/test_capability_ledger.pyscript18.8 KB
tests/test_codex_install.pyscript10.0 KB
tests/test_codex_marketplace.pyscript3.3 KB
tests/test_comment_false_positives.pyscript2.2 KB
tests/test_composer_dependencies.pyscript4.0 KB
tests/test_compromised_versions.pyscript51.2 KB
tests/test_context_gate.pyscript32.4 KB
tests/test_coverage_status.pyscript7.6 KB
tests/test_css_compounding_shrink.pyscript20.8 KB
tests/test_cursor_adapter.pyscript7.8 KB
tests/test_cursor_benign.pyscript3.4 KB
tests/test_cursor_degrade.pyscript12.7 KB
tests/test_cursor_install.pyscript17.1 KB
tests/test_cursor_latency.pyscript7.2 KB
tests/test_cursor_parity.pyscript5.8 KB
tests/test_cursor_redteam_fn.pyscript4.9 KB
tests/test_cursor_tamper_modify.pyscript14.2 KB
tests/test_cursor_wiring.pyscript32.3 KB
tests/test_d1_yara_correlation.pyscript9.2 KB
tests/test_dead_anchors_extract.pyscript7.6 KB
tests/test_dead_anchors_probe.pyscript19.7 KB
tests/test_evidence_engine_parity.pyscript8.1 KB
tests/test_evidence_model.pyscript11.4 KB
tests/test_forensics_core.pyscript79.2 KB
tests/test_fp_hardening_r3.pyscript9.7 KB
tests/test_fp_hardening_r4.pyscript18.8 KB
tests/test_fp_regression_pairs.pyscript62.5 KB
tests/test_fp_structural.pyscript21.2 KB
tests/test_freshness.pyscript6.2 KB
tests/test_frontmatter_validity.pyscript7.0 KB
tests/test_gpg_rce_hotfix.pyscript4.8 KB
tests/test_hook_inert_data.pyscript6.1 KB
tests/test_hook_scripts.pyscript14.0 KB
tests/test_inspection_cpu_budget.pyscript11.6 KB
tests/test_ioc_manager.pyscript55.4 KB
tests/test_kernel_privesc_rules.pyscript27.8 KB
tests/test_legit_precision_regressions.pyscript6.8 KB
tests/test_lethal_trifecta.pyscript20.7 KB
tests/test_manifest_signature.pyscript1.5 KB
tests/test_manifest_validity.pyscript2.9 KB
tests/test_monotonic_trust_e2e.pyscript4.4 KB
tests/test_non_breaking_contract.pyscript22.7 KB
tests/test_openclaw_install.pyscript6.6 KB
tests/test_pack_parity.pyscript24.8 KB
tests/test_parse_pnpm_lock.pyscript10.7 KB
tests/test_plugin_checkout_provenance.pyscript11.1 KB
tests/test_powershell_hook_wire.pyscript10.6 KB
tests/test_powershell_verdict_corpus.pyscript6.2 KB
tests/test_pr44_hardening.pyscript6.5 KB
tests/test_pre_scan.pyscript19.6 KB
tests/test_pre_scan_composer.pyscript7.4 KB
tests/test_precondition_fields.pyscript4.6 KB
tests/test_provenance_offline.pyscript2.5 KB
tests/test_published_rulepack_feed_current.pyscript1.4 KB
tests/test_py38_compat.pyscript3.3 KB
tests/test_pypi_pinned_versions.pyscript19.3 KB
tests/test_pyproject_string_forms.pyscript2.2 KB
tests/test_redteam_fn_regression.pyscript32.5 KB
tests/test_reflective_fetch_execute.pyscript23.5 KB
tests/test_reflective_review_fixes.pyscript17.8 KB
tests/test_refresh_controller.pyscript19.9 KB
tests/test_refresh_rulepacks.pyscript12.4 KB
tests/test_review_gate_regressions.pyscript9.3 KB
tests/test_rule_loader.pyscript23.2 KB
tests/test_rulepack_feed.pyscript38.1 KB
tests/test_run_forensics_json.pyscript1012 B
tests/test_run_scanner_fail_loud.pyscript6.5 KB
tests/test_runtime_floors.pyscript19.8 KB
tests/test_sandbox_probing_rules.pyscript9.6 KB
tests/test_sarif_export.pyscript19.9 KB
tests/test_scan_agent_skills.pyscript31.3 KB
tests/test_scan_archive.pyscript11.6 KB
tests/test_scan_ast.pyscript12.8 KB
tests/test_scan_binary.pyscript15.3 KB
tests/test_scan_bytecode.pyscript21.5 KB
tests/test_scan_dast.pyscript32.1 KB
tests/test_scan_dataflow.pyscript7.1 KB
tests/test_scan_dead_anchors.pyscript11.5 KB
tests/test_scan_decode.pyscript28.0 KB
tests/test_scan_dependencies.pyscript37.8 KB
tests/test_scan_devcontainer.pyscript8.5 KB
tests/test_scan_entropy.pyscript11.2 KB
tests/test_scan_entrypoint.pyscript19.5 KB
tests/test_scan_git_config.pyscript58.5 KB
tests/test_scan_git_config_review_fixes.pyscript33.3 KB

tests/test_coverage_status.py

View on GitHub
"""Coverage-honesty aggregation tests."""

import json
import os

import aggregate_json as module


def _write(path, content):
    os.makedirs(os.path.dirname(path), exist_ok=True)
    with open(path, "w", encoding="utf-8") as handle:
        handle.write(content)


def _scan_dir(tmp_path):
    """A separate empty repo dir used as the scan target."""
    d = tmp_path / "repo"
    d.mkdir()
    return d


def _scanner(name, findings, exit_code=0, parse_error=None):
    return {
        "name": name,
        "exit_code": exit_code,
        "parse_error": parse_error,
        "finding_count": len(findings),
        "findings": findings,
    }


class TestBuildCoverageStatus:
    def test_all_clean_returns_complete(self):
        scanners = [
            _scanner("secrets", [{"severity": "high", "category": "secret"}]),
            _scanner("sast", [{"severity": "medium", "category": "sql-injection"}]),
        ]
        status = module.build_coverage_status(scanners, [])
        assert status["overall"] == "COMPLETE"
        assert status["gaps"] == []
        assert status["per_scanner"]["secrets"]["status"] == "COMPLETE"
        assert status["per_scanner"]["sast"]["status"] == "COMPLETE"

    def test_unsupported_archive_type(self):
        scanners = [
            _scanner("archive", [
                {"severity": "low", "category": "unsupported-archive-type",
                 "file": "payload.7z", "line": 0, "title": "Unsupported archive type"},
            ]),
            _scanner("secrets", [{"severity": "high", "category": "secret"}]),
        ]
        status = module.build_coverage_status(scanners, [])
        assert status["overall"] == "UNSUPPORTED"
        assert status["per_scanner"]["archive"]["status"] == "UNSUPPORTED"
        assert status["per_scanner"]["secrets"]["status"] == "COMPLETE"
        assert any(g["category"] == "unsupported-archive-type" for g in status["gaps"])

    def test_incomplete_budget(self):
        scanners = [
            _scanner("oversize", [
                {"severity": "low", "category": "archive-scan-incomplete",
                 "file": "big.bin", "line": 0, "title": "Oversize scan incomplete"},
            ]),
        ]
        status = module.build_coverage_status(scanners, [])
        assert status["overall"] == "INCOMPLETE"
        assert status["per_scanner"]["oversize"]["status"] == "INCOMPLETE"

    def test_parse_error_marks_incomplete(self):
        scanners = [
            _scanner("archive", [], parse_error="Invalid JSON output: foo"),
        ]
        status = module.build_coverage_status(scanners, [])
        assert status["overall"] == "INCOMPLETE"
        assert status["per_scanner"]["archive"]["status"] == "INCOMPLETE"
        assert any(g["category"] == "parse-error" for g in status["gaps"])

    def test_unexpected_exit_code_marks_incomplete(self):
        scanners = [
            _scanner("sast", [], exit_code=7),
        ]
        status = module.build_coverage_status(scanners, [])
        assert status["overall"] == "INCOMPLETE"
        assert status["per_scanner"]["sast"]["status"] == "INCOMPLETE"

    def test_dependencies_and_dast_ignored_for_coverage_categories(self):
        # dependencies may emit enrichment-degraded; dast may emit dast-unsandboxed.
        # Those are findings, not coverage gaps.
        scanners = [
            _scanner("dependencies", [
                {"severity": "medium", "category": "enrichment-degraded"},
            ]),
            _scanner("dast", [
                {"severity": "medium", "category": "dast-unsandboxed"},
            ]),
        ]
        status = module.build_coverage_status(scanners, [])
        assert status["overall"] == "COMPLETE"
        assert status["gaps"] == []

    def test_dast_without_sandbox_is_incomplete(self):
        scanners = [_scanner("dast", [
            {"severity": "medium", "category": "scan-incomplete",
             "file": "hook.sh", "line": 0, "title": "DAST sandbox unavailable"},
        ])]
        status = module.build_coverage_status(scanners, [])
        assert status["overall"] == "INCOMPLETE"
        assert status["per_scanner"]["dast"]["status"] == "INCOMPLETE"

    def test_dependencies_parse_error_still_incomplete(self):
        scanners = [
            _scanner("dependencies", [], parse_error="No JSON output captured from scanner"),
        ]
        status = module.build_coverage_status(scanners, [])
        assert status["overall"] == "INCOMPLETE"

    def test_worst_status_unsupported_wins_over_incomplete(self):
        scanners = [
            _scanner("archive", [
                {"severity": "low", "category": "unsupported-archive-type"},
            ]),
            _scanner("oversize", [
                {"severity": "low", "category": "archive-scan-incomplete"},
            ]),
        ]
        status = module.build_coverage_status(scanners, [])
        assert status["overall"] == "UNSUPPORTED"


class TestCoverageStatusInReport:
    def test_build_report_includes_coverage_status(self, tmp_path):
        repo = _scan_dir(tmp_path)
        _write(tmp_path / "a.out", json.dumps([
            {"severity": "high", "category": "secret", "title": "Key",
             "file": "x.py", "line": 1, "confidence": 0.80},
        ]))
        _write(tmp_path / "a.err", "")
        _write(tmp_path / "a.exit", "1")
        report = module.build_report(str(tmp_path), str(repo), "false")
        assert "coverage_status" in report
        assert report["coverage_status"]["overall"] == "COMPLETE"
        assert report["coverage_status"]["per_scanner"]["a"]["status"] == "COMPLETE"

    def test_build_report_unsupported_archive_surfaces_in_coverage_status(self, tmp_path):
        repo = _scan_dir(tmp_path)
        _write(tmp_path / "archive.out", json.dumps([
            {"scanner": "archive", "severity": "low", "category": "unsupported-archive-type",
             "title": "Unsupported archive type", "file": "payload.7z", "line": 0,
             "snippet": "payload.7z", "description": "Cannot open .7z"},
        ]))
        _write(tmp_path / "archive.err", "")
        _write(tmp_path / "archive.exit", "0")
        report = module.build_report(str(tmp_path), str(repo), "false")
        assert report["coverage_status"]["overall"] == "UNSUPPORTED"
        assert report["coverage_status"]["per_scanner"]["archive"]["status"] == "UNSUPPORTED"
        # An UNSUPPORTED gap over an ARCHIVE is a live uninspected
        # indirection, so the report may no longer claim exit 0 over it. The
        # floor is 1 (review), not 2 — nothing malicious is confirmed.
        assert report["exit_code"] == 1
        assert any(f["category"] == "coverage-gap" for f in report["findings"])

    def test_build_report_coverage_does_not_change_exit_code(self, tmp_path):
        repo = _scan_dir(tmp_path)
        # A critical secret plus an unsupported archive: core exit code stays 2.
        _write(tmp_path / "secrets.out", json.dumps([
            {"scanner": "secrets", "severity": "critical", "category": "secret",
             "title": "Key", "file": "x.py", "line": 1, "confidence": 0.95},
        ]))
        _write(tmp_path / "secrets.err", "")
        _write(tmp_path / "secrets.exit", "0")
        _write(tmp_path / "archive.out", json.dumps([
            {"scanner": "archive", "severity": "low", "category": "unsupported-archive-type",
             "title": "Unsupported archive type", "file": "payload.7z", "line": 0},
        ]))
        _write(tmp_path / "archive.err", "")
        _write(tmp_path / "archive.exit", "0")
        report = module.build_report(str(tmp_path), str(repo), "false")
        assert report["exit_code"] == 2
        assert report["coverage_status"]["overall"] == "UNSUPPORTED"
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 194kUpdated Claude CodeCodexVerifiedInstall