Skip to content

alexgreensh/repo-forensics / skills/repo-forensics

repo-forensics

Flagged

Security forensics for git repos, AI skills, and MCP servers. Audits dependencies, detects prompt injection, credential theft, runtime dynamism, manifest drift, known CVEs, CISA KEV (actively exploited) vulns, and 2026 attack patterns. Not for fixing vulnerabilities or pentesting.

FileKindSize
.gitignoreother193 B
SKILL.mdskill md43.4 KB
checksums.jsonconfig10.8 KB
checksums.json.sigother64 B
data/README.mdmarkdown1.3 KB
data/compromised_versions.jsonconfig188.3 KB
data/rule_ids.csvother35.3 KB
data/rulepacks/.gitkeepother221 B
data/rulepacks/dead_anchors.jsonconfig9.0 KB
data/rulepacks/mcp_security.jsonconfig31.2 KB
data/rulepacks/runtime_dynamism.jsonconfig46.7 KB
data/rulepacks/sast.jsonconfig107.6 KB
data/rulepacks/secrets.jsonconfig30.4 KB
data/rulepacks/shared.jsonconfig4.4 KB
data/rulepacks/skill_threats.jsonconfig95.4 KB
data/runtime_floors.jsonconfig2.3 KB
data/yara/cryptominers.yarother1.8 KB
data/yara/hacktools.yarother2.2 KB
data/yara/malware.yarother2.2 KB
data/yara/manifest.jsonconfig8.0 KB
data/yara/webshells.yarother2.5 KB
references/cursor-hook-contract.mdmarkdown5.6 KB
references/kernel_privesc_sandbox_pack.mdmarkdown5.0 KB
references/mcp-attack-patterns.mdmarkdown8.7 KB
references/research_sources.mdmarkdown8.0 KB
references/threat_patterns.mdmarkdown20.3 KB
scripts/_context_gate.pyscript21.7 KB
scripts/_ed25519.pyscript5.1 KB
scripts/_pyc_unmarshal.pyscript17.1 KB
scripts/_shared_patterns.pyscript4.8 KB
scripts/adjudication.pyscript16.4 KB
scripts/adjudication_bridge.pyscript1.0 KB
scripts/aggregate_json.pyscript69.2 KB
scripts/auto_scan.pyexecutablescript152.1 KB
scripts/corpus_sync.pyscript10.0 KB
scripts/cursor_pre_scan.pyscript22.5 KB
scripts/dast_sandbox.sbother1.6 KB
scripts/dead_anchors_extract.pyscript14.8 KB
scripts/dead_anchors_probe.pyscript27.1 KB
scripts/forensics_core.pyscript176.5 KB
scripts/gen_rule_ids.pyscript8.6 KB
scripts/hook_adapter.pyscript19.4 KB
scripts/ioc_manager.pyscript49.6 KB
scripts/parse_pnpm_lock.pyscript7.9 KB
scripts/pre_scan.pyscript143.5 KB
scripts/pypi_pins.pyscript8.1 KB
scripts/refresh_controller.pyexecutablescript48.4 KB
scripts/refresh_threat_dbs.pyexecutablescript19.4 KB
scripts/rule_loader.pyscript44.8 KB
scripts/rulepack_feed.pyscript26.4 KB
scripts/run_forensics.shexecutablescript20.3 KB
scripts/sarif_export.pyscript18.6 KB
scripts/scan_agent_skills.pyscript33.2 KB
scripts/scan_archive.pyscript29.1 KB
scripts/scan_ast.pyscript44.9 KB
scripts/scan_binary.pyscript10.9 KB
scripts/scan_bytecode.pyscript28.2 KB
scripts/scan_dast.pyscript28.8 KB
scripts/scan_dataflow.pyscript15.4 KB
scripts/scan_dead_anchors.pyscript15.9 KB
scripts/scan_decode.pyscript37.5 KB
scripts/scan_dependencies.pyscript124.5 KB
scripts/scan_devcontainer.pyscript8.5 KB
scripts/scan_entropy.pyscript15.6 KB
scripts/scan_entrypoint.pyscript34.3 KB
scripts/scan_git_config.pyscript96.3 KB
scripts/scan_git_forensics.pyscript24.1 KB
scripts/scan_history.pyscript14.5 KB
scripts/scan_infra.pyscript54.3 KB
scripts/scan_integrity.pyscript41.0 KB
scripts/scan_lifecycle.pyscript65.1 KB
scripts/scan_manifest_drift.pyscript47.0 KB
scripts/scan_mcp_security.pyscript42.3 KB
scripts/scan_oversize.pyscript11.7 KB
scripts/scan_post_incident.pyscript36.9 KB
scripts/scan_provenance.pyscript19.4 KB
scripts/scan_runtime_dynamism.pyscript23.5 KB
scripts/scan_runtime_floors.pyscript33.5 KB
scripts/scan_sast.pyscript59.1 KB
scripts/scan_secrets.pyscript11.9 KB
scripts/scan_skill_threats.pyscript102.4 KB
scripts/scan_splitstream.pyscript29.5 KB
scripts/scan_yara.pyscript19.7 KB
scripts/session_scan.pyscript54.1 KB
scripts/suppressions.pyscript15.4 KB
scripts/validate_manifests.pyscript13.7 KB
scripts/verify_install.pyscript26.2 KB
scripts/vuln_feed.pyscript31.1 KB
tests/conftest.pyscript13.4 KB
tests/corpus/DEAD_ANCHORS_CORPUS.mdmarkdown2.3 KB
tests/corpus/budgets.jsonconfig5.6 KB
tests/cursor_helpers.pyscript12.6 KB
tests/fixtures/legacy_main_blocks.jsonconfig10.3 KB
tests/fixtures/powershell_verdict_corpus.jsonconfig114.9 KB
tests/golden/parity_mcp_security.jsonconfig17.5 KB
tests/golden/parity_runtime_dynamism.jsonconfig31.7 KB
tests/golden/parity_sast.jsonconfig59.8 KB
tests/golden/parity_secrets.jsonconfig18.8 KB
tests/golden/parity_skill_threats.jsonconfig48.8 KB
tests/parity_corpus.pyscript6.3 KB
tests/powershell_hook.pyscript8.2 KB
tests/report_builders.pyscript5.0 KB
tests/schemas/sarif-schema-2.1.0.jsonconfig109.1 KB
tests/shell_compat.pyscript2.2 KB
tests/test_adjudication_bridge.pyscript832 B
tests/test_adjudication_containment.pyscript1.4 KB
tests/test_adjudication_output.pyscript20.0 KB
tests/test_adjudication_suppressions.pyscript18.7 KB
tests/test_advisory_adjudication.pyscript1.3 KB
tests/test_agent_relay_rules.pyscript7.8 KB
tests/test_aggregate_json.pyscript10.0 KB
tests/test_auto_scan_patterns.pyscript10.5 KB
tests/test_benign_corpus.pyscript16.4 KB
tests/test_benign_new_scanners.pyscript6.1 KB
tests/test_build_output_skip.pyscript10.6 KB
tests/test_capability_ledger.pyscript18.8 KB
tests/test_codex_install.pyscript10.0 KB
tests/test_codex_marketplace.pyscript3.3 KB
tests/test_comment_false_positives.pyscript2.2 KB
tests/test_composer_dependencies.pyscript4.0 KB
tests/test_compromised_versions.pyscript51.2 KB
tests/test_context_gate.pyscript32.4 KB
tests/test_coverage_status.pyscript7.6 KB
tests/test_css_compounding_shrink.pyscript20.8 KB
tests/test_cursor_adapter.pyscript7.8 KB
tests/test_cursor_benign.pyscript3.4 KB
tests/test_cursor_degrade.pyscript12.7 KB
tests/test_cursor_install.pyscript17.1 KB
tests/test_cursor_latency.pyscript7.2 KB
tests/test_cursor_parity.pyscript5.8 KB
tests/test_cursor_redteam_fn.pyscript4.9 KB
tests/test_cursor_tamper_modify.pyscript14.2 KB
tests/test_cursor_wiring.pyscript32.3 KB
tests/test_d1_yara_correlation.pyscript9.2 KB
tests/test_dead_anchors_extract.pyscript7.6 KB
tests/test_dead_anchors_probe.pyscript19.7 KB
tests/test_evidence_engine_parity.pyscript8.1 KB
tests/test_evidence_model.pyscript11.4 KB
tests/test_forensics_core.pyscript79.2 KB
tests/test_fp_hardening_r3.pyscript9.7 KB
tests/test_fp_hardening_r4.pyscript18.8 KB
tests/test_fp_regression_pairs.pyscript62.5 KB
tests/test_fp_structural.pyscript21.2 KB
tests/test_freshness.pyscript6.2 KB
tests/test_frontmatter_validity.pyscript7.0 KB
tests/test_gpg_rce_hotfix.pyscript4.8 KB
tests/test_hook_inert_data.pyscript6.1 KB
tests/test_hook_scripts.pyscript14.0 KB
tests/test_inspection_cpu_budget.pyscript11.6 KB
tests/test_ioc_manager.pyscript55.4 KB
tests/test_kernel_privesc_rules.pyscript27.8 KB
tests/test_legit_precision_regressions.pyscript6.8 KB
tests/test_lethal_trifecta.pyscript20.7 KB
tests/test_manifest_signature.pyscript1.5 KB
tests/test_manifest_validity.pyscript2.9 KB
tests/test_monotonic_trust_e2e.pyscript4.4 KB
tests/test_non_breaking_contract.pyscript22.7 KB
tests/test_openclaw_install.pyscript6.6 KB
tests/test_pack_parity.pyscript24.8 KB
tests/test_parse_pnpm_lock.pyscript10.7 KB
tests/test_plugin_checkout_provenance.pyscript11.1 KB
tests/test_powershell_hook_wire.pyscript10.6 KB
tests/test_powershell_verdict_corpus.pyscript6.2 KB
tests/test_pr44_hardening.pyscript6.5 KB
tests/test_pre_scan.pyscript19.6 KB
tests/test_pre_scan_composer.pyscript7.4 KB
tests/test_precondition_fields.pyscript4.6 KB
tests/test_provenance_offline.pyscript2.5 KB
tests/test_published_rulepack_feed_current.pyscript1.4 KB
tests/test_py38_compat.pyscript3.3 KB
tests/test_pypi_pinned_versions.pyscript19.3 KB
tests/test_pyproject_string_forms.pyscript2.2 KB
tests/test_redteam_fn_regression.pyscript32.5 KB
tests/test_reflective_fetch_execute.pyscript23.5 KB
tests/test_reflective_review_fixes.pyscript17.8 KB
tests/test_refresh_controller.pyscript19.9 KB
tests/test_refresh_rulepacks.pyscript12.4 KB
tests/test_review_gate_regressions.pyscript9.3 KB
tests/test_rule_loader.pyscript23.2 KB
tests/test_rulepack_feed.pyscript38.1 KB
tests/test_run_forensics_json.pyscript1012 B
tests/test_run_scanner_fail_loud.pyscript6.5 KB
tests/test_runtime_floors.pyscript19.8 KB
tests/test_sandbox_probing_rules.pyscript9.6 KB
tests/test_sarif_export.pyscript19.9 KB
tests/test_scan_agent_skills.pyscript31.3 KB
tests/test_scan_archive.pyscript11.6 KB
tests/test_scan_ast.pyscript12.8 KB
tests/test_scan_binary.pyscript15.3 KB
tests/test_scan_bytecode.pyscript21.5 KB
tests/test_scan_dast.pyscript32.1 KB
tests/test_scan_dataflow.pyscript7.1 KB
tests/test_scan_dead_anchors.pyscript11.5 KB
tests/test_scan_decode.pyscript28.0 KB
tests/test_scan_dependencies.pyscript37.8 KB
tests/test_scan_devcontainer.pyscript8.5 KB
tests/test_scan_entropy.pyscript11.2 KB
tests/test_scan_entrypoint.pyscript19.5 KB
tests/test_scan_git_config.pyscript58.5 KB
tests/test_scan_git_config_review_fixes.pyscript33.3 KB

tests/test_run_scanner_fail_loud.py

View on GitHub
"""Fail-loud contract for auto_scan.run_scanner (scanner orchestrator).

ROOT-CAUSE bug (preexisting, all scanners): run_scanner ran each scanner as a
subprocess and SILENTLY returned [] on every failure mode — timeout, signal-kill
(SIGKILL/OOM, returncode < 0), error exit (returncode > 2), unparseable JSON, or
a NON-zero exit with empty stdout (the uncaught-exception crash door: rc 1/2 +
traceback on stderr + empty stdout). A clean verdict on an incomplete scan =
detection bypass: an attacker who makes any scanner overrun the 15s budget (OOM)
or simply CRASH thereby suppresses all of that scanner's findings with no trace.
(Torture 2026-06-17 "SIGKILL -> silent zero"; CE review P1 "crash -> silent zero".)

These tests pin that each failure mode now produces a LOUD high-severity
'scan-incomplete' finding that flows into the verdict, while a legitimate
empty/clean result stays [] (no false loud finding) and normal findings pass
through unchanged.
"""

import json
import subprocess

import auto_scan


class _Result:
    """Stand-in for subprocess.CompletedProcess."""

    def __init__(self, returncode, stdout):
        self.returncode = returncode
        self.stdout = stdout
        self.stderr = ""


# subprocess is lazy-imported inside run_scanner, so patch the stdlib name.
def _run_with(monkeypatch, fake):
    monkeypatch.setattr(subprocess, "run", fake)
    return auto_scan.run_scanner("scan_secrets.py", "/some/repo")


def _is_loud(findings):
    return (
        isinstance(findings, list)
        and len(findings) == 1
        and findings[0]["category"] == "scan-incomplete"
        and findings[0]["severity"] == "high"
        and "did not complete" in findings[0]["title"].lower()
    )


# (a) timeout -> loud
def test_timeout_is_loud(monkeypatch):
    def fake(*a, **k):
        raise subprocess.TimeoutExpired(cmd="scan", timeout=15)

    findings = _run_with(monkeypatch, fake)
    assert _is_loud(findings)
    assert "timed out" in findings[0]["description"].lower()
    assert findings[0]["scanner"] == "scan_secrets"


# (b) killed by signal (rc < 0) -> loud
def test_signal_kill_is_loud(monkeypatch):
    def fake(*a, **k):
        return _Result(returncode=-9, stdout="")

    findings = _run_with(monkeypatch, fake)
    assert _is_loud(findings)
    assert "signal 9" in findings[0]["description"].lower()


# (c) error exit (rc > 2) -> loud
def test_error_exit_is_loud(monkeypatch):
    def fake(*a, **k):
        return _Result(returncode=3, stdout="garbage")

    findings = _run_with(monkeypatch, fake)
    assert _is_loud(findings)
    assert "error code 3" in findings[0]["description"].lower()


# (d) unparseable JSON on non-empty stdout -> loud
def test_unparseable_json_is_loud(monkeypatch):
    def fake(*a, **k):
        return _Result(returncode=0, stdout="this is not json {")

    findings = _run_with(monkeypatch, fake)
    assert _is_loud(findings)
    assert "unparseable" in findings[0]["description"].lower()


# (e) legitimate empty + rc 0 -> still [] (no false loud finding)
def test_clean_empty_is_silent(monkeypatch):
    def fake(*a, **k):
        return _Result(returncode=0, stdout="   \n")

    findings = _run_with(monkeypatch, fake)
    assert findings == []


# (g) rc==1 + empty stdout = uncaught-exception CRASH -> loud (P1, CE review).
# A scanner that throws exits 1 with its traceback on stderr and EMPTY stdout.
# That must NOT be read as "ran clean, no findings" — it suppressed the scanner.
def test_crash_rc1_empty_stdout_is_loud(monkeypatch):
    def fake(*a, **k):
        return _Result(returncode=1, stdout="")

    findings = _run_with(monkeypatch, fake)
    assert _is_loud(findings)
    assert "rc 1" in findings[0]["description"].lower()
    assert "crashed" in findings[0]["description"].lower()


# (h) rc==2 + empty stdout -> also loud (non-zero + no output = no results).
def test_crash_rc2_empty_stdout_is_loud(monkeypatch):
    def fake(*a, **k):
        return _Result(returncode=2, stdout="   \n")

    findings = _run_with(monkeypatch, fake)
    assert _is_loud(findings)
    assert "rc 2" in findings[0]["description"].lower()


# (i) rc==1 WITH valid findings JSON -> findings returned, NOT clobbered.
# Some scanners use the exit code as a severity/found signal; if they printed
# findings, those findings are real and must survive.
def test_rc1_with_findings_passes_through(monkeypatch):
    payload = [
        {
            "scanner": "secrets",
            "severity": "high",
            "title": "token",
            "description": "found a token",
            "file": "b.py",
            "line": 9,
            "snippet": "ghp_...",
            "category": "secret",
        }
    ]

    def fake(*a, **k):
        return _Result(returncode=1, stdout=json.dumps(payload))

    findings = _run_with(monkeypatch, fake)
    assert findings == payload


# (f) normal findings pass through unchanged
def test_normal_findings_pass_through(monkeypatch):
    payload = [
        {
            "scanner": "secrets",
            "severity": "critical",
            "title": "AWS key",
            "description": "found a key",
            "file": "a.py",
            "line": 4,
            "snippet": "AKIA...",
            "category": "secret",
        }
    ]

    def fake(*a, **k):
        return _Result(returncode=2, stdout=json.dumps(payload))

    findings = _run_with(monkeypatch, fake)
    assert findings == payload


def test_oserror_launch_failure_is_loud(monkeypatch):
    def fake(*a, **k):
        raise OSError("exec format error")

    findings = _run_with(monkeypatch, fake)
    assert _is_loud(findings)
    assert "oserror" in findings[0]["description"].lower()


# The loud finding actually surfaces in the verdict (not swallowed downstream).
def test_loud_finding_flips_verdict():
    loud = auto_scan._scan_incomplete_finding("scan_secrets.py", "TIMED OUT")
    out = auto_scan.format_output(loud, scanned_target="some/repo")
    assert "VERDICT" in out
    assert "HIGH" in out
    # high-severity loud finding => HIGH verdict line, not a clean "no issues" line.
    assert "no issues found" not in out


def test_loud_finding_shape_survives_finding_dataclass():
    # The synthetic dict must round-trip through forensics_core.Finding the same
    # way real scanner findings do (so correlation + aggregation never crash).
    import forensics_core as core

    loud = auto_scan._scan_incomplete_finding("scan_sast.py", "was KILLED by signal 9")
    objs = core.findings_from_dicts(loud)
    assert len(objs) == 1
    assert objs[0].severity == "high"
    assert objs[0].category == "scan-incomplete"
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 196kUpdated Claude CodeCodexVerifiedInstall