Skip to content

alexgreensh/repo-forensics / skills/repo-forensics

repo-forensics

Flagged

Security forensics for git repos, AI skills, and MCP servers. Audits dependencies, detects prompt injection, credential theft, runtime dynamism, manifest drift, known CVEs, CISA KEV (actively exploited) vulns, and 2026 attack patterns. Not for fixing vulnerabilities or pentesting.

FileKindSize
.gitignoreother193 B
SKILL.mdskill md43.4 KB
checksums.jsonconfig10.8 KB
checksums.json.sigother64 B
data/README.mdmarkdown1.3 KB
data/compromised_versions.jsonconfig188.3 KB
data/rule_ids.csvother35.3 KB
data/rulepacks/.gitkeepother221 B
data/rulepacks/dead_anchors.jsonconfig9.0 KB
data/rulepacks/mcp_security.jsonconfig31.2 KB
data/rulepacks/runtime_dynamism.jsonconfig46.7 KB
data/rulepacks/sast.jsonconfig107.6 KB
data/rulepacks/secrets.jsonconfig30.4 KB
data/rulepacks/shared.jsonconfig4.4 KB
data/rulepacks/skill_threats.jsonconfig95.4 KB
data/runtime_floors.jsonconfig2.3 KB
data/yara/cryptominers.yarother1.8 KB
data/yara/hacktools.yarother2.2 KB
data/yara/malware.yarother2.2 KB
data/yara/manifest.jsonconfig8.0 KB
data/yara/webshells.yarother2.5 KB
references/cursor-hook-contract.mdmarkdown5.6 KB
references/kernel_privesc_sandbox_pack.mdmarkdown5.0 KB
references/mcp-attack-patterns.mdmarkdown8.7 KB
references/research_sources.mdmarkdown8.0 KB
references/threat_patterns.mdmarkdown20.3 KB
scripts/_context_gate.pyscript21.7 KB
scripts/_ed25519.pyscript5.1 KB
scripts/_pyc_unmarshal.pyscript17.1 KB
scripts/_shared_patterns.pyscript4.8 KB
scripts/adjudication.pyscript16.4 KB
scripts/adjudication_bridge.pyscript1.0 KB
scripts/aggregate_json.pyscript69.2 KB
scripts/auto_scan.pyexecutablescript152.1 KB
scripts/corpus_sync.pyscript10.0 KB
scripts/cursor_pre_scan.pyscript22.5 KB
scripts/dast_sandbox.sbother1.6 KB
scripts/dead_anchors_extract.pyscript14.8 KB
scripts/dead_anchors_probe.pyscript27.1 KB
scripts/forensics_core.pyscript176.5 KB
scripts/gen_rule_ids.pyscript8.6 KB
scripts/hook_adapter.pyscript19.4 KB
scripts/ioc_manager.pyscript49.6 KB
scripts/parse_pnpm_lock.pyscript7.9 KB
scripts/pre_scan.pyscript143.5 KB
scripts/pypi_pins.pyscript8.1 KB
scripts/refresh_controller.pyexecutablescript48.4 KB
scripts/refresh_threat_dbs.pyexecutablescript19.4 KB
scripts/rule_loader.pyscript44.8 KB
scripts/rulepack_feed.pyscript26.4 KB
scripts/run_forensics.shexecutablescript20.3 KB
scripts/sarif_export.pyscript18.6 KB
scripts/scan_agent_skills.pyscript33.2 KB
scripts/scan_archive.pyscript29.1 KB
scripts/scan_ast.pyscript44.9 KB
scripts/scan_binary.pyscript10.9 KB
scripts/scan_bytecode.pyscript28.2 KB
scripts/scan_dast.pyscript28.8 KB
scripts/scan_dataflow.pyscript15.4 KB
scripts/scan_dead_anchors.pyscript15.9 KB
scripts/scan_decode.pyscript37.5 KB
scripts/scan_dependencies.pyscript124.5 KB
scripts/scan_devcontainer.pyscript8.5 KB
scripts/scan_entropy.pyscript15.6 KB
scripts/scan_entrypoint.pyscript34.3 KB
scripts/scan_git_config.pyscript96.3 KB
scripts/scan_git_forensics.pyscript24.1 KB
scripts/scan_history.pyscript14.5 KB
scripts/scan_infra.pyscript54.3 KB
scripts/scan_integrity.pyscript41.0 KB
scripts/scan_lifecycle.pyscript65.1 KB
scripts/scan_manifest_drift.pyscript47.0 KB
scripts/scan_mcp_security.pyscript42.3 KB
scripts/scan_oversize.pyscript11.7 KB
scripts/scan_post_incident.pyscript36.9 KB
scripts/scan_provenance.pyscript19.4 KB
scripts/scan_runtime_dynamism.pyscript23.5 KB
scripts/scan_runtime_floors.pyscript33.5 KB
scripts/scan_sast.pyscript59.1 KB
scripts/scan_secrets.pyscript11.9 KB
scripts/scan_skill_threats.pyscript102.4 KB
scripts/scan_splitstream.pyscript29.5 KB
scripts/scan_yara.pyscript19.7 KB
scripts/session_scan.pyscript54.1 KB
scripts/suppressions.pyscript15.4 KB
scripts/validate_manifests.pyscript13.7 KB
scripts/verify_install.pyscript26.2 KB
scripts/vuln_feed.pyscript31.1 KB
tests/conftest.pyscript13.4 KB
tests/corpus/DEAD_ANCHORS_CORPUS.mdmarkdown2.3 KB
tests/corpus/budgets.jsonconfig5.6 KB
tests/cursor_helpers.pyscript12.6 KB
tests/fixtures/legacy_main_blocks.jsonconfig10.3 KB
tests/fixtures/powershell_verdict_corpus.jsonconfig114.9 KB
tests/golden/parity_mcp_security.jsonconfig17.5 KB
tests/golden/parity_runtime_dynamism.jsonconfig31.7 KB
tests/golden/parity_sast.jsonconfig59.8 KB
tests/golden/parity_secrets.jsonconfig18.8 KB
tests/golden/parity_skill_threats.jsonconfig48.8 KB
tests/parity_corpus.pyscript6.3 KB
tests/powershell_hook.pyscript8.2 KB
tests/report_builders.pyscript5.0 KB
tests/schemas/sarif-schema-2.1.0.jsonconfig109.1 KB
tests/shell_compat.pyscript2.2 KB
tests/test_adjudication_bridge.pyscript832 B
tests/test_adjudication_containment.pyscript1.4 KB
tests/test_adjudication_output.pyscript20.0 KB
tests/test_adjudication_suppressions.pyscript18.7 KB
tests/test_advisory_adjudication.pyscript1.3 KB
tests/test_agent_relay_rules.pyscript7.8 KB
tests/test_aggregate_json.pyscript10.0 KB
tests/test_auto_scan_patterns.pyscript10.5 KB
tests/test_benign_corpus.pyscript16.4 KB
tests/test_benign_new_scanners.pyscript6.1 KB
tests/test_build_output_skip.pyscript10.6 KB
tests/test_capability_ledger.pyscript18.8 KB
tests/test_codex_install.pyscript10.0 KB
tests/test_codex_marketplace.pyscript3.3 KB
tests/test_comment_false_positives.pyscript2.2 KB
tests/test_composer_dependencies.pyscript4.0 KB
tests/test_compromised_versions.pyscript51.2 KB
tests/test_context_gate.pyscript32.4 KB
tests/test_coverage_status.pyscript7.6 KB
tests/test_css_compounding_shrink.pyscript20.8 KB
tests/test_cursor_adapter.pyscript7.8 KB
tests/test_cursor_benign.pyscript3.4 KB
tests/test_cursor_degrade.pyscript12.7 KB
tests/test_cursor_install.pyscript17.1 KB
tests/test_cursor_latency.pyscript7.2 KB
tests/test_cursor_parity.pyscript5.8 KB
tests/test_cursor_redteam_fn.pyscript4.9 KB
tests/test_cursor_tamper_modify.pyscript14.2 KB
tests/test_cursor_wiring.pyscript32.3 KB
tests/test_d1_yara_correlation.pyscript9.2 KB
tests/test_dead_anchors_extract.pyscript7.6 KB
tests/test_dead_anchors_probe.pyscript19.7 KB
tests/test_evidence_engine_parity.pyscript8.1 KB
tests/test_evidence_model.pyscript11.4 KB
tests/test_forensics_core.pyscript79.2 KB
tests/test_fp_hardening_r3.pyscript9.7 KB
tests/test_fp_hardening_r4.pyscript18.8 KB
tests/test_fp_regression_pairs.pyscript62.5 KB
tests/test_fp_structural.pyscript21.2 KB
tests/test_freshness.pyscript6.2 KB
tests/test_frontmatter_validity.pyscript7.0 KB
tests/test_gpg_rce_hotfix.pyscript4.8 KB
tests/test_hook_inert_data.pyscript6.1 KB
tests/test_hook_scripts.pyscript14.0 KB
tests/test_inspection_cpu_budget.pyscript11.6 KB
tests/test_ioc_manager.pyscript55.4 KB
tests/test_kernel_privesc_rules.pyscript27.8 KB
tests/test_legit_precision_regressions.pyscript6.8 KB
tests/test_lethal_trifecta.pyscript20.7 KB
tests/test_manifest_signature.pyscript1.5 KB
tests/test_manifest_validity.pyscript2.9 KB
tests/test_monotonic_trust_e2e.pyscript4.4 KB
tests/test_non_breaking_contract.pyscript22.7 KB
tests/test_openclaw_install.pyscript6.6 KB
tests/test_pack_parity.pyscript24.8 KB
tests/test_parse_pnpm_lock.pyscript10.7 KB
tests/test_plugin_checkout_provenance.pyscript11.1 KB
tests/test_powershell_hook_wire.pyscript10.6 KB
tests/test_powershell_verdict_corpus.pyscript6.2 KB
tests/test_pr44_hardening.pyscript6.5 KB
tests/test_pre_scan.pyscript19.6 KB
tests/test_pre_scan_composer.pyscript7.4 KB
tests/test_precondition_fields.pyscript4.6 KB
tests/test_provenance_offline.pyscript2.5 KB
tests/test_published_rulepack_feed_current.pyscript1.4 KB
tests/test_py38_compat.pyscript3.3 KB
tests/test_pypi_pinned_versions.pyscript19.3 KB
tests/test_pyproject_string_forms.pyscript2.2 KB
tests/test_redteam_fn_regression.pyscript32.5 KB
tests/test_reflective_fetch_execute.pyscript23.5 KB
tests/test_reflective_review_fixes.pyscript17.8 KB
tests/test_refresh_controller.pyscript19.9 KB
tests/test_refresh_rulepacks.pyscript12.4 KB
tests/test_review_gate_regressions.pyscript9.3 KB
tests/test_rule_loader.pyscript23.2 KB
tests/test_rulepack_feed.pyscript38.1 KB
tests/test_run_forensics_json.pyscript1012 B
tests/test_run_scanner_fail_loud.pyscript6.5 KB
tests/test_runtime_floors.pyscript19.8 KB
tests/test_sandbox_probing_rules.pyscript9.6 KB
tests/test_sarif_export.pyscript19.9 KB
tests/test_scan_agent_skills.pyscript31.3 KB
tests/test_scan_archive.pyscript11.6 KB
tests/test_scan_ast.pyscript12.8 KB
tests/test_scan_binary.pyscript15.3 KB
tests/test_scan_bytecode.pyscript21.5 KB
tests/test_scan_dast.pyscript32.1 KB
tests/test_scan_dataflow.pyscript7.1 KB
tests/test_scan_dead_anchors.pyscript11.5 KB
tests/test_scan_decode.pyscript28.0 KB
tests/test_scan_dependencies.pyscript37.8 KB
tests/test_scan_devcontainer.pyscript8.5 KB
tests/test_scan_entropy.pyscript11.2 KB
tests/test_scan_entrypoint.pyscript19.5 KB
tests/test_scan_git_config.pyscript58.5 KB
tests/test_scan_git_config_review_fixes.pyscript33.3 KB

tests/test_scan_entropy.py

View on GitHub
"""Tests for scan_entropy.py - Entropy & Encoding Scanner.

Covers the U2 decode-and-rescan wiring: a flagged base64/hex blob is handed to
scan_decode, so a payload hidden one encoding layer deep is surfaced as an
additive decoded-payload finding without dropping the existing blob finding.
"""

import base64

import scan_entropy as scanner

# Plaintext that trips the SAST/trifecta heuristics once decoded.
# (chr(114) avoids embedding a literal shell pipe in the test source.)
MALICIOUS = b'import os\nos.system(chr(114))\nimport socket\nsubprocess.Popen([])\n'
ENCODED = base64.b64encode(MALICIOUS).decode()


def _cats(findings):
    return [f.category for f in findings]


def test_sha256_manifest_digests_are_not_long_hex_warnings(tmp_path):
    digest = "a" * 64
    manifest = tmp_path / "CHECKSUMS.sha256"
    manifest.write_text(f"{digest}  source.py\n")
    assert not [f for f in scanner.scan_file(str(manifest), manifest.name)
                if f.title == "Long Hex String"]

    ordinary = tmp_path / "payload.txt"
    ordinary.write_text(f"{digest}\n")
    assert [f for f in scanner.scan_file(str(ordinary), ordinary.name)
            if f.title == "Long Hex String"]

    manifest.write_text(f"{digest}  payload-{digest}.py\n")
    assert [f for f in scanner.scan_file(str(manifest), manifest.name)
            if f.title == "Long Hex String"]


def test_pinned_image_and_pip_digests_are_not_long_hex_warnings(tmp_path):
    digest = "cce12316475d7d56d605f76e1d811d0dc4e7227f2d4afd29951521264f504ff8"
    dockerfile = tmp_path / "Dockerfile"
    dockerfile.write_text(f"FROM python:3.11-slim@sha256:{digest} AS runtime\n")
    reqs = tmp_path / "requirements.txt"
    reqs.write_text(f"requests==2.32.3 \\\n    --hash=sha256:{digest}\n")
    for path in (dockerfile, reqs):
        assert not [f for f in scanner.scan_file(str(path), path.name)
                    if f.title == "Long Hex String"], path.name

    # The rule still fires on other long hex runs, including a longer run
    # hiding behind a digest prefix.
    other = tmp_path / "blob.py"
    other.write_text(f'blob = "{digest}"\nx = "img@sha256:{digest}{digest}"\n')
    hits = [f for f in scanner.scan_file(str(other), other.name)
            if f.title == "Long Hex String"]
    assert [f.line for f in hits] == [1, 2]
    assert all(f.severity == "high" for f in hits)


class TestDecodeAndRescan:
    def test_base64_payload_flags_both_findings(self, tmp_path):
        """A base64 blob encoding os.system produces BOTH the existing encoding
        finding AND an additive decoded-payload finding."""
        f = tmp_path / "evil.txt"
        f.write_text('payload = "%s"\n' % ENCODED)
        findings = scanner.scan_file(str(f), "evil.txt")
        cats = _cats(findings)
        assert "encoding" in cats, "existing base64 block finding must remain"
        assert "decoded-payload" in cats, "decoded os.system must be surfaced"

    def test_same_blob_twice_decodes_once(self, tmp_path):
        """The same blob on two lines is decoded only once (dedup): exactly one
        unique decode, so decoded-payload findings are not duplicated per line."""
        f = tmp_path / "evil.txt"
        f.write_text('a = "%s"\nb = "%s"\n' % (ENCODED, ENCODED))
        findings = scanner.scan_file(str(f), "evil.txt")
        # Two encoding findings (one per line) but the decode ran once. scan_decode
        # emits a fixed set of findings per decode; that count must not double.
        single = tmp_path / "single.txt"
        single.write_text('a = "%s"\n' % ENCODED)
        single_payloads = [c for c in _cats(scanner.scan_file(str(single), "single.txt"))
                           if c == "decoded-payload"]
        double_payloads = [c for c in _cats(findings) if c == "decoded-payload"]
        assert len(double_payloads) == len(single_payloads), \
            "repeated blob must decode once, not once per occurrence"

    def test_benign_base64_no_payload(self, tmp_path):
        """Regression: benign base64 (harmless text) must NOT add a
        decoded-payload finding (no severity inflation)."""
        benign = base64.b64encode(
            b'the quick brown fox jumps over the lazy dog repeatedly today and tomorrow'
        ).decode()
        f = tmp_path / "benign.txt"
        f.write_text('blob = "%s"\n' % benign)
        findings = scanner.scan_file(str(f), "benign.txt")
        assert "decoded-payload" not in _cats(findings), \
            "benign base64 must not inflate into a decoded-payload finding"


# A short base64 payload (just over the 50-char pattern floor, UNDER the old
# 80-char visible-finding gate that used to gate the decode feed too: torture C1).
_SHORT_PLAIN = b'import os\nos.system(chr(105))\nimport socket'
_SHORT_ENCODED = base64.b64encode(_SHORT_PLAIN).decode()


class TestShortBase64Decoded:
    def test_short_base64_under_80_is_decoded(self, tmp_path):
        """A base64 blob of 50-79 chars (no visible Base64 Block finding) is STILL
        routed to scan_decode, so a short payload one layer deep is caught
        (torture C1: the 80-char floor on the decode feed defeated short payloads)."""
        assert 50 <= len(_SHORT_ENCODED) < 80, "fixture must be in the 50-79 band"
        f = tmp_path / "short.txt"
        f.write_text('x = "%s"\n' % _SHORT_ENCODED)
        findings = scanner.scan_file(str(f), "short.txt")
        titles = [x.title for x in findings]
        assert "Base64 Encoded Block" not in titles, \
            "a <80 char base64 must not raise the visible block finding"
        assert "decoded-payload" in _cats(findings), \
            "a short (<80) base64 payload must still be decoded and flagged"


class TestBase85Base32Routed:
    """torture H1: scan_entropy only routed base64/hex; base85/base32-hidden
    payloads slipped through end-to-end even though scan_decode handles them."""

    def test_base85_payload_routed(self, tmp_path):
        enc = base64.a85encode(MALICIOUS).decode()
        f = tmp_path / "b85.txt"
        f.write_text('y = "%s"\n' % enc)
        findings = scanner.scan_file(str(f), "b85.txt")
        assert "decoded-payload" in _cats(findings), "base85 payload must be flagged"

    def test_base32_payload_routed(self, tmp_path):
        enc = base64.b32encode(MALICIOUS).decode()
        f = tmp_path / "b32.txt"
        f.write_text('z = "%s"\n' % enc)
        findings = scanner.scan_file(str(f), "b32.txt")
        assert "decoded-payload" in _cats(findings), "base32 payload must be flagged"

    def test_benign_base85_no_payload(self, tmp_path):
        benign = base64.a85encode(
            b'the quick brown fox jumps over the lazy dog repeatedly today tomorrow'
        ).decode()
        f = tmp_path / "benign85.txt"
        f.write_text('y = "%s"\n' % benign)
        assert "decoded-payload" not in _cats(scanner.scan_file(str(f), "benign85.txt"))

    def test_rfc1924_b85_payload_routed(self, tmp_path):
        """Adversarial P1-1 regression at the entropy ROUTING level: a real
        base64.b85encode payload (RFC1924, uses v-z/{|}~) was split by the old
        `[!-u]` regex into sub-floor fragments and never routed. The hoisted
        detect_encoded_blobs now matches it whole."""
        enc = base64.b85encode(MALICIOUS).decode()
        assert any(c in enc for c in "vwxyz{|}~"), "fixture must exercise the gap"
        f = tmp_path / "b85rfc.txt"
        f.write_text('w = "%s"\n' % enc)
        findings = scanner.scan_file(str(f), "b85rfc.txt")
        assert "decoded-payload" in _cats(findings), \
            "a real RFC1924 b85 payload must now be routed + flagged"


class TestSharedBudgetBounded:
    """torture: re-arming a fresh 12s deadline per blob let N blobs blow the 15s
    auto_scan SIGKILL into a silent zero. One shared budget across all blobs in a
    file (and across files in main()) keeps the whole scan fast and bounded."""

    def test_many_blobs_one_file_fast(self, tmp_path):
        import time
        enc = base64.b64encode(MALICIOUS).decode()
        lines = "\n".join('v%d = "%s"' % (i, enc + ("A" * (i % 4)))
                          for i in range(40))
        f = tmp_path / "many.txt"
        f.write_text(lines)
        t0 = time.monotonic()
        findings = scanner.scan_file(str(f), "many.txt")
        elapsed = time.monotonic() - t0
        # 40 distinct blobs. With per-blob re-arm this could approach 40*12s; with
        # ONE shared budget it must finish in a small bounded time, well under the
        # 12s single-budget deadline.
        assert elapsed < 11, "shared budget must keep the whole scan well bounded"
        assert any(x.category == "decoded-payload" for x in findings)

    def test_main_threads_one_budget(self, tmp_path, monkeypatch):
        """main() must mint exactly ONE budget and thread it into every file."""
        import scan_decode
        calls = {"n": 0}
        real = scan_decode.new_budget

        def counting_new_budget(deadline=None):
            calls["n"] += 1
            return real(deadline=deadline)

        monkeypatch.setattr(scan_decode, "new_budget", counting_new_budget)
        enc = base64.b64encode(MALICIOUS).decode()
        for name in ("a.txt", "b.txt", "c.txt"):
            (tmp_path / name).write_text('p = "%s"\n' % enc)
        monkeypatch.setattr("sys.argv", ["scan_entropy.py", str(tmp_path), "--format", "json"])
        scanner.main()
        assert calls["n"] == 1, "main() must mint exactly one shared budget for the scan"


class TestIssue38HexStringDescription:
    """Regression (Issue #38, defense-in-depth): the `Long Hex String` finding's
    description must NOT contain the substring `shell` — keeping it source-clean
    means a downstream correlation rule cannot accidentally satisfy its
    code-execution side by reading the entropy finding's own prose."""

    def test_long_hex_string_description_excludes_shell_substring(self, tmp_path):
        f = tmp_path / "hx.txt"
        # 64+ char hex string (no 0x prefix)
        f.write_text("deadbeef" * 12 + "\n")
        findings = scanner.scan_file(str(f), "hx.txt")
        lex_findings = [x for x in findings if x.title == "Long Hex String"]
        assert lex_findings, "fixture must produce at least one Long Hex String finding"
        for fx in lex_findings:
            assert "shell" not in fx.description.lower(), (
                "Long Hex String description must not contain 'shell' "
                "because that substring matches forensics_core.Rule 2 "
                "exec_keywords and would let a single entropy finding "
                "self-correlate. See Issue #38."
            )

    def test_long_hex_string_description_excludes_exec_keywords(self, tmp_path):
        f = tmp_path / "hx.txt"
        f.write_text("deadbeef" * 12 + "\n")
        findings = scanner.scan_file(str(f), "hx.txt")
        lex_findings = [x for x in findings if x.title == "Long Hex String"]
        assert lex_findings
        # Defense in depth: also assert the loose exec_keywords set cannot
        # match the entropy finding's description.
        EXEC_KW = {"eval", "exec", "system", "subprocess", "code execution", "shell"}
        for fx in lex_findings:
            tags = (fx.description + " " + fx.title + " " + fx.category).lower()
            for kw in EXEC_KW:
                assert kw not in tags, (
                    "Long Hex String finding must not contain exec_keywords "
                    f"substring {kw!r}; found in: {tags!r}"
                )
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 194kUpdated Claude CodeCodexVerifiedInstall