Skip to content

alexgreensh/repo-forensics / skills/repo-forensics

repo-forensics

Flagged

Security forensics for git repos, AI skills, and MCP servers. Audits dependencies, detects prompt injection, credential theft, runtime dynamism, manifest drift, known CVEs, CISA KEV (actively exploited) vulns, and 2026 attack patterns. Not for fixing vulnerabilities or pentesting.

FileKindSize
.gitignoreother193 B
SKILL.mdskill md43.4 KB
checksums.jsonconfig10.8 KB
checksums.json.sigother64 B
data/README.mdmarkdown1.3 KB
data/compromised_versions.jsonconfig188.3 KB
data/rule_ids.csvother35.3 KB
data/rulepacks/.gitkeepother221 B
data/rulepacks/dead_anchors.jsonconfig9.0 KB
data/rulepacks/mcp_security.jsonconfig31.2 KB
data/rulepacks/runtime_dynamism.jsonconfig46.7 KB
data/rulepacks/sast.jsonconfig107.6 KB
data/rulepacks/secrets.jsonconfig30.4 KB
data/rulepacks/shared.jsonconfig4.4 KB
data/rulepacks/skill_threats.jsonconfig95.4 KB
data/runtime_floors.jsonconfig2.3 KB
data/yara/cryptominers.yarother1.8 KB
data/yara/hacktools.yarother2.2 KB
data/yara/malware.yarother2.2 KB
data/yara/manifest.jsonconfig8.0 KB
data/yara/webshells.yarother2.5 KB
references/cursor-hook-contract.mdmarkdown5.6 KB
references/kernel_privesc_sandbox_pack.mdmarkdown5.0 KB
references/mcp-attack-patterns.mdmarkdown8.7 KB
references/research_sources.mdmarkdown8.0 KB
references/threat_patterns.mdmarkdown20.3 KB
scripts/_context_gate.pyscript21.7 KB
scripts/_ed25519.pyscript5.1 KB
scripts/_pyc_unmarshal.pyscript17.1 KB
scripts/_shared_patterns.pyscript4.8 KB
scripts/adjudication.pyscript16.4 KB
scripts/adjudication_bridge.pyscript1.0 KB
scripts/aggregate_json.pyscript69.2 KB
scripts/auto_scan.pyexecutablescript152.1 KB
scripts/corpus_sync.pyscript10.0 KB
scripts/cursor_pre_scan.pyscript22.5 KB
scripts/dast_sandbox.sbother1.6 KB
scripts/dead_anchors_extract.pyscript14.8 KB
scripts/dead_anchors_probe.pyscript27.1 KB
scripts/forensics_core.pyscript176.5 KB
scripts/gen_rule_ids.pyscript8.6 KB
scripts/hook_adapter.pyscript19.4 KB
scripts/ioc_manager.pyscript49.6 KB
scripts/parse_pnpm_lock.pyscript7.9 KB
scripts/pre_scan.pyscript143.5 KB
scripts/pypi_pins.pyscript8.1 KB
scripts/refresh_controller.pyexecutablescript48.4 KB
scripts/refresh_threat_dbs.pyexecutablescript19.4 KB
scripts/rule_loader.pyscript44.8 KB
scripts/rulepack_feed.pyscript26.4 KB
scripts/run_forensics.shexecutablescript20.3 KB
scripts/sarif_export.pyscript18.6 KB
scripts/scan_agent_skills.pyscript33.2 KB
scripts/scan_archive.pyscript29.1 KB
scripts/scan_ast.pyscript44.9 KB
scripts/scan_binary.pyscript10.9 KB
scripts/scan_bytecode.pyscript28.2 KB
scripts/scan_dast.pyscript28.8 KB
scripts/scan_dataflow.pyscript15.4 KB
scripts/scan_dead_anchors.pyscript15.9 KB
scripts/scan_decode.pyscript37.5 KB
scripts/scan_dependencies.pyscript124.5 KB
scripts/scan_devcontainer.pyscript8.5 KB
scripts/scan_entropy.pyscript15.6 KB
scripts/scan_entrypoint.pyscript34.3 KB
scripts/scan_git_config.pyscript96.3 KB
scripts/scan_git_forensics.pyscript24.1 KB
scripts/scan_history.pyscript14.5 KB
scripts/scan_infra.pyscript54.3 KB
scripts/scan_integrity.pyscript41.0 KB
scripts/scan_lifecycle.pyscript65.1 KB
scripts/scan_manifest_drift.pyscript47.0 KB
scripts/scan_mcp_security.pyscript42.3 KB
scripts/scan_oversize.pyscript11.7 KB
scripts/scan_post_incident.pyscript36.9 KB
scripts/scan_provenance.pyscript19.4 KB
scripts/scan_runtime_dynamism.pyscript23.5 KB
scripts/scan_runtime_floors.pyscript33.5 KB
scripts/scan_sast.pyscript59.1 KB
scripts/scan_secrets.pyscript11.9 KB
scripts/scan_skill_threats.pyscript102.4 KB
scripts/scan_splitstream.pyscript29.5 KB
scripts/scan_yara.pyscript19.7 KB
scripts/session_scan.pyscript54.1 KB
scripts/suppressions.pyscript15.4 KB
scripts/validate_manifests.pyscript13.7 KB
scripts/verify_install.pyscript26.2 KB
scripts/vuln_feed.pyscript31.1 KB
tests/conftest.pyscript13.4 KB
tests/corpus/DEAD_ANCHORS_CORPUS.mdmarkdown2.3 KB
tests/corpus/budgets.jsonconfig5.6 KB
tests/cursor_helpers.pyscript12.6 KB
tests/fixtures/legacy_main_blocks.jsonconfig10.3 KB
tests/fixtures/powershell_verdict_corpus.jsonconfig114.9 KB
tests/golden/parity_mcp_security.jsonconfig17.5 KB
tests/golden/parity_runtime_dynamism.jsonconfig31.7 KB
tests/golden/parity_sast.jsonconfig59.8 KB
tests/golden/parity_secrets.jsonconfig18.8 KB
tests/golden/parity_skill_threats.jsonconfig48.8 KB
tests/parity_corpus.pyscript6.3 KB
tests/powershell_hook.pyscript8.2 KB
tests/report_builders.pyscript5.0 KB
tests/schemas/sarif-schema-2.1.0.jsonconfig109.1 KB
tests/shell_compat.pyscript2.2 KB
tests/test_adjudication_bridge.pyscript832 B
tests/test_adjudication_containment.pyscript1.4 KB
tests/test_adjudication_output.pyscript20.0 KB
tests/test_adjudication_suppressions.pyscript18.7 KB
tests/test_advisory_adjudication.pyscript1.3 KB
tests/test_agent_relay_rules.pyscript7.8 KB
tests/test_aggregate_json.pyscript10.0 KB
tests/test_auto_scan_patterns.pyscript10.5 KB
tests/test_benign_corpus.pyscript16.4 KB
tests/test_benign_new_scanners.pyscript6.1 KB
tests/test_build_output_skip.pyscript10.6 KB
tests/test_capability_ledger.pyscript18.8 KB
tests/test_codex_install.pyscript10.0 KB
tests/test_codex_marketplace.pyscript3.3 KB
tests/test_comment_false_positives.pyscript2.2 KB
tests/test_composer_dependencies.pyscript4.0 KB
tests/test_compromised_versions.pyscript51.2 KB
tests/test_context_gate.pyscript32.4 KB
tests/test_coverage_status.pyscript7.6 KB
tests/test_css_compounding_shrink.pyscript20.8 KB
tests/test_cursor_adapter.pyscript7.8 KB
tests/test_cursor_benign.pyscript3.4 KB
tests/test_cursor_degrade.pyscript12.7 KB
tests/test_cursor_install.pyscript17.1 KB
tests/test_cursor_latency.pyscript7.2 KB
tests/test_cursor_parity.pyscript5.8 KB
tests/test_cursor_redteam_fn.pyscript4.9 KB
tests/test_cursor_tamper_modify.pyscript14.2 KB
tests/test_cursor_wiring.pyscript32.3 KB
tests/test_d1_yara_correlation.pyscript9.2 KB
tests/test_dead_anchors_extract.pyscript7.6 KB
tests/test_dead_anchors_probe.pyscript19.7 KB
tests/test_evidence_engine_parity.pyscript8.1 KB
tests/test_evidence_model.pyscript11.4 KB
tests/test_forensics_core.pyscript79.2 KB
tests/test_fp_hardening_r3.pyscript9.7 KB
tests/test_fp_hardening_r4.pyscript18.8 KB
tests/test_fp_regression_pairs.pyscript62.5 KB
tests/test_fp_structural.pyscript21.2 KB
tests/test_freshness.pyscript6.2 KB
tests/test_frontmatter_validity.pyscript7.0 KB
tests/test_gpg_rce_hotfix.pyscript4.8 KB
tests/test_hook_inert_data.pyscript6.1 KB
tests/test_hook_scripts.pyscript14.0 KB
tests/test_inspection_cpu_budget.pyscript11.6 KB
tests/test_ioc_manager.pyscript55.4 KB
tests/test_kernel_privesc_rules.pyscript27.8 KB
tests/test_legit_precision_regressions.pyscript6.8 KB
tests/test_lethal_trifecta.pyscript20.7 KB
tests/test_manifest_signature.pyscript1.5 KB
tests/test_manifest_validity.pyscript2.9 KB
tests/test_monotonic_trust_e2e.pyscript4.4 KB
tests/test_non_breaking_contract.pyscript22.7 KB
tests/test_openclaw_install.pyscript6.6 KB
tests/test_pack_parity.pyscript24.8 KB
tests/test_parse_pnpm_lock.pyscript10.7 KB
tests/test_plugin_checkout_provenance.pyscript11.1 KB
tests/test_powershell_hook_wire.pyscript10.6 KB
tests/test_powershell_verdict_corpus.pyscript6.2 KB
tests/test_pr44_hardening.pyscript6.5 KB
tests/test_pre_scan.pyscript19.6 KB
tests/test_pre_scan_composer.pyscript7.4 KB
tests/test_precondition_fields.pyscript4.6 KB
tests/test_provenance_offline.pyscript2.5 KB
tests/test_published_rulepack_feed_current.pyscript1.4 KB
tests/test_py38_compat.pyscript3.3 KB
tests/test_pypi_pinned_versions.pyscript19.3 KB
tests/test_pyproject_string_forms.pyscript2.2 KB
tests/test_redteam_fn_regression.pyscript32.5 KB
tests/test_reflective_fetch_execute.pyscript23.5 KB
tests/test_reflective_review_fixes.pyscript17.8 KB
tests/test_refresh_controller.pyscript19.9 KB
tests/test_refresh_rulepacks.pyscript12.4 KB
tests/test_review_gate_regressions.pyscript9.3 KB
tests/test_rule_loader.pyscript23.2 KB
tests/test_rulepack_feed.pyscript38.1 KB
tests/test_run_forensics_json.pyscript1012 B
tests/test_run_scanner_fail_loud.pyscript6.5 KB
tests/test_runtime_floors.pyscript19.8 KB
tests/test_sandbox_probing_rules.pyscript9.6 KB
tests/test_sarif_export.pyscript19.9 KB
tests/test_scan_agent_skills.pyscript31.3 KB
tests/test_scan_archive.pyscript11.6 KB
tests/test_scan_ast.pyscript12.8 KB
tests/test_scan_binary.pyscript15.3 KB
tests/test_scan_bytecode.pyscript21.5 KB
tests/test_scan_dast.pyscript32.1 KB
tests/test_scan_dataflow.pyscript7.1 KB
tests/test_scan_dead_anchors.pyscript11.5 KB
tests/test_scan_decode.pyscript28.0 KB
tests/test_scan_dependencies.pyscript37.8 KB
tests/test_scan_devcontainer.pyscript8.5 KB
tests/test_scan_entropy.pyscript11.2 KB
tests/test_scan_entrypoint.pyscript19.5 KB
tests/test_scan_git_config.pyscript58.5 KB
tests/test_scan_git_config_review_fixes.pyscript33.3 KB

tests/test_dead_anchors_extract.py

View on GitHub
"""Tests for dead_anchors_extract.py — U1 anchor extraction (zero network)."""

import os

import pytest

import dead_anchors_extract as extract
import rule_loader


def _write(tmp_path, name, body):
    p = tmp_path / name
    p.write_text(body, encoding="utf-8")
    return tmp_path


def _anchors(tmp_path):
    return extract.extract_anchors(str(tmp_path))


def _by_type(anchors, t):
    return [a for a in anchors if a.type == t]


# --- GitHub extraction -------------------------------------------------------

def test_github_url_extracts_owner_repo(tmp_path):
    _write(tmp_path, "SKILL.md", "source at github.com/torvalds/linux here")
    gh = _by_type(_anchors(tmp_path), "github")
    assert len(gh) == 1 and gh[0].owner == "torvalds" and gh[0].repo == "linux"


def test_github_shorthand_extracts_same_shape(tmp_path):
    _write(tmp_path, "SKILL.md", "install github:hexiaochun/seedance2-api now")
    gh = _by_type(_anchors(tmp_path), "github")
    assert len(gh) == 1 and gh[0].target == "hexiaochun/seedance2-api"


def test_reserved_word_owner_excluded(tmp_path):
    _write(tmp_path, "SKILL.md", "visit github.com/about for info")
    assert _by_type(_anchors(tmp_path), "github") == []


def test_npx_skills_does_not_double_fire(tmp_path):
    # Not an install verb, not github: prefixed -> extracts NOTHING.
    _write(tmp_path, "SKILL.md", "run npx skills hexiaochun/seedance2-api")
    anchors = _anchors(tmp_path)
    assert _by_type(anchors, "github") == []
    assert _by_type(anchors, "package") == []


def test_github_dedup_single_anchor(tmp_path):
    _write(tmp_path, "SKILL.md",
           "github.com/x/y\nlater again https://github.com/x/y done")
    assert len(_by_type(_anchors(tmp_path), "github")) == 1


# --- package extraction ------------------------------------------------------

def test_pip_install_strips_version(tmp_path):
    _write(tmp_path, "SKILL.md", "pip install requests==2.31.0")
    pk = _by_type(_anchors(tmp_path), "package")
    assert len(pk) == 1 and pk[0].ecosystem == "PyPI"
    assert pk[0].target == "PyPI:requests"


def test_npm_install_strips_flag_and_specifier(tmp_path):
    _write(tmp_path, "SKILL.md", "npm install --save lodash@^4.17.0")
    pk = _by_type(_anchors(tmp_path), "package")
    assert len(pk) == 1 and pk[0].target == "npm:lodash"


def test_gem_cargo_not_probed_in_p0(tmp_path):
    _write(tmp_path, "SKILL.md", "gem install rails\ncargo install ripgrep")
    # ecosystem=None entries are dropped from the returned set (not probed).
    assert _by_type(_anchors(tmp_path), "package") == []


def test_no_package_from_prose(tmp_path):
    _write(tmp_path, "SKILL.md", "we install the software manually")
    assert _by_type(_anchors(tmp_path), "package") == []


# --- domain / cloud extraction ----------------------------------------------

def test_bare_cloud_suffix_without_subdomain_excluded(tmp_path):
    _write(tmp_path, "SKILL.md", "hosted somewhere on https://vercel.app today")
    a = _anchors(tmp_path)
    assert _by_type(a, "cloud") == []
    # And it is not RDAP-probed as a bare domain either.
    assert _by_type(a, "domain") == []


def test_cloud_subdomain_flagged_free_tier(tmp_path):
    _write(tmp_path, "SKILL.md", "app at https://myapp.vercel.app/home")
    cl = _by_type(_anchors(tmp_path), "cloud")
    assert len(cl) == 1 and cl[0].suffix == "vercel.app" and cl[0].is_free_tier


def test_safe_domain_allowlist_skipped(tmp_path):
    _write(tmp_path, "SKILL.md", "docs https://docs.python.org/3/library/os.html")
    assert _by_type(_anchors(tmp_path), "domain") == []


def test_compound_tld_reduction(tmp_path):
    _write(tmp_path, "SKILL.md", "link https://sub.example.co.uk/x page")
    dm = _by_type(_anchors(tmp_path), "domain")
    assert len(dm) == 1 and dm[0].target == "example.co.uk"


def test_plain_domain_reduction(tmp_path):
    _write(tmp_path, "SKILL.md", "link https://a.b.example.com/x page")
    dm = _by_type(_anchors(tmp_path), "domain")
    assert len(dm) == 1 and dm[0].target == "example.com"


# --- discovery / robustness --------------------------------------------------

def test_reads_multiple_seed_files(tmp_path):
    _write(tmp_path, "SKILL.md", "github.com/a/b")
    (tmp_path / "AGENTS.md").write_text("pip install flask", encoding="utf-8")
    a = _anchors(tmp_path)
    assert _by_type(a, "github") and _by_type(a, "package")


def test_line_and_file_tracked(tmp_path):
    _write(tmp_path, "SKILL.md", "intro\nsee github.com/a/b\n")
    gh = _by_type(_anchors(tmp_path), "github")[0]
    assert gh.file == "SKILL.md" and gh.line == 2


def test_empty_repo_no_anchors(tmp_path):
    (tmp_path / "main.py").write_text("print('hi')", encoding="utf-8")
    assert _anchors(tmp_path) == []


# --- rulepack self-test ------------------------------------------------------

def test_rulepack_self_tests_pass():
    pack = rule_loader.load_pack("dead_anchors")
    assert pack is not None
    results = rule_loader.self_test_pack(pack)
    failed = [r for r in results if not r.passed]
    assert not failed, f"pack self-test failures: {failed}"
    assert len(pack.all_rules) == 8


# --- torture-room regressions ------------------------------------------------

def test_fifo_seed_file_is_skipped_no_hang(tmp_path):
    # A FIFO named SKILL.md (shippable inside a malicious tar/repo) must be
    # skipped, never opened for read — otherwise extract_anchors blocks forever
    # (python-redos F1). Hard watchdog: the call must complete well under 5s.
    import os
    import threading
    if not hasattr(os, "mkfifo"):
        pytest.skip("mkfifo unavailable on this platform")
    os.mkfifo(str(tmp_path / "SKILL.md"))
    (tmp_path / "AGENTS.md").write_text("github.com/live/repo", encoding="utf-8")
    # Preload the pack in the main thread (rule_loader's SIGALRM ReDoS guard only
    # works in the main thread); the watchdog thread just runs extraction.
    pack = rule_loader.load_pack("dead_anchors")
    result = {}

    def _run():
        result["anchors"] = extract.extract_anchors(str(tmp_path), pack=pack)

    t = threading.Thread(target=_run, daemon=True)
    t.start()
    t.join(5.0)
    assert not t.is_alive(), "extract_anchors hung on a FIFO seed file"
    # The FIFO is skipped; the real AGENTS.md is still processed.
    assert _by_type(result["anchors"], "github")


def test_malformed_pack_non_keyword_rule_no_crash(tmp_path):
    # A pack whose keyword id (DA-CL-001) is tampered into a non-keyword type
    # (rule.values is then None) must degrade to a no-op, never set(None) crash
    # (python-redos F2 / never-hard-fail).
    class _FakeRule:
        def __init__(self, rid, rtype, regex=None, values=None):
            self.id = rid
            self.type = rtype
            self.regex = regex
            self.values = values

    import re as _re

    class _FakePack:
        all_rules = [
            _FakeRule("DA-GH-001", "regex", regex=_re.compile(r"github\.com/(\w+)/(\w+)")),
            _FakeRule("DA-CL-001", "regex", regex=_re.compile(r"x")),  # tampered: no .values
        ]

    _write(tmp_path, "SKILL.md", "github.com/a/b")
    # Must not raise even though DA-CL-001 has values=None.
    anchors = extract.extract_anchors(str(tmp_path), pack=_FakePack())
    assert isinstance(anchors, list)


def test_github_case_variants_dedup_single_anchor(tmp_path):
    _write(tmp_path, "SKILL.md",
           "github.com/Torvalds/Linux\ngithub.com/torvalds/linux\n"
           "github.com/TORVALDS/LINUX")
    assert len(_by_type(_anchors(tmp_path), "github")) == 1


def test_pypi_separator_variants_dedup_single_anchor(tmp_path):
    _write(tmp_path, "SKILL.md",
           "pip install My_Package\npip install my-package\npip install my.package")
    assert len(_by_type(_anchors(tmp_path), "package")) == 1
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 196kUpdated Claude CodeCodexVerifiedInstall