Skip to content

hint-shu/deep-research / skills/osint-research

osint-research

Unverified

OSINT recon skill — passive entity discovery for domain / IP / email / person / company / github user. Builds a hybrid findings/dossier/graph report from free public sources (Whois, DNS, crt.sh, Wayback, Shodan InternetDB, GitHub code search, Tavily/Firecrawl/Exa/Perplexity dorks, optional theHarvester/subfinder). No subscription dependencies. Disclaimer is non-removable; secrets are redacted; blocklisted dump sites are filtered at outbound and inbound levels.

FileKindSize
SKILL.mdskill md6.1 KB
channels/crtsh.shexecutablescript1.8 KB
channels/dorks.shexecutablescript3.5 KB
channels/github-leaks.shexecutablescript2.0 KB
channels/shodan-idb.shexecutablescript2.2 KB
channels/subfinder-wrap.shscript1.8 KB
channels/theharvester-wrap.shexecutablescript1.8 KB
channels/wayback.shexecutablescript1.5 KB
channels/whois-dns.shexecutablescript2.2 KB
lib/entity-classifier.shexecutablescript1.4 KB
lib/findings-extractor.shexecutablescript1.6 KB
lib/inbound-filter.shscript6.9 KB
lib/secret-patterns.txtmarkdown1.1 KB
lib/secret-redactor.shexecutablescript2.3 KB
templates/graph.mmd.tplother53 B
templates/osint-report.md.tplother1.1 KB

lib/findings-extractor.sh

View on GitHub
#!/usr/bin/env bash
# skills/osint-research/lib/findings-extractor.sh
# Assigns CRITICAL/HIGH/MEDIUM/LOW priorities to channel findings.

set -uo pipefail

# Plan defect fix: bash heredoc shadows python's stdin. Write python script
# to a tmp file so python3 inherits parent stdin (the piped NDJSON).
_py_tmp=$(mktemp)
trap 'rm -f "$_py_tmp"' EXIT
cat > "$_py_tmp" <<'PY'
import json, sys, re

CRITICAL_PORTS = {6379, 27017, 9200, 11211, 5432, 3306}  # redis, mongo, es, memcached, pg, mysql
SUSPICIOUS_SUBDOMAIN_RE = re.compile(r'^(admin|dev|staging|test|jenkins|jira|grafana|kibana|metabase|backup|legacy|old)[\.\-]', re.I)
SEP = (',', ':')  # compact JSON to match test assertions

for line in sys.stdin:
    line = line.strip()
    if not line:
        continue
    try:
        rec = json.loads(line)
    except Exception:
        continue

    channel = rec.get("channel", "")
    rtype = rec.get("record_type", "")
    content = rec.get("content", "")
    meta = rec.get("metadata", {}) or {}

    priority = "LOW"

    if channel == "github-leaks" and ("..." in content or "<REDACTED:" in content):
        priority = "CRITICAL"
    elif channel == "shodan-idb" and rtype == "open_port":
        port = meta.get("port")
        if port in CRITICAL_PORTS:
            priority = "CRITICAL"
        elif port in (22, 21, 23, 3389):
            priority = "MEDIUM"
    elif channel == "shodan-idb" and rtype == "cve":
        priority = "HIGH"
    elif rtype == "subdomain" and SUSPICIOUS_SUBDOMAIN_RE.match(content or ""):
        priority = "HIGH"

    rec["priority"] = priority
    print(json.dumps(rec, separators=SEP))
PY
python3 "$_py_tmp"
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 194kUpdated Claude CodeCodexVerifiedInstall