Skip to content

hint-shu/deep-research / skills/osint-research

osint-research

Unverified

OSINT recon skill — passive entity discovery for domain / IP / email / person / company / github user. Builds a hybrid findings/dossier/graph report from free public sources (Whois, DNS, crt.sh, Wayback, Shodan InternetDB, GitHub code search, Tavily/Firecrawl/Exa/Perplexity dorks, optional theHarvester/subfinder). No subscription dependencies. Disclaimer is non-removable; secrets are redacted; blocklisted dump sites are filtered at outbound and inbound levels.

FileKindSize
SKILL.mdskill md6.1 KB
channels/crtsh.shexecutablescript1.8 KB
channels/dorks.shexecutablescript3.5 KB
channels/github-leaks.shexecutablescript2.0 KB
channels/shodan-idb.shexecutablescript2.2 KB
channels/subfinder-wrap.shscript1.8 KB
channels/theharvester-wrap.shexecutablescript1.8 KB
channels/wayback.shexecutablescript1.5 KB
channels/whois-dns.shexecutablescript2.2 KB
lib/entity-classifier.shexecutablescript1.4 KB
lib/findings-extractor.shexecutablescript1.6 KB
lib/inbound-filter.shscript6.9 KB
lib/secret-patterns.txtmarkdown1.1 KB
lib/secret-redactor.shexecutablescript2.3 KB
templates/graph.mmd.tplother53 B
templates/osint-report.md.tplother1.1 KB

channels/subfinder-wrap.sh

View on GitHub
#!/usr/bin/env bash
# skills/osint-research/channels/subfinder-wrap.sh
# Wraps the optional subfinder CLI. Silent no-op when CLI is absent.
# Emits NDJSON: one {"channel":"subfinder",...} object per discovered subdomain.
set -uo pipefail

ENTITY_TYPE=""
TARGET=""
FIXTURE=""
while [ $# -gt 0 ]; do
    case "$1" in
        --type)    ENTITY_TYPE="$2"; shift 2;;
        --target)  TARGET="$2";      shift 2;;
        --fixture) FIXTURE="$2";     shift 2;;
        *) echo "subfinder-wrap: unknown flag: $1" >&2; exit 1;;
    esac
done

[ -z "$TARGET" ] && { echo "subfinder-wrap: empty target" >&2; exit 1; }

# subfinder only makes sense for domain/company targets
case "$ENTITY_TYPE" in
    domain|company) ;;
    *) exit 0;;
esac

# Defense in depth: TARGET must be hostname-shaped before reaching printf.
[[ "$TARGET" =~ ^[a-zA-Z0-9._-]+$ ]] || { echo "subfinder-wrap: invalid target shape: $TARGET" >&2; exit 1; }

if [ -n "$FIXTURE" ]; then
    lines=$(cat "$FIXTURE")
elif command -v subfinder >/dev/null 2>&1; then
    lines=$(subfinder -d "$TARGET" -silent 2>/dev/null || true)
else
    # subfinder not installed — silent skip
    exit 0
fi

# Use "|| [ -n "$sub" ]" to catch an unterminated final line (defense-in-depth;
# herestring adds a trailing newline but the pattern is consistent with other channels).
while IFS= read -r sub || [ -n "$sub" ]; do
    [ -z "$sub" ] && continue
    # Hostname-shape guard: only emit subdomains matching valid FQDN chars.
    # Prevents JSON injection if subfinder output is corrupted or an
    # adversary controls the fixture file.
    [[ "$sub" =~ ^[a-zA-Z0-9._-]+$ ]] || continue
    printf '{"channel":"subfinder","record_type":"subdomain","url":"subfinder://%s","content":"%s","metadata":{"target":"%s"}}\n' \
        "$TARGET" "$sub" "$TARGET"
done <<<"$lines"
rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics.Stars: 472kUpdated Claude CodeCodexVerifiedInstall
ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first.Stars: 196kUpdated Claude CodeCodexVerifiedInstall