hint-shu/deep-research / skills/osint-research
osint-research
UnverifiedOSINT recon skill — passive entity discovery for domain / IP / email / person / company / github user. Builds a hybrid findings/dossier/graph report from free public sources (Whois, DNS, crt.sh, Wayback, Shodan InternetDB, GitHub code search, Tavily/Firecrawl/Exa/Perplexity dorks, optional theHarvester/subfinder). No subscription dependencies. Disclaimer is non-removable; secrets are redacted; blocklisted dump sites are filtered at outbound and inbound levels.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 6.1 KB |
| channels/crtsh.shexecutable | script | 1.8 KB |
| channels/dorks.shexecutable | script | 3.5 KB |
| channels/github-leaks.shexecutable | script | 2.0 KB |
| channels/shodan-idb.shexecutable | script | 2.2 KB |
| channels/subfinder-wrap.sh | script | 1.8 KB |
| channels/theharvester-wrap.shexecutable | script | 1.8 KB |
| channels/wayback.shexecutable | script | 1.5 KB |
| channels/whois-dns.shexecutable | script | 2.2 KB |
| lib/entity-classifier.shexecutable | script | 1.4 KB |
| lib/findings-extractor.shexecutable | script | 1.6 KB |
| lib/inbound-filter.sh | script | 6.9 KB |
| lib/secret-patterns.txt | markdown | 1.1 KB |
| lib/secret-redactor.shexecutable | script | 2.3 KB |
| templates/graph.mmd.tpl | other | 53 B |
| templates/osint-report.md.tpl | other | 1.1 KB |
channels/github-leaks.sh
View on GitHub#!/usr/bin/env bash
# skills/osint-research/channels/github-leaks.sh
# GitHub code search → emits NDJSON, redacted via secret-redactor.
set -uo pipefail
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
REDACT="$SCRIPT_DIR/../lib/secret-redactor.sh"
ENTITY_TYPE=""
TARGET=""
FIXTURE=""
while [ $# -gt 0 ]; do
case "$1" in
--type) ENTITY_TYPE="$2"; shift 2;;
--target) TARGET="$2"; shift 2;;
--fixture) FIXTURE="$2"; shift 2;;
*) echo "github-leaks: unknown flag: $1" >&2; exit 1;;
esac
done
[ -z "$TARGET" ] && { echo "github-leaks: empty target" >&2; exit 1; }
if [ -n "$FIXTURE" ]; then
json=$(cat "$FIXTURE")
elif command -v gh >/dev/null; then
json=$(gh api -X GET "search/code" -f q="$TARGET" --jq . 2>/dev/null || echo "{}")
else
json="{}"
fi
# Plan defect #1 fix: heredoc + pipe conflict — write script to tmp file instead.
_py_tmp=$(mktemp)
trap 'rm -f "$_py_tmp"' EXIT
cat > "$_py_tmp" <<'PY'
import json, sys
target = sys.argv[1]
try:
data = json.loads(sys.stdin.read())
except Exception:
sys.exit(0)
SEP = (',', ':') # Plan defect #2 fix: compact JSON to match test assertions.
for item in data.get("items", []):
repo = (item.get("repository") or {}).get("full_name", "")
path = item.get("path", "")
url = item.get("html_url", "")
fragments = item.get("text_matches") or []
if not fragments:
fragments = [{"fragment": ""}]
for f in fragments:
body = f.get("fragment", "")
out = {
"channel": "github-leaks",
"record_type": "code_match",
"url": url,
"content": body,
"metadata": {"target": target, "repo": repo, "path": path}
}
print(json.dumps(out, separators=SEP))
PY
# Pipeline: json input → python parses → emits NDJSON → redactor scrubs secrets.
# Redactor is the security boundary for github-derived data.
printf '%s' "$json" | python3 "$_py_tmp" "$TARGET" | bash "$REDACT"
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |