Skip to content

code-yeongyu/oh-my-openagent / packages/shared-skills/skills/ultimate-browsing

ultimate-browsing

Flagged

Reaches web pages the user's browser cannot open: WAF-blocked and bot-scored hosts, platform-native readers (Chinese and social platforms), archive snapshots with provenance, and a browser you own for stealth or throwaway profiles. Not for plain search, an unblocked static fetch, or a page the user's browser can open.

FileKindSize
.gitignoreother29 B
ATTRIBUTION.mdmarkdown2.5 KB
SKILL.mdskill md11.9 KB
engine/AGENTS.mdmarkdown10.8 KB
engine/__init__.pyscript668 B
engine/__main__.pyscript5.0 KB
engine/bias_check.pyscript7.1 KB
engine/curl_probe.pyscript2.4 KB
engine/executor.pyscript8.0 KB
engine/fetch_chain.pyscript13.0 KB
engine/referers.pyscript327 B
engine/result_schema.pyscript1.5 KB
engine/summary.pyscript1.2 KB
engine/surrogate.pyscript7.9 KB
engine/surrogates.yamlconfig2.3 KB
engine/templates/knip.workspace.jsoncother1.5 KB
engine/templates/package.jsonmanifest349 B
engine/templates/playwright_mobile_chrome.jsscript3.6 KB
engine/templates/playwright_real_chrome.jsscript5.5 KB
engine/tests/fixtures/amp_redirect_stub.htmlother323 B
engine/tests/fixtures/search_interstitial.htmlother90.4 KB
engine/tests/fixtures/wayback_available.jsonconfig246 B
engine/tests/fixtures/wayback_snapshot.htmlother181.4 KB
engine/tests/test_executor_timeout.pyscript6.2 KB
engine/tests/test_fetch_chain.pyscript2.7 KB
engine/tests/test_playwright_stealth.pyscript3.9 KB
engine/tests/test_playwright_templates.pyscript10.7 KB
engine/tests/test_surrogate.pyscript11.3 KB
engine/tests/test_surrogate_validators.pyscript3.5 KB
engine/url_transforms.pyscript3.2 KB
engine/validators.pyscript9.1 KB
engine/waf_detector.pyscript6.9 KB
engine/waf_profiles.yamlconfig6.2 KB
references/agent-reach/README.mdmarkdown2.2 KB
references/agent-reach/career.mdmarkdown755 B
references/agent-reach/dev.mdmarkdown1.3 KB
references/agent-reach/search.mdmarkdown821 B
references/agent-reach/social.mdmarkdown5.6 KB
references/agent-reach/video.mdmarkdown2.7 KB
references/agent-reach/web.mdmarkdown2.1 KB
references/chrome-stealth.mdmarkdown2.4 KB
references/insane-search/README.mdmarkdown20.2 KB
references/insane-search/cache-archive.mdmarkdown4.1 KB
references/insane-search/fallback.mdmarkdown6.9 KB
references/insane-search/jina.mdmarkdown4.3 KB
references/insane-search/json-api.mdmarkdown3.5 KB
references/insane-search/media.mdmarkdown3.5 KB
references/insane-search/metadata.mdmarkdown2.9 KB
references/insane-search/naver.mdmarkdown3.4 KB
references/insane-search/playwright.mdmarkdown6.8 KB
references/insane-search/public-api.mdmarkdown3.4 KB
references/insane-search/rss.mdmarkdown3.0 KB
references/insane-search/tls-impersonate.mdmarkdown6.5 KB
references/insane-search/twitter.mdmarkdown3.5 KB
scripts/cookie_crypto.pyscript2.9 KB
scripts/cookie_domains.pyscript1.1 KB
scripts/cookie_paths.pyscript3.8 KB
scripts/extract_cookies.pyscript9.4 KB
scripts/tests/test_cookie_domain_filter.pyscript3.5 KB
scripts/tests/test_extract_cookies.pyscript9.4 KB

engine/__main__.py

View on GitHub
#!/usr/bin/env python3
"""CLI entrypoint for the insane-search engine.

Usage:
    python3 -B -m engine URL [--selector CSS] [--device auto|desktop|mobile]
                             [--timeout N] [--max-attempts N] [--json] [--trace]

`-B` is required: `-m` compiles the package before any engine code runs, so only
the interpreter flag keeps bytecode caches out of a signed app bundle.

Examples:
    python3 -B -m engine "https://example.com/" --selector "h1"
    python3 -B -m engine "https://example.com/" --json
    python3 -B -m engine "https://example.com/" --device mobile --trace

Exit codes:
    0   strong_ok or weak_ok
    1   ok=False (all attempts failed)
    2   CLI arg error
"""
from __future__ import annotations

import argparse
import json
import sys

from . import fetch


def build_parser() -> argparse.ArgumentParser:
    p = argparse.ArgumentParser(prog="python3 -B -m engine",
                                description="Generic WAF-profile fetch chain.")
    p.add_argument("url", help="URL to fetch.")
    p.add_argument("--selector", "-s", action="append", default=None,
                   dest="selectors", metavar="CSS",
                   help="Positive-proof CSS selector. Repeatable.")
    p.add_argument("--device", choices=("auto", "desktop", "mobile"), default="auto",
                   help="Device class pin.")
    p.add_argument("--timeout", type=int, default=25,
                   help="Per-attempt timeout seconds (default 25).")
    p.add_argument("--max-attempts", type=int, default=12,
                   help="Upper bound across all phases (default 12).")
    p.add_argument("--no-playwright", action="store_true",
                   help="Skip Playwright fallback (curl-only).")
    p.add_argument("--allow-proxy", action="store_true",
                   help=("Enable kind=proxy surrogate entries (raw relay routes; "
                        "MITM by construction — never citable alone, never "
                        "receives cookies/auth headers). Off by default."))
    p.add_argument("--json", action="store_true",
                   help="Emit FetchResult as JSON to stdout (content omitted).")
    p.add_argument("--trace", action="store_true",
                   help="Print per-attempt trace to stderr.")
    return p


def main(argv: list[str] | None = None) -> int:
    args = build_parser().parse_args(argv)
    try:
        result = fetch(
            args.url,
            success_selectors=args.selectors,
            device_class=args.device,
            timeout=args.timeout,
            max_attempts=args.max_attempts,
            enable_playwright=not args.no_playwright,
            allow_surrogate_proxy=args.allow_proxy,
        )
    except Exception as e:
        print(f"engine fatal: {type(e).__name__}: {e}", file=sys.stderr)
        return 2

    if args.trace:
        print("=== trace ===", file=sys.stderr)
        for att in result.trace:
            d = att.to_dict()
            imp = d.get("impersonate") or "-"
            ref = d.get("referer") or "-"
            print(
                f"[{d['phase']:<8}] {d['executor']:<18} "
                f"xform={d['url_transform']:<16} imp={imp:<14} ref={ref:<14} "
                f"status={d['status']:>4} size={d['body_size']:>8} "
                f"verdict={d['verdict']} {('err=' + d['error'][:60]) if d.get('error') else ''}",
                file=sys.stderr,
            )
        print(f"=== summary: {result.summary} ===", file=sys.stderr)

    # Surface R7 hint (API-first route) prominently when summary contains it,
    # regardless of --trace flag — this is actionable guidance, not noise.
    if "R7 API-first" in (result.summary or ""):
        print(
            "\n════════════════════════════════════════════════════════════════\n"
            "⚠️  R7 triggered — consider API-first route instead of HTML grid.\n"
            "   See summary below (or re-run with --trace for full attempt log).\n"
            "════════════════════════════════════════════════════════════════",
            file=sys.stderr,
        )
        # Also print the full summary (which includes the hint) so caller sees it.
        print(result.summary, file=sys.stderr)

    if args.json:
        payload = result.to_dict()
        print(json.dumps(payload, ensure_ascii=False, indent=2))
    else:
        # Default: HTML to stdout, status to stderr.
        print(result.content, end="")
        print(f"\n[engine] ok={result.ok} verdict={result.verdict} "
              f"profile={result.profile_used} attempts={len(result.trace)} "
              f"provenance={result.provenance}"
              + (f" snapshot_ts={result.snapshot_timestamp}" if result.snapshot_timestamp else ""),
              file=sys.stderr)

    return 0 if result.ok else 1


if __name__ == "__main__":
    sys.exit(main())
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 197kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall