Skip to content

code-yeongyu/oh-my-openagent / packages/shared-skills/skills/ultimate-browsing

ultimate-browsing

Flagged

Reaches web pages the user's browser cannot open: WAF-blocked and bot-scored hosts, platform-native readers (Chinese and social platforms), archive snapshots with provenance, and a browser you own for stealth or throwaway profiles. Not for plain search, an unblocked static fetch, or a page the user's browser can open.

FileKindSize
.gitignoreother29 B
ATTRIBUTION.mdmarkdown2.5 KB
SKILL.mdskill md11.9 KB
engine/AGENTS.mdmarkdown10.8 KB
engine/__init__.pyscript668 B
engine/__main__.pyscript5.0 KB
engine/bias_check.pyscript7.1 KB
engine/curl_probe.pyscript2.4 KB
engine/executor.pyscript8.0 KB
engine/fetch_chain.pyscript13.0 KB
engine/referers.pyscript327 B
engine/result_schema.pyscript1.5 KB
engine/summary.pyscript1.2 KB
engine/surrogate.pyscript7.9 KB
engine/surrogates.yamlconfig2.3 KB
engine/templates/knip.workspace.jsoncother1.5 KB
engine/templates/package.jsonmanifest349 B
engine/templates/playwright_mobile_chrome.jsscript3.6 KB
engine/templates/playwright_real_chrome.jsscript5.5 KB
engine/tests/fixtures/amp_redirect_stub.htmlother323 B
engine/tests/fixtures/search_interstitial.htmlother90.4 KB
engine/tests/fixtures/wayback_available.jsonconfig246 B
engine/tests/fixtures/wayback_snapshot.htmlother181.4 KB
engine/tests/test_executor_timeout.pyscript6.2 KB
engine/tests/test_fetch_chain.pyscript2.7 KB
engine/tests/test_playwright_stealth.pyscript3.9 KB
engine/tests/test_playwright_templates.pyscript10.7 KB
engine/tests/test_surrogate.pyscript11.3 KB
engine/tests/test_surrogate_validators.pyscript3.5 KB
engine/url_transforms.pyscript3.2 KB
engine/validators.pyscript9.1 KB
engine/waf_detector.pyscript6.9 KB
engine/waf_profiles.yamlconfig6.2 KB
references/agent-reach/README.mdmarkdown2.2 KB
references/agent-reach/career.mdmarkdown755 B
references/agent-reach/dev.mdmarkdown1.3 KB
references/agent-reach/search.mdmarkdown821 B
references/agent-reach/social.mdmarkdown5.6 KB
references/agent-reach/video.mdmarkdown2.7 KB
references/agent-reach/web.mdmarkdown2.1 KB
references/chrome-stealth.mdmarkdown2.4 KB
references/insane-search/README.mdmarkdown20.2 KB
references/insane-search/cache-archive.mdmarkdown4.1 KB
references/insane-search/fallback.mdmarkdown6.9 KB
references/insane-search/jina.mdmarkdown4.3 KB
references/insane-search/json-api.mdmarkdown3.5 KB
references/insane-search/media.mdmarkdown3.5 KB
references/insane-search/metadata.mdmarkdown2.9 KB
references/insane-search/naver.mdmarkdown3.4 KB
references/insane-search/playwright.mdmarkdown6.8 KB
references/insane-search/public-api.mdmarkdown3.4 KB
references/insane-search/rss.mdmarkdown3.0 KB
references/insane-search/tls-impersonate.mdmarkdown6.5 KB
references/insane-search/twitter.mdmarkdown3.5 KB
scripts/cookie_crypto.pyscript2.9 KB
scripts/cookie_domains.pyscript1.1 KB
scripts/cookie_paths.pyscript3.8 KB
scripts/extract_cookies.pyscript9.4 KB
scripts/tests/test_cookie_domain_filter.pyscript3.5 KB
scripts/tests/test_extract_cookies.pyscript9.4 KB

engine/waf_profiles.yaml

View on GitHub
# WAF Product Profiles — never site-specific.
#
# NO-SITE-NAME RULE:
#   * Key names are WAF products (akamai_bot_manager), not sites.
#   * Detectors use product artifacts (cookies / headers / vendor strings).
#   * Field values (markers, cookie names) must appear in any site running
#     that WAF, not just one. If a value only fits one site, it belongs
#     to runtime hints / observations, not this file.
#
# Profiles are *recommendations*, not deterministic recipes. The planner
# treats them as priors; attempts always evaluate real responses.
#
# Timestamp each profile entry. If stale (> 6 months), cross-validate.

_meta:
  schema_version: 1
  last_reviewed: "2026-04-21"

akamai_bot_manager:
  detectors:
    cookie: ["_abck", "bm_sz", "ak_bmsc", "bm_sv", "bm_so"]
    header: ["X-Akamai-*"]
    server_contains: ["AkamaiGHost"]
    body: ["sec-if-cpt-container", "Powered and protected by Akamai"]
  confidence_rules:
    # Multi-signal gating — single marker insufficient.
    strong: 2     # any 2 signals from above → confidence 0.9
    weak: 1       # 1 signal → confidence 0.6
  capabilities_needed:
    - needs_real_tls_stack   # Playwright Chromium (BoringSSL) is detected
    - needs_js_exec          # 2.6KB challenge requires JS sensor
  tls_impersonate_candidates:
    # Every impersonate target curl_cffi supports that historically yielded
    # at least a challenge page (i.e. IP still alive) rather than an outright
    # TLS reject. Grouped by family; planner tries top groups first.
    # Refresh quarterly — vendor WAFs shift which TLS fingerprints they trust.
    - [safari, safari15_3, safari15_5, safari17_0, safari260, safari2601]
    - [safari_ios, safari17_2_ios, safari260_ios]
    - [chrome99, chrome100, chrome101, chrome104, chrome110, chrome116, chrome119, chrome124, chrome131, chrome133a, chrome136, chrome142, chrome145, chrome146]
    - [chrome_android, chrome131_android]
    - [edge99, edge101]
  tls_impersonate_avoid:
    # Empirically observed to 403 immediately (TLS fingerprint blacklisted).
    # DO NOT hard-block — planner deprioritizes only. Refresh quarterly.
    # NOTE: requires curl_cffi >= 0.15.0 for chrome142/145/146 + safari260/2601 +
    # firefox144/147 targets (added 0.14.0-0.15.0; default aliases resolve to
    # chrome146/safari2601/firefox147 in 0.16.0+). Older installs raise ImpersonateError.
    - safari18_0
    - chrome107
    - chrome120
    - chrome123
    - firefox133
    - firefox135
  referer_strategies:
    - self_root    # scheme://host/
  url_transform_order:
    - original
    - mobile_subdomain   # www.* → m.* — strong observational win in SSR sites
  fallback_when_challenge:
    - surrogate_wayback   # Phase 2.5: archive/reader copy before a browser spin-up
    - curl_grid_exhaust   # try more impersonate × referer × url combos
    - playwright_real_chrome
  notes: |
    DO NOT encode site-specific selectors or byte-size fingerprints here.
    Those belong to caller's success_selectors param or observations log.

cloudflare_turnstile:
  detectors:
    cookie: ["cf_clearance", "__cf_bm", "__cfduid"]
    header: ["cf-ray", "cf-cache-status"]
    server_contains: ["cloudflare"]
    body: ["Just a moment...", "Checking your browser", "cf-chl-bypass", "Attention Required! | Cloudflare"]
  capabilities_needed:
    - needs_js_exec        # MCP Playwright Chromium OK — no real-TLS required
  tls_impersonate_candidates:
    - [chrome, chrome_android]
  referer_strategies:
    - google_search
    - self_root
  fallback_when_challenge:
    - surrogate_wayback   # Phase 2.5: archive/reader copy before a browser spin-up
    - playwright_mcp       # MCP sufficient; Chromium TLS passes CF baseline
    - playwright_real_chrome

f5_big_ip:
  detectors:
    cookie: ["BigIPServer", "TS01*", "F5_*"]
    body: ["The requested URL was rejected", "support ID is:"]
  capabilities_needed:
    - needs_real_tls_stack
  tls_impersonate_candidates:
    - [safari, chrome]
  referer_strategies:
    - self_root

aws_waf:
  detectors:
    cookie: ["aws-waf-token"]
    header: ["x-amzn-requestid", "x-amzn-errortype", "x-amzn-waf-*"]
  capabilities_needed:
    - needs_real_tls_stack
  tls_impersonate_candidates:
    - [chrome]
  referer_strategies:
    - self_root

datadome_probable:
  detectors:
    cookie: ["datadome"]
    body: ["DataDome"]
  capabilities_needed:
    - needs_real_tls_stack
    - needs_js_exec
  tls_impersonate_candidates:
    - [safari, chrome]
  fallback_when_challenge:
    - surrogate_wayback   # Phase 2.5: archive/reader copy before a browser spin-up
    - playwright_real_chrome
  notes: |
    "_probable" suffix reminds us this is a growing attack surface — mark
    as tentative until cross-site evidence accumulates in observations/.

perimeterx_human:
  detectors:
    cookie: ["_px3", "_pxhd", "_px2", "pxcts"]
    body: ["px-captcha", "Press & Hold to confirm you are a human"]
  capabilities_needed:
    - needs_real_tls_stack
    - needs_js_exec
  tls_impersonate_candidates:
    - [safari, chrome]
  fallback_when_challenge:
    - surrogate_wayback   # Phase 2.5: archive/reader copy before a browser spin-up
    - playwright_real_chrome
  notes: |
    PerimeterX (now HUMAN Bot Defender). Distinct cookie family from
    DataDome. Keep profiles separate so planner does not pick wrong
    fallback strategy.

# ---------------------------------------------------------------------------
# Safety net: always-valid fallback profile.
# ---------------------------------------------------------------------------
unknown_challenge:
  detectors: {}   # never matches actively — used only when no other profile fires
  confidence_rules:
    strong: 0
    weak: 0
  capabilities_needed:
    - needs_js_exec     # conservative default
  tls_impersonate_candidates:
    - [safari, chrome, firefox]
    - [safari_ios, chrome_android]
  referer_strategies:
    - self_root
    - google_search
    - none
  url_transform_order:
    - original
    - mobile_subdomain
  fallback_when_challenge:
    - surrogate_wayback   # Phase 2.5: archive/reader copy before a browser spin-up
    - playwright_mcp
    - playwright_real_chrome
  notes: |
    When detector returns low-confidence results we land here. Broad,
    conservative grid. Evidence from these runs should feed observations/
    for eventual profile promotion.
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall