oxylabs/agent-skills / skills/web-scraper-api
web-scraper-api
VerifiedProduction-grade web scraping with automatic anti-bot bypass, structured JSON parsing for 40+ targets, and geo-targeting. Use when the user needs to scrape web pages, extract product data, get search results, or collect structured data from supported e-commerce and search platforms without worrying about getting blocked and when geo targeting is required.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 5.7 KB |
| examples.md | markdown | 5.9 KB |
| sources.md | markdown | 5.4 KB |
sources.md
View on GitHub# Available Sources
## Universal
| Source | Use Case |
|--------|----------|
| `universal` | Any website by URL |
## Google
| Source | Use Case |
|--------|----------|
| `google_search` | Search results with ads, snippets, knowledge panels |
| `google_url` | Any Google page by URL |
| `google_image_search` | Image search results |
| `google_news_search` | News results |
| `google_local_search` | Local business results |
| `google_trends_explore` | Trends data by keyword |
| `google_travel_hotels` | Hotel search results |
| `google_lens` | Visual search from image URL |
| `google_ai_mode` | AI Mode responses |
| `google_ai_overviews` | AI Overviews data |
| `google_ads` | Paid advertisement data |
| `google_reverse_image_search` | Reverse image lookup |
## Bing
| Source | Use Case |
|--------|----------|
| `bing_search` | Search results |
| `bing_url` | Any Bing page by URL |
## Amazon
| Source | Use Case |
|--------|----------|
| `amazon_search` | Search results |
| `amazon_product` | Product details by ASIN |
| `amazon_pricing` | Price and offer data |
| `amazon_sellers` | Seller information |
| `amazon_best_sellers` | Best seller rankings |
| `amazon_url` | Any Amazon page by URL |
## Walmart
| Source | Use Case |
|--------|----------|
| `walmart_search` | Search results |
| `walmart_product` | Product details |
| `walmart_url` | Any Walmart page by URL |
## eBay
| Source | Use Case |
|--------|----------|
| `ebay_search` | Search results |
| `ebay_product` | Product details |
| `ebay_url` | Any eBay page by URL |
## Target
| Source | Use Case |
|--------|----------|
| `target_search` | Search results |
| `target_product` | Product details |
| `target_category` | Category pages |
## Best Buy
| Source | Use Case |
|--------|----------|
| `bestbuy_search` | Search results |
| `bestbuy_product` | Product details |
## Etsy
| Source | Use Case |
|--------|----------|
| `etsy_search` | Search results |
| `etsy_product` | Product details |
| `etsy_url` | Any Etsy page by URL |
## Costco
| Source | Use Case |
|--------|----------|
| `costco_search` | Search results |
| `costco_product` | Product details |
| `costco_url` | Any Costco page by URL |
## Alibaba
| Source | Use Case |
|--------|----------|
| `alibaba_search` | Search results |
| `alibaba_product` | Product details |
| `alibaba_url` | Any Alibaba page by URL |
## AliExpress
| Source | Use Case |
|--------|----------|
| `aliexpress_search` | Search results |
| `aliexpress_product` | Product details |
| `aliexpress_url` | Any AliExpress page by URL |
## Flipkart
| Source | Use Case |
|--------|----------|
| `flipkart_search` | Search results |
| `flipkart_product` | Product details |
| `flipkart_url` | Any Flipkart page by URL |
## Lazada
| Source | Use Case |
|--------|----------|
| `lazada_search` | Search results |
| `lazada_product` | Product details |
| `lazada_url` | Any Lazada page by URL |
## Mercado Libre
| Source | Use Case |
|--------|----------|
| `mercadolibre_search` | Search results |
| `mercadolibre_product` | Product details |
| `mercadolibre_url` | Any Mercado Libre page by URL |
## YouTube
| Source | Use Case |
|--------|----------|
| `youtube_search` | Video search results |
| `youtube_metadata` | Video metadata |
| `youtube_subtitles` | Closed captions |
| `youtube_channel` | Channel data |
## Real Estate
| Source | Use Case |
|--------|----------|
| `airbnb_homes` | Property listings |
| `airbnb_url` | Any Airbnb page by URL |
| `zillow_url` | Zillow property pages |
## AI Platforms
| Source | Use Case |
|--------|----------|
| `chatgpt` | ChatGPT responses |
| `perplexity` | Perplexity AI responses |
## TikTok Shop
| Source | Use Case |
|--------|----------|
| `tiktok_shop_search` | Search results |
| `tiktok_shop_product` | Product details |
| `tiktok_shop_url` | Any TikTok Shop page by URL |
## Other North American E-Commerce
| Source | Use Case |
|--------|----------|
| `lowes_search`, `lowes_product`, `lowes_url` | Lowe's |
| `kroger_search`, `kroger_product`, `kroger_url` | Kroger |
| `menards_search`, `menards_product`, `menards_url` | Menards |
| `grainger_search`, `grainger_product`, `grainger_url` | Grainger |
| `publix_search`, `publix_product`, `publix_url` | Publix |
| `instacart_search`, `instacart_product`, `instacart_url` | Instacart |
| `petco_search`, `petco_url` | Petco |
| `staples` | Staples |
| `bedbathandbeyond_search`, `bedbathandbeyond_product`, `bedbathandbeyond_url` | Bed Bath & Beyond |
| `bodega_aurrera_search`, `bodega_aurrera_product`, `bodega_aurrera_url` | Bodega Aurrerá |
## Other European E-Commerce
| Source | Use Case |
|--------|----------|
| `allegro_search`, `allegro_product` | Allegro |
| `mediamarkt_search`, `mediamarkt_product`, `mediamarkt_url` | MediaMarkt |
| `cdiscount_search`, `cdiscount_product`, `cdiscount_url` | Cdiscount |
| `idealo` | Idealo price comparison |
## Other Asian E-Commerce
| Source | Use Case |
|--------|----------|
| `indiamart_search`, `indiamart_product`, `indiamart_url` | IndiaMART |
| `rakuten_search`, `rakuten_url` | Rakuten |
| `tokopedia_search`, `tokopedia_url` | Tokopedia |
## Other Latin American E-Commerce
| Source | Use Case |
|--------|----------|
| `mercadolivre_search`, `mercadolivre_product` | Mercado Livre (Brazil) |
| `magazineluiza_search`, `magazineluiza_product`, `magazineluiza_url` | Magazine Luiza |
| `falabella_search`, `falabella_product`, `falabella_url` | Falabella |
| `dcard` | Dcard |
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| receiving-code-reviewobra/superpowersUse when receiving code review feedback, before implementing suggestions, especially if feedback seems unclear or technically questionable - requires technical rigor and verification, not performative agreement or blind implementation | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| requesting-code-reviewobra/superpowersUse when completing tasks, implementing major features, or before merging to verify work meets requirements | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| using-git-worktreesobra/superpowersUse when starting feature work that needs isolation from current workspace or before executing implementation plans - ensures an isolated workspace exists via native tools or git worktree fallback | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| verification-before-completionobra/superpowersUse when about to claim work is complete, fixed, or passing, before committing or creating PRs - requires running verification commands and confirming output before making any success claims; evidence before assertions always | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |