apify/agent-skills / skills/apify-ultimate-scraper
apify-ultimate-scraper
VerifiedUniversal AI-powered web scraper for any platform. Scrape data from Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Google Search, Google Trends, Reddit, Airbnb, Yelp, and 15+ more platforms. Use for lead generation, brand monitoring, competitor analysis, influencer discovery, trend research, content analytics, audience analysis, review analysis, SEO intelligence, recruitment, or any data extraction task.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 5.5 KB |
| references/actor-index.md | markdown | 9.7 KB |
| references/gotchas.md | markdown | 7.3 KB |
| references/workflows/brand-monitoring.md | markdown | 3.7 KB |
| references/workflows/company-research.md | markdown | 4.6 KB |
| references/workflows/competitive-intel.md | markdown | 3.5 KB |
| references/workflows/contact-enrichment.md | markdown | 3.6 KB |
| references/workflows/content-and-seo.md | markdown | 5.1 KB |
| references/workflows/ecommerce-price-monitoring.md | markdown | 4.4 KB |
| references/workflows/influencer-vetting.md | markdown | 3.9 KB |
| references/workflows/job-market-and-recruitment.md | markdown | 3.5 KB |
| references/workflows/knowledge-base-and-rag.md | markdown | 3.7 KB |
| references/workflows/lead-generation.md | markdown | 5.2 KB |
| references/workflows/real-estate-and-hospitality.md | markdown | 3.7 KB |
| references/workflows/review-analysis.md | markdown | 4.1 KB |
| references/workflows/social-media-analytics.md | markdown | 3.3 KB |
| references/workflows/trend-research.md | markdown | 3.3 KB |
references/workflows/ecommerce-price-monitoring.md
View on GitHub# E-commerce price monitoring workflows
## Competitor product price monitoring with alerts
**When:** User wants to track competitor prices across product pages and get notified when prices change.
### Pipeline
1. **Scrape product pages** -> `apify/e-commerce-scraping-tool`
- Key input: `startUrls` (competitor product page URLs), `proxyConfiguration`
2. **Match products across sites** -> `tri_angle/e-commerce-product-matching-tool`
- Pipe: `results[].url` + `results[].name` -> matching input
- Key input: source dataset ID from step 1, target product list
3. **Compare vs. baseline** (n8n logic: read Google Sheets last_price, compute % change, filter if changed)
4. **Alert** via Telegram/Slack node with price delta
### Output fields
Step 1: `price`, `currency`, `name`, `sku`, `availability`, `url`
Step 2: matched pairs with `similarityScore`, `sourceProduct`, `targetProduct`
### Cost estimate
`apify/e-commerce-scraping-tool` is pay-per-result. For 200 product URLs daily, expect ~$0.50-$1/run depending on site complexity.
### Gotcha
Many e-commerce sites use bot protection. If `e-commerce-scraping-tool` returns empty prices, fall back to `apify/camoufox-scraper` with residential proxy. Set `sessionPoolName` to reuse sessions and reduce blocks.
---
## Amazon product and review tracking
**When:** User wants to monitor own or competitor Amazon listings for price drops or review score changes.
### Pipeline
1. **Extract Amazon data** -> `apify/e-commerce-scraping-tool`
- Key input: `startUrls` (Amazon product URLs), `extractReviews` (bool)
2. **Compare vs. stored baseline** (n8n: read last values from Sheets or DB)
3. **Alert on new low price or rating drop** (n8n: If node + Telegram/Slack send)
### Output fields
`price`, `currency`, `rating`, `reviewsCount`, `title`, `asin`, `availability`
### Cost estimate
Flat per-result pricing. 50 ASINs daily ~ $0.10-$0.25/run.
### Gotcha
Amazon aggressively rotates prices and sometimes shows regional prices. Always store `currency` alongside `price`. For review text (not just counts), search `apify actors search "amazon reviews" --user-agent apify-agent-skills/apify-ultimate-scraper` for a dedicated Actor.
---
## Supplier catalog extraction to draft products
**When:** User wants to pull new products from a supplier portal and create draft listings with AI-enriched descriptions.
### Pipeline
1. **Crawl supplier catalog** -> `apify/playwright-scraper` (JS-heavy portals) or `apify/cheerio-scraper` (static HTML)
- Key input: `startUrls` (supplier category pages), `pseudoUrls` (product URL patterns), `maxCrawlPages`
2. **Extract product content** -> `apify/website-content-crawler` (optional second pass for detail pages)
- Pipe: `results[].url` -> `startUrls`
- Key input: `maxCrawlPages` (1 per product), `htmlTransformer: "readableText"`
3. **AI rewrite** (n8n: OpenAI node generates SEO title + bullets from raw specs)
4. **Create draft product** (n8n: Shopify node `POST /products.json` with `status: "draft"`)
### Output fields
Step 1/2: `text`, `url`, `metadata.title`, inline image URLs
### Cost estimate
Depends on catalog size. `playwright-scraper` is PPE; 500 product pages ~ $1-3.
### Gotcha
Supplier portals often require login. Use `apify/playwright-scraper` with `initialCookies` or a pre-login script in `preNavigationHooks`. Never hardcode credentials - pass via Actor input from n8n credentials store.
---
## Multi-site deal and coupon monitoring
**When:** User wants to detect when competitors run promotions or publish coupon codes so marketing can respond.
### Pipeline
1. **Scrape deals pages** -> `apify/e-commerce-scraping-tool`
- Key input: `startUrls` (competitor deal/sale page URLs), `proxyConfiguration`
2. **Dynamic JS deal pages** (fallback) -> `apify/camoufox-scraper`
- Pipe: failed URLs from step 1 -> `startUrls`
3. **AI extract promotion details** (n8n: OpenAI node extracts discount %, promo code, expiry from raw text)
4. **Dedup and alert** (n8n: compare against stored deals DB, Slack notify on new deals)
### Output fields
Raw: `price`, `discountText`, `url`; AI-extracted: `promoCode`, `validUntil`, `discountPercent`, `category`
### Cost estimate
Light scraping - deals pages are few. Expect < $0.20/run for 20 competitor pages.
### Gotcha
Promo codes and flash deals may only be visible after login or in geofenced regions. Test each target URL manually first. AI extraction of expiry dates is unreliable - treat as best-effort signal, not exact data.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |