apify/agent-skills / skills/apify-ultimate-scraper
apify-ultimate-scraper
VerifiedUniversal AI-powered web scraper for any platform. Scrape data from Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Google Search, Google Trends, Reddit, Airbnb, Yelp, and 15+ more platforms. Use for lead generation, brand monitoring, competitor analysis, influencer discovery, trend research, content analytics, audience analysis, review analysis, SEO intelligence, recruitment, or any data extraction task.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 5.5 KB |
| references/actor-index.md | markdown | 9.7 KB |
| references/gotchas.md | markdown | 7.3 KB |
| references/workflows/brand-monitoring.md | markdown | 3.7 KB |
| references/workflows/company-research.md | markdown | 4.6 KB |
| references/workflows/competitive-intel.md | markdown | 3.5 KB |
| references/workflows/contact-enrichment.md | markdown | 3.6 KB |
| references/workflows/content-and-seo.md | markdown | 5.1 KB |
| references/workflows/ecommerce-price-monitoring.md | markdown | 4.4 KB |
| references/workflows/influencer-vetting.md | markdown | 3.9 KB |
| references/workflows/job-market-and-recruitment.md | markdown | 3.5 KB |
| references/workflows/knowledge-base-and-rag.md | markdown | 3.7 KB |
| references/workflows/lead-generation.md | markdown | 5.2 KB |
| references/workflows/real-estate-and-hospitality.md | markdown | 3.7 KB |
| references/workflows/review-analysis.md | markdown | 4.1 KB |
| references/workflows/social-media-analytics.md | markdown | 3.3 KB |
| references/workflows/trend-research.md | markdown | 3.3 KB |
references/workflows/trend-research.md
View on GitHub# Trend and keyword research workflows
## Google Trends analysis
**When:** User wants to analyze search demand trends for keywords or topics.
### Pipeline
1. **Get trend data** -> `apify/google-trends-scraper`
- Key input: `searchTerms`, `timeRange`, `geo` (country code)
### Output fields
Step 1: `term`, `timelineData[]` (date, value), `relatedQueries[]`, `relatedTopics[]`
## Cross-platform hashtag research
**When:** User wants to evaluate a hashtag's reach and usage across platforms.
### Pipeline
1. **Cross-platform overview** -> `apify/social-media-hashtag-research`
- Key input: `hashtags`, `platforms` (instagram, youtube, tiktok, facebook)
### Output fields
Step 1: `hashtag`, `platform`, `postsCount`, `topPosts[]`, `relatedHashtags[]`
## TikTok trend discovery
**When:** User wants to find trending content, sounds, or hashtags on TikTok.
### Pipeline
1. **Trending content** -> `clockworks/tiktok-trends-scraper`
- Key input: `channel` (trending category)
2. **Explore categories** -> `clockworks/tiktok-explore-scraper`
- Key input: `exploreCategories`
### Output fields
Step 1: `videoUrl`, `description`, `likes`, `shares`, `views`, `author`, `music`
Step 2: `category`, `posts[]`, `authors[]`, `music[]`
## Reddit trend and community insight mining
**When:** User wants to surface emerging trends, product feedback themes, or competitor mentions from Reddit communities.
### Pipeline
1. **Scrape subreddits** -> `trudax/reddit-scraper-lite`
- Key input: `startUrls` (subreddit URLs), `maxItems`, `sort` (hot/rising/new)
### Output fields
Step 1: `title`, `body`, `subreddit`, `score`, `numberOfComments`, `url`, `createdAt`, `comments[]`
### Gotcha
Use `sort: rising` for early trend signals, `sort: hot` for confirmed trending topics. Filter by `score` threshold (e.g., >50) to reduce noise. Comments array provides qualitative context for AI sentiment analysis.
## YouTube outlier video discovery
**When:** User wants to identify breakout videos in a niche with disproportionate views vs. channel subscriber count - a signal for content strategy pivots.
### Pipeline
1. **Search niche videos** -> `streamers/youtube-scraper`
- Key input: `searchTerms`, `maxResults`, `sort` (viewCount), `uploadDate` (filter range)
2. **Get channel context** -> `streamers/youtube-channel-scraper`
- Pipe: `results[].channelUrl` -> `channelUrls`
### Output fields
Step 1: `title`, `viewCount`, `likeCount`, `commentCount`, `channelName`, `publishedAt`, `url`
Step 2: `subscriberCount`, `videoCount`, `viewCount` (channel totals)
### Gotcha
Outlier score = video `viewCount` / channel `subscriberCount`. Ratios > 10x indicate breakout potential. Run Step 2 on a filtered shortlist only - no need to fetch channel data for every result.
## Content topic validation
**When:** User wants to validate whether a topic has demand before creating content.
### Pipeline
1. **Search demand** -> `apify/google-trends-scraper`
- Key input: `searchTerms` (topic keywords)
2. **Social reach** -> `apify/social-media-hashtag-research`
- Key input: `hashtags` (topic hashtags)
### Output fields
Step 1: `timelineData[]` (trending up/down), `relatedQueries[]`
Step 2: `postsCount` per platform, `topPosts[]`
### Gotcha
Google Trends shows relative interest (0-100 scale), not absolute volume. Combine with hashtag post counts for a fuller picture.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |