apify/agent-skills / skills/apify-ultimate-scraper
apify-ultimate-scraper
VerifiedUniversal AI-powered web scraper for any platform. Scrape data from Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Google Search, Google Trends, Reddit, Airbnb, Yelp, and 15+ more platforms. Use for lead generation, brand monitoring, competitor analysis, influencer discovery, trend research, content analytics, audience analysis, review analysis, SEO intelligence, recruitment, or any data extraction task.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 5.5 KB |
| references/actor-index.md | markdown | 9.7 KB |
| references/gotchas.md | markdown | 7.3 KB |
| references/workflows/brand-monitoring.md | markdown | 3.7 KB |
| references/workflows/company-research.md | markdown | 4.6 KB |
| references/workflows/competitive-intel.md | markdown | 3.5 KB |
| references/workflows/contact-enrichment.md | markdown | 3.6 KB |
| references/workflows/content-and-seo.md | markdown | 5.1 KB |
| references/workflows/ecommerce-price-monitoring.md | markdown | 4.4 KB |
| references/workflows/influencer-vetting.md | markdown | 3.9 KB |
| references/workflows/job-market-and-recruitment.md | markdown | 3.5 KB |
| references/workflows/knowledge-base-and-rag.md | markdown | 3.7 KB |
| references/workflows/lead-generation.md | markdown | 5.2 KB |
| references/workflows/real-estate-and-hospitality.md | markdown | 3.7 KB |
| references/workflows/review-analysis.md | markdown | 4.1 KB |
| references/workflows/social-media-analytics.md | markdown | 3.3 KB |
| references/workflows/trend-research.md | markdown | 3.3 KB |
references/workflows/company-research.md
View on GitHub# Company research workflows
## Company intelligence profiling for sales or ABM
**When:** User has a list of target accounts and wants structured firmographic data, ICP signals, and key personnel for outreach or account-based marketing.
### Pipeline
1. **Crawl company website** -> `apify/website-content-crawler`
- Key input: `startUrls` (company domains), `maxCrawlDepth` (2), `includeUrlGlobs` (about, pricing, team, careers, blog)
2. **Enrich with LinkedIn company data** -> `harvestapi/linkedin-company`
- Pipe: company name or LinkedIn URL extracted from WCC text -> Actor input
- Key input: company identifier, `includeEmployees: false`
3. **AI extract structured signals** (n8n: OpenAI node outputs JSON schema with `companySize`, `industry`, `techStack`, `keyPersonnel`, `painSignals`)
4. **Store** in Supabase, Airtable, or HubSpot with AI-extracted fields as custom properties
### Output fields
WCC: `text` (per page), `url`
LinkedIn: `employeeCount`, `industry`, `headquarters`, `description`, `specialties`
AI-extracted: `companySize`, `industry`, `techStack`, `keyPersonnel`, `painSignals`
### Gotcha
WCC crawl at depth 2 can return 20-50 pages per company. For large batches, set `maxCrawlPages: 5` focused on the About and Pricing pages via `includeUrlGlobs`. This keeps cost and latency manageable without sacrificing signal quality.
---
## Startup scouting from Product Hunt
**When:** User wants weekly discovery of recently launched or funded startups in a target category for investor outreach, partnership, or competitive tracking.
### Pipeline
1. **Scrape Product Hunt launches** -> `apify/web-scraper`
- Key input: `startUrls` (Product Hunt today/weekly/topic pages), `maxCrawlPages` (3-5)
- Note: no dedicated Actor exists - search `apify actors search "product hunt" --user-agent apify-agent-skills/apify-ultimate-scraper` for community options
2. **Filter by category + upvote threshold** (n8n: Filter node on extracted `upvotes`, `category`)
3. **Crawl company sites** -> `apify/website-content-crawler`
- Pipe: `results[].website` -> `startUrls`
- Key input: `maxCrawlPages` (3), `includeUrlGlobs` (about, team)
4. **LinkedIn founder lookup** -> `harvestapi/linkedin-profile-search` (by name + company)
- Pipe: extracted founder names from step 3 -> search input
5. **AI ICP scoring** (n8n: OpenAI node scores each startup against defined criteria)
6. **Output** to Airtable pipeline + Slack alert for top matches
### Output fields
Step 1: `title`, `tagline`, `upvotes`, `website`, `makers[].name`, `makers[].profileUrl`
WCC: `text`, `url`
LinkedIn: `fullName`, `headline`, `profileUrl`, `currentCompany`
### Gotcha
Product Hunt ranking changes throughout the day. Schedule the scrape for end-of-day (11 pm UTC) to capture final vote counts. For AngelList/Wellfound, no maintained public Actor exists - use `apify/website-content-crawler` on search result pages as a fallback.
---
## Sales meeting prep from LinkedIn and news
**When:** A calendar event is detected and the user needs a briefing on meeting attendees - their recent activity, company context, and conversation talking points - delivered before the meeting.
### Pipeline
1. **Trigger on calendar event** (n8n: Google Calendar Trigger, filter for events starting in 30 min)
2. **Extract attendee LinkedIn activity** -> `harvestapi/linkedin-profile-scraper` + `harvestapi/linkedin-profile-posts`
- Key input: `profiles` (attendee LinkedIn URLs), `maxPosts` (5 recent posts)
3. **Extract company context** -> `harvestapi/linkedin-company`
- Pipe: `results[].currentCompany` -> company name
4. **Search recent news** -> `apify/google-search-scraper`
- Pipe: company name + "news" -> `queries`
- Key input: `queries`, `maxResultsPerPage` (5)
5. **AI synthesize brief** (n8n: OpenAI node produces: key topics, recent signals, suggested talking points)
6. **Deliver** via Gmail or WhatsApp node 30 minutes before meeting start
### Output fields
Profiles: `fullName`, `headline`, `recentPosts[]`, `experience[0]`
Posts: `postText`, `publishedAt`, `likes`, `comments`
Company: `description`, `employeeCount`, `recentNews`
Search: `organicResults[].title`, `organicResults[].snippet`, `organicResults[].url`
### Cost estimate
All HarvestAPI Actors are PPE. Per meeting with 2 attendees: profile scraper ~$0.02, posts ~$0.01, company ~$0.005, Google search ~$0.01. Total: ~$0.05 per meeting prep.
### Gotcha
LinkedIn profile URLs must be in the calendar event description or a linked CRM record - they won't auto-resolve from email addresses. Set up a step in your CRM or calendar template to include LinkedIn URLs for attendees. Without a valid `profileUrl`, the HarvestAPI Actors return empty results.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |