moonlight-lupin/agent-skills / web-scraping/website-scraping
website-scraping
VerifiedGeneric playbook for extracting structured data from any website — hotel prices, flight fares, e-commerce listings, real estate, jobs, competitor product catalogues, anything where the goal is to turn one or more URLs into clean records on disk. Use this skill whenever the user mentions scraping, harvesting, extracting, or pulling data from a website; names a specific site or competitor they want data from; asks how to handle JavaScript-rendered pages, Cloudflare blocks, bot detection, Turnstile challenges, or Playwright; wants to monitor prices over time; needs to automate a copy-paste research task; or says things like "just get the data from X" or "I need a script that grabs N from site Y". Covers recon, picking the lightest extraction tool that works, surviving anti-bot defences, and writing clean JSONL output with a run manifest. Scope is scraping only — landing data in a database, scheduling, and downstream pipeline work are explicitly out of scope and live in other tools.
Security report
VerifiedStatic analysis of one exact version. It reduces risk and shows evidence; it does not certify that a skill is safe.
- Commit
e943e3285cd03c44b2c762a9a52328e3d16444b1- Content hash
89ff25f191d59465026be3e36853ecbf23e0d51b7d2da0dadb8d31229000105a- Scanned
- 2026-11-17
- Scanner version
- skillxone-scan-1.0.0
- Policy version
- 0.1-draft
- Decision
- Every required check completed with no open blocking or medium findings.
- Verification expires
- 2026-12-17
Findings (6 low, 5 info)
A link uses unencrypted http:// (quotes.toscrape.com), so its content can be altered in transit.
START = "http://quotes.toscrape.com/search.aspx"Suggested fix: Use https://.
A link uses unencrypted http:// (quotes.toscrape.com), so its content can be altered in transit.
START = "http://quotes.toscrape.com/search.aspx"Suggested fix: Use https://.
A link uses unencrypted http:// (quotes.toscrape.com), so its content can be altered in transit.
On http://quotes.toscrape.com/search.aspx, use the two dependent dropdowns toSuggested fix: Use https://.
A link uses unencrypted http:// (quotes.toscrape.com), so its content can be altered in transit.
Target: `http://quotes.toscrape.com/search.aspx` (a purpose-built scraping sandbox).Suggested fix: Use https://.
A link uses unencrypted http:// (quotes.toscrape.com), so its content can be altered in transit.
--start-url http://quotes.toscrape.com/search.aspx \Suggested fix: Use https://.
A link uses unencrypted http:// (www.sitemaps.org), so its content can be altered in transit.
NS = {"sm": "http://www.sitemaps.org/schemas/sitemap/0.9"}Suggested fix: Use https://.
- info
INT-BINARY-ASSETexamples/agentic-browsing-quotes-demo/final_runs/run_1/screenshots/final_execution_1_author_selected.pngThe skill ships an image, font, media file or office document. It was not scanned.
Suggested fix: None required. Informational.
- info
INT-BINARY-ASSETexamples/agentic-browsing-quotes-demo/final_runs/run_1/screenshots/final_execution_2_tag_selected.pngThe skill ships an image, font, media file or office document. It was not scanned.
Suggested fix: None required. Informational.
- info
INT-BINARY-ASSETexamples/agentic-browsing-quotes-demo/final_runs/run_1/screenshots/final_execution_3_results.pngThe skill ships an image, font, media file or office document. It was not scanned.
Suggested fix: None required. Informational.
The skill ships an image, font, media file or office document. It was not scanned.
Suggested fix: None required. Informational.
The skill ships an image, font, media file or office document. It was not scanned.
Suggested fix: None required. Informational.
Checks run
- prompt-injection
- dangerous-commands
- credentials
- network
- file-access
- integrity
Checks skipped
- dependencies: No dependency manifest in the skill directory.
- gitleaks: gitleaks is not installed on this host.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |