bestdeejay-design/agent-skills / skills/seo-crawl
seo-crawl
VerifiedCrawlability and site structure for SEO: robots.txt, noindex, canonical, redirect chains, sitemap.xml; internal linking, click depth, orphan pages, URL hierarchy, breadcrumbs; competitor comparison (gaps, overlapping keywords, content gaps). Commands documented in commands/. Triggers: 'seo crawl', 'crawlability', 'robots txt', 'site structure', 'URL structure', 'competitor seo', 'индексация', 'структура сайта', 'конкуренты seo', 'краулинг'.
SEO Crawl — crawlability, structure & competitors
Use this skill for the crawl/visibility layer of SEO: whether search engines can reach the site, how it is internally linked, and how it compares to competitors.
Commands (documented in commands/)
| Command | What it does |
|---|---|
seo-crawl | Crawlability: robots.txt, noindex, canonical, redirect chains, sitemap.xml |
seo-structure | Internal linking, click depth, orphan pages, URL hierarchy, breadcrumbs |
seo-compare | Competitor comparison: gaps, overlapping keywords, content gaps (URL mode) |
Modes: URL (external sites) and File (local projects); seo-compare is URL-only.
When to use
- User asks for "seo crawl", "crawlability", "robots txt", "site structure", "URL structure", "competitor seo", "индексация", "структура сайта".
- Indexation, linking structure or competitor gaps are the task.
Do NOT use
- For the full technical audit / CWV / reports / fixes — that is
seo-audit. - For schema.org / meta tags — that is
seo-schema. - For content / keywords / headings / images — that is
seo-content.
Boundaries
- Do not use for copy quality or schema authoring; use
seo-contentorseo-schema.
Crawl workflow and safety
Declare crawl scope, user agent, rate limit, robots policy, maximum pages, and whether the input is a local build or a permitted URL. Separate robots exclusions, HTTP failures, canonical conflicts, redirect chains, orphan detection, and competitor observations; do not merge them into one score.
Output gate
Every finding contains URL/file, HTTP status or source evidence, affected link path, severity, and next action. Report pages not crawled and why. Never bypass robots.txt, authentication, rate limits, or access controls, and never call a competitor gap an observed fact without fetched evidence.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |