vistabylara-dev/vista-claude-skills / skills/robots-txt-validator
robots-txt-validator
Verifiedrobots.txt Validator Skill
Purpose
Analyze and validate a website's robots.txt file for correctness, crawlability, SEO best practices, and AI accessibility.
Input
- Website URL
- robots.txt content (optional)
Analyze
- Syntax validity
- User-agent directives
- Allow rules
- Disallow rules
- Sitemap declarations
- Crawl-delay directives
- Wildcard usage
- Blocked important pages
- Duplicate directives
- AI crawler accessibility
- Search engine compatibility
- Security risks
- Performance considerations
- Best practices
- Common mistakes
Output
Generate:
- Validation Status
- Errors
- Warnings
- SEO Impact
- AI Visibility Impact
- Recommended robots.txt
- Improvement Checklist
Return everything in Markdown.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |