vistabylara-dev/vista-claude-skills / skills/robots-txt-validator
robots-txt-validator
VerifiedSKILL.md
View on GitHub# robots.txt Validator Skill
## Purpose
Analyze and validate a website's robots.txt file for correctness, crawlability, SEO best practices, and AI accessibility.
## Input
- Website URL
- robots.txt content (optional)
## Analyze
1. Syntax validity
2. User-agent directives
3. Allow rules
4. Disallow rules
5. Sitemap declarations
6. Crawl-delay directives
7. Wildcard usage
8. Blocked important pages
9. Duplicate directives
10. AI crawler accessibility
11. Search engine compatibility
12. Security risks
13. Performance considerations
14. Best practices
15. Common mistakes
## Output
Generate:
- Validation Status
- Errors
- Warnings
- SEO Impact
- AI Visibility Impact
- Recommended robots.txt
- Improvement Checklist
Return everything in Markdown.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |