Skip to content

sergekostenchuk/seo-llm-skill-cluster / skills/server-log-crawler-analyst

server-log-crawler-analyst

Verified

Analyze credential-free public website monitoring evidence from server access logs, HTTP fetches, robots/llms/sitemap checks, and exported summaries while protecting raw IP and private query data. Use this skill when the user asks whether crawlers or AI bots reached a site, whether public SEO/LLM discovery files respond, or how to separate observed facts from unknown Search Console, rank, analytics, or citation claims.

fixtures/sample-access.log

View on GitHub
203.0.113.10 - - [11/Jun/2026:10:00:01 +0000] "GET /robots.txt HTTP/1.1" 200 912 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"
203.0.113.11 - - [11/Jun/2026:10:00:02 +0000] "GET /llms.txt HTTP/1.1" 200 2755 "-" "GPTBot/1.2"
203.0.113.12 - - [11/Jun/2026:10:00:03 +0000] "GET /news/948-langchain-introduces-self-checking-module-for-ai-agents/ HTTP/1.1" 200 18444 "-" "Mozilla/5.0"
203.0.113.13 - - [11/Jun/2026:10:00:04 +0000] "GET /.env HTTP/1.1" 404 153 "-" "curl/8.0"
203.0.113.14 - - [11/Jun/2026:10:00:05 +0000] "GET /wp-admin/ HTTP/1.1" 404 153 "-" "BadBot/0.1"
deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json.Stars: 118kUpdated Claude CodeCodexVerifiedInstall
agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json.Stars: 118kUpdated Claude CodeCodexVerifiedInstall