sergekostenchuk/seo-llm-skill-cluster / skills/server-log-crawler-analyst
server-log-crawler-analyst
VerifiedAnalyze credential-free public website monitoring evidence from server access logs, HTTP fetches, robots/llms/sitemap checks, and exported summaries while protecting raw IP and private query data. Use this skill when the user asks whether crawlers or AI bots reached a site, whether public SEO/LLM discovery files respond, or how to separate observed facts from unknown Search Console, rank, analytics, or citation claims.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 4.1 KB |
| agents/openai.yaml | config | 388 B |
| assets/crawler-monitor-report.template.md | markdown | 732 B |
| evals.json | config | 1.8 KB |
| fixtures/sample-access.log | other | 575 B |
| references/data-source-tiers.md | markdown | 2.0 KB |
| references/monitoring-backlog.md | markdown | 1.4 KB |
| scripts/analyze_access_log.py | script | 3.8 KB |
| validation-report.md | markdown | 1.2 KB |
references/monitoring-backlog.md
View on GitHub# Monitoring Backlog
task: T-012
status: deferred beyond credential-free baseline
## Deferred Skill: search-console-analyst
Purpose:
- interpret Search Console exports or API data for indexing, impressions, clicks, query/page groups, and coverage issues.
Dependencies:
- explicit credential/export access;
- privacy policy for private query/page rows;
- semantic core and URL map.
Acceptance criteria:
- records property, date range, export time, filters, dimensions;
- separates observed Search Console data from ranking conclusions;
- redacts private rows when reports are public.
## Deferred Skill: rank-serp-monitor
Purpose:
- track query rankings in a compliant, locale/device-aware way.
Dependencies:
- approved rank-tracking provider or manual method;
- query set from semantic core;
- locale/device/persona policy.
Acceptance criteria:
- records query, locale, device, timestamp, method, result URL, and caveats;
- does not scrape search engines against terms;
- does not generalize one query result to all users.
## Deferred Skill: credentialed-crawler-monitor
Purpose:
- combine CDN/server logs, verified bot IP methods, Search Console crawl stats, and alerting.
Dependencies:
- server/CDN access;
- bot verification policy;
- raw-log privacy controls.
Acceptance criteria:
- verified bot categories where possible;
- alert thresholds;
- redacted public reporting;
- raw data kept local or in approved private storage.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |