sergekostenchuk/seo-llm-skill-cluster / skills/server-log-crawler-analyst
server-log-crawler-analyst
VerifiedAnalyze credential-free public website monitoring evidence from server access logs, HTTP fetches, robots/llms/sitemap checks, and exported summaries while protecting raw IP and private query data. Use this skill when the user asks whether crawlers or AI bots reached a site, whether public SEO/LLM discovery files respond, or how to separate observed facts from unknown Search Console, rank, analytics, or citation claims.
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 4.1 KB |
| agents/openai.yaml | config | 388 B |
| assets/crawler-monitor-report.template.md | markdown | 732 B |
| evals.json | config | 1.8 KB |
| fixtures/sample-access.log | other | 575 B |
| references/data-source-tiers.md | markdown | 2.0 KB |
| references/monitoring-backlog.md | markdown | 1.4 KB |
| scripts/analyze_access_log.py | script | 3.8 KB |
| validation-report.md | markdown | 1.2 KB |
validation-report.md
View on GitHub# Server Log Crawler Analyst Validation Report
date: 2026-06-11
skill: server-log-crawler-analyst
status: pass
## Scope
Created a credential-free monitoring baseline skill for:
- public endpoint checks;
- server access-log summaries;
- crawler/user-agent class reporting;
- suspicious probe grouping;
- raw-IP privacy protection;
- Search Console/rank/citation claim boundaries.
## Backlog
Deferred skills are documented in `references/monitoring-backlog.md`:
- `search-console-analyst`;
- `rank-serp-monitor`;
- `credentialed-crawler-monitor`.
## Validation Commands
```bash
python3 <codex-skills-dir>/senior-skill-architect/scripts/lint_production_skill.py ./skills/server-log-crawler-analyst
python3 ./skills/server-log-crawler-analyst/scripts/analyze_access_log.py ./skills/server-log-crawler-analyst/fixtures/sample-access.log --report <tmp-dir>/server-log-crawler-report.json
python3 ./plans/seo-llm-skill-cluster/scripts/lint_skill_cluster.py .
```
## Result
- Production skill linter passed with 0 errors and 0 warnings.
- `analyze_access_log.py` passed on the synthetic fixture and generated redacted IP hashes only.
- Cluster consistency linter passed with 0 critical issues and 0 warnings across 10 staged skills.
- `evals.json` parses as valid JSON.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks. | Stars: 119k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |
| agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json. | Stars: 118k | Updated | Claude CodeCodex | Verified | Install |