Skip to content

sergekostenchuk/seo-llm-skill-cluster / skills/server-log-crawler-analyst

server-log-crawler-analyst

Verified

Analyze credential-free public website monitoring evidence from server access logs, HTTP fetches, robots/llms/sitemap checks, and exported summaries while protecting raw IP and private query data. Use this skill when the user asks whether crawlers or AI bots reached a site, whether public SEO/LLM discovery files respond, or how to separate observed facts from unknown Search Console, rank, analytics, or citation claims.

assets/crawler-monitor-report.template.md

View on GitHub
# Crawler Monitoring Report

target: `<site>`
checked_at: `<timestamp>`
mode: `<public-fetch|server-log|exported-summary>`

## Evidence Sources

| Source | Date Range | Method | Privacy Handling |
| --- | --- | --- | --- |
|  |  |  |  |

## Public Endpoint Checks

| URL | Status | Content Type | Bytes | Notes |
| --- | --- | --- | --- | --- |
|  |  |  |  |  |

## Log Summary

| Class | Requests | Statuses | Top Paths | Redacted IP Hashes |
| --- | --- | --- | --- | --- |
|  |  |  |  |  |

## Suspicious Or Irrelevant Traffic

| Pattern | Count | Notes |
| --- | --- | --- |
|  |  |  |

## Refused Claims

- Ranking:
- Indexing:
- Assistant citation:
- Verified bot identity:

## Open Questions

- 

## Next Evidence Needed

- 
deprecation-and-migrationaddyosmani/agent-skillsManages deprecation and migration. Use when removing old systems, APIs, or features. Use when migrating users from one implementation to another. Use when migrating a database schema in production, such as renaming or dropping a column without downtime (expand/contract). Use when deciding whether to maintain or sunset existing code.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
performance-optimizationaddyosmani/agent-skillsOptimizes application performance across frontend, backend, queries, and databases. Use when performance requirements exist, when you suspect performance regressions, when Core Web Vitals or load times need improvement, when N+1 query patterns need fixing, or when profiling reveals bottlenecks.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json.Stars: 118kUpdated Claude CodeCodexVerifiedInstall
agent-cost-reportthedotmack/claude-memBelievable agent cost report for any period, default the last 7 full days PT, not counting today. Measured tokens from Claude Code transcripts priced at OpenRouter list prices (ESTIMATED), measured provider spend when a sanctioned source exists, note-taker cost separate, Timing-style HTML/PDF plus report.json, line-items.csv, evidence.json.Stars: 118kUpdated Claude CodeCodexVerifiedInstall