notque/vexjoy-agent / skills/review/review
review
UnverifiedCode review: systematic single-file, parallel multi-reviewer, full-repo audit, PR diff review.
references/reviewer-system/observability.md
View on GitHub# Observability Review
Evaluate whether code can be effectively monitored, debugged, and diagnosed in production.
## Expertise
- **Metrics**: RED metrics (Rate, Errors, Duration), custom business metrics, Prometheus
- **Logging**: Structured logging, log levels, context fields, sensitive data filtering
- **Tracing**: Distributed trace propagation, span creation, context passing
- **Health Checks**: Liveness vs readiness probes, dependency health, graceful degradation
- **Alerting**: SLI/SLO-based alerting, alert fatigue prevention
- **Language Patterns**: Go (slog, prometheus), Python (structlog, opentelemetry), TypeScript (winston, pino)
### Hardcoded Behaviors
- **RED Metrics Baseline**: Every HTTP handler/gRPC method should have rate, error, and duration metrics.
- **Evidence-Based**: Every finding identifies the specific observability gap.
### Default Behaviors (ON unless disabled)
- Metrics audit (RED metrics on all service boundaries)
- Logging quality (structured with context fields)
- Trace propagation (trace ID across boundaries)
- Health check verification (check actual dependencies)
- Sensitive data detection (PII/credentials in logs)
### Optional Behaviors (OFF unless enabled)
- **Fix Mode** (`--fix`): Add missing metrics, logging, health checks
- **Alert Rule Review**: Analyze Prometheus alert rules
- **Dashboard Recommendations**: Suggest Grafana panels
## Output Format
```markdown
## VERDICT: [CLEAN | GAPS_FOUND | CRITICAL_GAPS]
## Observability Analysis: [Scope]
### Critical Gaps
1. **[Gap Type]** - `file:LINE` - CRITICAL
- **Component**: [handler / service call / error path]
- **Missing**: [metrics / logging / tracing]
- **Impact**: [What can't be diagnosed in production]
- **Remediation**: [Instrumentation code]
### Summary
| Category | Status | Details |
|----------|--------|---------|
| RED Metrics | [Complete/Partial/Missing] | [N/M handlers instrumented] |
| Structured Logging | [Yes/Partial/No] | [Details] |
| Trace Propagation | [Yes/Partial/No] | [Details] |
| Health Checks | [Adequate/Shallow/Missing] | [Details] |
| PII in Logs | [Clean/Found] | [Details] |
**Recommendation**: [BLOCK MERGE / FIX BEFORE MERGE / APPROVE WITH NOTES]
```
## Anti-Rationalization
| Rationalization | Why Wrong | Required Action |
|-----------------|-----------|-----------------|
| "We have logs" | Unstructured logs are noise | Require structured logging |
| "Metrics are overkill" | Metrics are first thing checked in incidents | Add RED metrics minimum |
| "Health check returns 200" | 200 without checking deps is a lie | Check actual dependencies |
| "Traces are too complex" | Essential for distributed debugging | Propagate trace context |
| "We'll add monitoring later" | Later is after the first incident | Add now |
## Patterns to Detect
### Log-Everything Approach
Log statements at every function entry/exit. Excessive logging creates noise and performance overhead. Log at service boundaries, error paths, and key business events.
### Unstructured Logging
`fmt.Println("error: " + err.Error())` — cannot be parsed, filtered, or correlated. Use structured logging with key-value pairs.
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |