Skip to content

jeremylongshore/tons-of-skills-marketplace / plugins/devops/monitoring-stack-deployer/skills/deploying-monitoring-stacks

deploying-monitoring-stacks

Verified

Monitor use when deploying monitoring stacks including Prometheus, Grafana, and Datadog. Trigger with phrases like "deploy monitoring stack", "setup prometheus", "configure grafana", or "install datadog agent". Generates production-ready configurations with metric collection, visualization dashboards, and alerting rules.

Deploying Monitoring Stacks

Overview

Deploy production monitoring stacks (Prometheus + Grafana, Datadog, or Victoria Metrics) with metric collection, custom dashboards, and alerting rules. Configure exporters, scrape targets, recording rules, and notification channels for comprehensive infrastructure and application observability.

Prerequisites

  • Target infrastructure identified: Kubernetes cluster, Docker hosts, or bare-metal servers
  • Metric endpoints accessible from the monitoring platform (application /metrics, node exporters)
  • Storage backend capacity planned for time-series data (Prometheus TSDB, Thanos, or Cortex for long-term)
  • Alert notification channels defined: Slack webhook, PagerDuty integration key, or email SMTP
  • Helm 3+ for Kubernetes deployments using kube-prometheus-stack or similar charts

Instructions

  1. Select the monitoring platform: Prometheus + Grafana for open-source self-hosted, Datadog for managed SaaS, Victoria Metrics for high-cardinality workloads
  2. Deploy the monitoring stack: helm install kube-prometheus-stack prometheus-community/kube-prometheus-stack or Docker Compose for non-Kubernetes
  3. Install exporters on monitored systems: node-exporter for host metrics, kube-state-metrics for Kubernetes object states, application-specific exporters
  4. Configure scrape targets in prometheus.yml: define job names, scrape intervals, and relabeling rules for service discovery
  5. Create recording rules for frequently queried aggregations to reduce dashboard query load
  6. Define alerting rules with meaningful thresholds: high CPU (>80% for 5m), high memory (>90%), error rate (>1%), latency P99 (>500ms)
  7. Configure Alertmanager with routing, grouping, and notification channels (Slack, PagerDuty, email)
  8. Build Grafana dashboards: RED metrics (Rate, Errors, Duration) for services, USE metrics (Utilization, Saturation, Errors) for resources
  9. Set up data retention: configure TSDB retention period (15-30 days local), set up Thanos/Cortex for long-term storage if needed
  10. Test the full pipeline: trigger a test alert and verify notification delivery

Output

  • Helm values file or Docker Compose for the monitoring stack
  • Prometheus configuration with scrape targets, recording rules, and alerting rules
  • Alertmanager configuration with routing tree and notification receivers
  • Grafana dashboard JSON files for infrastructure and application metrics
  • Exporter deployment manifests (node-exporter DaemonSet, application ServiceMonitor)

Error Handling

ErrorCauseSolution
No data points in dashboardScrape target not reachable or metric name wrongCheck Targets page in Prometheus UI; verify service discovery and metric name
Too many time series (high cardinality)Labels with unbounded values (user IDs, request IDs)Remove high-cardinality labels with metric_relabel_configs; use recording rules for aggregation
Alert condition met but no notificationAlertmanager routing or receiver misconfiguredVerify Alertmanager config with amtool check-config; test receiver with amtool silence
Prometheus OOMKilledInsufficient memory for series countIncrease memory limits; reduce scrape targets or retention; add WAL compression
Grafana datasource connection failedWrong Prometheus URL or network policy blocking accessVerify datasource URL in Grafana; check Kubernetes service name and port; review network policies

Examples

  • "Deploy kube-prometheus-stack on Kubernetes with alerts for node CPU > 80%, pod restart count > 5, and API error rate > 1%, sending to Slack."
  • "Set up Prometheus + Grafana on Docker Compose for monitoring 10 application servers with node-exporter and custom application metrics."
  • "Create Grafana dashboards for the four golden signals (latency, traffic, errors, saturation) for a microservices application."

Resources

writing-skillsobra/superpowersUse when creating new skills, editing existing skills, or verifying skills work before deploymentStars: 323kUpdated Claude CodeCodexVerifiedInstall
xlsxanthropics/skillsUse this skill any time a spreadsheet file is the primary input or output. This means any task where the user wants to: open, read, edit, or fix an existing .xlsx, .xlsm, .xltx, .csv, or .tsv file (e.g., adding columns, computing formulas, formatting, charting, cleaning messy data); create a new spreadsheet from scratch or from other data sources; or convert between tabular file formats. Trigger especially when the user references a spreadsheet file by name or path — even casually (like "the xlsx in my downloads") — and wants something done to it or produced from it. Also trigger for cleaning or restructuring messy tabular data files (malformed rows, misplaced headers, junk data) into proper spreadsheets. The deliverable must be a spreadsheet file. Do NOT trigger when the primary deliverable is a Word document, HTML report, standalone Python script, database pipeline, or Google Sheets API integration, even if tabular data is involved.Stars: 198kUpdated Claude CodeCodexVerifiedInstall
shipping-and-launchaddyosmani/agent-skillsPrepares production launches. Use when preparing to deploy to production, or when asking what needs to be in place before shipping. Use when you need a pre-launch checklist, when setting up monitoring, when planning a staged rollout, or when you need a rollback strategy.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
childhoodthedotmack/claude-memBabysit a shipped release after merge, publication, or deployment. Verify published packages, production behavior, installed plugins, and late CI or user reports until the observation window is clean; use babysit for PR readiness before release.Stars: 118kUpdated Claude CodeCodexVerifiedInstall