Skip to content

culiops/culiops-skills / skills/sre-investigate

sre-investigate

Unverified

FileKindSize
SKILL.mdskill md71.5 KB
access/standalone.mdmarkdown19.0 KB
agents/evidence.mdmarkdown8.1 KB
agents/helper.mdmarkdown3.9 KB
analytics/bin/logs-fetchexecutablescript229 B
analytics/bin/logs-inventoryexecutablescript209 B
analytics/bin/logs-statusexecutablescript192 B
analytics/bin/sqlqexecutablescript212 B
analytics/lib/s3logs/__init__.pyscript62 B
analytics/lib/s3logs/awscli.pyscript10.0 KB
analytics/lib/s3logs/budget.pyscript9.6 KB
analytics/lib/s3logs/cli_fetch.pyscript34.0 KB
analytics/lib/s3logs/cli_inventory.pyscript7.0 KB
analytics/lib/s3logs/cli_sqlq.pyscript18.4 KB
analytics/lib/s3logs/cli_status.pyscript3.0 KB
analytics/lib/s3logs/config.pyscript7.4 KB
analytics/lib/s3logs/convert.pyscript23.6 KB
analytics/lib/s3logs/duck.pyscript11.4 KB
analytics/lib/s3logs/layout.pyscript8.8 KB
analytics/lib/s3logs/paths.pyscript4.9 KB
analytics/lib/s3logs/redact.pyscript22.1 KB
analytics/lib/s3logs/s5.pyscript9.1 KB
analytics/lib/s3logs/sqlguard.pyscript11.8 KB
analytics/lib/s3logs/validate.pyscript4.4 KB
analytics/logs.env.exampleother4.2 KB
analytics/sql/alb/by_minute.sqlother918 B
analytics/sql/alb/lb_vs_target_status.sqlother629 B
analytics/sql/alb/status_by_target.sqlother887 B
analytics/sql/alb/summary.sqlother1.2 KB
analytics/sql/alb/target_latency_pct.sqlother1.4 KB
analytics/sql/alb/top_clients.sqlother429 B
analytics/sql/alb/top_paths_5xx.sqlother673 B
analytics/sql/cloudfront/aborted.sqlother1.1 KB
analytics/sql/cloudfront/by_day.sqlother499 B
analytics/sql/cloudfront/by_hour.sqlother489 B
analytics/sql/cloudfront/by_object.sqlother544 B
analytics/sql/cloudfront/bytes_per_viewer.sqlother1.1 KB
analytics/sql/cloudfront/cache_results.sqlother823 B
analytics/sql/cloudfront/client_concentration.sqlother707 B
analytics/sql/cloudfront/edges.sqlother434 B
analytics/sql/cloudfront/object_by_day.sqlother599 B
analytics/sql/cloudfront/range_requests.sqlother528 B
analytics/sql/cloudfront/referer_pages.sqlother393 B
analytics/sql/cloudfront/status_codes.sqlother342 B
analytics/sql/cloudfront/summary.sqlother719 B
analytics/sql/cloudfront/top_clients.sqlother353 B
analytics/sql/cloudfront/top_objects.sqlother349 B
analytics/sql/cloudfront/top_referers.sqlother492 B
analytics/sql/cloudfront/user_agents.sqlother533 B
analytics/sql/waf/asns.sqlother378 B
analytics/sql/waf/by_day.sqlother453 B
analytics/sql/waf/by_minute.sqlother314 B
analytics/sql/waf/client_keys.sqlother443 B
analytics/sql/waf/clients.sqlother521 B
analytics/sql/waf/compare_days.sqlother924 B
analytics/sql/waf/concentration.sqlother775 B
analytics/sql/waf/count_rules.sqlother556 B
analytics/sql/waf/countries.sqlother373 B
analytics/sql/waf/fingerprints.sqlother424 B
analytics/sql/waf/header_shape.sqlother425 B
analytics/sql/waf/labels.sqlother347 B
analytics/sql/waf/matched_data.sqlother530 B
analytics/sql/waf/rules_by_minute.sqlother497 B
analytics/sql/waf/summary.sqlother735 B
analytics/sql/waf/top_rules.sqlother361 B
analytics/sql/waf/uris.sqlother402 B
analytics/sql/waf/user_agents.sqlother557 B
analytics/tests/conftest.pyscript4.7 KB
analytics/tests/gen_fixtures.pyscript19.7 KB
analytics/tests/stubs/awsexecutablescript4.9 KB
analytics/tests/stubs/s5cmdexecutablescript4.5 KB
analytics/tests/test_awscli.pyscript16.0 KB
analytics/tests/test_budget.pyscript13.3 KB
analytics/tests/test_config.pyscript9.1 KB
analytics/tests/test_convert.pyscript25.9 KB
analytics/tests/test_duck.pyscript10.6 KB
analytics/tests/test_fetch.pyscript42.8 KB
analytics/tests/test_gen_fixtures.pyscript1.9 KB
analytics/tests/test_inventory.pyscript12.9 KB
analytics/tests/test_layout.pyscript9.8 KB
analytics/tests/test_named_queries.pyscript26.7 KB
analytics/tests/test_paths.pyscript3.2 KB
analytics/tests/test_redact.pyscript32.0 KB
analytics/tests/test_s5.pyscript17.8 KB
analytics/tests/test_sqlguard.pyscript10.8 KB
analytics/tests/test_sqlq.pyscript37.2 KB
analytics/tests/test_status.pyscript5.8 KB
analytics/tests/test_validate.pyscript2.9 KB
environment.template.mdmarkdown7.1 KB
playbooks/changes.mdmarkdown37.2 KB
playbooks/errors.mdmarkdown10.4 KB
playbooks/external.mdmarkdown15.4 KB
playbooks/infra-state.mdmarkdown13.7 KB
playbooks/logs-s3.mdmarkdown29.5 KB
playbooks/logs.mdmarkdown21.3 KB
playbooks/metrics.mdmarkdown39.0 KB
playbooks/other-backends.mdmarkdown7.2 KB
playbooks/traces.mdmarkdown16.2 KB
playbooks/waf.mdmarkdown17.2 KB
templates/incident.mdmarkdown3.9 KB
templates/ledger.mdmarkdown9.7 KB
templates/lesson.mdmarkdown2.7 KB
templates/profile.mdmarkdown4.5 KB
templates/report.mdmarkdown6.5 KB

playbooks/other-backends.md

View on GitHub
# Other backends (mapped)

Backends: Datadog · New Relic · Elastic APM
verified: docs-only

**Purpose.** These backends are mapped, not first-class: the method of the metrics, logs, traces, errors and changes playbooks applies unchanged, and the tables below translate each signal to where it lives and an equivalent query. Windows are the ledger's UTC window; tokens come from the `token_env` named in `environment.md` (names only; the examples use stand-in names). X-Ray is first-class and lives in the traces playbook.

## Datadog

Queries go to the site's API host (`https://api.<site>`, for example `api.datadoghq.com` or `api.datadoghq.eu`). Reads need the API key in the `DD-API-KEY` header and an application key in `DD-APPLICATION-KEY` (or a bearer access token), both from env vars: `curl -sG "https://api.<site>/api/v1/query" -H "DD-API-KEY: ${<DD_API_KEY_ENV>}" -H "DD-APPLICATION-KEY: ${<DD_APP_KEY_ENV>}" --data-urlencode "from=$START_S" --data-urlencode "to=$END_S" --data-urlencode 'query=<query>'`. The logs aggregate call is a `POST` that only reads.

| Signal | Where | Equivalent query | Gotcha |
|---|---|---|---|
| Rate and errors per endpoint | APM trace metrics `trace.<span_name>.hits` and `.errors` (counts) | `sum:trace.<span_name>.errors{service:<service>,env:<env>} by {resource_name,http.status_code}.as_count()` | Trace metrics are computed from all traffic before ingestion sampling, except with OpenTelemetry SDK or app-side sampling, where they are sampled too. |
| Latency percentiles | Distribution metric `trace.<span_name>` | `p95:trace.<span_name>{service:<service>,env:<env>}` | Use the distribution; `trace.<span_name>.duration` is a legacy gauge. Never average percentiles across tags. |
| Log counts and patterns | Logs aggregate API, `POST /api/v2/logs/analytics/aggregate` | body: `filter.query` `service:<service> status:error`, `filter.from`/`to` in epoch ms, `compute` `count`, `group_by` a facet with a `limit` | Indexed logs only; the product of `group_by` limits may not exceed 10,000. |
| Deploys | The `version` tag (unified service tagging) on trace metrics, traces and logs | `sum:trace.<span_name>.hits{service:<service>,env:<env>} by {version}.as_count()` | A version that is not tagged is invisible here; fall back to the changes playbook. |

<!-- doc: https://docs.datadoghq.com/api/latest/metrics/query-timeseries-points.md -->
<!-- doc: https://docs.datadoghq.com/logs/guide/access-your-log-data-programmatically/ -->
<!-- doc: https://docs.datadoghq.com/tracing/metrics/metrics_namespace/ -->
<!-- doc: https://docs.datadoghq.com/api/latest/logs/aggregate-events.md -->
<!-- doc: https://docs.datadoghq.com/tracing/services/deployment_tracking/ -->

## New Relic

NRQL is sent through NerdGraph: `POST https://api.newrelic.com/graphql` (EU: `api.eu.newrelic.com`) with the user key in the `API-Key` header and the body `{ actor { account(id: <account-id>) { nrql(query: "<NRQL>") { results } } } }`. Quoted datetimes in `SINCE`/`UNTIL` are UTC unless they carry an offset.

| Signal | Where | Equivalent query | Gotcha |
|---|---|---|---|
| Latency and throughput per endpoint | `Transaction` events | `SELECT percentile(duration, 95), count(*) FROM Transaction WHERE appName = '<service>' FACET name SINCE '<START>' UNTIL '<END>' TIMESERIES 1 minute` | `duration` is in seconds. Transaction events are sampled per agent harvest, so read ratios and shapes here and totals from metric data. |
| Errors by type | `TransactionError` events | `SELECT count(*) FROM TransactionError WHERE appName = '<service>' FACET error.class SINCE '<START>' UNTIL '<END>'` | Errors can be configured as ignored or expected, so counts do not match failed transactions. |
| Queries per request, slow downstream | `Transaction` attributes `databaseCallCount`, `databaseDuration`, `externalDuration` | `SELECT average(databaseCallCount), percentile(databaseDuration, 95), percentile(externalDuration, 95) FROM Transaction WHERE appName = '<service>' FACET name SINCE '<START>' UNTIL '<END>'` | Durations in seconds (Elastic uses microseconds): state the unit with every number. |
| Deploys and changes | `Deployment` and `ChangeTrackingEvent` events | `FROM Deployment, ChangeTrackingEvent SELECT entity.name, version, timestamp SINCE '<START>' UNTIL '<END>'` | Only changes someone recorded; an unrecorded deploy needs the changes playbook. |

<!-- doc: https://docs.newrelic.com/docs/apis/nerdgraph/get-started/introduction-new-relic-nerdgraph/ -->
<!-- doc: https://docs.newrelic.com/docs/apis/nerdgraph/examples/nerdgraph-nrql-tutorial/ -->
<!-- doc: https://docs.newrelic.com/docs/nrql/nrql-syntax-clauses-functions/ -->
<!-- doc: https://docs.newrelic.com/docs/query-your-data/nrql-new-relic-query-language/get-started/introduction-nrql-tutorial/ -->
<!-- doc: https://docs.newrelic.com/docs/data-apis/understand-data/event-data/new-relic-event-limits-sampling/ -->
<!-- doc: https://docs.newrelic.com/docs/data-apis/understand-data/event-data/events-reported-apm/ -->
<!-- doc: https://docs.newrelic.com/docs/change-tracking/change-tracking-view-analyze/ -->

## Elastic APM

ES|QL goes to `POST <elasticsearch-url>/_query` with `Authorization: ApiKey $<ENV_VAR>` and the query in the `query` field. Every query below starts with `FROM <data stream>` and a filter on `@timestamp >= "<START>" AND @timestamp < "<END>"`, shown here as `…`.

| Signal | Where | Equivalent query | Gotcha |
|---|---|---|---|
| Latency per endpoint | `traces-apm*`, transaction documents | `FROM traces-apm* \| WHERE service.name == "<service>" AND processor.event == "transaction" AND … \| STATS p95 = PERCENTILE(transaction.duration.us, 95), n = COUNT(*) BY transaction.name` | Microseconds. With head-based sampling, latency and throughput are estimated from sampled events only; with tail-based sampling they come from all events. |
| Errors by group | `logs-apm.error-*` | `FROM logs-apm.error-* \| WHERE service.name == "<service>" AND … \| STATS n = COUNT(*) BY error.grouping_key, error.exception.type` | Compare with the baseline window before calling a group new. |
| Slow downstream | `traces-apm*`, span documents | `FROM traces-apm* \| WHERE service.name == "<service>" AND processor.event == "span" AND … \| STATS p95 = PERCENTILE(span.duration.us, 95), n = COUNT(*) BY span.destination.service.resource` | Spans of unsampled traces are dropped, so span counts are not totals. |
| Deploys | `service.version` on transactions and errors | `FROM traces-apm* \| WHERE service.name == "<service>" AND … \| STATS n = COUNT(*) BY service.version, minute = BUCKET(@timestamp, 1 minute)` | The version must be set by the agent; otherwise use the changes playbook. |

<!-- doc: https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-esql-query -->
<!-- doc: https://www.elastic.co/docs/solutions/observability/apm/data-streams -->
<!-- doc: https://www.elastic.co/guide/en/apm/server/current/exported-fields-apm-transaction.html -->
<!-- doc: https://www.elastic.co/guide/en/apm/server/current/exported-fields-apm-span.html -->
<!-- doc: https://www.elastic.co/guide/en/apm/server/current/exported-fields-apm-error.html -->
<!-- doc: https://www.elastic.co/docs/reference/query-languages/esql/functions-operators/grouping-functions/bucket -->
<!-- doc: https://www.elastic.co/guide/en/observability/8.19/apm-sampling.html -->
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 196kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 196kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 196kUpdated Claude CodeCodexVerifiedInstall