Skip to content

culiops/culiops-skills / skills/sre-investigate

sre-investigate

Unverified

FileKindSize
SKILL.mdskill md71.5 KB
access/standalone.mdmarkdown19.0 KB
agents/evidence.mdmarkdown8.1 KB
agents/helper.mdmarkdown3.9 KB
analytics/bin/logs-fetchexecutablescript229 B
analytics/bin/logs-inventoryexecutablescript209 B
analytics/bin/logs-statusexecutablescript192 B
analytics/bin/sqlqexecutablescript212 B
analytics/lib/s3logs/__init__.pyscript62 B
analytics/lib/s3logs/awscli.pyscript10.0 KB
analytics/lib/s3logs/budget.pyscript9.6 KB
analytics/lib/s3logs/cli_fetch.pyscript34.0 KB
analytics/lib/s3logs/cli_inventory.pyscript7.0 KB
analytics/lib/s3logs/cli_sqlq.pyscript18.4 KB
analytics/lib/s3logs/cli_status.pyscript3.0 KB
analytics/lib/s3logs/config.pyscript7.4 KB
analytics/lib/s3logs/convert.pyscript23.6 KB
analytics/lib/s3logs/duck.pyscript11.4 KB
analytics/lib/s3logs/layout.pyscript8.8 KB
analytics/lib/s3logs/paths.pyscript4.9 KB
analytics/lib/s3logs/redact.pyscript22.1 KB
analytics/lib/s3logs/s5.pyscript9.1 KB
analytics/lib/s3logs/sqlguard.pyscript11.8 KB
analytics/lib/s3logs/validate.pyscript4.4 KB
analytics/logs.env.exampleother4.2 KB
analytics/sql/alb/by_minute.sqlother918 B
analytics/sql/alb/lb_vs_target_status.sqlother629 B
analytics/sql/alb/status_by_target.sqlother887 B
analytics/sql/alb/summary.sqlother1.2 KB
analytics/sql/alb/target_latency_pct.sqlother1.4 KB
analytics/sql/alb/top_clients.sqlother429 B
analytics/sql/alb/top_paths_5xx.sqlother673 B
analytics/sql/cloudfront/aborted.sqlother1.1 KB
analytics/sql/cloudfront/by_day.sqlother499 B
analytics/sql/cloudfront/by_hour.sqlother489 B
analytics/sql/cloudfront/by_object.sqlother544 B
analytics/sql/cloudfront/bytes_per_viewer.sqlother1.1 KB
analytics/sql/cloudfront/cache_results.sqlother823 B
analytics/sql/cloudfront/client_concentration.sqlother707 B
analytics/sql/cloudfront/edges.sqlother434 B
analytics/sql/cloudfront/object_by_day.sqlother599 B
analytics/sql/cloudfront/range_requests.sqlother528 B
analytics/sql/cloudfront/referer_pages.sqlother393 B
analytics/sql/cloudfront/status_codes.sqlother342 B
analytics/sql/cloudfront/summary.sqlother719 B
analytics/sql/cloudfront/top_clients.sqlother353 B
analytics/sql/cloudfront/top_objects.sqlother349 B
analytics/sql/cloudfront/top_referers.sqlother492 B
analytics/sql/cloudfront/user_agents.sqlother533 B
analytics/sql/waf/asns.sqlother378 B
analytics/sql/waf/by_day.sqlother453 B
analytics/sql/waf/by_minute.sqlother314 B
analytics/sql/waf/client_keys.sqlother443 B
analytics/sql/waf/clients.sqlother521 B
analytics/sql/waf/compare_days.sqlother924 B
analytics/sql/waf/concentration.sqlother775 B
analytics/sql/waf/count_rules.sqlother556 B
analytics/sql/waf/countries.sqlother373 B
analytics/sql/waf/fingerprints.sqlother424 B
analytics/sql/waf/header_shape.sqlother425 B
analytics/sql/waf/labels.sqlother347 B
analytics/sql/waf/matched_data.sqlother530 B
analytics/sql/waf/rules_by_minute.sqlother497 B
analytics/sql/waf/summary.sqlother735 B
analytics/sql/waf/top_rules.sqlother361 B
analytics/sql/waf/uris.sqlother402 B
analytics/sql/waf/user_agents.sqlother557 B
analytics/tests/conftest.pyscript4.7 KB
analytics/tests/gen_fixtures.pyscript19.7 KB
analytics/tests/stubs/awsexecutablescript4.9 KB
analytics/tests/stubs/s5cmdexecutablescript4.5 KB
analytics/tests/test_awscli.pyscript16.0 KB
analytics/tests/test_budget.pyscript13.3 KB
analytics/tests/test_config.pyscript9.1 KB
analytics/tests/test_convert.pyscript25.9 KB
analytics/tests/test_duck.pyscript10.6 KB
analytics/tests/test_fetch.pyscript42.8 KB
analytics/tests/test_gen_fixtures.pyscript1.9 KB
analytics/tests/test_inventory.pyscript12.9 KB
analytics/tests/test_layout.pyscript9.8 KB
analytics/tests/test_named_queries.pyscript26.7 KB
analytics/tests/test_paths.pyscript3.2 KB
analytics/tests/test_redact.pyscript32.0 KB
analytics/tests/test_s5.pyscript17.8 KB
analytics/tests/test_sqlguard.pyscript10.8 KB
analytics/tests/test_sqlq.pyscript37.2 KB
analytics/tests/test_status.pyscript5.8 KB
analytics/tests/test_validate.pyscript2.9 KB
environment.template.mdmarkdown7.1 KB
playbooks/changes.mdmarkdown37.2 KB
playbooks/errors.mdmarkdown10.4 KB
playbooks/external.mdmarkdown15.4 KB
playbooks/infra-state.mdmarkdown13.7 KB
playbooks/logs-s3.mdmarkdown29.5 KB
playbooks/logs.mdmarkdown21.3 KB
playbooks/metrics.mdmarkdown39.0 KB
playbooks/other-backends.mdmarkdown7.2 KB
playbooks/traces.mdmarkdown16.2 KB
playbooks/waf.mdmarkdown17.2 KB
templates/incident.mdmarkdown3.9 KB
templates/ledger.mdmarkdown9.7 KB
templates/lesson.mdmarkdown2.7 KB
templates/profile.mdmarkdown4.5 KB
templates/report.mdmarkdown6.5 KB

analytics/logs.env.example

View on GitHub
# Opt-in S3 log module for sre-investigate.
#
# Copy this file to ~/.config/culiops/sre-investigate/logs.env and edit it. The
# module is on only when that file exists, parses cleanly, defines at least one
# dataset, and s5cmd (>= 2.2.0), duckdb (>= 1.4.0) and the AWS CLI (>= 2.9.0)
# are installed.
# Check with: <skill base>/analytics/bin/logs-status (the base directory of the
# installed sre-investigate skill)
#
# Format rules:
# - This file is PARSED, never sourced. It is plain KEY=value lines: no quotes,
#   no spaces around "=", no "export", no $(...) or variable expansion.
# - Values may use only letters, digits and  _ . , : / { } @ + = -
# - "#" starts a comment. Unknown keys are an error (so a typo cannot silently
#   leave a cap at its default).
# - The size caps below can be set here or left at their defaults. They CANNOT
#   be overridden by environment variables.
# - The over-cap marker (~/.config/culiops/sre-investigate/over-cap.allow) must
#   be created by YOU only. The agent never creates it, and never asks for
#   --force unless you tell it you created the marker.
#
# Everything below is commented out. Uncomment and edit what you need.

# --- AWS access (optional) -------------------------------------------------
# Read-only access is enough: s3:ListBucket and s3:GetObject on the log buckets.
# Needs AWS CLI v2.9 or newer. AWS_PROFILE may be an SSO profile: the module asks the
# AWS CLI for short-lived credentials before each download batch and hands them to s5cmd.
#AWS_PROFILE=example-profile
#AWS_REGION=us-east-1

# --- Datasets --------------------------------------------------------------
# DATASET_<name>=<type>:s3://<bucket>/<template>
#   <name>      lowercase letters, digits, - and _ (max 32 chars)
#   <type>      cloudfront | alb | waf
#   <template>  must contain {yyyy} {MM} {dd}; {HH} is optional, except for
#               cloudfront, where it is required. Each day expands
#               into one S3 LIST prefix (cut just before {HH} when the date comes
#               first; the hour is then read from each key).
#
# CloudFront standard logs (legacy layout, hourly files):
#DATASET_cdn=cloudfront:s3://example-logs-bucket/cloudfront/E2EXAMPLE.{yyyy}-{MM}-{dd}-{HH}
# CloudFront standard logging v2 with hive-style partitioning (W3C text):
#DATASET_cdn2=cloudfront:s3://example-logs-bucket/cloudfront-v2/{yyyy}/{MM}/{dd}/{HH}/
# ALB access logs (the date directory is the DELIVERY date):
#DATASET_alb=alb:s3://example-logs-bucket/alb/AWSLogs/111122223333/elasticloadbalancing/us-east-1/{yyyy}/{MM}/{dd}/
# WAF logs delivered straight to S3 (AWS requires the bucket name to start with aws-waf-logs-):
#DATASET_waf=waf:s3://aws-waf-logs-example-bucket/AWSLogs/111122223333/WAFLogs/us-east-1/example-web-acl/{yyyy}/{MM}/{dd}/{HH}/
# ...for a web ACL with CloudFront scope the Region segment is the literal 'cloudfront':
#DATASET_waf-cf=waf:s3://aws-waf-logs-example-bucket/AWSLogs/111122223333/WAFLogs/cloudfront/example-web-acl/{yyyy}/{MM}/{dd}/{HH}/
# WAF logs through Firehose (any prefix that ends in the date and hour):
#DATASET_waf-fh=waf:s3://example-logs-bucket/waf-firehose/{yyyy}/{MM}/{dd}/{HH}/

# --- Cost estimates (optional) ---------------------------------------------
# Decimal USD. When unset, estimates print "est_cost n/a" instead of a number.
#PRICE_PER_GB=0.09
#PRICE_PER_1K_GET=0.0004

# --- Size caps (defaults shown, in MB) ----------------------
# MAX_MB     largest single download
# RUN_MAX_MB total downloaded for one investigation run
# DAY_MAX_MB total downloaded per day, across runs
# MARKER_TTL_S how long (seconds) an over-cap marker stays valid
#MAX_MB=200
#RUN_MAX_MB=1024
#DAY_MAX_MB=2048
#MARKER_TTL_S=1800

# --- Redaction lists (defaults shown; each REPLACES its default list) ----------
# Comma-separated, matched case-insensitively. Replacing a list drops its
# defaults, so copy the defaults you still want.
# Cookie names and headers whose values are replaced by a salted hash:
#WAF_IDENTITY_COOKIES=session,sessionid,sid,jsessionid,phpsessid,connect.sid
#WAF_IDENTITY_HEADERS=authorization,x-api-key
# Query-string parameters whose values are masked in every log type:
#SENSITIVE_PARAMS=token,access_token,id_token,refresh_token,code,password,passwd,pwd,secret,key,api_key,apikey,signature,sig,auth,session,sessionid,email,phone
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall