culiops/culiops-skills / skills/sre-investigate
sre-investigate
Unverifiedanalytics/logs.env.example
View on GitHub# Opt-in S3 log module for sre-investigate.
#
# Copy this file to ~/.config/culiops/sre-investigate/logs.env and edit it. The
# module is on only when that file exists, parses cleanly, defines at least one
# dataset, and s5cmd (>= 2.2.0), duckdb (>= 1.4.0) and the AWS CLI (>= 2.9.0)
# are installed.
# Check with: <skill base>/analytics/bin/logs-status (the base directory of the
# installed sre-investigate skill)
#
# Format rules:
# - This file is PARSED, never sourced. It is plain KEY=value lines: no quotes,
# no spaces around "=", no "export", no $(...) or variable expansion.
# - Values may use only letters, digits and _ . , : / { } @ + = -
# - "#" starts a comment. Unknown keys are an error (so a typo cannot silently
# leave a cap at its default).
# - The size caps below can be set here or left at their defaults. They CANNOT
# be overridden by environment variables.
# - The over-cap marker (~/.config/culiops/sre-investigate/over-cap.allow) must
# be created by YOU only. The agent never creates it, and never asks for
# --force unless you tell it you created the marker.
#
# Everything below is commented out. Uncomment and edit what you need.
# --- AWS access (optional) -------------------------------------------------
# Read-only access is enough: s3:ListBucket and s3:GetObject on the log buckets.
# Needs AWS CLI v2.9 or newer. AWS_PROFILE may be an SSO profile: the module asks the
# AWS CLI for short-lived credentials before each download batch and hands them to s5cmd.
#AWS_PROFILE=example-profile
#AWS_REGION=us-east-1
# --- Datasets --------------------------------------------------------------
# DATASET_<name>=<type>:s3://<bucket>/<template>
# <name> lowercase letters, digits, - and _ (max 32 chars)
# <type> cloudfront | alb | waf
# <template> must contain {yyyy} {MM} {dd}; {HH} is optional, except for
# cloudfront, where it is required. Each day expands
# into one S3 LIST prefix (cut just before {HH} when the date comes
# first; the hour is then read from each key).
#
# CloudFront standard logs (legacy layout, hourly files):
#DATASET_cdn=cloudfront:s3://example-logs-bucket/cloudfront/E2EXAMPLE.{yyyy}-{MM}-{dd}-{HH}
# CloudFront standard logging v2 with hive-style partitioning (W3C text):
#DATASET_cdn2=cloudfront:s3://example-logs-bucket/cloudfront-v2/{yyyy}/{MM}/{dd}/{HH}/
# ALB access logs (the date directory is the DELIVERY date):
#DATASET_alb=alb:s3://example-logs-bucket/alb/AWSLogs/111122223333/elasticloadbalancing/us-east-1/{yyyy}/{MM}/{dd}/
# WAF logs delivered straight to S3 (AWS requires the bucket name to start with aws-waf-logs-):
#DATASET_waf=waf:s3://aws-waf-logs-example-bucket/AWSLogs/111122223333/WAFLogs/us-east-1/example-web-acl/{yyyy}/{MM}/{dd}/{HH}/
# ...for a web ACL with CloudFront scope the Region segment is the literal 'cloudfront':
#DATASET_waf-cf=waf:s3://aws-waf-logs-example-bucket/AWSLogs/111122223333/WAFLogs/cloudfront/example-web-acl/{yyyy}/{MM}/{dd}/{HH}/
# WAF logs through Firehose (any prefix that ends in the date and hour):
#DATASET_waf-fh=waf:s3://example-logs-bucket/waf-firehose/{yyyy}/{MM}/{dd}/{HH}/
# --- Cost estimates (optional) ---------------------------------------------
# Decimal USD. When unset, estimates print "est_cost n/a" instead of a number.
#PRICE_PER_GB=0.09
#PRICE_PER_1K_GET=0.0004
# --- Size caps (defaults shown, in MB) ----------------------
# MAX_MB largest single download
# RUN_MAX_MB total downloaded for one investigation run
# DAY_MAX_MB total downloaded per day, across runs
# MARKER_TTL_S how long (seconds) an over-cap marker stays valid
#MAX_MB=200
#RUN_MAX_MB=1024
#DAY_MAX_MB=2048
#MARKER_TTL_S=1800
# --- Redaction lists (defaults shown; each REPLACES its default list) ----------
# Comma-separated, matched case-insensitively. Replacing a list drops its
# defaults, so copy the defaults you still want.
# Cookie names and headers whose values are replaced by a salted hash:
#WAF_IDENTITY_COOKIES=session,sessionid,sid,jsessionid,phpsessid,connect.sid
#WAF_IDENTITY_HEADERS=authorization,x-api-key
# Query-string parameters whose values are masked in every log type:
#SENSITIVE_PARAMS=token,access_token,id_token,refresh_token,code,password,passwd,pwd,secret,key,api_key,apikey,signature,sig,auth,session,sessionid,email,phone
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |