opensite-ai/opensite-skills / aws-observability
aws-observability
UnverifiedBuilds, configures, debugs, and optimizes AWS observability - operator-symptom questions and detecting Omni vs classic CloudWatch. CloudWatch on an already-reporting service: Log Insights, metric/composite/anomaly alarms, custom metrics/EMF, dashboards, X-Ray/ADOT tracing, canaries, CloudTrail, Dynamic Instrumentation (live breakpoints/snapshots), the Application Signals service map, and fleet health views. CloudWatch Omni on an existing Space: SQL over logs and traces, PromQL over metrics, Omni dashboards, Omni alerts, context graph for root cause, programmatic/IaC access (API/SDK/CLI/CloudFormation), driving Omni from a coding agent or skills, and evaluating AI agent quality from traces - on-demand and online scoring of live traffic, readback, custom evaluators. For first-time setup - creating an Omni Space, granting access, ingestion, or ADOT instrumentation for Application Signals (ServiceEvents, CI/CD metadata) or Omni - use setting-up-cloudwatch-observability. Not for app logging or threat detection.
assets/cloudwatch/alarm-template.ts
View on GitHub// Best-practice CloudWatch alarm patterns for CDK
import {
Alarm, CompositeAlarm, AlarmRule, AlarmState,
ComparisonOperator, MathExpression, TreatMissingData,
Dashboard, AlarmWidget, GraphWidget, TextWidget, PeriodOverride,
} from 'aws-cdk-lib/aws-cloudwatch';
import { SnsAction } from 'aws-cdk-lib/aws-cloudwatch-actions';
import { Duration } from 'aws-cdk-lib';
import { IFunction } from 'aws-cdk-lib/aws-lambda';
import { ITopic } from 'aws-cdk-lib/aws-sns';
import { Construct } from 'constructs';
/**
* Create Lambda monitoring with best-practice defaults.
*
* Best-practice defaults (vs common defaults):
* - evaluationPeriods: 3 (not 1) — reduces false positives
* - datapointsToAlarm: 2 (not 1) — M-of-N prevents flapping
* - treatMissingData: NOT_BREACHING (not MISSING) — absence of errors = OK
* - period: 60s (not 300s) — faster detection
* - error rate uses math expression (not raw Errors count)
* - duration uses p99 (not Average)
*/
export function createLambdaMonitoring(
scope: Construct,
fn: IFunction,
snsTopic: ITopic,
options?: {
errorRateThreshold?: number; // default: 5 (percent)
durationThresholdMs?: number; // default: 3000 (ms)
},
) {
const errorRateThreshold = options?.errorRateThreshold ?? 5;
const durationThreshold = options?.durationThresholdMs ?? 3000;
// Error rate alarm (percentage via math expression)
const errorRateAlarm = new Alarm(scope, 'ErrorRateAlarm', {
metric: new MathExpression({
expression: 'IF(invocations > 0, errors * 100 / invocations, 0)',
usingMetrics: {
errors: fn.metricErrors({ period: Duration.minutes(1) }),
invocations: fn.metricInvocations({ period: Duration.minutes(1) }),
},
}),
threshold: errorRateThreshold,
evaluationPeriods: 3,
datapointsToAlarm: 2,
comparisonOperator: ComparisonOperator.GREATER_THAN_THRESHOLD,
treatMissingData: TreatMissingData.NOT_BREACHING,
});
// Duration alarm (p99, not average)
const durationAlarm = new Alarm(scope, 'DurationP99Alarm', {
metric: fn.metricDuration({
statistic: 'p99',
period: Duration.minutes(1),
}),
threshold: durationThreshold,
evaluationPeriods: 3,
datapointsToAlarm: 2,
comparisonOperator: ComparisonOperator.GREATER_THAN_THRESHOLD,
treatMissingData: TreatMissingData.NOT_BREACHING,
});
// Throttle alarm
const throttleAlarm = new Alarm(scope, 'ThrottleAlarm', {
metric: fn.metricThrottles({ period: Duration.minutes(1) }),
threshold: 1,
evaluationPeriods: 3,
datapointsToAlarm: 2,
comparisonOperator: ComparisonOperator.GREATER_THAN_OR_EQUAL_TO_THRESHOLD,
treatMissingData: TreatMissingData.NOT_BREACHING,
});
// Composite alarm — only page when service is unhealthy
const serviceHealthAlarm = new CompositeAlarm(scope, 'ServiceHealthAlarm', {
alarmRule: AlarmRule.anyOf(
AlarmRule.fromAlarm(errorRateAlarm, AlarmState.ALARM),
AlarmRule.fromAlarm(durationAlarm, AlarmState.ALARM),
AlarmRule.fromAlarm(throttleAlarm, AlarmState.ALARM),
),
});
serviceHealthAlarm.addAlarmAction(new SnsAction(snsTopic));
// Dashboard
const dashboard = new Dashboard(scope, 'ServiceDashboard', {
start: '-PT8H',
periodOverride: PeriodOverride.INHERIT,
});
dashboard.addWidgets(
new TextWidget({ width: 24, height: 1, markdown: '# Service Health' }),
new AlarmWidget({ width: 8, height: 6, title: 'Error Rate', alarm: errorRateAlarm }),
new AlarmWidget({ width: 8, height: 6, title: 'Duration P99', alarm: durationAlarm }),
new AlarmWidget({ width: 8, height: 6, title: 'Throttles', alarm: throttleAlarm }),
new GraphWidget({
width: 24, height: 6,
title: 'Invocations & Errors',
left: [fn.metricInvocations({ period: Duration.minutes(1) })],
right: [fn.metricErrors({ period: Duration.minutes(1) })],
}),
);
return { errorRateAlarm, durationAlarm, throttleAlarm, serviceHealthAlarm, dashboard };
}
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| rea-analysis-optimizationmorluto/reaOptimize REA providers and shared analysis workflows for agent context, latency, CPU, and memory while preserving correctness and Evidence. Use for analysis bottlenecks and cache or query design; CI/test-suite optimization belongs to rea-ci-tests-audit. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-ci-tests-auditmorluto/reaAudit REA CI and test suites for correctness, fixture drift, false passes, and measured performance; use for suite or workflow investigations and efficiency changes, rather than ordinary feature testing or a single test failure. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| rea-tool-designmorluto/reaAudit, investigate, design, or change REA investigation tools, CLI/MCP contracts, provider capabilities, and Evidence semantics. | Stars: 472k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-auditDietrichGebert/ponytailQuality audit of the whole repo: bugs, security, real load, missing tests, speed, and what to delete. Most important first. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |