meltedinhex/analyst-ai-pack / skills/validating-detections-with-atomic-tests
validating-detections-with-atomic-tests
VerifiedValidates detection coverage by mapping Atomic Red Team tests to ATT&CK techniques, checking which of your detections cover each tested technique, and reporting coverage gaps. Activates for requests to validate detections with atomic tests, map Atomic Red Team to coverage, or find detection gaps against tested techniques.
| File | Kind | Size |
|---|---|---|
| LICENSE | other | 340 B |
| SKILL.md | skill md | 2.7 KB |
| references/api-reference.md | markdown | 1.2 KB |
| scripts/analyst.py | script | 2.5 KB |
references/api-reference.md
View on GitHub# API Reference: Validating Detections With Atomic Tests
## Overview
`scripts/analyst.py` computes detection coverage by joining Atomic Red Team-tested ATT&CK techniques
with your detection inventory's covered techniques, reporting covered/uncovered techniques and
ranking gaps by atomic-test count. It parses data only, executes nothing, and never runs an atomic.
## Dependencies
| Package | Version | Purpose |
|---------|---------|---------|
| (stdlib) | — | json, Counter, file IO |
## Inputs
- **atomics**: JSON list of `{"technique": "T1059.001", "test": "..."}` or a `technique→count`
mapping.
- **detections**: JSON list of technique IDs or objects with a `technique` key.
## Core functions
### `coverage(atomics_path, detections_path)`
Returns tested count, covered/uncovered technique lists, coverage percent, and gap priority.
## Usage
```bash
python scripts/analyst.py coverage --atomics atomics.json --detections detections.json
```
## Sources
- Atomic Red Team (test→technique mapping) — https://github.com/redcanaryco/atomic-red-team
- MITRE ATT&CK techniques/sub-techniques — https://attack.mitre.org/techniques/
- Coverage-by-technique validation approach from detection-engineering practice
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the work | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation code | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy. | Stars: 197k | Updated | Claude CodeCodex | Verified | Install |