amazon-science/ammo / ai_cli_session/.codex/skills/ammo
ammo
UnverifiedProfile and optimize GPU kernels for vLLM inference on NVIDIA GPUs. Use when targeting a specific model, hardware, dtype, parallelism, and workload to improve latency.
tests/fixtures/diluted_pass/legacy_no_phase.golden.md
View on GitHub# Validation Results (Phase 4)
Generated: GENERATED_AT (UTC)
> Default gates + required reporting checklist: `references/validation-defaults.md`.
## Environment
- TODO: record GPU + driver, torch + CUDA, vLLM commit, model id + quant, and TP/EP topology (`references/validation-defaults.md` § Required reporting checklist).
## Correctness
- TODO: run model-appropriate correctness tests (prefer existing vLLM tests for the model).
## Kernel perf (CUDA graphs)
- TODO: add GPU kernel-time table (baseline vs optimized) under CUDA graphs for the validated bucket set.
## E2E latency (vllm bench latency)
Workload:
- model_id: test/model
- input_len: 1024, output_len: 128
- tp: 1, max_model_len: 4096
- num_iters: 10
| Batch Size | baseline avg (s) | opt avg (s) | Speedup | Improvement | Fast-path evidence |
|---:|---:|---:|---:|---:|---|
| 1 | 1 | 0.952381 | 1.05x | 4.7619% | unknown |
> Note: ensure CUDA graphs / torch.compile settings match production parity per `references/e2e-latency-guide.md`.
## Decision
- TODO: Ship / restrict envelope / pivot route / stop (justify using kernel + E2E evidence).
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 198k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 194k | Updated | Claude CodeCodex | Verified | Install |