Skip to content

amazon-science/ammo / ai_cli_session/.codex/skills/ammo

Profile and optimize GPU kernels for vLLM inference on NVIDIA GPUs. Use when targeting a specific model, hardware, dtype, parallelism, and workload to improve latency.

FileKindSize
RUNTIME.mdmarkdown4.9 KB
SKILL.mdskill md18.5 KB
agents/ammo-auditor.mdmarkdown9.1 KB
agents/ammo-champion.mdmarkdown9.6 KB
agents/ammo-delegate.mdmarkdown3.2 KB
agents/ammo-implementer.mdmarkdown13.8 KB
agents/ammo-investigator.mdmarkdown4.0 KB
agents/ammo-report.mdmarkdown2.9 KB
agents/ammo-researcher.mdmarkdown10.3 KB
agents/ammo-resolver.mdmarkdown4.4 KB
agents/ammo-transcript-monitor.mdmarkdown7.8 KB
agents/openai.yamlexecutablescript313 B
data/ATTRIBUTION.mdmarkdown1.4 KB
data/gsm8k_full.jsonexecutablescript735.5 KB
data/gsm8k_subset.jsonexecutablescript116.8 KB
eval/EVAL-SKILL.mdexecutablescript21.8 KB
eval/agents/transcript_grader.mdexecutablescript18.0 KB
eval/causal/__init__.pyexecutablescript137 B
eval/causal/agents/causal_analyzer.mdexecutablescript10.5 KB
eval/causal/build_dag.pyexecutablescript21.6 KB
eval/causal/diff_versions.pyexecutablescript38.5 KB
eval/causal/extract_events.pyexecutablescript36.3 KB
eval/causal/generate_postmortem.pyexecutablescript17.0 KB
eval/causal/score_nodes.pyexecutablescript21.5 KB
eval/causal/templates/narrative_template.mdexecutablescript472 B
eval/causal/templates/viz_template.htmlexecutablescript9.5 KB
eval/causal/tests/__init__.pyexecutablescript151 B
eval/causal/tests/conftest.pyexecutablescript448 B
eval/causal/tests/fixtures/sample_session.jsonlexecutablescript10.4 KB
eval/causal/tests/fixtures/sample_session_data.jsonexecutablescript3.4 KB
eval/causal/tests/fixtures/sample_snapshot.jsonexecutablescript2.5 KB
eval/causal/tests/test_build_dag.pyexecutablescript2.7 KB
eval/causal/tests/test_diff_versions.pyexecutablescript13.5 KB
eval/causal/tests/test_extract_events.pyexecutablescript3.7 KB
eval/causal/tests/test_generate_postmortem.pyexecutablescript3.1 KB
eval/causal/tests/test_score_nodes.pyexecutablescript3.3 KB
eval/scripts/aggregate_versions.pyexecutablescript15.2 KB
eval/scripts/archive_run.pyexecutablescript9.1 KB
eval/scripts/codex_session.pyexecutablescript10.6 KB
eval/scripts/generate_dashboard.pyexecutablescript5.3 KB
eval/scripts/parse_artifacts.pyexecutablescript48.1 KB
eval/scripts/parse_session_logs.pyexecutablescript51.3 KB
eval/scripts/rescore_archived.pyexecutablescript5.5 KB
eval/scripts/score_campaign.pyexecutablescript43.8 KB
eval/scripts/snapshot_changes.pyexecutablescript11.1 KB
eval/scripts/verify_citations.pyexecutablescript8.8 KB
eval/tests/test_dashboard_bugs.pyexecutablescript8.8 KB
eval/tests/test_parse_session_logs.pyexecutablescript3.9 KB
eval/tests/test_parse_session_logs_round_inference.pyexecutablescript11.0 KB
eval/tests/test_score_campaign_diluted.pyexecutablescript9.4 KB
eval/viewer/dashboard_template.htmlexecutablescript15.1 KB
instrumentation/sitecustomize.pyexecutablescript3.6 KB
orchestration/audit-protocol.mdmarkdown9.3 KB
orchestration/debate-protocol.mdmarkdown11.2 KB
orchestration/integration-logic.mdmarkdown10.3 KB
orchestration/parallel-tracks.mdmarkdown8.9 KB
references/artifact-layout.mdexecutablescript22.4 KB
references/audit-invariants.mdmarkdown10.6 KB
references/champion-common-patterns.mdmarkdown3.4 KB
references/crossover-probing.mdexecutablescript4.7 KB
references/cudagraph-safety.mdmarkdown2.7 KB
references/debate-rules.mdmarkdown4.7 KB
references/debate-scoring-rubric.mdexecutablescript16.7 KB
references/e2e-delta-math.mdexecutablescript17.9 KB
references/e2e-latency-guide.mdexecutablescript9.6 KB
references/fusion-feasibility-heuristics.mdmarkdown5.6 KB
references/gpu-pool.mdexecutablescript5.4 KB
references/impl-track-rules.mdexecutablescript13.8 KB
references/nsys-profiling-guide.mdmarkdown9.8 KB
references/optimization-categories.mdexecutablescript11.0 KB
references/shutdown-protocol.mdexecutablescript3.1 KB
references/technology-selection.mdmarkdown5.0 KB
references/torch-compile-contract.mdmarkdown13.8 KB
references/validation-defaults.mdexecutablescript34.2 KB
references/workload-invocation.mdexecutablescript4.9 KB
references/writing-style.mdexecutablescript6.9 KB
scripts/ammo_state.pyexecutablescript142.0 KB
scripts/artifact_layout.jsonconfig16.3 KB
scripts/check_projection_accuracy.pyexecutablescript11.7 KB
scripts/create_evidence_template.pyexecutablescript9.7 KB
scripts/create_worktree_with_build.shexecutablescript10.2 KB
scripts/generate_validation_report.pyexecutablescript35.7 KB
scripts/gpu_reservation.pyexecutablescript27.1 KB
scripts/hook_cmd_classify.pyscript13.3 KB
scripts/mine_trace.pyscript29.4 KB
scripts/monitor_queue_ack.pyexecutablescript6.1 KB
scripts/ncu_sanity.shexecutablescript5.2 KB
scripts/ncu_sanity_driver.pyexecutablescript8.5 KB
scripts/new_target.pyexecutablescript22.0 KB
scripts/preflight_vllm_api.pyexecutablescript12.3 KB
scripts/reconcile_track_state.pyexecutablescript15.8 KB
scripts/remove_worktree_cleanup.shexecutablescript1.1 KB
scripts/resolve_codex_transcript.pyexecutablescript3.6 KB
scripts/run_vllm_bench_latency_sweep.pyexecutablescript249.6 KB
scripts/transcript_filter.pyexecutablescript38.4 KB
scripts/transitions.jsonexecutablescript1.5 KB
scripts/verify_validation_gates.pyexecutablescript88.8 KB
tests/agents/test-champion.mdexecutablescript20.4 KB
tests/agents/test-impl-champion.mdexecutablescript14.3 KB
tests/agents/test-implementer.mdexecutablescript15.8 KB
tests/agents/test-orchestrator.mdexecutablescript33.8 KB
tests/agents/test-researcher.mdexecutablescript21.0 KB
tests/agents/test-transcript-monitor.mdexecutablescript13.4 KB
tests/fixtures/diluted_pass/legacy_no_phase.golden.mdmarkdown1.1 KB
tests/fixtures/diluted_pass/legacy_no_phase.golden.summary.jsonconfig582 B
tests/fixtures/diluted_pass/legacy_no_phase.jsonconfig400 B
tests/fixtures/diluted_pass/legacy_scalar_phase.golden.mdmarkdown2.0 KB
tests/fixtures/diluted_pass/legacy_scalar_phase.golden.summary.jsonconfig1.0 KB
tests/fixtures/diluted_pass/legacy_scalar_phase.jsonconfig626 B
tests/fixtures/mining/real_campaign_bottleneck_analysis.mdmarkdown20.7 KB
tests/run_all.shexecutablescript1.6 KB
tests/scripts/test_transcript_filter.pyexecutablescript41.1 KB
tests/test_agent_runtime_contracts.pyexecutablescript1.8 KB
tests/test_ammo_state.pyexecutablescript71.7 KB
tests/test_artifact_layout_manifest.pyscript11.6 KB
tests/test_audit_started.pyscript18.2 KB
tests/test_correctness_comparator.pyscript12.6 KB
tests/test_diluted_pass.pyscript24.4 KB
tests/test_drift_compat.pyscript5.1 KB
tests/test_evidence_freshness.pyexecutablescript5.6 KB
tests/test_fail_closed.pyexecutablescript14.7 KB
tests/test_gpu_reservation.pyexecutablescript24.8 KB
tests/test_gpu_reservation_session_id.pyexecutablescript11.2 KB
tests/test_guidance_semantic_contract.pyscript24.9 KB
tests/test_hook_cmd_classify_parity.pyscript11.7 KB
tests/test_hook_semantics.pyexecutablescript95.3 KB
tests/test_mine_trace.pyscript24.2 KB
tests/test_mining_invalidated_schema.pyexecutablescript9.4 KB
tests/test_new_target_dp_ep.pyexecutablescript7.4 KB
tests/test_new_target_v2_scaffold.pyexecutablescript13.1 KB
tests/test_parse_artifacts.pyexecutablescript3.0 KB
tests/test_policy_convergence.pyscript797 B
tests/test_preflight_vllm_api.pyscript13.3 KB
tests/test_projection_accuracy_v2.pyexecutablescript4.1 KB
tests/test_reconcile_track_state.pyexecutablescript18.2 KB
tests/test_resolve_codex_transcript.pyexecutablescript3.1 KB
tests/test_state_schema_semantics.pyexecutablescript7.6 KB
tests/test_status_set_sync.pyexecutablescript9.1 KB
tests/test_sweep_baseline_from_arm.pyscript11.0 KB
tests/test_sweep_decode_capture.pyexecutablescript31.8 KB
tests/test_sweep_dp.pyexecutablescript45.4 KB
tests/test_sweep_fresh_cache.pyscript5.5 KB
tests/test_sweep_profiler_guard.pyscript22.6 KB
tests/test_sweep_real_prompts.pyscript20.1 KB
tests/test_sweep_refactor.pyexecutablescript37.6 KB
tests/test_sweep_round_slot.pyexecutablescript7.4 KB
tests/test_validation_report_phase_triage.pyexecutablescript10.0 KB
tests/test_validation_report_v2.pyexecutablescript6.2 KB
tests/test_verify_validation_gates.pyexecutablescript52.9 KB
tests/test_workload_matrix.pyexecutablescript19.3 KB

eval/causal/tests/fixtures/sample_session.jsonl

View on GitHub
{"type": "assistant", "timestamp": "2026-03-19T10:00:00.000Z", "sessionId": "test-session-001", "message": {"content": [{"type": "text", "text": "Starting AMMO campaign. Spawning researcher to capture baseline and mine bottlenecks."}, {"type": "tool_use", "id": "tu-researcher-001", "name": "spawn_agent", "input": {"name": "researcher-1", "agent_type": "ammo-researcher", "description": "Baseline capture + bottleneck mining", "model": "gpt-5.5"}}]}}
{"type": "assistant", "timestamp": "2026-03-19T10:05:00.000Z", "sessionId": "test-session-001", "agentId": "agent-researcher-001", "message": {"content": [{"type": "tool_use", "id": "tu-write-001", "name": "Write", "input": {"file_path": "/workspace/vllm/kernel_opt_artifacts/test/constraints.md", "content": "# AMMO Campaign Constraints\n\n## Hardware\n- GPU: L40S\n- CUDA: 12.9\n- TP: 1\n\n## Model\n- test-model (FP8)\n\n## Rules\n- No correctness regressions\n- E2E benchmark required for all shipped ops\n"}}]}}
{"type": "assistant", "timestamp": "2026-03-19T10:10:00.000Z", "sessionId": "test-session-001", "agentId": "agent-researcher-001", "message": {"content": [{"type": "text", "text": "Profiling complete. The top bottleneck is MoE dispatch at 29.8% of decode latency (2034 µs). Second is Mamba SSM at 14.8% of decode. These two account for 44.6% of per-step latency and are the primary targets for optimization."}, {"type": "tool_use", "id": "tu-write-002", "name": "Write", "input": {"file_path": "/workspace/vllm/kernel_opt_artifacts/test/bottleneck_analysis.md", "content": "# Bottleneck Analysis\n\n## Decode Latency Breakdown (BS=32)\n\n| Component | Latency (µs) | % of Decode |\n|-----------|-------------|-------------|\n| MoE dispatch | 2034 | 29.8% |\n| Mamba SSM | 1010 | 14.8% |\n| Attention | 890 | 13.0% |\n| Other | 2900 | 42.4% |\n\n## Top Bottleneck\nMoE dispatch at 29.8% of decode latency (2034 µs) is the primary target.\n\n## Second Bottleneck\nMamba SSM at 14.8% of decode is the secondary target.\n"}}]}}
{"type": "user", "timestamp": "2026-03-19T10:15:00.000Z", "sessionId": "test-session-001", "message": {"content": "<task-notification><task-id>task-001</task-id><tool-use-id>tu-researcher-001</tool-use-id><status>completed</status><summary>Profiling done</summary><usage><total_tokens>45000</total_tokens><tool_uses>12</tool_uses><duration_ms>120000</duration_ms></usage></task-notification>"}}
{"type": "assistant", "timestamp": "2026-03-19T10:20:00.000Z", "sessionId": "test-session-001", "message": {"content": [{"type": "text", "text": "Researcher complete. Spawning debate subagents for round 1."}, {"type": "tool_use", "id": "tu-team-create-001", "name": "spawn_agent", "input": {"description": "Round 1 debate"}}]}}
{"type": "assistant", "timestamp": "2026-03-19T10:25:00.000Z", "sessionId": "test-session-001", "message": {"content": [{"type": "text", "text": "Spawning champion-1 to propose optimization for MoE dispatch."}, {"type": "tool_use", "id": "tu-champ-001", "name": "spawn_agent", "input": {"name": "champion-1", "agent_type": "ammo-champion", "description": "Champion for MoE dispatch optimization", "model": "gpt-5.5"}}]}}
{"type": "assistant", "timestamp": "2026-03-19T10:30:00.000Z", "sessionId": "test-session-001", "message": {"content": [{"type": "text", "text": "Spawning champion-2 to propose alternative optimization."}, {"type": "tool_use", "id": "tu-champ-002", "name": "spawn_agent", "input": {"name": "champion-2", "agent_type": "ammo-champion", "description": "Champion for Mamba SSM optimization", "model": "gpt-5.5"}}]}}
{"type": "assistant", "timestamp": "2026-03-19T10:32:00.000Z", "sessionId": "test-session-001", "agentId": "agent-champion-001", "message": {"content": [{"type": "tool_use", "id": "tu-read-001", "name": "Read", "input": {"file_path": "/workspace/vllm/kernel_opt_artifacts/test/bottleneck_analysis.md"}}]}}
{"type": "assistant", "timestamp": "2026-03-19T10:35:00.000Z", "sessionId": "test-session-001", "agentId": "agent-champion-001", "message": {"content": [{"type": "text", "text": "Based on profiling, MoE dispatch at 29.8% of decode is the top target. Estimated +5% E2E speedup via kernel fusion of dispatch routing and weight loading. The 2034 µs per-step cost is addressable by overlapping token routing with weight prefetch."}, {"type": "tool_use", "id": "tu-write-003", "name": "Write", "input": {"file_path": "/workspace/vllm/kernel_opt_artifacts/test/debate/proposals/champion-1.md", "content": "# Champion-1 Proposal: MoE Dispatch Kernel Fusion\n\n## Bottleneck\nMoE dispatch at 29.8% of decode latency (2034 µs).\n\n## Proposal\nFuse token routing and weight loading into a single CUDA kernel to eliminate intermediate buffer reads.\n\n## Estimated Speedup\n+5% E2E at BS=32 based on roofline analysis.\n\n## Risk\nLow — routing logic is deterministic.\n"}}]}}
{"type": "assistant", "timestamp": "2026-03-19T10:37:00.000Z", "sessionId": "test-session-001", "agentId": "agent-champion-002", "message": {"content": [{"type": "tool_use", "id": "tu-read-002", "name": "Read", "input": {"file_path": "/workspace/vllm/kernel_opt_artifacts/test/bottleneck_analysis.md"}}]}}
{"type": "assistant", "timestamp": "2026-03-19T10:40:00.000Z", "sessionId": "test-session-001", "agentId": "agent-champion-002", "message": {"content": [{"type": "text", "text": "MoE dispatch takes 22.0% of decode. This is a significant bottleneck. Estimated +3% E2E. I propose reducing expert capacity factor from 1.25 to 1.0 to cut dispatch overhead by roughly 30%."}, {"type": "tool_use", "id": "tu-write-004", "name": "Write", "input": {"file_path": "/workspace/vllm/kernel_opt_artifacts/test/debate/proposals/champion-2.md", "content": "# Champion-2 Proposal: MoE Capacity Factor Reduction\n\n## Bottleneck\nMoE dispatch takes 22.0% of decode.\n\n## Proposal\nReduce expert capacity factor from 1.25 to 1.0 to cut dispatch buffer overhead.\n\n## Estimated Speedup\n+3% E2E at BS=32.\n\n## Risk\nMedium — may increase token dropping at high batch sizes.\n"}}]}}
{"type": "assistant", "timestamp": "2026-03-19T10:43:00.000Z", "sessionId": "test-session-001", "agentId": "agent-orchestrator-sub-001", "message": {"content": [{"type": "text", "text": "Cross-referencing proposals with profiling data. MoE dispatch at 29.8% of decode is confirmed by NCU trace. Champion-1 proposal is grounded in accurate data."}, {"type": "tool_use", "id": "tu-write-005", "name": "Write", "input": {"file_path": "/workspace/vllm/kernel_opt_artifacts/test/debate/scoring.md", "content": "# Debate Scoring Round 1\n\nChampion-1: 7.5/10 (correct f-value: 29.8%, concrete mechanism)\nChampion-2: 5.2/10 (incorrect f-value: cited 22.0% vs actual 29.8%)\n"}}]}}
{"type": "user", "timestamp": "2026-03-19T10:45:00.000Z", "sessionId": "test-session-001", "message": {"content": "<task-notification><task-id>task-002</task-id><tool-use-id>tu-champ-001</tool-use-id><status>completed</status><summary>Champion-1 proposal submitted</summary><usage><total_tokens>30000</total_tokens><tool_uses>8</tool_uses><duration_ms>90000</duration_ms></usage></task-notification>"}}
{"type": "user", "timestamp": "2026-03-19T10:47:00.000Z", "sessionId": "test-session-001", "message": {"content": "<task-notification><task-id>task-003</task-id><tool-use-id>tu-champ-002</tool-use-id><status>completed</status><summary>Champion-2 proposal submitted</summary><usage><total_tokens>28000</total_tokens><tool_uses>7</tool_uses><duration_ms>85000</duration_ms></usage></task-notification>"}}
{"type": "assistant", "timestamp": "2026-03-19T10:50:00.000Z", "sessionId": "test-session-001", "message": {"content": [{"type": "text", "text": "Debate complete. Closing completed subagents and selecting champion-1 proposal for implementation."}, {"type": "tool_use", "id": "tu-team-delete-001", "name": "CodexSubagentClose", "input": {}}]}}
{"type": "assistant", "timestamp": "2026-03-19T10:55:00.000Z", "sessionId": "test-session-001", "message": {"content": [{"type": "text", "text": "Spawning implementer for op001 (MoE dispatch kernel fusion)."}, {"type": "tool_use", "id": "tu-impl-001", "name": "spawn_agent", "input": {"name": "implementer-op001", "agent_type": "ammo-implementer", "description": "Implement MoE dispatch kernel fusion (op001)", "model": "gpt-5.5"}}]}}
{"type": "assistant", "timestamp": "2026-03-19T11:00:00.000Z", "sessionId": "test-session-001", "agentId": "agent-impl-001", "message": {"content": [{"type": "tool_use", "id": "tu-write-006", "name": "Write", "input": {"file_path": "/workspace/vllm/kernel_opt_artifacts/test/tracks/op001/validation_results.md", "content": "# OP-001 Validation Results\n\n## Kernel Speedup\n- BS=1: +1.8%\n- BS=8: +3.2%\n- BS=32: +5.1%\n\n## E2E Speedup\n- BS=1: +1.2%\n- BS=8: +3.0%\n- BS=32: +5.0%\n\n## Correctness\nPASS — output matches reference to FP16 tolerance.\n\n## Status: PASSED\n"}}]}}
{"type": "assistant", "timestamp": "2026-03-19T11:05:00.000Z", "sessionId": "test-session-001", "agentId": "agent-impl-001", "message": {"content": [{"type": "tool_use", "id": "tu-read-003", "name": "Read", "input": {"file_path": "/workspace/vllm/kernel_opt_artifacts/test/bottleneck_analysis.md"}}]}}
{"type": "assistant", "timestamp": "2026-03-19T11:08:00.000Z", "sessionId": "test-session-001", "agentId": "agent-impl-001", "message": {"content": [{"type": "text", "text": "Notifying validator. Implementation targets MoE dispatch at 29.8% of decode — confirmed from bottleneck_analysis.md."}, {"type": "tool_use", "id": "tu-send-001", "name": "send_input", "input": {"target": "validator-op001", "message": "Starting implementation of MoE dispatch kernel fusion. Target bottleneck: MoE dispatch at 29.8% of decode (2034 µs). Champion-1 proposal selected.", "summary": "Begin impl"}}]}}
{"type": "user", "timestamp": "2026-03-19T11:20:00.000Z", "sessionId": "test-session-001", "message": {"content": "<task-notification><task-id>task-004</task-id><tool-use-id>tu-impl-001</tool-use-id><status>completed</status><summary>op001 implementation and validation complete</summary><usage><total_tokens>60000</total_tokens><tool_uses>18</tool_uses><duration_ms>180000</duration_ms></usage></task-notification>"}}
{"type": "assistant", "timestamp": "2026-03-19T11:25:00.000Z", "sessionId": "test-session-001", "message": {"content": [{"type": "text", "text": "op001 shipped. Campaign exhausted after 1 round — no further bottlenecks above threshold. Final cumulative E2E speedup: +5.0% at BS=32."}]}}
{"type": "user", "timestamp": "2026-03-19T11:30:00.000Z", "sessionId": "test-session-001", "message": {"content": "Campaign summary received. Well done."}}
slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack."Stars: 198kUpdated Claude CodeCodexVerifiedInstall
ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.Stars: 194kUpdated Claude CodeCodexVerifiedInstall
ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.Stars: 194kUpdated Claude CodeCodexVerifiedInstall