Skip to content

kali20gakki/msAgent / skills/operator/ops-performance-tuning

ops-performance-tuning

Verified

Compile, profile, diagnose, optimize, and compare Ascend NPU operators across CANN versions and A2/A3/A5 for Ascend C, CATLASS, Triton-Ascend, TileLang-Ascend, PyPTO, and SHMEM/MC2. Use when an operator already has a runnable implementation and the user asks for msOpProf collection, bottleneck analysis, source-level tuning, or a reproducible before/after performance report. Do not use as the primary workflow for operator creation, migration, or unresolved correctness failures.

FileKindSize
SKILL.mdskill md15.4 KB
evals/evals.jsonconfig3.6 KB
references/case-routing.mdmarkdown30.0 KB
references/cases/ascendc/pr_ascendc_allgathermm_scalar_align.mdmarkdown1.7 KB
references/cases/ascendc/pr_ascendc_cann_samples_perf_story.mdmarkdown3.9 KB
references/cases/ascendc/pr_ascendc_cgdr_vf_inverse.mdmarkdown1.6 KB
references/cases/ascendc/pr_ascendc_conv3ddx_tque_tbuf.mdmarkdown1.6 KB
references/cases/ascendc/pr_ascendc_layernorm_areg.mdmarkdown1.6 KB
references/cases/ascendc/pr_ascendc_logit_a5_microapi.mdmarkdown1.9 KB
references/cases/ascendc/pr_ascendc_matmul_case_18x.mdmarkdown1.5 KB
references/cases/ascendc/pr_ascendc_matmul_full_load_wiki.mdmarkdown1.6 KB
references/cases/ascendc/pr_ascendc_matmul_vcv_wiki.mdmarkdown1.8 KB
references/cases/ascendc/pr_ascendc_mc2_fusion.mdmarkdown1.4 KB
references/cases/ascendc/pr_ascendc_mhc_24x.mdmarkdown1.2 KB
references/cases/ascendc/pr_ascendc_msopprof_add_block_imbalance.mdmarkdown1.7 KB
references/cases/ascendc/pr_ascendc_quantize_a2_micro_opt.mdmarkdown2.0 KB
references/cases/ascendc/pr_ascendc_rotate_quant_blaze.mdmarkdown2.8 KB
references/cases/ascendc/pr_ascendc_tiling_l2_official.mdmarkdown1.6 KB
references/cases/catlass/pr_catlass_baseline.mdmarkdown1.3 KB
references/cases/catlass/pr_catlass_fixpipe_dualdst.mdmarkdown1.6 KB
references/cases/catlass/pr_catlass_grouped_matmul_tiling.mdmarkdown1.5 KB
references/cases/catlass/pr_catlass_mstuner_3p8x.mdmarkdown1.9 KB
references/cases/catlass/pr_catlass_swizzle_balance.mdmarkdown1.6 KB
references/cases/pypto/pr_pypto_gqa_decode_vector_merge.mdmarkdown2.4 KB
references/cases/pypto/pr_pypto_l2_hit_layout_s13.mdmarkdown1.9 KB
references/cases/pypto/pr_pypto_per_matmul_tile_shapes.mdmarkdown2.4 KB
references/cases/pypto/pr_pypto_small_shape_matmul.mdmarkdown2.3 KB
references/cases/pypto/pr_pypto_weight_none_cacheable.mdmarkdown2.6 KB
references/cases/shmem/pr_shmem_alltoallv_mr152.mdmarkdown2.4 KB
references/cases/shmem/pr_shmem_reduce_scatter_serial.mdmarkdown2.6 KB
references/cases/tilelang/pr_tilelang_benchmark_vs_ascendc.mdmarkdown1.7 KB
references/cases/tilelang/pr_tilelang_compiler_prs.mdmarkdown2.3 KB
references/cases/tilelang/pr_tilelang_fa_pr698.mdmarkdown1.5 KB
references/cases/tilelang/pr_tilelang_gqa_bwd_pr1494.mdmarkdown1.3 KB
references/cases/tilelang/pr_tilelang_persistent_mqa_decode.mdmarkdown2.2 KB
references/cases/tilelang/pr_tilelang_sfa_pr665.mdmarkdown914 B
references/cases/triton/pr_triton_atomic_simd_24x.mdmarkdown1.8 KB
references/cases/triton/pr_triton_autotune_background.mdmarkdown1.0 KB
references/cases/triton/pr_triton_constexpr_recompile.mdmarkdown1.1 KB
references/cases/triton/pr_triton_lgamma_simt.mdmarkdown1.6 KB
references/compile/compile-ascendc.mdmarkdown9.0 KB
references/compile/compile-catlass.mdmarkdown2.4 KB
references/compile/compile-pypto.mdmarkdown2.0 KB
references/compile/compile-shmem.mdmarkdown2.6 KB
references/compile/compile-tilelang.mdmarkdown2.7 KB
references/compile/compile-triton.mdmarkdown4.4 KB
references/diagnose/diagnose-l2-cache.mdmarkdown2.2 KB
references/diagnose/diagnose-occupancy.mdmarkdown4.0 KB
references/diagnose/diagnose-pipeline.mdmarkdown4.1 KB
references/diagnose/diagnose-roofline.mdmarkdown3.1 KB
references/optimize/optimize-api-usage.mdmarkdown1.7 KB
references/optimize/optimize-ascendc-regbase-vf.mdmarkdown5.9 KB
references/optimize/optimize-ascendc-tiling.mdmarkdown935 B
references/optimize/optimize-catlass.mdmarkdown3.0 KB
references/optimize/optimize-data-copy.mdmarkdown870 B
references/optimize/optimize-index.mdmarkdown3.6 KB
references/optimize/optimize-memory-hierarchy.mdmarkdown599 B
references/optimize/optimize-pipeline.mdmarkdown1.0 KB
references/optimize/optimize-pypto.mdmarkdown1.5 KB
references/optimize/optimize-shmem.mdmarkdown5.1 KB
references/optimize/optimize-tilelang.mdmarkdown1.7 KB
references/optimize/optimize-triton.mdmarkdown3.8 KB
references/profile/benchmark-harness.mdmarkdown2.2 KB
references/profile/profile-msopprof.mdmarkdown7.4 KB
references/troubleshooting.mdmarkdown5.8 KB
scripts/bound_analyzer.pyscript9.8 KB
scripts/delta_report.pyscript5.5 KB
scripts/env_check.shscript5.7 KB
scripts/result_saver.pyscript5.8 KB

references/compile/compile-shmem.md

View on GitHub
# SHMEM / MC2:构建、运行与验证

通信算子的构建必须覆盖 Host 启动、Kernel、rank/PE 配置和通信初始化。不同仓的 API、启动器和通信库版本差异较大,因此先提取工程契约,不假设统一命令。

## 1. 识别工程契约

```bash
cd <repo_root>
rg -n "shmem|aclshmem|HCCL|rank|world_size|n_pes|symmetric|alltoall|reduce_scatter" \
  . --glob '!build/**' --glob '!output/**'
rg -n "build.sh|run.sh|mpirun|ranktable|add_executable|kernel" \
  CMakeLists.txt scripts/ tests/ examples/ 2>/dev/null
```

记录:CANN/driver/firmware、通信库版本、SoC、设备与 rank 映射、节点拓扑、消息大小、dtype、PE 数、build/run 命令、正确性条件以及 HCCL 标杆。

## 2. 构建与精度门禁

1. 使用目标仓文档指定的 CANN 和通信库组合,同时编译 Host 与 Kernel;不得复用其他 CANN 版本的二进制。
2. 保存每个 rank 的 stdout/stderr 和退出码;任一 rank 异常均视为失败。
3. 对比完整输出、通信元素数和 rank 映射;不以“程序退出 0”替代正确性验证。
4. 先跑 HCCL 或工程正式标杆,再跑 SHMEM/MC2;两者使用相同拓扑、消息量、dtype、warmup 和 repeat。
5. **设备前提检查(Step 1 就要做)**:`rankNum ≤ 可用空闲设备数`。host 侧 `deviceId = rankId` 的样例每 rank 独占一个物理设备,`ASCEND_RT_VISIBLE_DEVICES` 可见设备数不足时 rank 会在 `aclrtSetDevice` 报 `aclError:107001` 或对端阻塞超时——不要等到 Step 3/4 才发现。rankNum=1 退化运行通常挂起且失去通信语义,不能当基线。cann-samples 抽离案例的构建树重建见 [compile-ascendc.md §4.3.1](compile-ascendc.md)(`shmem.cmake` 会现场编译 third_party/shmem,已有 install 产物优先复用)。

## 3. 性能口径与采集

同时记录 e2e、kernel、algBw、busBw、每 rank 最大值与均值。通信性能由最慢 rank 决定,禁止只报告平均值。

仅当本机帮助明确支持多设备/MC2 时使用 `msprof op`;否则使用完整 `msprof`。每个 rank 的输出目录必须独立,命令、rank 映射、kernel 清单和采集失败项必须归档。详见 [msOpProf 采集指南](../profile/profile-msopprof.md)。

## 4. 调优入口

完成通信量、热点 PE、串行链路、同步次数和通算重叠的证据表后,读取 [SHMEM 优化技术](../optimize/optimize-shmem.md),再从 [案例路由](../case-routing.md) 选择最多三个同拓扑案例。每轮只修改一个分片、缓冲、信号、核角色或 overlap 机制,并重做所有 rank 的精度与性能验证。
planning-and-task-breakdownaddyosmani/agent-skillsBreaks work into ordered tasks. Use when you have a spec or clear requirements and need to break work into implementable tasks. Use when a task feels too large to start, when you need to estimate scope, or when parallel work is possible.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
screenpipethedotmack/claude-memSearch screen and audio history recorded by Screenpipe and optionally save selected context into claude-mem. Use when the user asks to recall desktop activity, a meeting, or something seen in another app through Screenpipe.Stars: 118kUpdated Claude CodeCodexVerifiedInstall
contact-widgetnexu-io/open-designSelf-contained floating chat widget with welcome screen, social links, meeting button, and message input. Single HTML file, zero dependencies.Stars: 108kUpdated Claude CodeCodexVerifiedInstall
meeting-notesnexu-io/open-designMeeting notes page — title bar with attendees, agenda checklist, decisions block, action items table with owners + dates, and a "next meeting" footer. Use when the brief mentions "meeting notes", "minutes", "1:1 notes", "all-hands recap", or "会议纪要".Stars: 108kUpdated Claude CodeCodexVerifiedInstall