Skip to content

Ascend/msagent / skills/operator/ops-performance-tuning

ops-performance-tuning

Verified

Compile, profile, diagnose, optimize, and compare Ascend NPU operators across CANN versions and A2/A3/A5 for Ascend C, CATLASS, Triton-Ascend, TileLang-Ascend, PyPTO, and SHMEM/MC2. Use when an operator already has a runnable implementation and the user asks for msOpProf collection, bottleneck analysis, source-level tuning, or a reproducible before/after performance report. Do not use as the primary workflow for operator creation, migration, or unresolved correctness failures.

FileKindSize
SKILL.mdskill md15.4 KB
evals/evals.jsonconfig3.6 KB
references/case-routing.mdmarkdown30.0 KB
references/cases/ascendc/pr_ascendc_allgathermm_scalar_align.mdmarkdown1.7 KB
references/cases/ascendc/pr_ascendc_cann_samples_perf_story.mdmarkdown3.9 KB
references/cases/ascendc/pr_ascendc_cgdr_vf_inverse.mdmarkdown1.6 KB
references/cases/ascendc/pr_ascendc_conv3ddx_tque_tbuf.mdmarkdown1.6 KB
references/cases/ascendc/pr_ascendc_layernorm_areg.mdmarkdown1.6 KB
references/cases/ascendc/pr_ascendc_logit_a5_microapi.mdmarkdown1.9 KB
references/cases/ascendc/pr_ascendc_matmul_case_18x.mdmarkdown1.5 KB
references/cases/ascendc/pr_ascendc_matmul_full_load_wiki.mdmarkdown1.6 KB
references/cases/ascendc/pr_ascendc_matmul_vcv_wiki.mdmarkdown1.8 KB
references/cases/ascendc/pr_ascendc_mc2_fusion.mdmarkdown1.4 KB
references/cases/ascendc/pr_ascendc_mhc_24x.mdmarkdown1.2 KB
references/cases/ascendc/pr_ascendc_msopprof_add_block_imbalance.mdmarkdown1.7 KB
references/cases/ascendc/pr_ascendc_quantize_a2_micro_opt.mdmarkdown2.0 KB
references/cases/ascendc/pr_ascendc_rotate_quant_blaze.mdmarkdown2.8 KB
references/cases/ascendc/pr_ascendc_tiling_l2_official.mdmarkdown1.6 KB
references/cases/catlass/pr_catlass_baseline.mdmarkdown1.3 KB
references/cases/catlass/pr_catlass_fixpipe_dualdst.mdmarkdown1.6 KB
references/cases/catlass/pr_catlass_grouped_matmul_tiling.mdmarkdown1.5 KB
references/cases/catlass/pr_catlass_mstuner_3p8x.mdmarkdown1.9 KB
references/cases/catlass/pr_catlass_swizzle_balance.mdmarkdown1.6 KB
references/cases/pypto/pr_pypto_gqa_decode_vector_merge.mdmarkdown2.4 KB
references/cases/pypto/pr_pypto_l2_hit_layout_s13.mdmarkdown1.9 KB
references/cases/pypto/pr_pypto_per_matmul_tile_shapes.mdmarkdown2.4 KB
references/cases/pypto/pr_pypto_small_shape_matmul.mdmarkdown2.3 KB
references/cases/pypto/pr_pypto_weight_none_cacheable.mdmarkdown2.6 KB
references/cases/shmem/pr_shmem_alltoallv_mr152.mdmarkdown2.4 KB
references/cases/shmem/pr_shmem_reduce_scatter_serial.mdmarkdown2.6 KB
references/cases/tilelang/pr_tilelang_benchmark_vs_ascendc.mdmarkdown1.7 KB
references/cases/tilelang/pr_tilelang_compiler_prs.mdmarkdown2.3 KB
references/cases/tilelang/pr_tilelang_fa_pr698.mdmarkdown1.5 KB
references/cases/tilelang/pr_tilelang_gqa_bwd_pr1494.mdmarkdown1.3 KB
references/cases/tilelang/pr_tilelang_persistent_mqa_decode.mdmarkdown2.2 KB
references/cases/tilelang/pr_tilelang_sfa_pr665.mdmarkdown914 B
references/cases/triton/pr_triton_atomic_simd_24x.mdmarkdown1.8 KB
references/cases/triton/pr_triton_autotune_background.mdmarkdown1.0 KB
references/cases/triton/pr_triton_constexpr_recompile.mdmarkdown1.1 KB
references/cases/triton/pr_triton_lgamma_simt.mdmarkdown1.6 KB
references/compile/compile-ascendc.mdmarkdown9.0 KB
references/compile/compile-catlass.mdmarkdown2.4 KB
references/compile/compile-pypto.mdmarkdown2.0 KB
references/compile/compile-shmem.mdmarkdown2.6 KB
references/compile/compile-tilelang.mdmarkdown2.7 KB
references/compile/compile-triton.mdmarkdown4.4 KB
references/diagnose/diagnose-l2-cache.mdmarkdown2.2 KB
references/diagnose/diagnose-occupancy.mdmarkdown4.0 KB
references/diagnose/diagnose-pipeline.mdmarkdown4.1 KB
references/diagnose/diagnose-roofline.mdmarkdown3.1 KB
references/optimize/optimize-api-usage.mdmarkdown1.7 KB
references/optimize/optimize-ascendc-regbase-vf.mdmarkdown5.9 KB
references/optimize/optimize-ascendc-tiling.mdmarkdown935 B
references/optimize/optimize-catlass.mdmarkdown3.0 KB
references/optimize/optimize-data-copy.mdmarkdown870 B
references/optimize/optimize-index.mdmarkdown3.6 KB
references/optimize/optimize-memory-hierarchy.mdmarkdown599 B
references/optimize/optimize-pipeline.mdmarkdown1.0 KB
references/optimize/optimize-pypto.mdmarkdown1.5 KB
references/optimize/optimize-shmem.mdmarkdown5.1 KB
references/optimize/optimize-tilelang.mdmarkdown1.7 KB
references/optimize/optimize-triton.mdmarkdown3.8 KB
references/profile/benchmark-harness.mdmarkdown2.2 KB
references/profile/profile-msopprof.mdmarkdown7.4 KB
references/troubleshooting.mdmarkdown5.8 KB
scripts/bound_analyzer.pyscript9.0 KB
scripts/delta_report.pyscript4.8 KB
scripts/env_check.shscript5.0 KB
scripts/result_saver.pyscript5.0 KB

references/optimize/optimize-index.md

View on GitHub
# 算子优化技术库(Reference):索引

> 本目录按主题整理通用算子优化技术,每条给出理论说明、代码示范与性能对比数字。

**技术线索引**:Ascend C(§1,按主题拆为 5 个文件)· SHMEM 通信算子(§2)· CATLASS(§3)· Triton-Ascend(§4)· TileLang-Ascend(§5)· PyPTO(§6)

## 文件索引

| 文件 | 内容 | 原小节 |
|---|---|---|
| [ascendc-tiling.md](optimize-ascendc-tiling.md) | Ascend C · Tiling 与核间负载 | §1.1 |
| [data-copy.md](optimize-data-copy.md) | Ascend C · 数据搬运 | §1.2 |
| [api-usage.md](optimize-api-usage.md) | Ascend C · API 使用 | §1.3 |
| [memory-hierarchy.md](optimize-memory-hierarchy.md) | Ascend C · 内存层级利用 | §1.4 |
| [pipeline.md](optimize-pipeline.md) | Ascend C · 流水与 Double Buffer | §1.5 |
| [regbase-vf.md](optimize-ascendc-regbase-vf.md) | Ascend C · RegBase / SIMD VF(950 寄存器范式:迁移判断、性能技术、诊断表) | — |
| [shmem.md](optimize-shmem.md) | SHMEM 通信算子(通信/流水/同步/内存/分核 + 端到端实战数据) | §2.1–2.6 |
| [catlass.md](optimize-catlass.md) | CATLASS(workspace 驻留 L2、容量约束、DispatchPolicy、诊断映射、Swizzle) | §3.1–3.7 |
| [triton.md](optimize-triton.md) | Triton-Ascend(Vector 类深度优化、30 优化点、SIMT→SIMD 原子操作、constexpr) | §4.1–4.4 |
| [tilelang.md](optimize-tilelang.md) | TileLang-Ascend(按算子类型、Persistent 调度、Double Buffer 前置分析) | §5.1–5.3 |
| [pypto.md](optimize-pypto.md) | PyPTO(三阶段调优框架、诊断决策树) | §6.1–6.2 |

---

## 附:跨技术线共性优化原语对照

| 原语 | Ascend C | SHMEM | CATLASS | Triton | TileLang |
|---|---|---|---|---|---|
| 双缓冲 | `InitBuffer(queue, 2, size)` | ping-pong 两组 UB+event id(95KB×2 实战) | `MmadAtlasA2Pingpong` STAGES | UB 留 50% 保证 DB | DB-ANALYSIS 后实施 |
| 流水掩盖 | CopyIn/Compute/CopyOut 三级 | 通信-计算 chunk 重叠 | DispatchPolicy Preload 系列 | 加载与计算交织 | num_stages / T.Pipelined |
| 同步降本 | SetFlag/WaitFlag 按需 | barrier→signal/wait 逐 chunk | workspaceStages 消空泡 | — | Cross-core Semaphore / wait_flag |
| 分核/负载均衡 | blockDim=核数、尾块交替 | sender/receiver 分核、串行 peer 消除 | swizzle `<4,1>` 均衡 | Grid 匹配核数 | `T.Persistent` physical_grid |
| 存储层级利用 | L2 分块、UB 融合、L0C 原地累加 | 避免 GM scratch | C 驻留 L2(命中 96–99%) | UB 容量规划 85KB | alloc_L1/alloc_ub |
| 标量削减 | 禁 std 数学函数、SetMaskCount | — | — | 循环不变量外提、优化点 5/6/17 | — |

---

## 已知覆盖缺口(实测确认,勿硬套本文档)

- **Mix / CV 融合算子(FlashAttention 类,1 AIC + 2 AIV、CrossCore mode2)**:无专项文档,跨 j 迭代 GM buffer ping-pong、CrossCore flag 粒度放宽、GM→L1 滚动预取等机制只有通用原理可推导,实施细节(event id 分配、pipe 内顺序论证)需自行证明并提高验证强度。
- **Double Buffer 的非 TQue 形态**:pipeline.md 的示范是 MemBase `InitBuffer(queue,2,size)`;Tensor API / 裸 SetFlag-WaitFlag 风格的 cube kernel 需要 ping-pong event id + prologue/drain 结构,改造前先确认可用 event id 数量并做 L1/L0 容量核算(多少 KB 能开几级缓冲)。

~~RegBase / SIMD VF~~:已补专项文档 [optimize-ascendc-regbase-vf.md](optimize-ascendc-regbase-vf.md)(迁移判断、11 项性能技术、VF 诊断表、常见错误)。
planning-and-task-breakdownaddyosmani/agent-skillsBreaks work into ordered tasks. Use when you have a spec or clear requirements and need to break work into implementable tasks. Use when a task feels too large to start, when you need to estimate scope, or when parallel work is possible.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
screenpipethedotmack/claude-memSearch screen and audio history recorded by Screenpipe and optionally save selected context into claude-mem. Use when the user asks to recall desktop activity, a meeting, or something seen in another app through Screenpipe.Stars: 118kUpdated Claude CodeCodexVerifiedInstall
contact-widgetnexu-io/open-designSelf-contained floating chat widget with welcome screen, social links, meeting button, and message input. Single HTML file, zero dependencies.Stars: 108kUpdated Claude CodeCodexVerifiedInstall
meeting-notesnexu-io/open-designMeeting notes page — title bar with attendees, agenda checklist, decisions block, action items table with owners + dates, and a "next meeting" footer. Use when the brief mentions "meeting notes", "minutes", "1:1 notes", "all-hands recap", or "会议纪要".Stars: 108kUpdated Claude CodeCodexVerifiedInstall