Skip to content

Ascend/msagent / skills/operator/ops-performance-tuning

ops-performance-tuning

Verified

Compile, profile, diagnose, optimize, and compare Ascend NPU operators across CANN versions and A2/A3/A5 for Ascend C, CATLASS, Triton-Ascend, TileLang-Ascend, PyPTO, and SHMEM/MC2. Use when an operator already has a runnable implementation and the user asks for msOpProf collection, bottleneck analysis, source-level tuning, or a reproducible before/after performance report. Do not use as the primary workflow for operator creation, migration, or unresolved correctness failures.

FileKindSize
SKILL.mdskill md15.4 KB
evals/evals.jsonconfig3.6 KB
references/case-routing.mdmarkdown30.0 KB
references/cases/ascendc/pr_ascendc_allgathermm_scalar_align.mdmarkdown1.7 KB
references/cases/ascendc/pr_ascendc_cann_samples_perf_story.mdmarkdown3.9 KB
references/cases/ascendc/pr_ascendc_cgdr_vf_inverse.mdmarkdown1.6 KB
references/cases/ascendc/pr_ascendc_conv3ddx_tque_tbuf.mdmarkdown1.6 KB
references/cases/ascendc/pr_ascendc_layernorm_areg.mdmarkdown1.6 KB
references/cases/ascendc/pr_ascendc_logit_a5_microapi.mdmarkdown1.9 KB
references/cases/ascendc/pr_ascendc_matmul_case_18x.mdmarkdown1.5 KB
references/cases/ascendc/pr_ascendc_matmul_full_load_wiki.mdmarkdown1.6 KB
references/cases/ascendc/pr_ascendc_matmul_vcv_wiki.mdmarkdown1.8 KB
references/cases/ascendc/pr_ascendc_mc2_fusion.mdmarkdown1.4 KB
references/cases/ascendc/pr_ascendc_mhc_24x.mdmarkdown1.2 KB
references/cases/ascendc/pr_ascendc_msopprof_add_block_imbalance.mdmarkdown1.7 KB
references/cases/ascendc/pr_ascendc_quantize_a2_micro_opt.mdmarkdown2.0 KB
references/cases/ascendc/pr_ascendc_rotate_quant_blaze.mdmarkdown2.8 KB
references/cases/ascendc/pr_ascendc_tiling_l2_official.mdmarkdown1.6 KB
references/cases/catlass/pr_catlass_baseline.mdmarkdown1.3 KB
references/cases/catlass/pr_catlass_fixpipe_dualdst.mdmarkdown1.6 KB
references/cases/catlass/pr_catlass_grouped_matmul_tiling.mdmarkdown1.5 KB
references/cases/catlass/pr_catlass_mstuner_3p8x.mdmarkdown1.9 KB
references/cases/catlass/pr_catlass_swizzle_balance.mdmarkdown1.6 KB
references/cases/pypto/pr_pypto_gqa_decode_vector_merge.mdmarkdown2.4 KB
references/cases/pypto/pr_pypto_l2_hit_layout_s13.mdmarkdown1.9 KB
references/cases/pypto/pr_pypto_per_matmul_tile_shapes.mdmarkdown2.4 KB
references/cases/pypto/pr_pypto_small_shape_matmul.mdmarkdown2.3 KB
references/cases/pypto/pr_pypto_weight_none_cacheable.mdmarkdown2.6 KB
references/cases/shmem/pr_shmem_alltoallv_mr152.mdmarkdown2.4 KB
references/cases/shmem/pr_shmem_reduce_scatter_serial.mdmarkdown2.6 KB
references/cases/tilelang/pr_tilelang_benchmark_vs_ascendc.mdmarkdown1.7 KB
references/cases/tilelang/pr_tilelang_compiler_prs.mdmarkdown2.3 KB
references/cases/tilelang/pr_tilelang_fa_pr698.mdmarkdown1.5 KB
references/cases/tilelang/pr_tilelang_gqa_bwd_pr1494.mdmarkdown1.3 KB
references/cases/tilelang/pr_tilelang_persistent_mqa_decode.mdmarkdown2.2 KB
references/cases/tilelang/pr_tilelang_sfa_pr665.mdmarkdown914 B
references/cases/triton/pr_triton_atomic_simd_24x.mdmarkdown1.8 KB
references/cases/triton/pr_triton_autotune_background.mdmarkdown1.0 KB
references/cases/triton/pr_triton_constexpr_recompile.mdmarkdown1.1 KB
references/cases/triton/pr_triton_lgamma_simt.mdmarkdown1.6 KB
references/compile/compile-ascendc.mdmarkdown9.0 KB
references/compile/compile-catlass.mdmarkdown2.4 KB
references/compile/compile-pypto.mdmarkdown2.0 KB
references/compile/compile-shmem.mdmarkdown2.6 KB
references/compile/compile-tilelang.mdmarkdown2.7 KB
references/compile/compile-triton.mdmarkdown4.4 KB
references/diagnose/diagnose-l2-cache.mdmarkdown2.2 KB
references/diagnose/diagnose-occupancy.mdmarkdown4.0 KB
references/diagnose/diagnose-pipeline.mdmarkdown4.1 KB
references/diagnose/diagnose-roofline.mdmarkdown3.1 KB
references/optimize/optimize-api-usage.mdmarkdown1.7 KB
references/optimize/optimize-ascendc-regbase-vf.mdmarkdown5.9 KB
references/optimize/optimize-ascendc-tiling.mdmarkdown935 B
references/optimize/optimize-catlass.mdmarkdown3.0 KB
references/optimize/optimize-data-copy.mdmarkdown870 B
references/optimize/optimize-index.mdmarkdown3.6 KB
references/optimize/optimize-memory-hierarchy.mdmarkdown599 B
references/optimize/optimize-pipeline.mdmarkdown1.0 KB
references/optimize/optimize-pypto.mdmarkdown1.5 KB
references/optimize/optimize-shmem.mdmarkdown5.1 KB
references/optimize/optimize-tilelang.mdmarkdown1.7 KB
references/optimize/optimize-triton.mdmarkdown3.8 KB
references/profile/benchmark-harness.mdmarkdown2.2 KB
references/profile/profile-msopprof.mdmarkdown7.4 KB
references/troubleshooting.mdmarkdown5.8 KB
scripts/bound_analyzer.pyscript9.0 KB
scripts/delta_report.pyscript4.8 KB
scripts/env_check.shscript5.0 KB
scripts/result_saver.pyscript5.0 KB

scripts/env_check.sh

View on GitHub
#!/usr/bin/env bash
# Ascend operator tuning environment check.
# Usage:
#   bash scripts/env_check.sh [--mode board|sim] [--cann-path PATH]
# Environment:
#   CANN_PATH may point to a versioned CANN or ascend-toolkit directory.

set -u

MODE="board"
CANN_ROOT="${CANN_PATH:-${ASCEND_HOME_PATH:-/usr/local/Ascend/cann}}"
FAIL=0

pass() { echo "[PASS] $1"; }
warn() { echo "[WARN] $1"; }
fail() { echo "[FAIL] $1"; FAIL=1; }
hint() { echo "       $1"; }

while [ "$#" -gt 0 ]; do
    case "$1" in
        --mode)
            [ "$#" -ge 2 ] || { echo "ERROR: --mode requires board or sim" >&2; exit 2; }
            MODE="$2"
            shift 2
            ;;
        --cann-path)
            [ "$#" -ge 2 ] || { echo "ERROR: --cann-path requires a path" >&2; exit 2; }
            CANN_ROOT="$2"
            shift 2
            ;;
        -h|--help)
            sed -n '2,8p' "$0"
            exit 0
            ;;
        *)
            echo "ERROR: unknown argument: $1" >&2
            exit 2
            ;;
    esac
done

case "$MODE" in
    board|sim) ;;
    *) echo "ERROR: --mode must be board or sim" >&2; exit 2 ;;
esac

SET_ENV=""
for candidate in \
    "$CANN_ROOT/set_env.sh" \
    "$CANN_ROOT/ascend-toolkit/set_env.sh" \
    "$CANN_ROOT/ascend-toolkit/latest/set_env.sh"; do
    if [ -f "$candidate" ]; then
        SET_ENV="$candidate"
        break
    fi
done

if [ -n "$SET_ENV" ]; then
    if source "$SET_ENV" >/dev/null 2>&1; then
        pass "CANN environment: $SET_ENV"
        CANN_ROOT="${ASCEND_HOME_PATH:-$CANN_ROOT}"
    else
        fail "CANN environment cannot be sourced: $SET_ENV"
    fi
else
    fail "CANN set_env.sh not found under: $CANN_ROOT"
    hint "Pass the exact installation with --cann-path or CANN_PATH."
fi

if command -v bisheng >/dev/null 2>&1; then
    pass "BiSheng compiler: $(command -v bisheng)"
else
    warn "BiSheng is not in PATH; Ascend C/CATLASS compilation will be unavailable."
fi

if command -v msprof >/dev/null 2>&1 && msprof op --help >/dev/null 2>&1; then
    pass "msOpProf entry: msprof op"
elif command -v msopprof >/dev/null 2>&1; then
    pass "msOpProf entry: $(command -v msopprof)"
elif command -v msprof >/dev/null 2>&1; then
    warn "msprof exists but 'msprof op' is unavailable; only full msprof fallback is visible."
else
    fail "Neither msprof nor msopprof is available."
fi

SOC_TEXT=""
if command -v npu-smi >/dev/null 2>&1; then
    SOC_TEXT=$(npu-smi info 2>/dev/null | awk -F'|' '/Ascend/ {print $3; exit}' | tr -d ' ')
    [ -n "$SOC_TEXT" ] && pass "NPU detected by npu-smi: $SOC_TEXT"
fi

if [ -z "$SOC_TEXT" ] && command -v python3 >/dev/null 2>&1; then
    SOC_TEXT=$(python3 - <<'PY' 2>/dev/null
try:
    import acl
    print(acl.get_soc_name())
except Exception:
    try:
        import torch_npu
        import torch
        if torch.npu.is_available() and torch.npu.device_count() > 0:
            print(torch.npu.get_device_name(0))
    except Exception:
        pass
PY
)
    [ -n "$SOC_TEXT" ] && pass "NPU detected by runtime: $SOC_TEXT"
fi

if [ -n "$SOC_TEXT" ]; then
    case "$SOC_TEXT" in
        *950*)
            pass "SoC family: A5; common targets are --soc=ascend950 / dav-3510"
            ;;
        *910_93*|*910_9391*|*A3*)
            pass "SoC family: A3; use --soc=ascend910_93 and obtain NPU_ARCH from this toolchain"
            ;;
        *910B*|*A2*)
            pass "SoC family: A2; common targets are --soc=ascend910b / dav-2201"
            ;;
        *)
            warn "Unknown SoC mapping: $SOC_TEXT; inspect project and compiler help before building."
            ;;
    esac
elif [ "$MODE" = "board" ]; then
    fail "No board device was detected by npu-smi, ACL, or torch_npu."
else
    warn "No board device detected; simulator mode may continue."
fi

SIM_LIB=""
if [ -d "$CANN_ROOT" ]; then
    SIM_LIB=$(find "$CANN_ROOT" -path '*/simulator/dav_*/lib/libruntime_camodel.so' -type f -print -quit 2>/dev/null)
fi
if [ -n "$SIM_LIB" ]; then
    pass "Simulator runtime: $SIM_LIB"
elif [ "$MODE" = "sim" ]; then
    fail "Simulator runtime libruntime_camodel.so was not found under $CANN_ROOT."
else
    warn "Simulator runtime not found; this is non-blocking for board mode."
fi

if command -v python3 >/dev/null 2>&1; then
    pass "Python: $(command -v python3)"
    if python3 -m pip --version >/dev/null 2>&1; then
        pass "pip: $(python3 -m pip --version 2>/dev/null | awk '{print $2}')"
    else
        warn "pip is unavailable; --pkg/ES wheel flows may fail."
    fi
    python3 -c 'import setuptools' >/dev/null 2>&1 || \
        warn "setuptools is unavailable; package build flows may fail."
    python3 -c 'import packaging' >/dev/null 2>&1 || \
        warn "Python package 'packaging' is unavailable; some ops-transformer builds require it."
else
    fail "python3 is unavailable."
fi

echo
if [ "$FAIL" -eq 0 ]; then
    echo "[env_check] READY ($MODE mode). Warnings must be resolved only if the selected path needs them."
    exit 0
fi

echo "[env_check] BLOCKED ($MODE mode). Resolve FAIL items before running this path."
exit 1
planning-and-task-breakdownaddyosmani/agent-skillsBreaks work into ordered tasks. Use when you have a spec or clear requirements and need to break work into implementable tasks. Use when a task feels too large to start, when you need to estimate scope, or when parallel work is possible.Stars: 119kUpdated Claude CodeCodexVerifiedInstall
screenpipethedotmack/claude-memSearch screen and audio history recorded by Screenpipe and optionally save selected context into claude-mem. Use when the user asks to recall desktop activity, a meeting, or something seen in another app through Screenpipe.Stars: 118kUpdated Claude CodeCodexVerifiedInstall
contact-widgetnexu-io/open-designSelf-contained floating chat widget with welcome screen, social links, meeting button, and message input. Single HTML file, zero dependencies.Stars: 108kUpdated Claude CodeCodexVerifiedInstall
meeting-notesnexu-io/open-designMeeting notes page — title bar with attendees, agenda checklist, decisions block, action items table with owners + dates, and a "next meeting" footer. Use when the brief mentions "meeting notes", "minutes", "1:1 notes", "all-hands recap", or "会议纪要".Stars: 108kUpdated Claude CodeCodexVerifiedInstall