Ascend/msagent / skills/quantizer/msmodelslim-quick-quant
msmodelslim-quick-quant
Unverified提供 msModelSlim 的通用快速量化指引,包含安装、最简 YAML 配置与基础执行校验。适用于用户询问 msmodelslim 安装、快速量化、配置 yaml、linear_quant 或 minmax 基础参数时。
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 2.1 KB |
| reference/linear_quant.md | markdown | 1.7 KB |
reference/linear_quant.md
View on GitHub# linear_quant 参数参考(简洁版)
## 处理器级参数
| 参数 | 类型 | 说明 | 常用值 |
|---|---|---|---|
| `type` | string | 处理器类型,固定为线性量化 | `"linear_quant"` |
| `qconfig` | object | 量化核心配置,包含 `act` 和 `weight` | `{ act: ..., weight: ... }` |
| `include` | array[string] | 包含的层名模式(支持通配符) | `["*"]`, `["*self_attn*"]` |
| `exclude` | array[string] | 排除的层名模式,优先级高于 `include` | `["*down_proj*"]` |
## qconfig.act(激活量化)
| 参数 | 类型 | 可选值 | 默认值 | 说明 |
|---|---|---|---|---|
| `scope` | string | `"per_tensor"`, `"per_token"`, `"pd_mix"` | `"per_tensor"` | 激活量化粒度/模式 |
| `dtype` | string | `"int8"`, `"int4"`, `"float"` | `"int8"` | 激活量化数据类型 |
| `symmetric` | bool | `true`, `false` | `false` | 是否对称量化 |
| `method` | string | `"minmax"`, `"histogram"` | `"minmax"` | 激活量化算法 |
## qconfig.weight(权重量化)
| 参数 | 类型 | 可选值 | 默认值 | 说明 |
|---|---|---|---|---|
| `scope` | string | `"per_tensor"`, `"per_channel"`, `"per_group"` | `"per_channel"` | 权重量化粒度 |
| `dtype` | string | `"int8"`, `"int4"` | `"int8"` | 权重量化数据类型 |
| `symmetric` | bool | `true`, `false` | `true` | 是否对称量化 |
| `method` | string | `"minmax"`, `"ssz"`, `"gptq"` | `"minmax"` | 权重量化算法 |
## 最小可用建议
- 优先从 `act.scope: "per_tensor"` + `weight.scope: "per_channel"` 开始。
- 优先使用 `method: "minmax"` 作为基础配置。
- 先用 `include: ["*"]` 验证流程,再按需增加 `exclude`。
- 对 MoE 模型,路由器 `gate` 模块一般不量化,建议 `exclude: ["*.gate"]`。
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| slack-gif-creatoranthropics/skillsKnowledge and utilities for creating animated GIFs optimized for Slack. Provides constraints, validation tools, and animation concepts. Use when users request animated GIFs for Slack like "make me a GIF of X doing Y for Slack." | Stars: 196k | Updated | Claude CodeCodex | Verified | Install |
| ponytailDietrichGebert/ponytailLazy senior dev mode for any coding task: the smallest change that fully solves it, and a reply a busy human understands in one read. | Stars: 192k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailHarvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report. | Stars: 192k | Updated | Claude CodeCodex | Verified | Install |
| ponytail-debtDietrichGebert/ponytailList every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt. | Stars: 192k | Updated | Claude CodeCodex | Verified | Install |