kali20gakki/msAgent / skills/quantizer/quantization-accuracy-tuning-orchestrator
quantization-accuracy-tuning-orchestrator
VerifiedEnd-to-end automated model quantization and accuracy tuning workflow. Use when user asks for automated model quantization and accuracy tuning, e.g. "自动量化", "量化调优", "一键量化", "精度调优", etc. 当用户给出多卡(≥2 卡)卡号时,量化阶段通过 EP 并行适配(msmodelslim-ep-parallel-adaptation)保证多卡 EP 并行,调优主流程仍在本 Skill。
| File | Kind | Size |
|---|---|---|
| SKILL.md | skill md | 25.4 KB |
| references/background_information.md | markdown | 948 B |
| references/output_format.md | markdown | 5.0 KB |
| references/prepare_environment.md | markdown | 2.6 KB |
| references/prepare_model.md | markdown | 9.7 KB |
| references/quantization_tuning.md | markdown | 24.5 KB |
| references/routing.md | markdown | 2.6 KB |
| references/subagent_io_protocol.md | markdown | 10.3 KB |
| references/user_input.md | markdown | 5.9 KB |
| scripts/accuracy_append.py | script | 3.7 KB |
| scripts/accuracy_cleanup.py | script | 2.8 KB |
| scripts/accuracy_lookup.py | script | 3.3 KB |
| scripts/finalize_practice_repo.py | script | 3.7 KB |
| scripts/history_append.py | script | 3.1 KB |
| scripts/history_clear.py | script | 2.1 KB |
references/background_information.md
View on GitHub# 量化自动调优背景知识
## 什么是modelslim?
ModelSlim 是昇腾提供的大模型量化工具套件,可以将 LLM 权重压缩至 INT4/INT8 等低位宽,降低显存占用并提升推理性能。适用于昇腾 NPU 上的大模型部署场景。
ModelSlim 已支持 MCP 集成,可通过 MCP 工具暴露量化、评测、history 管理等接口。
## 什么是量化自动调优?
量化是有损压缩,量化后模型在数据集测评时会有精度损失。**量化自动调优一套流程,用来寻找指定精度损失约束下的最优量化配置。**
**工作原理:**
量化自动调优通过调整量化算法、回退特定敏感层等手段,寻找最优量化配置使精度达标。
**核心优势:**
- 免手工调参:自动决定保留哪些层为高精度、调整量化方案
- 闭环反馈:基于实测指标而非经验值
- 最优收敛:多轮迭代找最佳压缩比与精度平衡
Related skills
| Skill | Stars | Updated | Works with | Status | Install |
|---|---|---|---|---|---|
| reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis. | Stars: 471k | Updated | Claude CodeCodex | Verified | Install |
| diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness. | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependencies | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |
| executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is available | Stars: 322k | Updated | Claude CodeCodex | Verified | Install |