Skip to content

kali20gakki/msAgent / skills/quantizer/quantization-accuracy-tuning-orchestrator

quantization-accuracy-tuning-orchestrator

Verified

End-to-end automated model quantization and accuracy tuning workflow. Use when user asks for automated model quantization and accuracy tuning, e.g. "自动量化", "量化调优", "一键量化", "精度调优", etc. 当用户给出多卡(≥2 卡)卡号时,量化阶段通过 EP 并行适配(msmodelslim-ep-parallel-adaptation)保证多卡 EP 并行,调优主流程仍在本 Skill。

references/background_information.md

View on GitHub
# 量化自动调优背景知识

## 什么是modelslim?

ModelSlim 是昇腾提供的大模型量化工具套件,可以将 LLM 权重压缩至 INT4/INT8 等低位宽,降低显存占用并提升推理性能。适用于昇腾 NPU 上的大模型部署场景。
ModelSlim 已支持 MCP 集成,可通过 MCP 工具暴露量化、评测、history 管理等接口。

## 什么是量化自动调优?

量化是有损压缩,量化后模型在数据集测评时会有精度损失。**量化自动调优一套流程,用来寻找指定精度损失约束下的最优量化配置。**

**工作原理:**

量化自动调优通过调整量化算法、回退特定敏感层等手段,寻找最优量化配置使精度达标。

**核心优势:**

- 免手工调参:自动决定保留哪些层为高精度、调整量化方案
- 闭环反馈:基于实测指标而非经验值
- 最优收敛:多轮迭代找最佳压缩比与精度平衡
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 471kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall