Skip to content

kali20gakki/msAgent / skills/accuracy/rl-prefill-consistency-dump

rl-prefill-consistency-dump

Verified

训推一致性(prefill)采集侧:为训练/推理两侧采集可比的 prefill dump(输入对齐 PROMPTS_ONLY → 参数对齐校验(dump 前前置:校验两侧 config 超参/结构/权重,不一致输出参数不一致点并对齐)→ msprobe 接入采集 → 采集验证 → 恢复代码)。按用户需求判断用法:① 仅采集 dump——用户只要 dump 数据,走采集主流程(0→7→9),直接产出两侧可比 dump;② 配合分析——用户要求找所有独立差异点/差异点隔离验证/配合 rl-consistency-dump-analysis 分析时,才按分析侧打桩指令用 msprobe `load` 覆盖边界二次采集(阶段 8)再恢复代码。差异分析、首差异定位、打桩指令、整体结论由 rl-consistency-dump-analysis 承担。触发词:训推一致、训推一致性、prefill 比对、msprobe dump/采集、精度比对数据采集、打桩二次采集、参数对齐校验、参数不一致点、mHC 配置不一致、权重不同步、清卡验环境后采数据;已采 dump 的分析转 rl-consistency-dump-analysis。

references/templates/stub_instruction.example.json

View on GitHub
{
  "round": 1,
  "source_side": "infer",
  "target_side": "train",
  "isolate_boundary": "layer0.attn.q_proj_output",
  "side_operators": {
    "train": "Module.<训练侧模块路径>.<训练侧算子类名>.forward.<N>",
    "infer": "Module.<推理侧模块路径>.<推理侧算子类名>.forward.<N>"
  },
  "source_dump": "<源侧 dump 根>/<step>/<rank>/dump_tensor_data",
  "target_run": "<目标侧运行描述,如 train/infer 及卡号>",
  "modules": [
    {
      "target_entry": "Module.<训练侧模块路径>.<训练侧算子类名>.forward.<N>",
      "source_files": [
        "Module.<推理侧模块路径>.<推理侧算子类名>.forward.<N>.output.<n>.pt"
      ],
      "transform": "融合输出按权重行序取 q 段: x[:, :num_heads*head_dim] → squeeze 前导 batch 维 → 转 bf16; 融合布局(q|kv 还是 kv|q)现场 bitwise 验证后定切片",
      "dtype": "bf16",
      "note": "q_dim / kv_dim 与融合布局以现场语义映射为准, 勿沿用旧结论"
    }
  ],
  "dump_after_load": true,
  "expected": "覆盖后 train 侧 q_proj 输入与 infer 侧 q 段 bitwise 一致; 若下游仍逻辑级差异 → 确认下一独立差异",
  "stop_if": "下游全 EXACT → 结束枚举; 只剩余舍入级 → 记已知 gap"
}
reverse-engineer-anythingmorluto/reaReverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA, and build agent environments (AgentEnv bundles) of web applications from a live instance or a capture, and of Linux desktop apps with a task from a request. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.Stars: 471kUpdated Claude CodeCodexVerifiedInstall
diagnosing-superpowersobra/superpowersUse when a superpowers session went wrong and your human partner wants to know why — repeated work, ignored plans, stumbles, poor results, a skill that didn't fire, "it took too long", "why is it so expensive", "what is it doing" — or wants to build a bug report for the superpowers maintainers, for the current session or a past one identified by id or path, on any harness.Stars: 322kUpdated Claude CodeCodexVerifiedInstall
dispatching-parallel-agentsobra/superpowersUse when facing 2+ independent tasks that can be worked on without shared state or sequential dependenciesStars: 322kUpdated Claude CodeCodexVerifiedInstall
executing-plansobra/superpowersUse when executing an implementation plan in the current session as the implementer yourself — your human partner chose inline execution, or no subagent tool is availableStars: 322kUpdated Claude CodeCodexVerifiedInstall