Skip to content

Commit b6789f9

Browse files
chore(changelog): record MI325X MiniMax-M3 vLLM v0.31.0 bump
记录 MI325X MiniMax-M3 vLLM 镜像更新至 v0.31.0。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
1 parent 6ebfef4 commit b6789f9

1 file changed

Lines changed: 6 additions & 0 deletions

File tree

‎inferencex-e2e/perf-changelog.yaml‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9646,3 +9646,9 @@
96469646
- "ATOM's mono decode path (on by default) now takes any decode step of up to 48 rows, i.e. concurrency 1-8 with five DSpark drafts, not only DSpark verify steps. Steps of 12 or more rows that are a multiple of TP run its sublayers token-parallel, with reduce-scatters instead of all-reduces. The draft runner never runs token-parallel."
96479647
- "No data-type or precision change to the DSpark draft. The checkpoint's bundled mtp.0-2 stages are stored like the target's layers: FP8 E4M3 weights with 32x32 UE8M0 block scales for the attention projections, shared experts and main_proj; MXFP4 routed experts; BF16 norms, router gate, Markov head and confidence head; F32 attention sinks and hc mixers. ATOM builds the draft with the target's native_quant_config() and make_v4_quant_config(), with no online quantization in this recipe, so it runs as shipped: FP8 activations on the FP8 GEMMs and the target's BF16 KV cache. Between 73defd9b8 and a0527c9db only the rows the draft reads under bounded replay change."
96489648
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3928
9649+
9650+
- config-keys:
9651+
- minimaxm3-fp8-mi325x-vllm-agentic-mtp
9652+
description:
9653+
- "Update the MI325X MiniMax-M3 vLLM AgentX image from vllm-openai-rocm v0.27.1 to v0.31.0."
9654+
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3954

0 commit comments

Comments
 (0)