Skip to content

Commit 4823086

Browse files
seungrokjclaude
andcommitted
chore(changelog): set the pr-link of the Kimi-K3 MI355X vLLM block to #3951
- 将 Kimi-K3 MI355X vLLM 条目的 pr-link 设为 #3951。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
1 parent 58ac1ff commit 4823086

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

‎inferencex-e2e/perf-changelog.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9633,4 +9633,4 @@
96339633
- "Concurrency 92 and 96 run without a DSpark draft (no speculative-config) and keep the mtp matrix label. They use dcp8 a2a, the DRAM tier, max-num-seqs 2x concurrency (184, 192), max-num-batched-tokens 24576, async scheduling off (--no-async-scheduling), and FULL_AND_PIECEWISE CUDA graphs at every even size up to 2x concurrency."
96349634
- "The new image brings Kimi-K3 ROCm changes vllm-project/vllm#59591 (latent MoE up-proj stores only the local rank's shards), #59069 (AttnRes output fused with per-token FP8 input quantization), #60717 (vLLM's FP8 max in that fused quantization), #60446 (KDA autotune keys), #59523 (cuMem CUDA-graph pool offload on ROCm) and #59880 (speculative block reservations across KV cache groups with a KV connector)."
96359635
- "No change to the Inferact/Kimi-K3-DSpark draft's precision: K3DSparkModel and get_draft_quant_config() are unchanged between the two images, so the draft keeps BF16 weights and an fp8 KV cache where it runs; concurrency 92 and 96 load no draft."
9636-
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/XXXX
9636+
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3951

0 commit comments

Comments
 (0)