Skip to content

Commit bb06d51

Browse files
Klaud-Coldgithub-actions[bot]claudefunctionstackx
authored
[Klaud Cold] Update DSR1 FP8 MI355X ATOM image to v0.1.7 / [Klaud Cold] 将 DSR1 FP8 MI355X ATOM 镜像更新至 v0.1.7 (#3911)
* chore(amd): bump dsr1-fp8-mi355x-atom to ATOM v0.1.7 image Pin rocm/atom-dev:nightly_202610080328 by digest; it is built from the ATOM v0.1.7 release commit a526f0d. 将 dsr1-fp8-mi355x-atom 更新为 ATOM v0.1.7 镜像:按摘要固定 rocm/atom-dev:nightly_202610080328,该镜像构建自 ATOM v0.1.7 发布提交 a526f0d。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * chore(changelog): add dsr1-fp8-mi355x-atom ATOM v0.1.7 entry 为 dsr1-fp8-mi355x-atom 的 ATOM v0.1.7 镜像更新追加 perf-changelog 条目。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * chore: refresh PR #3911 for sweep reuse [skip-sweep] --------- Co-authored-by: claude[bot] <41898282+claude[bot]@users.noreply.github.com> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com> Co-authored-by: functionstackx <47992694+functionstackx@users.noreply.github.com>
1 parent 850676d commit bb06d51

3 files changed

Lines changed: 8 additions & 2 deletions

File tree

‎inferencex-e2e/benchmarks/single_node/srt-slurm-recipes/dsr1/atom/mi355x-fp8/8k1k.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ base:
33
name: dsr1-fp8-mi355x-atom-8k1k
44
model:
55
path: hf:deepseek-ai/DeepSeek-R1-0528
6-
container: rocm/atom:rocm7.2.3_ubuntu24.04_py3.12_pytorch_release_2.10.0_atom20260511
6+
container: rocm/atom-dev:nightly_202610080328@sha256:9c3070bb7d2600d2e1bcfd03cf5f71e4dc0941f3e1d20d3a5845056aae2334eb
77
precision: fp8
88
resources:
99
gpu_type: mi355x

‎inferencex-e2e/configs/amd-master.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -513,7 +513,7 @@ qwen3.5-fp8-mi300x-sglang-agentic-mtp:
513513
- { tp: 8, ep: 8, spec-decoding: mtp, kv-offloading: none, conc-list: [4, 16, 20, 24, 32], srt-recipe: benchmarks/single_node/srt-slurm-recipes/qwen3.5/sglang/mi300x-fp8-mtp/agentic.yaml }
514514

515515
dsr1-fp8-mi355x-atom:
516-
image: rocm/atom:rocm7.2.3_ubuntu24.04_py3.12_pytorch_release_2.10.0_atom20260511
516+
image: rocm/atom-dev:nightly_202610080328@sha256:9c3070bb7d2600d2e1bcfd03cf5f71e4dc0941f3e1d20d3a5845056aae2334eb
517517
model: deepseek-ai/DeepSeek-R1-0528
518518
model-prefix: dsr1
519519
runner: mi355x

‎inferencex-e2e/perf-changelog.yaml‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9683,3 +9683,9 @@
96839683
- "TP2 c16/c32: 16K prefill chunks with decoder SWA bounded replay and the prefill CUDA graph disabled, a 96/48-step prefill-decode interval, PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True and 4 tokenizer workers; SGLANG_NUMA_BIND_V2=0 at c16 (previously 4K chunks with the default 16-step interval). Local one-hour runs on the new image: c16 55,560 tok/s/GPU at 264.6 tok/s/user P90 (324.9 median); c32 113,613 at 183.1 (242.7)."
96849684
- "c64 and c128 move from TP2 to DEP2 (TP2/DP2/EP2 with DP attention, DP LM head and MegaMoE) behind sglang-router (cache_aware, dp-aware, routing key from the AIPerf correlation id), with total_requests load balancing, shortest-prefill-first scheduling, 16K chunks, 4096 SWA prefix tails and 4 tokenizer workers. c64 uses a 24-step prefill-decode interval and admits 128; c128 a 16-step interval, mem-fraction-static 0.85, admits 256 with a 128 graph batch. Local one-hour runs: c64 200,265 tok/s/GPU at 114.3 tok/s/user P90 (132.7 median), versus 149,666 at 99.4 median for the TP2 point it replaces; c128 271,364 at 81.6 P90 (93.0 median), versus 147,763 at 37.9 median."
96859685
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3859
9686+
9687+
- config-keys:
9688+
- dsr1-fp8-mi355x-atom
9689+
description:
9690+
- "Bump ATOM image to the v0.1.7 release build (rocm/atom-dev:nightly_202610080328, digest-pinned)."
9691+
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3911

0 commit comments

Comments
 (0)