Skip to content

Commit 0f27784

Browse files
yhl-amdclaudeseungrokjOseltamivir
authored
feat(amd): bump DSv4.1-Flash ATOM AgentX to 1010 nightly / 将 DSv4.1-Flash ATOM AgentX 更新至 1010 nightly (#3901)
* feat(amd): bump DSv4.1-Flash ATOM AgentX to 1010 nightly Update dsv41flash-fp4-mi355x-atom-agentic-dspark from rocm/atom-dev:nightly_202610070333 to nightly_202610100929 (ATOM 0.1.8.dev14+g73defd9b8). Recipe, points and server settings are unchanged. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * chore: set perf-changelog pr-link to #3901 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * feat(amd): bump DSv4.1-Flash ATOM AgentX to 1010 nightly - Update the image from rocm/atom-dev:nightly_202610070333 to nightly_202610100929 (digest sha256:cc60ba06b28050a7fdec71e21f1853c782a9ec8850f031e84ebf0e49f3180974; ATOM 0.1.8.dev14+g73defd9b8, ROCm 7.2.4) and update model.container to match. The recipe, points and server settings are unchanged; upstream recipes/DeepSeek-V4.1-Flash-Agentic.md is unchanged between 7fc0926c6 and 73defd9b8. - ROCm/ATOM#2507 turns decoder SWA bounded replay on by default for DeepSeek-V4.1: a prefill runs layers 21..39 on each request's last 133 rows only, the same approximation as SGLang's --enable-decoder-swa-bounded-replay. Upstream reports +10.7% / +22.7% / +38.1% P90 interactivity at TP2 c16 / c32 / c64 on this AgentX workload, with no GSM8K or long-context retrieval change beyond noise. - ROCm/ATOM#2512 samples the DSpark Markov block from each TP rank's vocab shard instead of all-gathering the full logits (bit-identical ids; draft head 657 -> 302 us per decode step at TP2 c32). ROCm/ATOM#2513 packs the FP4 index logits by row visibility and moves BF16 decode to the two-source paged kernel (needs ROCm/aiter#6334). ROCm/ATOM#2495 fixes the FP4 sparse indexer output contract. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com> Co-authored-by: seungrokj <seungrok.jung@amd.com> Co-authored-by: Bryan Shan <58582368+Oseltamivir@users.noreply.github.com>
1 parent 3020f4a commit 0f27784

3 files changed

Lines changed: 13 additions & 3 deletions

File tree

‎inferencex-e2e/benchmarks/single_node/srt-slurm-recipes/dsv41flash/atom/mi355x-fp4-mtp/agentic.yaml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
11
# DeepSeek-V4.1-Flash AgentX on MI355X with ATOM DSpark (five draft tokens),
22
# following ROCm/ATOM recipes/DeepSeek-V4.1-Flash-Agentic.md at the image's
3-
# revision (7fc0926c698e3f19df9dca23091e399851d3d0ec). TP2 and TP4, no expert
3+
# revision (73defd9b868663be51985fedff06115ef9bcab3d). TP2 and TP4, no expert
44
# parallelism; the KV cache is GPU-resident.
55
base:
66
schema: 2
77
name: dsv41flash-fp4-mi355x-atom-agentic
88
model:
99
path: hf:deepseek-ai/DeepSeek-V4.1-Flash
10-
container: rocm/atom-dev:nightly_202610070333
10+
container: rocm/atom-dev:nightly_202610100929
1111
precision: fp4
1212
resources:
1313
gpu_type: mi355x

‎inferencex-e2e/configs/amd-master.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1522,7 +1522,7 @@ dsv41flash-fp4-mi355x-vllm-agentic-dspark:
15221522
# DeepSeek-V4.1-Flash on ATOM, following the upstream TP2 / TP4 AgentX recipe.
15231523
# Five-token DSpark uses golden AL 3.51 for throughput and real acceptance for eval.
15241524
dsv41flash-fp4-mi355x-atom-agentic-dspark:
1525-
image: rocm/atom-dev:nightly_202610070333
1525+
image: rocm/atom-dev:nightly_202610100929
15261526
model: deepseek-ai/DeepSeek-V4.1-Flash
15271527
model-prefix: dsv41flash
15281528
runner: cluster:mi355x-amds

‎inferencex-e2e/perf-changelog.yaml‎

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9539,6 +9539,16 @@
95399539
- "Enable SGLANG_OPT_FP8_WO_A_FUSED_INVROPE."
95409540
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3778
95419541

9542+
- config-keys:
9543+
- dsv41flash-fp4-mi355x-atom-agentic-dspark
9544+
scenario-type:
9545+
- agentic-coding
9546+
description:
9547+
- "Update the image from rocm/atom-dev:nightly_202610070333 to nightly_202610100929 (digest sha256:cc60ba06b28050a7fdec71e21f1853c782a9ec8850f031e84ebf0e49f3180974; ATOM 0.1.8.dev14+g73defd9b8, ROCm 7.2.4) and update model.container to match. The recipe, points and server settings are unchanged; upstream recipes/DeepSeek-V4.1-Flash-Agentic.md is unchanged between 7fc0926c6 and 73defd9b8."
9548+
- "ROCm/ATOM#2507 turns decoder SWA bounded replay on by default for DeepSeek-V4.1: a prefill runs layers 21..39 on each request's last 133 rows only, the same approximation as SGLang's --enable-decoder-swa-bounded-replay. Upstream reports +10.7% / +22.7% / +38.1% P90 interactivity at TP2 c16 / c32 / c64 on this AgentX workload, with no GSM8K or long-context retrieval change beyond noise."
9549+
- "ROCm/ATOM#2512 samples the DSpark Markov block from each TP rank's vocab shard instead of all-gathering the full logits (bit-identical ids; draft head 657 -> 302 us per decode step at TP2 c32). ROCm/ATOM#2513 packs the FP4 index logits by row visibility and moves BF16 decode to the two-source paged kernel (needs ROCm/aiter#6334). ROCm/ATOM#2495 fixes the FP4 sparse indexer output contract."
9550+
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3901
9551+
95429552
- config-keys:
95439553
- dsv4-fp4-mi355x-atom-agentic-mtp
95449554
scenario-type:

0 commit comments

Comments
 (0)