Repository navigation
Commit 0f27784
feat(amd): bump DSv4.1-Flash ATOM AgentX to 1010 nightly / 将 DSv4.1-Flash ATOM AgentX 更新至 1010 nightly (#3901)
* feat(amd): bump DSv4.1-Flash ATOM AgentX to 1010 nightly
Update dsv41flash-fp4-mi355x-atom-agentic-dspark from
rocm/atom-dev:nightly_202610070333 to nightly_202610100929
(ATOM 0.1.8.dev14+g73defd9b8). Recipe, points and server settings are
unchanged.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
* chore: set perf-changelog pr-link to #3901
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
* feat(amd): bump DSv4.1-Flash ATOM AgentX to 1010 nightly
- Update the image from rocm/atom-dev:nightly_202610070333 to
nightly_202610100929 (digest
sha256:cc60ba06b28050a7fdec71e21f1853c782a9ec8850f031e84ebf0e49f3180974;
ATOM 0.1.8.dev14+g73defd9b8, ROCm 7.2.4) and update model.container to
match. The recipe, points and server settings are unchanged; upstream
recipes/DeepSeek-V4.1-Flash-Agentic.md is unchanged between 7fc0926c6
and 73defd9b8.
- ROCm/ATOM#2507 turns decoder SWA bounded replay on by default for
DeepSeek-V4.1: a prefill runs layers 21..39 on each request's last 133
rows only, the same approximation as SGLang's
--enable-decoder-swa-bounded-replay. Upstream reports +10.7% / +22.7% /
+38.1% P90 interactivity at TP2 c16 / c32 / c64 on this AgentX workload,
with no GSM8K or long-context retrieval change beyond noise.
- ROCm/ATOM#2512 samples the DSpark Markov block from each TP rank's vocab
shard instead of all-gathering the full logits (bit-identical ids; draft
head 657 -> 302 us per decode step at TP2 c32). ROCm/ATOM#2513 packs the
FP4 index logits by row visibility and moves BF16 decode to the
two-source paged kernel (needs ROCm/aiter#6334). ROCm/ATOM#2495 fixes the
FP4 sparse indexer output contract.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: seungrokj <seungrok.jung@amd.com>
Co-authored-by: Bryan Shan <58582368+Oseltamivir@users.noreply.github.com>1 parent 3020f4a commit 0f27784
3 files changed
Lines changed: 13 additions & 3 deletions
File tree
- inferencex-e2e
- benchmarks/single_node/srt-slurm-recipes/dsv41flash/atom/mi355x-fp4-mtp
- configs
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
10 | | - | |
| 10 | + | |
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1522 | 1522 | | |
1523 | 1523 | | |
1524 | 1524 | | |
1525 | | - | |
| 1525 | + | |
1526 | 1526 | | |
1527 | 1527 | | |
1528 | 1528 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
9539 | 9539 | | |
9540 | 9540 | | |
9541 | 9541 | | |
| 9542 | + | |
| 9543 | + | |
| 9544 | + | |
| 9545 | + | |
| 9546 | + | |
| 9547 | + | |
| 9548 | + | |
| 9549 | + | |
| 9550 | + | |
| 9551 | + | |
9542 | 9552 | | |
9543 | 9553 | | |
9544 | 9554 | | |
| |||
0 commit comments