Skip to content

Commit 5b5c365

Browse files
committed
fix(configs): select each GB200 DSR1 FP8 low-latency variant explicitly
The low-latency row named disagg-tp8-stp-variants.yaml without a selector, so one job submitted all three zip variants under a 4-node, 1-decode-worker label. Each variant now runs only the concurrencies it is tuned for, with its selector and its 7 TP8 decode workers on 16 nodes: zip_override_lowlat[0] (c8) at 4 and 8, zip_override_lowlat[1] (c16-32) at 16. zip_override_lowlat[2] is tuned for concurrency 64, which the entry never ran, so it has no row.
1 parent 2c24d1b commit 5b5c365

1 file changed

Lines changed: 15 additions & 3 deletions

File tree

‎inferencex-e2e/configs/nvidia-master.yaml‎

Lines changed: 15 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2656,20 +2656,32 @@ dsr1-fp8-gb200-dynamo-sglang:
26562656
- isl: 8192
26572657
osl: 1024
26582658
search-space:
2659-
# "Low latency" (1 prefill worker at TP8 and 1 decode worker at TP8)
2660-
- conc-list: [4, 8, 16]
2659+
# "Low latency" (1 prefill worker at TP8 and 7 decode workers at TP8)
2660+
- conc-list: [4, 8]
26612661
# https://github.com/NVIDIA/srt-slurm/blob/sa-submission-q2-2026/recipes/gb200-fp8/8k1k/low-latency.yaml
2662-
srt-recipe: disagg-tp8-stp-variants.yaml
2662+
srt-recipe: disagg-tp8-stp-variants.yaml:zip_override_lowlat[0]
26632663
prefill:
26642664
num-worker: 1
26652665
tp: 8
26662666
ep: 1
26672667
dp-attn: false
26682668
decode:
2669+
num-worker: 7
2670+
tp: 8
2671+
ep: 1
2672+
dp-attn: false
2673+
- conc-list: [16]
2674+
srt-recipe: disagg-tp8-stp-variants.yaml:zip_override_lowlat[1]
2675+
prefill:
26692676
num-worker: 1
26702677
tp: 8
26712678
ep: 1
26722679
dp-attn: false
2680+
decode:
2681+
num-worker: 7
2682+
tp: 8
2683+
ep: 1
2684+
dp-attn: false
26732685

26742686
# "Mid curve" (5 prefill workers at DEP8 and 1 decode worker at DEP32)
26752687
- conc-list: [512, 1024, 2048, 6144]

0 commit comments

Comments
 (0)