Skip to content

Commit 68ef3a8

Browse files
committed
fix(amd): preserve DSV4 MoRI dispatch pin
Keep the proven 128-token per-rank decode dispatch setting for both DEP8 fixed-sequence recipes while the shared launcher derives only admission and the inter-kernel threshold.
1 parent 8711b47 commit 68ef3a8

2 files changed

Lines changed: 2 additions & 2 deletions

File tree

‎benchmarks/multi_node/srt-slurm-recipes/sglang/deepseek-v4/mi355x/fixed-seq/disagg-1p1d-dep8-mtp.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -105,7 +105,7 @@ backend:
105105
SGLANG_DISAGGREGATION_FORCE_QUERY_PREFILL_DP_RANK: "1"
106106
decode_environment:
107107
<<: *common_environment
108-
SGLANG_MORI_NUM_MAX_DISPATCH_TOKENS_PER_RANK: "1024"
108+
SGLANG_MORI_NUM_MAX_DISPATCH_TOKENS_PER_RANK: "128"
109109
sglang_config:
110110
prefill: &common_server
111111
served-model-name: "deepseek-ai/DeepSeek-V4-Pro"

‎benchmarks/multi_node/srt-slurm-recipes/sglang/deepseek-v4/mi355x/fixed-seq/disagg-1p1d-dep8-stp.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -105,7 +105,7 @@ backend:
105105
SGLANG_DISAGGREGATION_FORCE_QUERY_PREFILL_DP_RANK: "1"
106106
decode_environment:
107107
<<: *common_environment
108-
SGLANG_MORI_NUM_MAX_DISPATCH_TOKENS_PER_RANK: "1024"
108+
SGLANG_MORI_NUM_MAX_DISPATCH_TOKENS_PER_RANK: "128"
109109
sglang_config:
110110
prefill: &common_server
111111
served-model-name: "deepseek-ai/DeepSeek-V4-Pro"

0 commit comments

Comments
 (0)