Skip to content

Commit 0ab83e4

Browse files
Update Qwen3.8-Flash-Next FP8 H200 SGLang AgentX image to v0.5.21-cu130
Pin lmsysorg/sglang:v0.5.21-cu130 by digest and rename the removed --cuda-graph-max-bs alias to --cuda-graph-max-bs-decode. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
1 parent f85e1b9 commit 0ab83e4

2 files changed

Lines changed: 7 additions & 7 deletions

File tree

‎inferencex-e2e/benchmarks/single_node/srt-slurm-recipes/qwen3.8next/sglang/h200-fp8-mtp/agentic.yaml‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ base:
44
name: qwen3.8next-fp8-h200-sglang-agentic
55
model:
66
path: hf:Qwen/Qwen3.8-Flash-Next-FP8
7-
container: lmsysorg/sglang:qwen38flashnext
7+
container: lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469
88
precision: fp8
99
resources:
1010
gpu_type: h200
@@ -59,7 +59,7 @@ override_c1:
5959
agg:
6060
args:
6161
max-running-requests: 2
62-
cuda-graph-max-bs: 1
62+
cuda-graph-max-bs-decode: 1
6363
benchmark:
6464
env:
6565
CONC: '1'
@@ -69,7 +69,7 @@ override_c4:
6969
agg:
7070
args:
7171
max-running-requests: 8
72-
cuda-graph-max-bs: 4
72+
cuda-graph-max-bs-decode: 4
7373
benchmark:
7474
env:
7575
CONC: '4'
@@ -79,7 +79,7 @@ override_c8:
7979
agg:
8080
args:
8181
max-running-requests: 16
82-
cuda-graph-max-bs: 8
82+
cuda-graph-max-bs-decode: 8
8383
benchmark:
8484
env:
8585
CONC: '8'
@@ -89,7 +89,7 @@ override_c12:
8989
agg:
9090
args:
9191
max-running-requests: 24
92-
cuda-graph-max-bs: 12
92+
cuda-graph-max-bs-decode: 12
9393
benchmark:
9494
env:
9595
CONC: '12'
@@ -99,7 +99,7 @@ override_c16:
9999
agg:
100100
args:
101101
max-running-requests: 32
102-
cuda-graph-max-bs: 16
102+
cuda-graph-max-bs-decode: 16
103103
benchmark:
104104
env:
105105
CONC: '16'

‎inferencex-e2e/configs/nvidia-master.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5391,7 +5391,7 @@ qwen3.5-fp8-h200-sglang-agentic-mtp:
53915391
# low-latency single-node command, which shards the 512-expert MoE with expert
53925392
# parallelism rather than sharding attention eight ways.
53935393
qwen3.8next-fp8-h200-sglang-agentic-mtp:
5394-
image: lmsysorg/sglang:qwen38flashnext
5394+
image: lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469
53955395
model: Qwen/Qwen3.8-Flash-Next-FP8
53965396
model-prefix: qwen3.8next
53975397
runner: cluster:h200-dgxc

0 commit comments

Comments
 (0)