Skip to content

Commit daee924

Browse files
committed
fix(dsxe): exclude degraded B300 nodes
从 B300 AgentX 配方中排除性能异常节点,并迁移到自动合成验收长度选择。
1 parent d66abd2 commit daee924

7 files changed

Lines changed: 15 additions & 10 deletions

File tree

‎benchmarks/multi_node/srt-slurm-recipes/dsv4/sglang/b300-fp4/agentx/agg-tp4-c4-mtp.yaml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -104,6 +104,7 @@ roles:
104104
sbatch_directives:
105105
mem: "0"
106106
cpus-per-task: "192"
107+
exclude: "dsxe-sa-b300-prd0-gpu-00,dsxe-sa-b300-prd0-gpu-04,dsxe-sa-b300-prd0-gpu-16"
107108

108109
srun_options:
109110
mem: "0"

‎benchmarks/multi_node/srt-slurm-recipes/dsv4/sglang/b300-fp4/agentx/agg-tp4-c8-mtp.yaml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -104,6 +104,7 @@ roles:
104104
sbatch_directives:
105105
mem: "0"
106106
cpus-per-task: "192"
107+
exclude: "dsxe-sa-b300-prd0-gpu-00,dsxe-sa-b300-prd0-gpu-04,dsxe-sa-b300-prd0-gpu-16"
107108

108109
srun_options:
109110
mem: "0"

‎benchmarks/multi_node/srt-slurm-recipes/dsv4/sglang/b300-fp4/agentx/agg-tp8-c1-mtp.yaml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -104,6 +104,7 @@ roles:
104104
sbatch_directives:
105105
mem: "0"
106106
cpus-per-task: "192"
107+
exclude: "dsxe-sa-b300-prd0-gpu-00,dsxe-sa-b300-prd0-gpu-04,dsxe-sa-b300-prd0-gpu-16"
107108

108109
srun_options:
109110
mem: "0"

‎benchmarks/multi_node/srt-slurm-recipes/dsv4/sglang/b300-fp4/agentx/disagg-1p1d-dep8-dep8-c240-mtp-kvoffload.yaml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -226,6 +226,7 @@ roles:
226226
sbatch_directives:
227227
mem: "0"
228228
cpus-per-task: "192"
229+
exclude: "dsxe-sa-b300-prd0-gpu-00,dsxe-sa-b300-prd0-gpu-04,dsxe-sa-b300-prd0-gpu-16"
229230

230231
srun_options:
231232
mem: "0"

‎benchmarks/multi_node/srt-slurm-recipes/dsv4/sglang/b300-fp4/agentx/disagg-2p1d-dep8-dep8-c480-mtp-kvoffload.yaml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -228,6 +228,7 @@ roles:
228228
sbatch_directives:
229229
mem: "0"
230230
cpus-per-task: "192"
231+
exclude: "dsxe-sa-b300-prd0-gpu-00,dsxe-sa-b300-prd0-gpu-04,dsxe-sa-b300-prd0-gpu-16"
231232

232233
srun_options:
233234
mem: "0"

‎configs/nvidia-master.yaml‎

Lines changed: 0 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -6437,8 +6437,6 @@ dsv4-fp4-b300-dynamo-sglang-agentic-agg:
64376437
ep: 1
64386438
dp-attn: false
64396439
additional-settings:
6440-
- "SYNTHETIC_ACCEPTANCE=true"
6441-
- "SYNTHETIC_ACCEPTANCE_LENGTH=3.77"
64426440
- "CONFIG_FILE=recipes/dsv4/sglang/b300-fp4/agentx/agg-tp8-c1-mtp.yaml"
64436441
- spec-decoding: draft_model
64446442
conc-list: [4]
@@ -6449,8 +6447,6 @@ dsv4-fp4-b300-dynamo-sglang-agentic-agg:
64496447
ep: 1
64506448
dp-attn: false
64516449
additional-settings:
6452-
- "SYNTHETIC_ACCEPTANCE=true"
6453-
- "SYNTHETIC_ACCEPTANCE_LENGTH=3.77"
64546450
- "CONFIG_FILE=recipes/dsv4/sglang/b300-fp4/agentx/agg-tp4-c4-mtp.yaml"
64556451
- spec-decoding: draft_model
64566452
conc-list: [8]
@@ -6461,8 +6457,6 @@ dsv4-fp4-b300-dynamo-sglang-agentic-agg:
64616457
ep: 1
64626458
dp-attn: false
64636459
additional-settings:
6464-
- "SYNTHETIC_ACCEPTANCE=true"
6465-
- "SYNTHETIC_ACCEPTANCE_LENGTH=3.77"
64666460
- "CONFIG_FILE=recipes/dsv4/sglang/b300-fp4/agentx/agg-tp4-c8-mtp.yaml"
64676461
dsv4-fp4-b300-dynamo-sglang-agentic-disagg:
64686462
image: lmsysorg/sglang:nightly-dev-20260916-c9a8fba9
@@ -6489,8 +6483,6 @@ dsv4-fp4-b300-dynamo-sglang-agentic-disagg:
64896483
ep: 8
64906484
dp-attn: true
64916485
additional-settings:
6492-
- "SYNTHETIC_ACCEPTANCE=true"
6493-
- "SYNTHETIC_ACCEPTANCE_LENGTH=3.77"
64946486
- "CONFIG_FILE=recipes/dsv4/sglang/b300-fp4/agentx/disagg-1p1d-dep8-dep8-c240-mtp-kvoffload.yaml"
64956487
decode:
64966488
num-worker: 1
@@ -6507,8 +6499,6 @@ dsv4-fp4-b300-dynamo-sglang-agentic-disagg:
65076499
ep: 8
65086500
dp-attn: true
65096501
additional-settings:
6510-
- "SYNTHETIC_ACCEPTANCE=true"
6511-
- "SYNTHETIC_ACCEPTANCE_LENGTH=3.77"
65126502
- "CONFIG_FILE=recipes/dsv4/sglang/b300-fp4/agentx/disagg-2p1d-dep8-dep8-c480-mtp-kvoffload.yaml"
65136503
decode:
65146504
num-worker: 1

‎perf-changelog.yaml‎

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8607,3 +8607,13 @@
86078607
- "为 DSXE 多节点任务挂载持久化的 AgentX 数据集 mmap 缓存与 Hugging Face 缓存。"
86088608
- "将 DSXE DSV4 Dynamo+SGLang AgentX 的作业时限提高到八小时,使低并发轨迹能够完成。"
86098609
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3190
8610+
8611+
- config-keys:
8612+
- dsv4-fp4-b300-dynamo-sglang-agentic-agg
8613+
- dsv4-fp4-b300-dynamo-sglang-agentic-disagg
8614+
scenario-type:
8615+
- agentic-coding
8616+
description:
8617+
- "Exclude the two B300 DSXE nodes that produced degraded low-concurrency results from all five recipes while their health is investigated."
8618+
- "在节点健康状况调查期间,从全部五个配方中排除两个在低并发测试中性能异常的 B300 DSXE 节点。"
8619+
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3190

0 commit comments

Comments
 (0)