Skip to content

Commit 9643753

Browse files
committed
refactor(srt): take the GB300 DSv4 Mooncake RDMA devices from the fabric
prefill role. Like the other recipes' NIC lists, both read '@fabric.rdma-devices', which renders the same mlx5_0..mlx5_3 list on gb300-nv.
1 parent 7315dee commit 9643753

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

  • inferencex-e2e/benchmarks/multi_node/srt-slurm-recipes/dsv4/sglang/gb300-fp4/agentx

‎inferencex-e2e/benchmarks/multi_node/srt-slurm-recipes/dsv4/sglang/gb300-fp4/agentx/disagg-variants.yaml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@ base:
5151
args: ["--port", "8800"]
5252
env:
5353
MOONCAKE_PROTOCOL: rdma
54-
MOONCAKE_DEVICE: "mlx5_0,mlx5_1,mlx5_2,mlx5_3"
54+
MOONCAKE_DEVICE: "@fabric.rdma-devices"
5555
MOONCAKE_GLOBAL_SEGMENT_SIZE: 180gb
5656
MC_STORE_CLIENT_METRIC_INTERVAL: '5'
5757
MC_ENABLE_DEST_DEVICE_AFFINITY: '1'
@@ -137,7 +137,7 @@ base:
137137
MOONCAKE_PROTOCOL: rdma
138138
# The store only registers host buffers on RDMA; without an explicit list it
139139
# falls back to NVLink for same-domain peers and aborts at the warmup put.
140-
MOONCAKE_DEVICE: "mlx5_0,mlx5_1,mlx5_2,mlx5_3"
140+
MOONCAKE_DEVICE: "@fabric.rdma-devices"
141141
MOONCAKE_GLOBAL_SEGMENT_SIZE: '@dram.per-gpu-bytes'
142142
MOONCAKE_STANDALONE_STORAGE: '0'
143143
MC_STORE_CLIENT_METRIC_INTERVAL: '5'

0 commit comments

Comments
 (0)