Skip to content

Commit 1955dcc

Browse files
Juntian777claude
andcommitted
Drop numa-bind on the DEP2 prefill workers
Two DEP2 prefill workers share a node (GPUs 0-1 and 2-3) under CPU affinity set by the launcher, so vLLM's automatic GPU-to-NUMA detection refuses to run and the prefill engines exit; an explicit numa-bind-nodes list cannot fit both workers. Matches the other DEP2 vLLM recipes, which do not set numa-bind. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
1 parent 7522c22 commit 1955dcc

1 file changed

Lines changed: 0 additions & 1 deletion

File tree

  • inferencex-e2e/benchmarks/multi_node/srt-slurm-recipes/dsv41flash/vllm/gb300-fp4/agentx

‎inferencex-e2e/benchmarks/multi_node/srt-slurm-recipes/dsv41flash/vllm/gb300-fp4/agentx/disagg-variants.yaml‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -126,7 +126,6 @@ base:
126126
max-num-batched-tokens: 16384
127127
long-prefill-token-threshold: 8192
128128
prefix-cache-retention-interval: 32768
129-
numa-bind: true
130129
decode:
131130
nodes: 4
132131
workers: 1

0 commit comments

Comments
 (0)