Repository navigation
Commit 1955dcc
Drop numa-bind on the DEP2 prefill workers
Two DEP2 prefill workers share a node (GPUs 0-1 and 2-3) under CPU affinity set by the launcher, so vLLM's automatic
GPU-to-NUMA detection refuses to run and the prefill engines exit; an explicit numa-bind-nodes list cannot fit both
workers. Matches the other DEP2 vLLM recipes, which do not set numa-bind.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>1 parent 7522c22 commit 1955dcc
1 file changed
Lines changed: 0 additions & 1 deletion
File tree
- inferencex-e2e/benchmarks/multi_node/srt-slurm-recipes/dsv41flash/vllm/gb300-fp4/agentx
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
126 | 126 | | |
127 | 127 | | |
128 | 128 | | |
129 | | - | |
130 | 129 | | |
131 | 130 | | |
132 | 131 | | |
| |||
0 commit comments