Repository navigation
Commit 677436c
Run the Dynamo frontend and the AgentX client on a dedicated node
On the head node the frontend and the client grew next to two DEP2 prefill instances (Engram CPU tables plus 70 GiB
host KV per rank) until the 8P1D c5120 job was OOM-killed during warmup. Both now share one CPU-only node
(frontend and benchmark placement dedicated, colocated), which adds one node per disaggregated point and leaves the
GPU count unchanged. The frontend is pinned to NUMA node 0 (frontend.numa_bind) now that worker steps get every CPU.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>1 parent ef5b28e commit 677436c
1 file changed
Lines changed: 8 additions & 0 deletions
File tree
- inferencex-e2e/benchmarks/multi_node/srt-slurm-recipes/dsv41flash/vllm/gb300-fp4/agentx
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
52 | 52 | | |
53 | 53 | | |
54 | 54 | | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
55 | 58 | | |
56 | 59 | | |
57 | 60 | | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
58 | 64 | | |
59 | 65 | | |
60 | 66 | | |
| |||
186 | 192 | | |
187 | 193 | | |
188 | 194 | | |
| 195 | + | |
| 196 | + | |
189 | 197 | | |
190 | 198 | | |
191 | 199 | | |
| |||
0 commit comments