Skip to content

Commit 677436c

Browse files
Juntian777claude
andcommitted
Run the Dynamo frontend and the AgentX client on a dedicated node
On the head node the frontend and the client grew next to two DEP2 prefill instances (Engram CPU tables plus 70 GiB host KV per rank) until the 8P1D c5120 job was OOM-killed during warmup. Both now share one CPU-only node (frontend and benchmark placement dedicated, colocated), which adds one node per disaggregated point and leaves the GPU count unchanged. The frontend is pinned to NUMA node 0 (frontend.numa_bind) now that worker steps get every CPU. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
1 parent ef5b28e commit 677436c

1 file changed

Lines changed: 8 additions & 0 deletions

File tree

  • inferencex-e2e/benchmarks/multi_node/srt-slurm-recipes/dsv41flash/vllm/gb300-fp4/agentx

‎inferencex-e2e/benchmarks/multi_node/srt-slurm-recipes/dsv41flash/vllm/gb300-fp4/agentx/disagg-variants.yaml‎

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -52,9 +52,15 @@ base:
5252
type: etcd
5353
placement:
5454
node: infra
55+
# The Dynamo frontend and the AgentX client share one CPU-only node: next to two DEP2 prefill instances (Engram CPU
56+
# tables plus 70 GiB host KV per rank) the client and frontend memory at conc 5120 exhausted the head node. The
57+
# frontend is pinned to NUMA node 0.
5558
frontend:
5659
type: dynamo
5760
enable_multiple_frontends: false
61+
numa_bind: true
62+
placement:
63+
node: dedicated
5864
args:
5965
router-mode: "kv"
6066
router-session-affinity-ttl-secs: 14400
@@ -186,6 +192,8 @@ base:
186192
benchmark:
187193
type: custom
188194
command: bash /infmax-workspace/benchmarks/srt_agentic.sh
195+
placement:
196+
node: dedicated
189197
env:
190198
INFMAX_CONTAINER_WORKSPACE: "/infmax-workspace"
191199
RESULT_DIR: "/logs/agentic"

0 commit comments

Comments
 (0)