Skip to content

Commit b2e7a69

Browse files
committed
perf: confirm MI300X NIXL C8 in the full AgentX curve
1 parent 8237573 commit b2e7a69

2 files changed

Lines changed: 16 additions & 0 deletions

File tree

‎inferencex-e2e/benchmarks/multi_node/srt-slurm-recipes/dsv41flash/vllm/mi300x-fp4/agentx/disagg-variants.yaml‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -93,6 +93,11 @@ base:
9393

9494
override_cpu_engram_c4: {}
9595

96+
override_cpu_engram_c8:
97+
benchmark:
98+
env:
99+
CONC: "8"
100+
96101
override_cpu_engram_c16:
97102
benchmark:
98103
env:

‎inferencex-e2e/configs/amd-master.yaml‎

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1067,6 +1067,17 @@ dsv41flash-fp4-mi300x-vllm-agentic-nixl:
10671067
additional-settings:
10681068
- CONFIG_FILE=recipes/dsv41flash/vllm/mi300x-fp4/agentx/disagg-variants.yaml:override_cpu_engram_c4
10691069
decode: {num-worker: 1, tp: 4, ep: 1, dp-attn: false}
1070+
- spec-decoding: mtp
1071+
kv-offloading: none
1072+
conc-list: [8]
1073+
prefill:
1074+
num-worker: 1
1075+
tp: 4
1076+
ep: 1
1077+
dp-attn: false
1078+
additional-settings:
1079+
- CONFIG_FILE=recipes/dsv41flash/vllm/mi300x-fp4/agentx/disagg-variants.yaml:override_cpu_engram_c8
1080+
decode: {num-worker: 1, tp: 4, ep: 1, dp-attn: false}
10701081
- spec-decoding: mtp
10711082
kv-offloading: none
10721083
conc-list: [16]

0 commit comments

Comments
 (0)