Repository navigation
Commit e5d1fa0
perf(dsv41flash): refresh GB200 SGLang AgentX aggregate curve
Repin dsv41flash-fp4-gb200-sglang-agentic-dspark to
lmsysorg/sglang:nightly-dev-cu13-20261011-d32d8fa0 (multiarch digest
pinned) and replace the TP4/EP1 and TP2/EP1 C1-C128 sweeps with TP4/EP4
points at C1, C4, C8 and C16 and aggregate TP4/EP4 points with DP attention
at C32, C64, C128 and C192 behind sglang-router 0.3.2. The recipe carries
the per-point prefill-decode interval, prefill chunking, admission, memory
and SWA prefix-tail settings, and appends the matching changelog entry.
将 dsv41flash-fp4-gb200-sglang-agentic-dspark 更新为
lmsysorg/sglang:nightly-dev-cu13-20261011-d32d8fa0(固定 multiarch
digest),并以 TP4/EP4 的 C1、C4、C8、C16,以及在 sglang-router 0.3.2
之后启用 DP attention 的聚合式 TP4/EP4 的 C32、C64、C128、C192,取代原本的
TP4/EP1 与 TP2/EP1 C1-C128 扫描。recipe 包含各点的 prefill-decode
interval、prefill chunk、运行请求上限、显存与 SWA 前缀尾部设置,并追加对应的
changelog 条目。
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>1 parent 20c8fba commit e5d1fa0
3 files changed
Lines changed: 146 additions & 210 deletions
File tree
- inferencex-e2e
- benchmarks/single_node/srt-slurm-recipes/dsv41flash/sglang/gb200-fp4-mtp
- configs
0 commit comments