Repository navigation
Commit e012723
authored
perf(b300): update vLLM AgentX to DSpark6 with native SRT recipes / 使用原生 SRT 配方更新 B300 vLLM AgentX 至 DSpark6 (#3477)
* perf(b300): configure DSpark6 AgentX with native SRT recipes
使用原生 SRT YAML 配方配置 B300 DSpark6 AgentX,保留图捕获覆盖、逐点 KV 缓存配置和持久化数据集缓存,并将集群默认 CPU 数设为 192。
* perf(b300): reserve runtime headroom for DEP8
将所有 DEP8 并发点的 KV 缓存统一设为 105000000000 字节,为运行时工作区留出余量;将性能变更记录链接指向 PR #3477。1 parent e7d99b8 commit e012723
5 files changed
Lines changed: 70 additions & 398 deletions
File tree
- inferencex-e2e
- benchmarks/single_node/srt-slurm-recipes/dsv4/vllm/b300-fp4-mtp
- configs
- runners
- srt-slurm
0 commit comments