Repository navigation
Commit 8c01db9
committed
refactor(srt): compose main's new GB300 and B300 AgentX recipes from fragments
#3816, #3840 and #3744 added full recipes: the Qwen3.8 GB300 and Qwen3.5
GB300 DEP16 recipes carry model blocks, the client command, benchmark MODEL,
TOTAL_CPU_DRAM_GB, KV_OFFLOADING and the client paths the launcher hands
multi-node points, and both new recipes and the DSv4.1-Flash B300 one set the
identity repo and image the binder writes. Like the other AgentX fragments
they drop them, and WEKA_LOADER_OVERRIDE, which names both models' default
corpus.
The Qwen3.8 HiCache pool was the 225 GB matrix allowance less 1 GB of
alignment headroom; it now takes '@dram.per-gpu-gb' and the entry's
dram-utilization drops from 1.0 to 0.995, so the pool stays 224 GB and the
bound TOTAL_CPU_DRAM_GB is 224. Each point otherwise binds to main's
selected variant, with the Qwen3.5 model alias bound as its Hub id like the
other GB300 Qwen3.5 AgentX points.1 parent 7299153 commit 8c01db9
4 files changed
Lines changed: 6 additions & 36 deletions
File tree
- inferencex-e2e
- benchmarks
- multi_node/srt-slurm-recipes/qwen3.5/sglang/gb300-fp8/agentx
- single_node/srt-slurm-recipes
- dsv41flash/sglang/b300-fp4-mtp
- qwen3.8next/sglang/gb300-fp4-mtp
- configs
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
4 | | - | |
5 | | - | |
6 | | - | |
7 | 3 | | |
8 | 4 | | |
9 | 5 | | |
| |||
227 | 223 | | |
228 | 224 | | |
229 | 225 | | |
230 | | - | |
231 | | - | |
232 | 226 | | |
233 | | - | |
234 | | - | |
235 | | - | |
236 | | - | |
237 | | - | |
238 | | - | |
239 | | - | |
240 | 227 | | |
241 | 228 | | |
242 | 229 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
6 | | - | |
7 | 6 | | |
8 | | - | |
9 | | - | |
| 7 | + | |
10 | 8 | | |
11 | 9 | | |
12 | 10 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | | - | |
3 | | - | |
| 2 | + | |
4 | 3 | | |
5 | 4 | | |
6 | 5 | | |
7 | 6 | | |
8 | 7 | | |
9 | | - | |
10 | 8 | | |
11 | | - | |
12 | | - | |
13 | | - | |
14 | | - | |
15 | | - | |
16 | | - | |
| 9 | + | |
17 | 10 | | |
18 | 11 | | |
19 | 12 | | |
| |||
82 | 75 | | |
83 | 76 | | |
84 | 77 | | |
85 | | - | |
| 78 | + | |
86 | 79 | | |
87 | 80 | | |
88 | 81 | | |
| |||
104 | 97 | | |
105 | 98 | | |
106 | 99 | | |
107 | | - | |
108 | | - | |
109 | 100 | | |
110 | | - | |
111 | 101 | | |
112 | | - | |
113 | | - | |
114 | | - | |
115 | | - | |
116 | 102 | | |
117 | 103 | | |
118 | 104 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
9174 | 9174 | | |
9175 | 9175 | | |
9176 | 9176 | | |
9177 | | - | |
9178 | | - | |
9179 | | - | |
| 9177 | + | |
| 9178 | + | |
9180 | 9179 | | |
9181 | 9180 | | |
9182 | 9181 | | |
| |||
0 commit comments