Repository navigation
Commit aff5c1b
committed
chore(agentx): merge main and rebase the lmcache-server patch on srt-slurm v2.30.0
main bumped srt-slurm to v2.30.0 and dropped the 504 patch. The 507 patch
is regenerated on v2.30.0 from SemiAnalysisAI/srt-slurm#32 at 181b2e4, and
the #3545 perf-changelog entry is rewritten to state the benchmark change:
one lmcache-server with 1296 GB L1 instead of 8 per-rank 162 GB servers,
image v0.30.0, LMCacheMPConnector at localhost:8750 with mq_timeout 6000,
re-measured results.11 files changed
Lines changed: 108 additions & 462 deletions
File tree
- inferencex-e2e
- benchmarks
- multi_node/srt-slurm-recipes
- single_node/srt-slurm-recipes/dsv4/vllm/b300-fp4-mtp
- configs
- runners
- srt-slurm
- patches
- utils
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
7 | | - | |
| 7 | + | |
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
| |||
69 | 69 | | |
70 | 70 | | |
71 | 71 | | |
72 | | - | |
| 72 | + | |
73 | 73 | | |
74 | 74 | | |
75 | 75 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
7 | | - | |
| 7 | + | |
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
| |||
69 | 69 | | |
70 | 70 | | |
71 | 71 | | |
72 | | - | |
| 72 | + | |
73 | 73 | | |
74 | 74 | | |
75 | 75 | | |
| |||
0 commit comments