[Klaud Cold] Update dsr1-fp4-b200-sglang-mtp to SGLang v0.5.21 / [Klaud Cold] 将 dsr1-fp4-b200-sglang-mtp 更新至 SGLang v0.5.21

[Klaud-Cold]

Goal: Update SGLang image from lmsysorg/sglang:v0.5.16-cu130 to lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469.
Baseline: 2026-08-06 · lmsysorg/sglang:v0.5.16-cu130
Mean latency · Sources: API 1, API 2, API 3

Point	Total tok/s/GPU ↑	Output tok/s/GPU ↑	TTFT ms ↓	TPOT ms ↓
8k/1k c1 TP4 EP1 1ecad2	664.03	74.17	205.09	3.16
8k/1k c2 TP4 EP1 b79296	1,120.85	125.76	250.4	3.59
8k/1k c4 TP4 EP1 d56e03	1,649.89	183.51	296.12	4.98
8k/1k c8 TP4 EP1 298215	2,321.26	260.92	412.66	7
8k/1k c16 TP4 EP1 c2ec41	2,940.82	325.82	826.07	11.1
8k/1k c32 TP4 EP1 fb2b10	3,839.76	429.34	1,288.53	16.88
8k/1k c64 TP4 EP4 6b9bd7	5,786.09	641.84	1,462.11	22.72
8k/1k c128 TP4 EP4 c02deb	7,290.73	807.46	1,991.22	36.79
8k/1k c256 TP4 EP4 98a050	8,783.42	976.13	6,426.93	57.6

Eval	Score ↑	Samples
gsm8k/em_strict · c32	95.75%	1,319
gsm8k/em_strict · c128	95.83%	1,319
gsm8k/em_strict · c256	94.92%	1,319

中文

**目标：**将 SGLang 镜像从 lmsysorg/sglang:v0.5.16-cu130 更新为 lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469。
**基线：**2026-08-06 · lmsysorg/sglang:v0.5.16-cu130
平均延迟 · 来源： API 1, API 2, API 3；数值及异常说明见上表。

[github-actions]

Thanks for the contribution!

• Review: If this PR changes files owned by someone other than a repository admin or @SemiAnalysisAI/core, ask one eligible CODEOWNER to complete the latest PR_REVIEW_CHECKLIST.md before contacting a core maintainer on Slack. Follow the template exactly, including As a PR reviewer and CODEOWNER, I have reviewed this and have, so sign-off verification triggers.
• PR verification: Sweeps run only when the PR appends an inferencex-e2e/perf-changelog.yaml entry and carries exactly one primary label: full-sweep-fail-fast (strongly recommended; canary plus per-matrix fail-fast), full-sweep-enabled (canary; matrix jobs continue after a failure), or non-canary-full-sweep-enabled (no canary or fail-fast). The modifiers all-evals, evals-only, and agentx-fast require a primary label. On fork PRs, a maintainer applies the label. See sweep labels and reuse.
• After merging: PR authors must ensure all GitHub Actions jobs pass. Transient failures often pass on rerun; see how to rerun failed jobs.

中文

感谢你的贡献！

• **审阅：**如果 PR 修改的文件归属于仓库管理员及 @SemiAnalysisAI/core 之外的 CODEOWNER，请先联系一位有资格的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md，再通过 Slack 联系核心维护者。必须严格遵循模板，并保留 As a PR reviewer and CODEOWNER, I have reviewed this and have，才能触发签核验证。
• **PR 验证：**只有当 PR 在 inferencex-e2e/perf-changelog.yaml 末尾追加了条目，并且恰好带有一个主标签时，才会运行扫描：full-sweep-fail-fast（强烈推荐；canary 加逐矩阵 fail-fast）、full-sweep-enabled（有 canary；矩阵任务在失败后继续运行）或 non-canary-full-sweep-enabled（无 canary，也无 fail-fast）。修饰标签 all-evals、evals-only 和 agentx-fast 必须与主标签一起使用。fork PR 的标签由维护者添加。参见扫描标签与复用。
• **合并后：**PR 作者必须确保所有 GitHub Actions 任务通过。临时性失败通常可以通过重新运行恢复；参见重新运行失败任务的说明。

[Klaud-Cold]

Initial attempt · Failed · Run 38401530676 / attempt 1 · 2026-10-13 13:10 UTC
lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469 · f85e1b9a259b · Mean latency
Change: Pin SGLang v0.5.21-cu130 by digest and replace the removed --cuda-graph-max-bs / --disable-piecewise-cuda-graph aliases with their exact replacements --cuda-graph-max-bs-decode / --cuda-graph-backend-prefill disabled (sglang#38375, v0.5.16 aliases, v0.5.21 fields); all other flags and env vars still parse, and --enable-flashinfer-allreduce-fusion remains a deprecated alias for backend auto.

Point	Output tok/s/GPU ↑	TTFT ms ↓	TPOT ms ↓
8k/1k c1 TP4 EP1 1ecad2	N/A	N/A	N/A
8k/1k c64 TP4 EP4 6b9bd7	N/A	N/A	N/A

Note: 8k/1k c1 TP4 EP1 1ecad2: failed.
Note: All rows: request errors unavailable.
Note: All rows: Δ N/A: point unavailable.
Note: 8k/1k c64 TP4 EP4 6b9bd7: cancelled.

Eval	Score ↑	Samples
gsm8k/em_strict · c32	N/A	1,319/N/A (old/new)
gsm8k/em_strict · c128	N/A	1,319/N/A (old/new)

Note: gsm8k/em_strict · c32: failed.
Note: All rows: Δ N/A: eval score unavailable.
Note: gsm8k/em_strict · c128: unavailable.

Next: Stop as readiness-blocked until the DeepSeek-R1-0528-NVFP4-v2 weights are restaged on b200-nscale /scratch/models; the c1 failure is missing weights, not SGLang v0.5.21, and the c64/c128 cancellations are fail-fast siblings.

中文

初次尝试 · 失败 · Run 38401530676 / attempt 1 · 2026-10-13 13:10 UTC
lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469 · f85e1b9a259b · 平均延迟
**变更：**按摘要固定 SGLang v0.5.21-cu130，并将上游已移除的 --cuda-graph-max-bs / --disable-piecewise-cuda-graph 别名替换为等价的 --cuda-graph-max-bs-decode / --cuda-graph-backend-prefill disabled（见 sglang#38375）；其余参数和环境变量仍可解析，--enable-flashinfer-allreduce-fusion 仍作为 auto 后端的弃用别名。实测数值及异常说明见上表。
**下一步：**在 b200-nscale 的 /scratch/models 重新放置 DeepSeek-R1-0528-NVFP4-v2 权重之前，以 readiness-blocked 停止；c1 失败原因是权重缺失而非 SGLang v0.5.21，c64/c128 为 fail-fast 取消。

[Klaud-Cold]

readiness-blocked · Cleanup pending. Stop and confirm owned runs before closing.

中文

readiness-blocked · 清理待完成。先停止并确认自有运行结束，再关闭 PR。

[Klaud-Cold]

readiness-blocked · Repairs: 0 · Runs: 38401530676
All owned runs ended. PR closed; branch deleted for retry.

中文

readiness-blocked · 修复次数：0 · 运行：38401530676
所有自有运行均已结束。PR 已关闭；分支已删除，可重新尝试。