Skip to content

[Klaud Cold] Update Qwen3.8-Flash-Next FP8 H200 SGLang AgentX image to v0.5.21-cu130 / 将 Qwen3.8-Flash-Next FP8 H200 SGLang AgentX 镜像更新至 v0.5.21-cu130 - #3961

Open
Klaud-Cold wants to merge 2 commits into
mainfrom
klaud/auto-96e33f528241a7b6-cb3f7f5ee450245b
Open

Klaud-Cold wants to merge 2 commits into
mainfrom
klaud/auto-96e33f528241a7b6-cb3f7f5ee450245b

Conversation

@Klaud-Cold

@Klaud-Cold Klaud-Cold commented Oct 13, 2026 •

Copy link
Copy Markdown
Collaborator

Goal: Update SGLang image from lmsysorg/sglang:qwen38flashnext to lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469.
Baseline: 2026-08-27 · lmsysorg/sglang:qwen38flashnext
AgentX · TP4/EP4 · Mean latency · Sources: API 1, API 2, API 3

Concurrency Total tok/s/GPU ↑ Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
1 1,709.56 19.13 5,070.74 24.39
4 4,177.47 46.83 1,177.78 10.4
8 9,683.36 92.09 868.75 5.91
12 14,679.55 135.49 1,016.67 10.23
16 17,081.36 152.85 1,197.06 16.86
Eval Score ↑ Samples
gsm8k/em_strict · c16 97.73% 1,319
中文

**目标:**将 SGLang 镜像从 lmsysorg/sglang:qwen38flashnext 更新为 lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469。
**基线:**2026-08-27 · lmsysorg/sglang:qwen38flashnext
AgentX · TP4/EP4 · 平均延迟 · 来源: API 1, API 2, API 3;数值及异常说明见上表。

AI model disclosure

Prepared autonomously by Klaud Cold using claude-opus-5-5 (edits, upstream source comparison, dispatch and reporting). No delegated agents.

🤖 Generated with Claude Code

Pin lmsysorg/sglang:v0.5.21-cu130 by digest and rename the removed
--cuda-graph-max-bs alias to --cuda-graph-max-bs-decode.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution!

  • Review: If this PR changes files owned by someone other than a repository admin or @SemiAnalysisAI/core, ask one eligible CODEOWNER to complete the latest PR_REVIEW_CHECKLIST.md before contacting a core maintainer on Slack. Follow the template exactly, including As a PR reviewer and CODEOWNER, I have reviewed this and have, so sign-off verification triggers.
  • PR verification: Sweeps run only when the PR appends an inferencex-e2e/perf-changelog.yaml entry and carries exactly one primary label: full-sweep-fail-fast (strongly recommended; canary plus per-matrix fail-fast), full-sweep-enabled (canary; matrix jobs continue after a failure), or non-canary-full-sweep-enabled (no canary or fail-fast). The modifiers all-evals, evals-only, and agentx-fast require a primary label. On fork PRs, a maintainer applies the label. See sweep labels and reuse.
  • After merging: PR authors must ensure all GitHub Actions jobs pass. Transient failures often pass on rerun; see how to rerun failed jobs.
中文

感谢你的贡献!

  • **审阅:**如果 PR 修改的文件归属于仓库管理员及 @SemiAnalysisAI/core 之外的 CODEOWNER,请先联系一位有资格的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,再通过 Slack 联系核心维护者。必须严格遵循模板,并保留 As a PR reviewer and CODEOWNER, I have reviewed this and have,才能触发签核验证。
  • **PR 验证:**只有当 PR 在 inferencex-e2e/perf-changelog.yaml 末尾追加了条目,并且恰好带有一个主标签时,才会运行扫描:full-sweep-fail-fast(强烈推荐;canary 加逐矩阵 fail-fast)、full-sweep-enabled(有 canary;矩阵任务在失败后继续运行)或 non-canary-full-sweep-enabled(无 canary,也无 fail-fast)。修饰标签 all-evals、evals-only 和 agentx-fast 必须与主标签一起使用。fork PR 的标签由维护者添加。参见扫描标签与复用。
  • **合并后:**PR 作者必须确保所有 GitHub Actions 任务通过。临时性失败通常可以通过重新运行恢复;参见重新运行失败任务的说明。

@Klaud-Cold

Klaud-Cold commented Oct 13, 2026 •

Copy link
Copy Markdown
Collaborator Author

Initial attempt · Passed · Run 38401077777 / attempt 1 · 2026-10-13 14:18 UTC
lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469 · f85e1b9a259b · AgentX · TP4/EP4 · Mean latency
Change: At measured branch head 0ab83e4, move from the dev-qwen38flashnext build (593134d, a 15-commit Qwen 3.8 branch off main) to stock v0.5.21 (e00930c), which ships the same qwen4_exp model, MTP head and QSA backend, and rename --cuda-graph-max-bs to --cuda-graph-max-bs-decode because v0.5.21's arg_groups parser dropped the deprecated alias (same decode-graph semantics); other recipe flags parse unchanged.

Concurrency Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
1 19.27 (N/A) 4,820.76 (N/A) 24.6 (N/A)

Note: All rows: Δ N/A: dataset/scenario/statistic mismatch.

Eval Score ↑ Samples
gsm8k/em_strict · c16 97.65% (N/A) N/A/1,319 (old/new)

Note: All rows: Δ N/A: no matched eval baseline.

Next: Append the changelog entry and run the final full sweep.

中文

初次尝试 · 已通过 · Run 38401077777 / attempt 1 · 2026-10-13 14:18 UTC
lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469 · f85e1b9a259b · AgentX · TP4/EP4 · 平均延迟
**变更:**在被测分支提交 0ab83e4 上,从 dev-qwen38flashnext 构建(593134d,基于 main 的 15 个提交的 Qwen 3.8 分支)切换到官方 v0.5.21(e00930c),其包含相同的 qwen4_exp 模型、MTP 头和 QSA 后端;由于 v0.5.21 的 arg_groups 解析器移除了已弃用的别名,将 --cuda-graph-max-bs 改为 --cuda-graph-max-bs-decode(解码图语义不变),其余配方参数解析不变。实测数值及异常说明见上表。
**下一步:**追加变更日志条目并运行最终完整 sweep。

…pdate

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@Klaud-Cold Klaud-Cold added the full-sweep-fail-fast Full sweep with canary gate; first failure cancels the rest of that matrix (recommended) label Oct 13, 2026
@Klaud-Cold

Klaud-Cold commented Oct 13, 2026 •

Copy link
Copy Markdown
Collaborator Author

Final full sweep · Cancelled · Run 38412326100 / attempt 1 · 2026-10-13 14:20 UTC
lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469 · 2a938efd3d3f · AgentX · TP4/EP4 · Mean latency
Change: Append the exact-family perf-changelog entry and run the full fail-fast sweep (5 AgentX points and the c16 gsm8k eval) with no recipe changes since the passing smoke.

Concurrency Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
1 N/A N/A N/A
4 N/A N/A N/A
8 N/A N/A N/A
12 N/A N/A N/A
16 N/A N/A N/A

Note: All rows: cancelled.
Note: All rows: request errors unavailable.
Note: All rows: Δ N/A: point unavailable.

Next: Follow the superseding sweep run 38412393944 on the same head.

中文

最终完整 sweep · 已取消 · Run 38412326100 / attempt 1 · 2026-10-13 14:20 UTC
lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469 · 2a938efd3d3f · AgentX · TP4/EP4 · 平均延迟
**变更:**追加该配置族的 perf-changelog 条目,并运行完整 fail-fast sweep(5 个 AgentX 点及 c16 gsm8k 评测),自冒烟通过以来配方无变化。实测数值及异常说明见上表。
**下一步:**跟踪同一提交上取代它的 sweep 运行 38412393944。

@Klaud-Cold

Klaud-Cold commented Oct 13, 2026 •

Copy link
Copy Markdown
Collaborator Author

Final full sweep · Passed · Run 38412393944 / attempt 1 · 2026-10-13 16:37 UTC
lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469 · 2a938efd3d3f · AgentX · TP4/EP4 · Mean latency
Change: Validate the complete updated-image family at this head.

Concurrency Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
1 19.17 (N/A) 5,018.83 (N/A) 24.05 (N/A)
4 47.76 (N/A) 1,110.74 (N/A) 9.95 (N/A)
8 92.08 (N/A) 756.29 (N/A) 6.4 (N/A)
12 135.57 (N/A) 866.03 (N/A) 9.59 (N/A)
16 158.6 (N/A) 991.59 (N/A) 15.84 (N/A)

Note: All rows: Δ N/A: dataset/scenario/statistic mismatch.
Note: c16: 1 request error.

Eval Score ↑ Samples
gsm8k/em_strict · c16 97.8% (N/A) N/A/1,319 (old/new)

Note: All rows: Δ N/A: no matched eval baseline.

Next: Mark ready for maintainer review.

中文

最终完整 sweep · 已通过 · Run 38412393944 / attempt 1 · 2026-10-13 16:37 UTC
lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469 · 2a938efd3d3f · AgentX · TP4/EP4 · 平均延迟
**变更:**验证此提交更新镜像后的完整配置族。实测数值及异常说明见上表。
**下一步:**标记为就绪,等待维护者审查。

@github-actions

Copy link
Copy Markdown
Contributor

@Klaud-Cold
Klaud-Cold marked this pull request as ready for review October 13, 2026 16:37
@Klaud-Cold
Klaud-Cold requested a review from a team October 13, 2026 16:37
@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

validated · Repairs: 0 · Runs: 38401077777, 38412326100, 38412393944
All owned runs ended. Full sweep verified; ready for review.

中文

validated · 修复次数:0 · 运行:38401077777, 38412326100, 38412393944
所有自有运行均已结束。完整 sweep 已验证;已就绪,等待审查。

@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

/use 38412393944

@claude

claude Bot commented Oct 13, 2026 •

Copy link
Copy Markdown
Contributor

Claude finished @Klaud-Cold's task in 14s —— View job


LGTM - no blocking issues found

@github-actions

github-actions Bot commented Oct 13, 2026 •

Copy link
Copy Markdown
Contributor

@Klaud-Cold staged run 38412393944.

This run remains available across future /stage-results requests. Staging the same run ID again updates its staged data. Staging workflow

@claude claude Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, straightforward image bump + mechanical flag rename.

What was reviewed: the image pin update in both the recipe YAML and nvidia-master.yaml (strings match exactly, sha256 digest is well-formed), the cuda-graph-max-bs → cuda-graph-max-bs-decode rename across all five concurrency overrides (c1/c4/c8/c12/c16) with no leftover old-name references, and the perf-changelog.yaml entry (appended at tail, single PR link, matches the config-key).

Extended reasoning...

Three-file config-only diff: a pinned SGLang image bump kept identical between the single-node recipe and nvidia-master.yaml, a uniform launch-arg rename (cuda-graph-max-bs -> cuda-graph-max-bs-decode) applied consistently to all five concurrency override blocks with nothing left stale, and one well-formed perf-changelog entry appended at the file tail citing PR #3961. No code logic, auth, or security-sensitive paths are touched, the change follows the repo's documented image-bump/changelog conventions, and the bug hunt reported no findings, so this is simple and mechanical enough to approve without further human review.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

full-sweep-fail-fast Full sweep with canary gate; first failure cancels the rest of that matrix (recommended)

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

1 participant