Repository navigation
[Docs] Cookbook: refresh SemiAnalysis AgentX launches (DeepSeek-V4.1 GB200/GB300, GLM-5.2 FP8 B300) - #43983
Merged
nvpohanh merged 1 commit intoOct 13, 2026
Conversation
…GB200/GB300, GLM-5.2 FP8 B300) Mirror SemiAnalysis InferenceX main (029d019d), overlaid with the open InferenceX PRs 3927, 3859, 3836, 3817, 2978, 3606 and 3860, into the Agentic Long-Context Deployment sections of GLM-5.2, DeepSeek-V4, DeepSeek-V4.1, Qwen3.5 and Qwen3.8-Flash-Next. - DeepSeek-V4.1 GB200 (InferenceX#3927): Agg TP4-EP4 (c1-c16) and Agg DEP4 (c32-c192) on the 20261011 nightly replace the Agg TP2 / TP4 curves. - DeepSeek-V4.1 GB300 (InferenceX#3859): the measured 7-point curve (TP4 c1/c4/c16, TP2-EP2 c16/c32, DEP2 c64/c128). - GLM-5.2 FP8 B300 (InferenceX#3836): adds c20/c24/c28; the lane is in progress at the PR head until it gets a new /use run. - InferenceX PRs 3890 and 3701 have merged and are mirrored from main. Supersedes sgl-project#43934. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
nvpohanh
requested review from
JustinTong0323,
sogalin,
wisclmy0611 and
zijiexia
as code owners
October 13, 2026 04:50
This was referenced Oct 13, 2026
Collaborator
Author
|
Verified locally. UI looks good. Force merge to unblock SA AgentX submission. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
[by Claude Code]
Motivation
Refresh the cookbook's interactive Agentic Long-Context Deployment sections (#42726, #43083, #43799) on GLM-5.2, DeepSeek-V4, DeepSeek-V4.1, Qwen3.5 and Qwen3.8-Flash-Next against the latest SemiAnalysis InferenceX AgentX submissions. The configurations are mirrored from SemiAnalysis submissions as raw launch commands, each linked to the run that measured it.
This PR supersedes #43934. It brings in the GLM-5.2 FP8 B300 update from InferenceX #3836 (c20/c24/c28 added to the existing c1–c16) through the AgentX explorer and leaves the Deployment panel unchanged.
Source
InferenceX
main(029d019d), with these open InferenceX PRs overlaid:dsv41flash-fp4-gb200-sglang-agentic-dspark/use), verifieddsv41flash-fp4-gb300-sglang-agentic-dspark/use), verifiedglm5.2-fp8-b300-sglang-agentic-mtp/useyet: in progress, PR head3120bc1bdsv4-fp4-b300-dynamo-sglang-agentic-agg,-disagg/use), verifiedqwen3.5-fp4-b300-dynamo-sglang-agentic-pareto/reuse-sweep-run), verifieddsv4-fp4-b300-sglang-agentic-hicache-mtp/useyet: in progress, PR head5b394d39dsv41flash-fp4-gb300-dynamo-sglang-agentic-disagg/useyet: in progress, PR headb2061c77A lane from a PR without an authorized
/userun is rendered at the PR head and labeled "In progress in SA InferenceX AgentX". It switches to the measured run on the next sync after a/usecomment or a merge. Two overlays from #43799, InferenceX #3890 and InferenceX #3701, have since merged into InferenceXmainand are now mirrored from there, at their dashboard runs.What this PR does
Only the generated data files change. The component (
_agentx.jsx), page text, Deployment panels and Playgrounds are untouched. Rendered commands change only for these three lanes:nightly-dev-cu13-20260923-06008c17tag), are replaced by "Agg TP4·EP4" (c1/c4/c8/c16) and "Agg DEP4" (c32/c64/c128/c192). Both new deployments run onlmsysorg/sglang:nightly-dev-cu13-20261011-d32d8fa0@sha256:8346c975…, which is available on Docker Hub./userun; [Docs] Cookbook: refresh SemiAnalysis AgentX launches (GLM-5.2 B300, DeepSeek-V4.1 GB300) #43799 had it in progress at an earlier head. The curve has 7 points: "Agg TP4" c1/c4/c16, "Agg TP2·EP2" c16/c32 and "Agg DEP2" c64/c128. TP4 c1, TP2·EP2 c16/c32 and DEP2 c64/c128 are byte-identical tomain, and TP4 c4/c16 are new. TP2·EP2 c1–c8, TP4 c2 and the "Agg TP4·EP4" deployment (c4–c128) are no longer in the submission and are removed.--max-running-requestsand--cuda-graph-max-bsset to 40, 48 and 56. The c1–c16 commands are byte-identical. The PR was force-pushed to a single commit and its earlier/usecomment was removed, so the whole lane (c1–c28) now shows as in progress at the PR head (3120bc1b) until it gets a new/userun.Status- and provenance-only changes (the commands are byte-identical to
main): GLM-5.2 NVFP4 B300 (InferenceX #3890) and DeepSeek-V4 GB200 Dynamo agg/disagg (InferenceX #3701) are now pinned to their dashboard runs on InferenceXmain.How the commands are produced
The pipeline and rules are the same as in #42726, #43083 and #43799, and no keep/remove/rewrite rule was added. Each lane is rendered at the exact commit of the run that produced its dashboard data. For an open PR, that is the run named by its authorized
/usecomment, or the PR head when there is none. SA-only settings are removed: the benchmark harness, cluster paths and caches, telemetry, and InferenceX's synthetic speculative acceptance (disclosed per deployment). Placeholders replace IPs, ports and NICs. Router and KV-offload variants that were not run are derived and labeled "Derived — not run".qwen3.5-fp8-h100-sglang-agentic(H100 without MTP) has never produced dashboard data, so there is no run to pin it to.mainversion ofdsv41flash-fp4-gb300-dynamo-sglang-agentic-disaggkeeps donating the derived HiCache flags while InferenceX #3860's revision is unmeasured.The data files are generated, so there is no hand-written code to review here.
Validation
mint validate(strict build) andmint broken-links --check-anchors --check-redirectspass.node docs/scripts/check_cookbook_configs.mjspasses, and so doespre-commit run --all-files.mint dev, opening every tab. That is 2,274 command sets: GLM-5.2 300, DeepSeek-V4 424, DeepSeek-V4.1 426, Qwen3.5 1,048 and Qwen3.8-Flash-Next 76. The rendered commands match the expected text exactly. For every deployment, the "Copy link" URL of a non-default selection was reopened in a fresh tab and restored the same selection and tab (129 links).main, every deployment outside the three lanes above renders byte-identical commands on all five pages, including the derived router and KV-offload variants.sglang.launch_server,dynamo.sglang,sglang_router.launch_routeranddynamo.frontendcommand (1,934 distinct, across 28 images) parses with the argument parsers of its own submission image (CPU only). The 80 commands that are new in this PR were parsed now, each in its own image: 50 innightly-dev-cu13-20261011-d32d8fa0, 12 innightly-dev-cu13-20261012-e6072935and 18 in the GLM-5.2 FP8 B300 imagelmsysorg/sglang@sha256:2d53500c…. The rest are identical to commands parsed for [Docs] Cookbook: interactive SemiAnalysis InferenceX AgentX launches for GLM-5.2, DeepSeek-V4 and DeepSeek-V4.1 #42726, [Docs] Cookbook: AgentX launches for Qwen3.5 / Qwen3.8-Flash-Next; refresh GLM-5.2, DeepSeek-V4, DeepSeek-V4.1 #43083 and [Docs] Cookbook: refresh SemiAnalysis AgentX launches (GLM-5.2 B300, DeepSeek-V4.1 GB300) #43799.No serving or benchmark runs were performed for this PR; the numbers live in the linked SemiAnalysis runs. SGLang CI was not triggered.
🤖 Generated with Claude Code
CI States
Latest PR Test (Base): ✅ Run #38348415549
Latest PR Test (Extra): ❌ Run #38348415375
Latest PR Test (AMD ROCm 10): ➖ No AMD PR run found for this commit.