Repository navigation
[AgentX] add Muse Spark Open NVFP4 on B300 / [AgentX] 新增 B300 Muse Spark Open NVFP4 支持 - #4146
Conversation
|
Thanks for the contribution!
中文感谢你的贡献!
|
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=38825818513 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=38825818513 |
|
[by Claude Code] The SGLang cookbook integration of this PR's AgentX config ( This PR has no authorized |
|
/use 38825818513 |
|
@functionstackx staged run 38825818513. This run remains available across future |
|
/reuse-sweep-run 38825818513 |
# Conflicts: # inferencex-e2e/perf-changelog.yaml
|
Claude finished @edwingao28's task in 27s —— View job LGTM - no blocking issues found What I checked
|
There was a problem hiding this comment.
I reviewed this PR and didn't find any bugs. It adds a new benchmark config to CODEOWNER-owned NVIDIA paths, so a code-owner review is still worthwhile.
What was reviewed:
- The new single-node agentic.yaml recipe: TP4/EP4 agg role on 4 GPUs, DFLASH draft settings, the health-check and AIPerf timeout env, and zip_override_tp4. All three swept lists have 10 entries, so they line up.
- The nvidia-master.yaml entry: srt-recipe-dir and srt-recipe point to the new file, and the conc-list matches the recipe's CONC list.
- The runners.yaml models mapping and the perf-changelog.yaml block. The block is appended at the end of the file and covers the new config key.
Extended reasoning...
The change adds one new srt-slurm recipe, one nvidia-master.yaml entry, one runners.yaml model mapping and one perf-changelog.yaml entry, 89 added lines in total. It is benchmark configuration only and touches no auth, crypto or data-exposure surface. The recipe hard-codes no synthetic acceptance length, and the new entry follows existing master and recipe patterns. nvidia-master.yaml and the b300-* recipe trees are covered by CODEOWNERS entries for NVIDIA reviewers and core, so code-owner sign-off is expected.
|
[by Claude Code] sgl-project/sglang#44654 has been merged. This PR's AgentX config ( This PR has no authorized |
Summary
Add TP4/EP4 Muse Spark Open NVFP4 AgentX on B300 with DFlash2 and the upstream recipe.
Testing: Sweep,
a23546bea, attempt 1: ten canonical throughput points and GSM8K 97.65% passed; raw/power verified. Retains one request error and 383 cutoff cancellations, including C64/128 acknowledgement timeouts.Blocker: Main sync/reuse, cookbook coverage, CODEOWNER/Core review, and an admin exception for three P90 Pareto points.
AI model disclosure
PR checklist and change type
Type of Change
Checklist
python -m infx.matrix.changed --base origin/mainlists affected config keys, I have appended one new entry covering them to the physical end ofinferencex-e2e/perf-changelog.yaml; if it lists none, I have added none. I have not edited historical entriesinferencex-e2e/perf-changelog.yamlentry, it carries exactly one primary sweep label (a maintainer applies it on fork PRs):full-sweep-fail-fast(recommended),full-sweep-enabled, ornon-canary-full-sweep-enabled. Optional modifiersall-evals,evals-only, andagentx-fastrequire a primary label; the last two block reuse while applied.OWNER/MEMBER/COLLABORATOR) has commented/use <run_id>(or the legacy/reuse-sweep-run) on this PR. Do this only once there is a final full sweep that is all green with evals passing, since after this comment the primary sweep label will no longer automatically kick off new sweeps. Remove and re-add the primary sweep label to force a new sweep.中文
新增 B300 TP4/EP4 Muse Spark Open NVFP4 AgentX,使用 DFlash2 和上方上游配方。
验证:
a23546bea的 sweep 第1次运行:10个标准吞吐点及 GSM8K 97.65% 通过,原始产物和功耗已核验。保留1次请求错误及383次截止取消,其中C64/128取消确认超时。**待办:**同步 main/复用、cookbook 覆盖、CODEOWNER/Core 审查,以及三个 P90 Pareto 前沿点的管理员例外。
改动类型:新功能、配置变更。模型/版本:运行环境未提供可核实的精确标识。AI 用于实现和审查,包括委派给其他 agent 的工作。