Repository navigation
perf(dsv41flash): tune B200 vLLM AgentX DEP2/DEP4 and add TP2 c1 and DEP2 c128 host-KV rows / 调优 B200 vLLM AgentX DEP2/DEP4 并新增 TP2 c1 与 DEP2 c128 主机 KV 行 - #3837
Conversation
…DEP2 c128 host-KV rows / 调优 B200 vLLM AgentX DEP2/DEP4 并新增 TP2 c1 与 DEP2 c128 主机 KV 行 Signed-off-by: hshrivastava-droid <hshrivastava@nvidia.com>
|
Thanks for the contribution!
中文感谢你的贡献!
|
| pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3603 | ||
| - config-keys: |
There was a problem hiding this comment.
🔴 This new changelog entry will make the perf-changelog CI check fail for this PR because it was appended without the required blank-line separator from the prior entry. Line 9412 (pr-link: .../pull/3603) is immediately followed by - config-keys: at 9413 with no empty line between them, unlike every other entry boundary in this file. Fix: insert one blank line between the end of the pull/3603 entry and the new - config-keys: block, matching the separator pattern used throughout the rest of perf-changelog.yaml.
Why this was flagged
infx/workflows/validate_perf_changelog.py:validate_raw_change (lines 198-236) checks appended changelog bytes: since base_raw (the file before this PR) ends with a single \n (not \n\n), it requires the appended suffix to start with \n- config-keys: (one empty separator line), per line 213. The diff instead appends - config-keys: directly after pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3603\n with zero blank lines, so suffix.startswith(expected_start) is false and the function raises ChangelogValidationError: 'new changelog entries must be separated from history by one empty line and appended at the end'. On the base branch every prior append has this blank line (verified: every - config-keys: line in the file is preceded by a blank line except this new one), so CI's changelog validation step, which gates merges per AGENTS.md's append-only/byte-sensitive rule, fails for this PR until the separator is restored.
Verification: The new changelog entry is appended without the required blank-line separator. In perf-changelog.yaml line 9412 ( pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3603) is immediately followed by - config-keys: at line 9413 with no empty line between them, unlike every other entry boundary in the file.
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=38008138803 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=38008138803 |
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
…4 host-KV rows / 新增 B200 vLLM AgentX DEP2 c24、DEP4 c96 与 DEP2 c64 主机 KV 行 Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Summary
Tunes the B200 vLLM AgentX recipe for
dsv41flash-fp4-b200-vllm-agentic-dsparkand adds two new rows.dsv41flash-fp4-b200-vllm-agentic-dsparkvllm/vllm-openai:nightly-dev-x86_64-cu130-ac9126e58aa7(unchanged)AI model disclosure
claude-sonnet-5-5)PR checklist and change type
Type of Change
Checklist
inferencex-e2e/perf-changelog.yamland have not edited historical entries/use <run_id>on this PR中文
调优
dsv41flash-fp4-b200-vllm-agentic-dspark的 B200 vLLM AgentX recipe,并新增两行。配置:dsv41flash-fp4-b200-vllm-agentic-dspark;镜像:vllm/vllm-openai:nightly-dev-x86_64-cu130-ac9126e58aa7(不变)。改动类型:配置变更。