Skip to content

perf(recipe): add DeepSeek V4 Flash GB300 FP8MX recipes - #5258

Draft
malay-nagda wants to merge 12 commits into
r0.6.0from
malay/dsv4_flash_mx_gb
Draft

perf(recipe): add DeepSeek V4 Flash GB300 FP8MX recipes#5258
malay-nagda wants to merge 12 commits into
r0.6.0from
malay/dsv4_flash_mx_gb

Conversation

@malay-nagda

Copy link
Copy Markdown
Contributor

What does this PR do ?

Adds three DeepSeek V4 Flash 128-GPU GB300 MXFP8 performance recipes corresponding to benchmark rows 17–19.

Changelog

  • Add the MBS=1 DeepSeek V4 Flash GB300 MXFP8 recipe.
  • Add the MBS=2 MoE activation-recompute variant.
  • Add the MBS=2 optimizer-state and expert-FC1 offload variant.
  • Export the new recipes from the DeepSeek performance recipe package.
  • Add focused unit coverage for topology, batching, CUDA graphs, precision, recompute, and offload settings.

GitHub Actions CI

Validation performed:

  • uv run --no-sync pre-commit run --all-files — passed.
  • Focused pytest collection could not run in the local macOS environment because torch is not installed. A normal uv project sync is blocked earlier while building the CUDA-only fast-hadamard-transform dependency.

Before your PR is "Ready for review"

Pre checks:

  • Read and followed the contributor guidelines.
  • Added focused unit tests.
  • No additional documentation is required for these exported recipe helpers.
  • This PR does not change optional-component import behavior.

Additional Information

The benchmark sheet lists PP=1 and VPP=4, while all three saved W&B runtime configs resolve VPP to null. Megatron-Core requires PP greater than 1 whenever VPP is enabled, so these recipes preserve PP=1 and set VPP to None.

The branch is based on r0.6.0 commit ff3795155a582cc1b7acc5c48c10098cafc123fe.

Signed-off-by: Malay Nagda <malayn@nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented Aug 3, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@malay-nagda malay-nagda added feature New capabilities, enhancements, or enablement work area:recipe Training recipes and launch configs area:perf Performance optimizations and benchmarking labels Aug 3, 2026
Signed-off-by: Malay Nagda <malayn@nvidia.com>
Signed-off-by: Malay Nagda <malayn@nvidia.com>
Signed-off-by: Malay Nagda <malayn@nvidia.com>
Signed-off-by: Malay Nagda <malayn@nvidia.com>
Signed-off-by: Malay Nagda <malayn@nvidia.com>
Signed-off-by: Malay Nagda <malayn@nvidia.com>
Signed-off-by: Malay Nagda <malayn@nvidia.com>
Signed-off-by: Malay Nagda <malayn@nvidia.com>
This reverts commit 2eb6ef2.

Signed-off-by: Malay Nagda <malayn@nvidia.com>
Signed-off-by: Malay Nagda <malayn@nvidia.com>
Signed-off-by: Malay Nagda <malayn@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:perf Performance optimizations and benchmarking area:recipe Training recipes and launch configs feature New capabilities, enhancements, or enablement work

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant