Repository navigation

Add opt-in Turbo fused cross entropy for TP1 training - #1245

Open

suachong wants to merge 12 commits into

mainfrom

suachong/turbo-ce-main-20261010

Commits on Oct 10, 2026
- Add opt-in Turbo cross entropy for Megatron TP1 training
  suachong
  committed
  4a8cb8c
- Document Turbo CE enablement and fallback behavior
  suachong
  committed
  3f428c9
- Isolate CE patch registration during unit tests
  suachong
  committed
  c08b0f6
- Use the repository Black formatting for CE tests
  suachong
  committed
  2b46959
- docs: record Turbo CE throughput and convergence limits
  suachong
  committed
  e63d33c
- Pin CE-enabled Turbo for GPU integration tests
  suachong
  committed
  a844303
- Limit CE performance documentation to kernel measurements
  suachong
  committed
  297c895
- Keep CE integration documentation focused on its public API
  suachong
  committed
  1a77016
- fix(megatron): expose Turbo cross entropy as training arguments
  suachong
  committed
  510e410
Commits on Oct 11, 2026
- Merge main and preserve MoE and cross-entropy integration
  suachong
  committed
  e6537d8
- ci: pin Turbo main after MoE and cross-entropy merges
  suachong
  committed
  14477e0
- test: isolate single-node torchrun rendezvous ports
  suachong
  committed
  99439f8