Repository navigation

feat(engine): add CPU-staged Megatron AdamW - #1613

Merged

sitabulaixizawaluduo merged 60 commits into

mainfrom

feature/optimizer_offload

Oct 16, 2026

Merged

feat(engine): add CPU-staged Megatron AdamW#1613
sitabulaixizawaluduo merged 60 commits into
mainfrom
feature/optimizer_offload

Commits on Aug 11, 2026
- feat(trainer): add multi-objective policy distillation
  yulangz
  committed
  c1df884
- fix: propagate role env to forked workers
  yulangz
  committed
  a51aa18
- feat: offload SGLang CUDA graphs during AWEX training
  yulangz
  committed
  3794efa
- Merge branch 'main' into feature/mopd
  yulangz
  authored
  a0be494
Commits on Aug 12, 2026
- Merge remote-tracking branch 'github/main' into feature/mopd
  yulangz
  committed
  e249e32
- fix: restore MOPD CI compatibility
  yulangz
  committed
  a05754b
- chore: merge main into feature/mopd
  yulangz
  committed
  47f36e0
- chore: merge main into feature/mopd
  yulangz
  committed
  627a4f4
- test: stabilize MOPD CI fixtures
  yulangz
  committed
  476fc62
Commits on Aug 13, 2026
- fix(engine): stabilize AWEX colocated weight updates
  yulangz
  committed
  7cad29b
Commits on Aug 17, 2026
- feat(engine): add GPU-staged optimizer support
  yulangz
  committed
  ce6b7a7
- feat(examples): add CPU-staged Qwen3 MoE example
  yulangz
  committed
  f7f7f7c
Commits on Aug 18, 2026
- test: consolidate staged optimizer coverage
  yulangz
  committed
  62a7b4a
Commits on Aug 20, 2026
- feat: add DAPO-Math CPU-staged training example
  root
  committed
  07fda30
Commits on Aug 21, 2026
- fix(dataset): use compatible chat template helper
  root
  committed
  8fd2a5e
Commits on Aug 24, 2026
- fix: release colocated actor memory between phases
  root
  committed
  7dd2bed
- feat(engine): integrate CPU-staged optimizer residency
  root
  committed
  0365518
- fix(engine): use native AWEX Qwen3 converter
  root
  committed
  e1fc363
Commits on Aug 25, 2026
- feat(engine): decouple staged offload from optimizer choice
  root
  committed
  d5bd29b
Commits on Aug 27, 2026
- test(engine): add staged optimizer parity coverage
  root
  committed
  e97a42d
- refactor(engine): share staged optimizer runtime
  root
  committed
  3c90fba
- refactor(engine): reuse native staged update rules
  root
  committed
  eb63993
- perf(engine): select staged AdamW update backend
  root
  committed
  e9ecd7e
Commits on Aug 28, 2026
- test(engine): expand staged optimizer parallel coverage
  root
  committed
  08826c7
Commits on Sep 7, 2026
- fix(engine): handle staged optimizer schedules and empty owners
  root
  committed
  f4c94a2
- chore: merge main into optimizer offload branch
  root
  committed
  e851361
- fix(engine): use physical GPU ranks for AWEX TP servers
  root
  committed
  551b48a
- fix(models): disable bridge wgrad fusion without native extension
  root
  committed
  27b110c
- refactor: simplify staged optimizers and add Qwen3.5 example
  root
  committed
  812992a
Commits on Sep 8, 2026
- fix(engine): budget padded microbatches by rectangular input size
  root
  committed
  335cf93
- fix(ci): provision Muon dependency and correct test fixtures
  root
  committed
  6fc019c
- fix(ci): install Muon dependency in a runner-writable directory
  root
  committed
  5da34c0
Commits on Sep 9, 2026
- test: reduce tree training memory and always release engines
  root
  committed
  b8a97bd
Commits on Sep 10, 2026
- fix(engine): avoid ephemeral ports for SGLang rendezvous
  root
  committed
  8c909e3
Commits on Sep 18, 2026
- chore: merge main into optimizer offload branch
  root
  committed
  25d91c2
Commits on Sep 20, 2026
- Merge remote-tracking branch 'origin/main' into feature/optimizer_offload
  root
  committed
  d745230
- test: align unit tests with runtime backends
  root
  committed
  fbc070f
Commits on Sep 21, 2026
- Merge remote-tracking branch 'origin/main' into feature/optimizer_offload
  root
  committed
  fff0213
- refactor(engine): split Muon from staged AdamW
  root
  committed
  1d6f822
Commits on Sep 22, 2026
- chore: merge main and align CI fixtures
  root
  committed
  8228c45
- test(engine): align optimizer fixture with model config
  root
  committed
  0186f36
- fix(engine): keep AWEX transfer ranks dense
  root
  committed
  163773d
- test: defer VLM model path resolution during collection
  root
  committed
  e9e05d4
- fix(ci): preserve checkout path for worker processes
  root
  committed
  b63aeae
Commits on Sep 29, 2026
- chore: merge main into optimizer offload branch
  root
  committed
  b00bd98
Commits on Oct 8, 2026
- fix(engine): merge main and refresh offload test fixtures
  root
  committed
  bac678a
Commits on Oct 9, 2026
- fix(ci): align AWEX with latest main before unit tests
  root
  committed
  231e92b
Commits on Oct 12, 2026
- fix(engine): rebuild staged optimizer state after HF reload
  root
  committed
  4a2a677
- fix(engine): avoid double-offset AWEX transfer ranks
  root
  committed
  37431a6
- refactor(engine): split activation tracking from optimizer offload
  root
  committed
  be24155
- fix(engine): release AWEX IPC exports after reader acknowledgement
  root
  committed
  1d0f81a
Commits on Oct 13, 2026
- refactor(engine): narrow AWEX changes to staged optimizer support
  root
  committed
  25ba63b
- fix(engine): allow chunked Qwen3.5 text in model-owned THD
  root
  committed
  e40259f
- fix: propagate AWEX transfer ranks for separate rollout workers
  root
  committed
  309a5ce
- fix(engine): preserve stub optimizers on frozen pipeline ranks
  root
  committed
  f4a707c
- ci: isolate ephemeral GPU runners by workflow run and attempt
  root
  committed
  fdb3955
- chore: merge latest main into optimizer offload branch
  root
  committed
  1cbf988
Commits on Oct 15, 2026
- chore: merge latest main with named loss support
  root
  committed
  af68c53
- test: complete Qwen recovery configuration fixture
  root
  committed
  99e9507
- chore: sync R3 main and drop superseded Flash Next fix
  root
  committed
  59f5705

Commits

Commits on Aug 11, 2026

Commits on Aug 12, 2026

Commits on Aug 13, 2026

Commits on Aug 17, 2026

Commits on Aug 18, 2026

Commits on Aug 20, 2026

Commits on Aug 21, 2026

Commits on Aug 24, 2026

Commits on Aug 25, 2026

Commits on Aug 27, 2026

Commits on Aug 28, 2026

Commits on Sep 7, 2026

Commits on Sep 8, 2026

Commits on Sep 9, 2026

Commits on Sep 10, 2026

Commits on Sep 18, 2026

Commits on Sep 20, 2026

Commits on Sep 21, 2026

Commits on Sep 22, 2026

Commits on Sep 29, 2026

Commits on Oct 8, 2026

Commits on Oct 9, 2026

Commits on Oct 12, 2026

Commits on Oct 13, 2026

Commits on Oct 15, 2026