Repository navigation

feat(deepseek-v4): packed-sequence (THD) SFT — full model at 4k and 128k on 3 nodes - #1062

Merged

wenxie-amd merged 4 commits into

mainfrom

zhaobing/dev/deepseek-v4-thd-packed

Sep 1, 2026

Merged

feat(deepseek-v4): packed-sequence (THD) SFT — full model at 4k and 128k on 3 nodes#1062
wenxie-amd merged 4 commits into
mainfrom
zhaobing/dev/deepseek-v4-thd-packed

Commits on Sep 1, 2026
- feat(deepseek-v4): packed-sequence (THD) 128k SFT on gfx942
  
  zhaobing
  and
  claude
  committed
  0b938eb
- feat(deepseek-v4): packed-sequence (THD) recipes for the full model, single- and multi-node
  
  zhaobing
  and
  claude
  committed
  27a5860
- Merge branch 'main' into zhaobing/dev/deepseek-v4-thd-packed
  Xiaoming-AMD
  authored
  3f717e4
- fix(sft): keep segment_align out of HuggingFace load_dataset kwargs
  
  zhaobing
  and
  claude
  committed
  f8d7b1d