feat(optimizer): NVMe streaming of DistributedOptimizer state - #63

Merged

Zhichenzzz merged 12 commits into

yueming/nvme-streaming-optimizer

Jul 28, 2026

Commits on Jul 8, 2026

Add NVMe streaming optimizer state store (v1)
yueming-yuan
committed

Commits on Jul 9, 2026

Harden NVMe state store for large-model DP1
yueming-yuan
committed
NVMe store checkpointing: save/load bucket files with manifest (same-topology resume)
yueming-yuan
committed
Disambiguate store directories: chained optimizer instances can share instance_id
yueming-yuan
committed

Commits on Jul 21, 2026

Commits on Jul 22, 2026

Move NVMe optimizer-state store to miles side
Zhichenzzz
committed

Commits on Jul 25, 2026

Move the NVMe state store to miles, keep only the two checkpoint hooks
yueming-yuan
committed