feat: pipeline-parallel hidden-state export, a patched vLLM image, and the K3 DSpark MLA draft - #165

Merged

torchspec-bot merged 8 commits into

mainfrom

export/vllm-pp-hidden-states

Aug 9, 2026

Commits on Aug 9, 2026

build(vllm): pin a nightly image whose models capture aux hidden states per PP stage
torchspec-bot
committed
4feb46c
feat(mooncake): write hidden states as per-PP-stage fragments and reassemble them
torchspec-bot
committed
0cd7a56
feat(vllm): configure pipeline parallelism, headless followers, and a per-stage capture gate
torchspec-bot
committed
0ff74a3
docs(vllm): add a pipeline-parallel training config and document building the patched image
torchspec-bot
committed
dc092d6
feat(models): load and train the published K3 DSpark MLA draft
torchspec-bot
committed
7f1e090
docs(configs): add the Kimi-K3 DSpark stage-1 training recipe
torchspec-bot
committed
74a7577
fix(models): build the YaRN rotary cache at the configured rope_theta
torchspec-bot
committed
c8314a5
fix: resolve rope_theta from wherever the config stores it (#166)
torchspec-bot
authored
d82382a