feat(zmq): vLLM DP>1 as grouped engine workers with least-loaded selection - #2087

Merged

slin1237 merged 11 commits into

mainfrom

Aug 13, 2026

Commits on Aug 11, 2026

feat(zmq): grouped vLLM DP workers with least-loaded engine selection
slin1237
committed
3565bda
feat(zmq): zmq_engine_count router knob for grouped startup workers
slin1237
committed
026471d
feat(zmq): grouped vLLM engine launch through CLI, bindings, and serve
slin1237
committed
2a96df9
test(zmq): pin least-loaded engine selection on the mock harness
slin1237
committed
1ef5662
test(zmq): 2-GPU grouped dp=2 e2e lane
slin1237
committed
c08bd7c
feat(zmq): adopt vLLM's DP scoring for unpinned engine selection
slin1237
committed
afdf16b
fix(zmq): review round - reservation rollback, tier-1 dp lane, append-at-end
slin1237
committed
9d49add
fix(zmq): wake a lockstep group unconditionally on every submit
slin1237
committed
d71f4af
fix(zmq): bump the wave clock on every lockstep wake
slin1237
committed
450866b
fix(zmq): key DP in-flight slots by request id, not by count
slin1237
committed
ee978b3
docs(zmq): give the dispatcher back its own doc comment
slin1237
committed
354491f