Repository navigation

feat(frontends): add the llm-d router - #45

Open

cquil11 wants to merge 25 commits into

mainfrom

feat/llm-d-frontend

Open

feat(frontends): add the llm-d router#45
cquil11 wants to merge 25 commits into
mainfrom
feat/llm-d-frontend

Commits on Oct 8, 2026
- feat(frontends): add the llm-d router
  cquil11
  committed
  8420094
- fix(llm-d): answer /metrics at Envoy instead of routing it to a worker
  cquil11
  committed
  90632aa
- chore(llm-d): add NVIDIA SPDX headers to llm-d files
  cquil11
  committed
  f847fc7
- feat(llm-d): route to DP ranks and by the workers' KV-cache events
  cquil11
  committed
  ab0b08f
- feat(llm-d): run the no-Kubernetes guide's scorers without an epp_config
  cquil11
  committed
  1c3080e
- feat(llm-d): run the P/D sidecar for NIXL inside a MultiConnector
  cquil11
  committed
  d04b5d2
- docs(llm-d): describe DP-rank and KV-event routing and offloaded tiers
  cquil11
  committed
  1ac5bc6
- fix(llm-d): type-check the sidecar's default command after the upstream sync
  cquil11
  committed
  35234a6
- fix(llm-d): reject unsupported nginx readiness topology
  cquil11
  committed
  9d5cb47
- fix(vllm): include context parallelism in DP rank placement
  cquil11
  committed
  bd53c28
- fix(tests): distinguish subscriber destinations from listener ports
  cquil11
  committed
  c00ec85
- refactor(vllm): share effective KV connector resolution
  cquil11
  committed
  3138690
- refactor(llm-d): rename the Envoy template to llm_d_envoy.yaml.j2
  cquil11
  committed
  41616ad
- fix(llm-d): load the renamed Envoy template
  cquil11
  committed
  9fe40b6
- docs(llm-d): tighten implementation comments
  cquil11
  committed
  35637e8
- fix(llm-d): reject frontend.epp_config on other frontends
  cquil11
  committed
  2c093c0
- fix(llm-d): reject unsupported and conflicting configuration
  cquil11
  committed
  01947da
- chore: keep upstream's CODEOWNERS
  cquil11
  committed
  1f0836d
- chore: drop the fork's launch-plan recording from the llm-d branch
  cquil11
  committed
  28f34b8
- refactor(vllm): expose DP mode to frontends
  cquil11
  committed
  e475df0
- refactor: read typed process DP ranks directly
  cquil11
  committed
  f33d6ee
- refactor(llm-d): validate EPP arguments only at config load
  cquil11
  committed
  bdd7ddd
- refactor(llm-d): centralize and document KV event port offsets
  cquil11
  committed
  572a844
Commits on Oct 9, 2026
- docs(llm-d): pin upstream references to llm-d-router v0.10.0
  cquil11
  committed
  e238f6a
- test: give worker-stage fake processes a dp_rank
  cquil11
  committed
  e4f5c0e

Commits

Commits on Oct 8, 2026

Commits on Oct 9, 2026