Skip to content

fix(vllm-frontend): report real KV capacity for engines that publish it#475

Merged
xiaguan merged 2 commits into
openinfer-project:mainfrom
FeathBow:fix/vllm-frontend-real-kv-ready
Jun 30, 2026
Merged

fix(vllm-frontend): report real KV capacity for engines that publish it#475
xiaguan merged 2 commits into
openinfer-project:mainfrom
FeathBow:fix/vllm-frontend-real-kv-ready