Skip to content

Add request-owned eight-way MTP serving for Qwen 35B - #245

Open
davidtai wants to merge 22 commits into
youssofal:mainfrom
davidtai:fix/ar-batch-filter-fail-closed
Open

Add request-owned eight-way MTP serving for Qwen 35B#245
davidtai wants to merge 22 commits into
youssofal:mainfrom
davidtai:fix/ar-batch-filter-fail-closed

Key vLLM Metal cache by MLX ABI

c15903e
Select commit
Loading
Failed to load commit list.
Sign in for the full log view