Skip to content

fix(qwen3): cap PerToken CUDA Graph buckets - #848

Open
RicardoMin wants to merge 4 commits into
pegainfer-project:mainfrom
RicardoMin:fix/qwen3-pertoken-graph-memory-780
Open

fix(qwen3): cap PerToken CUDA Graph buckets#848
RicardoMin wants to merge 4 commits into
pegainfer-project:mainfrom
RicardoMin:fix/qwen3-pertoken-graph-memory-780

fix(qwen3): bound PerToken CUDA graph memory

824f5d8
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Commit attribution notice
succeeded Aug 8, 2026 in 5s