Skip to content

Fix ChunkedKVCache dropping valid tokens during decode (llama4) - #1673

Open
binaydhakal wants to merge 1 commit into
ml-explore:mainfrom
binaydhakal:fix-chunked-kv-cache-decode
Open

Fix ChunkedKVCache dropping valid tokens during decode (llama4)#1673
binaydhakal wants to merge 1 commit into
ml-explore:mainfrom
binaydhakal:fix-chunked-kv-cache-decode

Commits

Commits on Aug 7, 2026