Add padded-buffer KV corruption reproductions - #338

Draft

i386 wants to merge 15 commits into

oxiglade:mainfrom

i386:kvcache-padded-buffer-bug

Commits on Mar 29, 2026

Add trim support to ConcatKeyValueCache
i386
committed
3549607
Add qwen2 model support
i386
committed
6d95787
Implement qwen2 attention and cache behavior
i386
committed
445e8ac
Initialize qwen2 kv caches by default
i386
committed
6ecc803
Use additive causal mask for qwen2 prefill
i386
committed
4d8a7da
Add KV cache for native qwen2 generation
i386
committed
73265df
Use causal mask fast path for qwen2 prefill
i386
committed
4cdae74
Preserve causal attention masks in qwen2
i386
committed
c3a1894
Fix qwen2 model input state type
i386
committed
fa8ac7b
Export attention mask type for qwen2 inputs
i386
committed
153a820
Force eval after qwen2 KV cache updates
i386
committed
e957ecc
Clone qwen2 KV cache prefix views before reuse
i386
committed
59dcfb6
Fix native qwen2 cached decode
i386
committed
bb134fb
Reuse qwen2 rope offset arrays per decode step
i386
committed
9647f60
Add KV padded-buffer corruption repro
i386
committed
58a056b