feat: reuse KV cache across chat turns (recurrent / hybrid / SWA + multimodal) - #367

Merged

jhen0409 merged 8 commits into

mybigday:mainfrom

a-ghorbani:feat/kv-cache-reuse

Jul 18, 2026

Commits on Jul 14, 2026

feat: reuse the KV cache across chat turns on recurrent/hybrid/SWA models
a-ghorbani
committed
725f0d6
test: KV-cache reuse suite and device benchmark harness
a-ghorbani
committed
e75ff5a
fix: quote the CMake generator in the Hexagon HTP build script
a-ghorbani
committed
1e12b60
test: cover slot-path media + absolute trim/double-decode probe
a-ghorbani
committed
b041fa3
fix(mtmd): reuse media KV across turns without re-encoding the image
a-ghorbani
committed
1d44f86
test(mtmd): vision arch matrix + media-path double-decode probe
a-ghorbani
committed
d806145

Commits on Jul 15, 2026

fix(jsi): fix lambda capture of state_cache params in initContext
a-ghorbani
committed
b97b0e7

Commits on Jul 18, 2026

fix: prevent stale multimodal cache reuse
jhen0409
committed
b09040b