Skip to content

[None][fix] Size the cross-attention KV cache from the encoder's decl… - #19516

Closed
ravo42-maker wants to merge 3 commits into
NVIDIA:mainfrom
ravo42-maker:fix/cross-kv-encoder-length
Closed

ravo42-maker wants to merge 3 commits into
NVIDIA:mainfrom
ravo42-maker:fix/cross-kv-encoder-length

[None][test] Cover max_input_len precedence over the explicit fallback

7761266
Select commit
Loading
Failed to load commit list.