Skip to content

perf(attn): cp.async double-buffered KV staging in GQA flash-decode split#187

Open
real-venus wants to merge 1 commit into
gittensor-ai-lab:mainfrom
real-venus:perf/flash-decode-cpasync-kv-staging
Open

perf(attn): cp.async double-buffered KV staging in GQA flash-decode split#187
real-venus wants to merge 1 commit into
gittensor-ai-lab:mainfrom
real-venus:perf/flash-decode-cpasync-kv-staging

Commits

Commits on Jul 3, 2026