Skip to content

perf(decode): default gate/up to 1-row mmvq2_qwen + rmsnorm load elimination (sm_120)#188

Closed
thomasalvaedison7777-lgtm wants to merge 1 commit into
gittensor-ai-lab:mainfrom
thomasalvaedison7777-lgtm:perf/decode-gate-up-mmvq2-default
Closed

perf(decode): default gate/up to 1-row mmvq2_qwen + rmsnorm load elimination (sm_120)#188
thomasalvaedison7777-lgtm wants to merge 1 commit into
gittensor-ai-lab:mainfrom
thomasalvaedison7777-lgtm:perf/decode-gate-up-mmvq2-default