Skip to content

[WS1][CUDA][Qwen3-Next] TP4 GDN, convolution and D=256 attention mixers on real weights (RFC #428 stack 6/8) - #507

Open
fusheng-ji wants to merge 71 commits into
RL-Align:test-qwennextfrom
fusheng-ji:feat/ws1-qwen3-next-tp4-mixers
Open

fusheng-ji wants to merge 71 commits into
RL-Align:test-qwennextfrom
fusheng-ji:feat/ws1-qwen3-next-tp4-mixers

fix(qwen3-next): type annotations for mypy in the attention prior-art…

fac8f92
Select commit
Loading
Failed to load commit list.