Skip to content

[WS1][CUDA][Qwen3-Next] TP4 GDN, convolution and D=256 attention mixers on real weights (RFC #428 stack 6/8) - #507

Open
fusheng-ji wants to merge 71 commits into
RL-Align:test-qwennextfrom
fusheng-ji:feat/ws1-qwen3-next-tp4-mixers
Open

[WS1][CUDA][Qwen3-Next] TP4 GDN, convolution and D=256 attention mixers on real weights (RFC #428 stack 6/8)#507
fusheng-ji wants to merge 71 commits into
RL-Align:test-qwennextfrom
fusheng-ji:feat/ws1-qwen3-next-tp4-mixers

Commits

  1. Commits on Oct 4, 2026

  2. Commits on Oct 6, 2026

  3. Commits on Oct 7, 2026

  4. Commits on Oct 8, 2026

  5. Commits on Oct 9, 2026

  6. Commits on Oct 10, 2026

  7. Commits on Oct 11, 2026