Skip to content

Fix ALiBi slopes for non-power-of-2 num_heads - #3071

Merged
awni merged 2 commits into
ml-explore:mainfrom
vovw:main
Jan 29, 2026
Merged

Fix ALiBi slopes for non-power-of-2 num_heads#3071
awni merged 2 commits into
ml-explore:mainfrom
vovw:main

Commits

Commits on Jan 27, 2026

Commits on Jan 29, 2026