Skip to content

Fix ALiBi slopes for non-power-of-2 num_heads - #3071

Merged
awni merged 2 commits into
ml-explore:mainfrom
vovw:main
Jan 29, 2026
Merged

Fix ALiBi slopes for non-power-of-2 num_heads#3071
awni merged 2 commits into
ml-explore:mainfrom
vovw:main

refactor create_alibi_slope

27c1a32
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

The logs for this run have expired and are no longer available.