longformer, linformer, normalization modularity, extended activation functions#44

Merged

CCranney merged 28 commits intomainfrom

dev/longformer-attention

May 9, 2025

Commits on Apr 3, 2025

Commits on Apr 9, 2025

Merge pull request #39 from xomicsdatascience/main
CCranney
authored

Commits on Apr 10, 2025

Commits on May 1, 2025

Commits on May 3, 2025

fixed padding mask bug
CCranney
committed

Commits on May 6, 2025

Commits on May 7, 2025

Merge pull request #43 from xomicsdatascience/dev/expand-norm-and-activations
CCranney
authored

Commits on May 8, 2025

enable separate weights for global tokens in longformer
CCranney
committed