Skip to content

Comments

AttentionSmithy Code Review#1

Open
CCranney wants to merge 168 commits intoreview/attention-smithy-code-reviewfrom
main
Open

AttentionSmithy Code Review#1
CCranney wants to merge 168 commits intoreview/attention-smithy-code-reviewfrom
main

Conversation

@CCranney
Copy link
Member

No description provided.

CCranney added 30 commits April 10, 2025 15:46
rotary custom embedding dimension error fix
…ivations

Dev/expand norm and activations
longformer, linformer, normalization modularity, extended activation functions
…tion

adding squared relu activation function
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants