#

opensource-ai

Here is 1 public repository matching this topic...

kyegomez / Hedgehog

Implementation of the model "Hedgehog" from the paper: "The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry"

open-source ai ml attention multi-modal neural-nets feedforward softmax attention-is-all-you-need attention-mechanisms mlps ffns opensource-ai

Updated Mar 11, 2024
Python

Improve this page

Add a description, image, and links to the opensource-ai topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the opensource-ai topic, visit your repo's landing page and select "manage topics."