rebuild Hugging Face models for improved performance of newer llamafile #592
tomchiverton
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
https://huggingface.co/Mozilla/Mistral-7B-Instruct-v0.2-llamafile/tree/main for instance, predates the x10 to x100 performance boost from https://github.com/Mozilla-Ocho/llamafile/releases/tag/0.8.14
Beta Was this translation helpful? Give feedback.
All reactions