-
Notifications
You must be signed in to change notification settings - Fork 101
Use LEANN for local RAG #46
Copy link
Copy link
Open
Labels
area:embeddingsEmbedding model and transformers.jsEmbedding model and transformers.jsarea:searchSearch and vector queriesSearch and vector queriesenhancementNew feature or requestNew feature or request
Metadata
Metadata
Assignees
Labels
area:embeddingsEmbedding model and transformers.jsEmbedding model and transformers.jsarea:searchSearch and vector queriesSearch and vector queriesenhancementNew feature or requestNew feature or request
Is your feature request related to a problem? Please describe.
Not particularly. This is an improvement idea that could turn episodic memory into a much powerful tool by using a dedicated RAG db under the hood.
Describe the solution you'd like
The current sqlite provides a very simple approach to memory management, and has its clear limitations.
I recommend moving the project to build upon https://github.com/yichuan-w/LEANN
I've used it a few times already, and it performs really well, with very small storage needs for a vector-based solution.
Describe alternatives you've considered
Additional context