Skip to content

Use LEANN for local RAG #46

@nagyv

Description

@nagyv

Is your feature request related to a problem? Please describe.

Not particularly. This is an improvement idea that could turn episodic memory into a much powerful tool by using a dedicated RAG db under the hood.

Describe the solution you'd like

The current sqlite provides a very simple approach to memory management, and has its clear limitations.

I recommend moving the project to build upon https://github.com/yichuan-w/LEANN

I've used it a few times already, and it performs really well, with very small storage needs for a vector-based solution.

Describe alternatives you've considered

  • Staying with the current solution
  • Using a heavyweight vector-db that would likely require its dedicated infra or cloud service

Additional context

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:embeddingsEmbedding model and transformers.jsarea:searchSearch and vector queriesenhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions