Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

consider using hnswlib for faster search... #172

Open
yeus opened this issue Jan 15, 2025 · 1 comment
Open

consider using hnswlib for faster search... #172

yeus opened this issue Jan 15, 2025 · 1 comment

Comments

@yeus
Copy link

yeus commented Jan 15, 2025

I am not sure, I think sqlite-vec is currently using brute-force?

consider using this library here:

https://github.com/nmslib/hnswlib

it would speed the search up a lot... it is header-only library which I imagine
wouldn't make it too hard, integrating it with sqlite-vec? This library also works with WASM.

I would be glad to help with this project! I love this sqlite extension and that its possible to use as WASM.

@asg017
Copy link
Owner

asg017 commented Jan 23, 2025

Thanks for filing an issue!

Yes sqlite-vec is currently brute-force only. We'll add an ANN index soon, details in #25 .

No matter which ANN index we pick, it'll be built from scratch in C, to keep dependencies low and keep it cross-platform. hnswlib is great, but it won't fit for this project

That being said, vectorlite is a SQLite extension that uses hnswlib under the hood, if you want to take a look at other options!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants