You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Refactoring of backend for local-first storage solution (7ff45e7)
BREAKING CHANGES
Introduction of 2 new backends, alteration of interfaces, removal of FAISS as a standalone backend.
Support of SQLiteVecBackend and PGVectorEmbeddingBackend with common interfaces and methods for storage and retrieval
Unified ORM for both backends and associated tables for easy interaction using SQLAlchemy
Standardised embedding storage table and ModelRegistry
Enforcement of a singular IndexType per model to streamline ingestion and retrieval. CLI interfaces to update IndexType are provided.
Improved CLI maintenance modules
Default IndexType.FLAT ingestion to accelerate bulk ingestion and interfaces for creating, modifying and deleting indices
FAISS: demoted from ground truth to read-acceleration, per-index staleness tracking via .json sidecars, import-faiss-cache CLI for round-tripping, transparent fast path in EmbeddingReaderInterface via faiss_cache_dir
temporary table JOINs replacing IN (...) clauses across both backends
prevent the hard-capped limit for each dialect
optional packages with pgvector backend and faiss export
fail at import time with install hint (omop-emb[pgvector], omop-emb[faiss-cpu])
