Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

.Net: Vector store abstractions hybrid search ADR #10196

Draft
wants to merge 54 commits into
base: main
Choose a base branch
from
Draft
Changes from 1 commit
Commits
Show all changes
54 commits
Select commit Hold shift + click to select a range
f19e88e
Add initial hybrid ADR doc.
westey-m Dec 3, 2024
531d220
Add sparse data model row.
westey-m Dec 3, 2024
5819cfb
Add cosmosdb nosql and mongo db to comparison. Add FusionMethod optio…
westey-m Jan 15, 2025
26eaa82
Fix typo
westey-m Jan 15, 2025
e6e1819
Fix more typos.
westey-m Jan 15, 2025
174cbd1
TF-IDF .net link
westey-m Jan 15, 2025
bab8740
Add another decision to adr and improve formatting.
westey-m Jan 17, 2025
5f119ce
Add more keyword param options
westey-m Jan 20, 2025
c56ffb7
Merge branch 'main' into vector-store-hybrid-adr
westey-m Jan 20, 2025
165cac1
Add Azure AI Search implementation and common keyword hybrid tests.
westey-m Jan 20, 2025
92853ee
Merge branch 'main' into vector-store-hybrid-adr
westey-m Jan 20, 2025
ac95190
Add ability to choose text property for hybrid azure ai search.
westey-m Jan 20, 2025
fee9651
Fix namespace issue.
westey-m Jan 22, 2025
3d58e63
Merge branch 'main' into vector-store-hybrid-adr
westey-m Jan 22, 2025
a68afec
Merge branch 'main' into vector-store-hybrid-adr
westey-m Jan 23, 2025
a920489
Update ADR with suggestions from pr and other improvements.
westey-m Jan 23, 2025
c153aa9
Add options around index required params.
westey-m Jan 23, 2025
cb358fb
Add support for azure cosmos db nosql hybrid search, without configur…
westey-m Jan 24, 2025
589528a
Fix typos.
westey-m Jan 24, 2025
f85e098
Fix typo
westey-m Jan 24, 2025
c774af9
Add a comparison of keyword matching behaviors between different DBs.
westey-m Jan 28, 2025
585405a
Add a qdrant hybrid search implementation
westey-m Jan 28, 2025
f7a65bc
Fix typo
westey-m Jan 28, 2025
c09e36a
Clarify "either" option further and fix typo.
westey-m Jan 29, 2025
a2b38d4
Add weaviate hybrid search implementation
westey-m Jan 31, 2025
424806a
Update ADR with postgres info
westey-m Jan 31, 2025
f567ebb
Update ADR with more info on keyword splitting.
westey-m Jan 31, 2025
0cc7494
Fix weaviate hybrid search score bug.
westey-m Jan 31, 2025
5fa5a24
Merge branch 'main' into vector-store-hybrid-adr
westey-m Feb 4, 2025
5b49efe
Fix weaviate unit test
westey-m Feb 4, 2025
8712882
Adding collection of keywords hybrid search overload
westey-m Feb 4, 2025
c790be5
Add mongo db hybrid search.
westey-m Feb 5, 2025
4f40559
Fix test
westey-m Feb 5, 2025
bccfddf
Switch cosmosdb nosql away from keyword parameter since it's not yet …
westey-m Feb 5, 2025
9b4b35d
Fix cosmos db nosql unit test
westey-m Feb 5, 2025
b541093
Change description param to searchtext as per pr suugestion
westey-m Feb 5, 2025
49e3cbf
Remove dense from naming, and remove single keyword hybrid search ove…
westey-m Feb 6, 2025
da99b31
Add updates from ADR Review to document.
westey-m Feb 6, 2025
b05c0ff
Update text property option to also throw if mulitple matches exist.
westey-m Feb 6, 2025
3e2c06f
Change hybrid search tests for azure ai search to use machine name po…
westey-m Feb 6, 2025
4244822
Remove FusionMethod until required, since only two DBs that we suppor…
westey-m Feb 6, 2025
46a97c7
Remove fusion method from remaining ADR locations.
westey-m Feb 6, 2025
547acd5
Rename TextPropertyName to FullTextPropertyName to indicate that it m…
westey-m Feb 6, 2025
4114ac0
Merge branch 'main' into vector-store-hybrid-adr
westey-m Feb 6, 2025
e266bdb
Add attributes to exclude azure ai search integration tests automatic…
westey-m Feb 6, 2025
11543b3
Address pr comments.
westey-m Feb 7, 2025
dc52964
Update xml doc for hybrid search method.
westey-m Feb 11, 2025
8c00934
Improve xml doc comment
westey-m Feb 11, 2025
722e9fb
Update ADR with more naming options.
westey-m Feb 11, 2025
73cfc20
Update Qdrant and Weaviate for PR
westey-m Feb 12, 2025
20d24b1
Update CosmosDBNoSQL for pr.
westey-m Feb 13, 2025
99ffa72
Add mongo db pre-pr fixes.
westey-m Feb 13, 2025
ab7b07d
Fixes for NoSql PR
westey-m Feb 17, 2025
3d5eeb3
Add azure cosmosdb MongoDB hybrid keyword search support. Missing the…
westey-m Feb 18, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix typo
westey-m committed Jan 24, 2025
commit f85e098f7575a90ab53a8e5d3b0e7ae28c9d1acc
2 changes: 1 addition & 1 deletion docs/decisions/00NN-hybrid-search.md
Original file line number Diff line number Diff line change
@@ -336,7 +336,7 @@ This language would then be used for all full text search indexes created by the

Add a property bag to the VectorStoreRecordProperty allowing database specific metadata to be provided.
Add an abstract base attribute that can be inherited from that allows extra metadata to be added to the data model,
where each database has their own attributes to specificy their settings, with a method to convert the contents to
where each database has their own attributes to specify their settings, with a method to convert the contents to
the property bag required by VectorStoreRecordProperty.

- Pros: Allows multiple languages to be used for different fields in one record