Update redisearch base client to include timeout. Minor improvements on general latency and exported metrics #1

filipecosta90 · 2023-07-04T22:56:59Z

No description provided.

…trics to include p50

This reverts commit dcdfe21.

… setups

…atches of 32 vectors

…vector-db-benchmark into update.redisearch

… cluster is ready/alive before benchmark

…stion to avoid bad state

This reverts commit 9641080.

Redis Vector Sets support

Fixing scalability issues with vector db benchmark

This reverts commit 85a6bc7, reversing changes made to ba175b1.

cd /home/fco/redislabs/vector-db-benchmark && git add engine/base_client/search.py engine/base_client/client.py chunk up the iterable before starting the processes

…tion

…imizations Restore performance optimizations

…ts with --skip-search --skip-upload (#22) * Add script for creating vectorsets configuration, do not flush database on init, make noquant default * Add topKs to create-vectorsets script * Add get_memory_usage function to vectorsets * Add empty line

Also record end time immediately after obtaining results, before joining the processes. Also remove progress bar because all processes do not report intermediate progress and all processes finish in a similar time.

filipecosta90 and others added 30 commits July 4, 2023 17:56

Update redisearch base client to include timeout. Extended latency me…

17ef49e

…trics to include p50

Included batch_size and parallel info in upload results

1e8e719

Enable passing env variables for url and api_key qdrant parameters

084a68a

Print ef info if available in config

d890fa1

waiting on full index before return qdrant

dcdfe21

Revert "waiting on full index before return qdrant"

a1ba1b1

This reverts commit dcdfe21.

Added REDIS_QUERY_TIMEOUT config parameter

87b0330

Introduced MILVUS_USER and MILVUS_PASS env vars

435038a

Introduce MILVUS_PORT env variable

f4e49be

Simplify milvus port settings

42133d0

Added missing milvus env variables on configure file

ee7cb9b

specify milvus uri when http is detected

dfefb49

wrap milvus upload_batch with backoff

9766207

Enabled using the API_KEY of weaviate and detecting secure connection…

9ad6022

… setups

Only printing ef in search parameters if it's available

4e1408a

Simplified weviate client construct

824f17a

fix NameError on weviate search.py

31b2a18

Update weviate client to include multi-tenant schema check fix

909594d

Specify batch_size (and reduce from 64 to 32) on milvus configs.

42fc051

Updating milvus upload params from 16 to 4 concurrent clients doing b…

228b10d

…atches of 32 vectors

Cleanup on milvus client

55f91c2

Change recall computation to be as ann-benchmarks'

9641080

Merge branch 'update.redisearch' of https://github.com/filipecosta90/…

666de49

…vector-db-benchmark into update.redisearch

Reducing weaviate batch size due to recurrent ingest errors. ensuring…

e108874

… cluster is ready/alive before benchmark

Reducing milvus batch size to ensure a steady ingestion

60360ad

Increasing timeout config for weaviate. Reduce parallel count on inge…

832fc86

…stion to avoid bad state

Added single client weviate config

f8b4b7a

Added single client weviate config

c10df6d

Revert "Change recall computation to be as ann-benchmarks'"

32b4c6e

This reverts commit 9641080.

Included single segment config for qdrant

0559dd4

filipecosta90 and others added 30 commits March 31, 2025 13:12

fixed missing } on hybrid policy

0e9f9ad

fixed missing } on hybrid policy

4aef017

fixed missing } on hybrid policy

92dee85

adding laion dataset'

312547d

adding laion dataset 1M

0c36709

chunk up the iterable before starting the processes

3b5e2c9

replace arbitrary 15 sec wait with barrier

92b4ddb

fixed chunk to correct size

deaf5ab

implemented custom process management , instead of using pool

4c1d080

measure time only during the critical work

0d513c2

Merge branch 'update.redisearch' into fix-sync

12868aa

Add itertools before islice function

2c592a0

update vset tests

83e3f3e

adding q8

2f1a6fb

Merge pull request #17 from redis-performance/dvirdu_vectorsets

ba175b1

Redis Vector Sets support

Merge pull request #16 from mpozniak95/fix-sync

85a6bc7

Fixing scalability issues with vector db benchmark

Revert "Merge pull request #16 from mpozniak95/fix-sync"

20cea00

This reverts commit 85a6bc7, reversing changes made to ba175b1.

Optimize client imports to only load engines specified in command line

8a21508

Add --queries option to specify number of queries to run

075c5c0

Add --ef-runtime option to filter search experiments by ef values

a8d26cd

cd /home/fco/redislabs/vector-db-benchmark && git status

0209d91

cd /home/fco/redislabs/vector-db-benchmark && git add engine/base_client/search.py engine/base_client/client.py chunk up the iterable before starting the processes

Restore performance optimizations from PR #16 (85a6bc7)

534de8c

Add real-time progress bar with throughput display for parallel execu…

71c1f3b

…tion

Add test script for multiprocessing with progress bar

2eda5b7

Optimize query cycling for large query counts using generators

6127e84

Update test script to test query cycling optimization

343e906

Merge pull request #18 from redis-performance/restore-performance-opt…

25ca5ac

…imizations Restore performance optimizations

Add SVS support (#23)

7640df0

Record start time before query processing starts (#21)

878f46d

Also record end time immediately after obtaining results, before joining the processes. Also remove progress bar because all processes do not report intermediate progress and all processes finish in a similar time.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Update redisearch base client to include timeout. Minor improvements on general latency and exported metrics #1

Update redisearch base client to include timeout. Minor improvements on general latency and exported metrics #1

Uh oh!

filipecosta90 commented Jul 4, 2023

Uh oh!

Uh oh!

Update redisearch base client to include timeout. Minor improvements on general latency and exported metrics #1

Are you sure you want to change the base?

Update redisearch base client to include timeout. Minor improvements on general latency and exported metrics #1

Uh oh!

Conversation

filipecosta90 commented Jul 4, 2023

Uh oh!

Uh oh!