Skip to content

bug: Slow vector parameter pass #664

Open
@azevaykin

Description

@azevaykin

Bug Report

YDB Python SDK version: 3.21.1
Python version: 3.8.10
OS: Linux-5.4.210-39.1.pagevecsize-x86_64-with-glibc2.29

Behavior:

  1. When I pass a vector to the query as a list, I have 127 RPS.
  2. When I pass a vector to the query as a string, I have 617 RPS.

First way is the default way in YDB vector search. It's used in langchain-ydb. But it's slower.
Second way is undocumented way but it's much faster.

In C++ SDK we have numbers: 810 and 860 RPS.

Please, fix vector pass as a list in python SDK. 127 RPS is too slow.

See an example in the attached python file: vector-parameter.py.

You can change behaviour by these lines:

MODE = "list"
# MODE = "string"

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions