Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/columnar dataset python extension #699

Merged
merged 50 commits into from
Oct 1, 2024

Conversation

mgovers
Copy link
Member

@mgovers mgovers commented Aug 21, 2024

Adds the actual support for columnar dataset types in the Python API

Follow-up to #663

  • TODO's related to columnar data to be resolved

@mgovers mgovers added the feature New feature or request label Aug 21, 2024
@mgovers mgovers changed the base branch from main to feature/columnar-dataset-python-api August 21, 2024 13:16
Base automatically changed from feature/columnar-dataset-python-api to main August 21, 2024 13:17
@mgovers mgovers changed the base branch from main to feature/columnar-data-c-api September 13, 2024 10:23
Base automatically changed from feature/columnar-data-c-api to main September 17, 2024 07:27
@nitbharambe
Copy link
Member

nitbharambe commented Sep 19, 2024

When deserializing using an all columnar filter, the deserializer does not know what attributes are present in the given binary buffer. Hence buffers for all attributes are generated when ... data_filter is used.

Edit: Having empty columns is expected behavior
Edit2: Shall be addressed in separate PR as an optional argument in serializing

Signed-off-by: Nitish Bharambe <[email protected]>
Signed-off-by: Nitish Bharambe <[email protected]>
Signed-off-by: Nitish Bharambe <[email protected]>
@nitbharambe nitbharambe changed the base branch from main to fix/columnar-convert-mutable-to-const-1 September 23, 2024 09:03
Base automatically changed from fix/columnar-convert-mutable-to-const-1 to main September 24, 2024 08:48
Signed-off-by: Martijn Govers <[email protected]>
Signed-off-by: Martijn Govers <[email protected]>
Signed-off-by: Martijn Govers <[email protected]>
@mgovers mgovers mentioned this pull request Oct 1, 2024
mgovers and others added 5 commits October 1, 2024 09:21
…/columnar-dataset-python-mypy

Signed-off-by: Martijn Govers <[email protected]>
Signed-off-by: Martijn Govers <[email protected]>
Signed-off-by: Martijn Govers <[email protected]>
…re/columnar-dataset-python-mypy

Signed-off-by: Martijn Govers <[email protected]>
@mgovers mgovers enabled auto-merge October 1, 2024 08:34
figueroa1395
figueroa1395 previously approved these changes Oct 1, 2024
@mgovers mgovers added this pull request to the merge queue Oct 1, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to invalid changes in the merge commit Oct 1, 2024
@mgovers mgovers dismissed figueroa1395’s stale review October 1, 2024 09:36

The merge-base changed after approval.

figueroa1395
figueroa1395 previously approved these changes Oct 1, 2024
@mgovers mgovers dismissed figueroa1395’s stale review October 1, 2024 09:58

The merge-base changed after approval.

figueroa1395
figueroa1395 previously approved these changes Oct 1, 2024
@mgovers mgovers enabled auto-merge October 1, 2024 10:09
@mgovers mgovers dismissed figueroa1395’s stale review October 1, 2024 10:09

The merge-base changed after approval.

figueroa1395
figueroa1395 previously approved these changes Oct 1, 2024
@mgovers mgovers dismissed figueroa1395’s stale review October 1, 2024 10:31

The merge-base changed after approval.

Copy link

sonarqubecloud bot commented Oct 1, 2024

@mgovers mgovers added this pull request to the merge queue Oct 1, 2024
Merged via the queue into main with commit 2c0f663 Oct 1, 2024
26 checks passed
@mgovers mgovers deleted the feature/columnar-dataset-python-extension branch October 1, 2024 12:47
@mgovers mgovers mentioned this pull request Nov 5, 2024
27 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants