Skip to content

Support multi-threaded writing of Parquet files with modular encryption #7359

Open
@adamreeve

Description

@adamreeve

See https://github.com/apache/arrow-rs/pull/7111/files#r2015196618

#7111 adds support for writing Parquet files with modular encryption but this only works when using an ArrowWriter to write Arrow record batches. There isn't a way to implement concurrent writing of separate columns using an ArrowColumnWriter with encryption.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementAny new improvement worthy of a entry in the changelogparquetChanges to the parquet crate

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions