@@ -40,23 +40,24 @@ pip install "pyiceberg[s3fs,hive]"
4040
4141You can mix and match optional dependencies depending on your needs:
4242
43- | Key | Description: |
44- | ------------ | ------------------------------------------------------------------------- |
45- | hive | Support for the Hive metastore |
46- | glue | Support for AWS Glue |
47- | dynamodb | Support for AWS DynamoDB |
48- | sql-postgres | Support for SQL Catalog backed by Postgresql |
49- | sql-sqlite | Support for SQL Catalog backed by SQLite |
50- | pyarrow | PyArrow as a FileIO implementation to interact with the object store |
51- | pandas | Installs both PyArrow and Pandas |
52- | duckdb | Installs both PyArrow and DuckDB |
53- | ray | Installs PyArrow, Pandas, and Ray |
54- | daft | Installs Daft |
55- | s3fs | S3FS as a FileIO implementation to interact with the object store |
56- | adlfs | ADLFS as a FileIO implementation to interact with the object store |
57- | snappy | Support for snappy Avro compression |
58- | gcsfs | GCSFS as a FileIO implementation to interact with the object store |
59- | rest-sigv4 | Support for generating AWS SIGv4 authentication headers for REST Catalogs |
43+ | Key | Description: |
44+ | ---------------| ---------------------------------------------------------------------------|
45+ | hive | Support for the Hive metastore |
46+ | hive-kerberos | Support for Hive metastore in Kerberos environment |
47+ | glue | Support for AWS Glue |
48+ | dynamodb | Support for AWS DynamoDB |
49+ | sql-postgres | Support for SQL Catalog backed by Postgresql |
50+ | sql-sqlite | Support for SQL Catalog backed by SQLite |
51+ | pyarrow | PyArrow as a FileIO implementation to interact with the object store |
52+ | pandas | Installs both PyArrow and Pandas |
53+ | duckdb | Installs both PyArrow and DuckDB |
54+ | ray | Installs PyArrow, Pandas, and Ray |
55+ | daft | Installs Daft |
56+ | s3fs | S3FS as a FileIO implementation to interact with the object store |
57+ | adlfs | ADLFS as a FileIO implementation to interact with the object store |
58+ | snappy | Support for snappy Avro compression |
59+ | gcsfs | GCSFS as a FileIO implementation to interact with the object store |
60+ | rest-sigv4 | Support for generating AWS SIGv4 authentication headers for REST Catalogs |
6061
6162You either need to install ` s3fs ` , ` adlfs ` , ` gcsfs ` , or ` pyarrow ` to be able to fetch files from an object store.
6263
0 commit comments