GH-32123: [R] Expose azure blob filesystem#49553

Draft

marberts wants to merge 108 commits intoapache:mainfrom

marberts:32123-expose-azure-blob-filesystem

Commits on Apr 1, 2026

Add AzureBlobFileSystem placeholder, verify devtools::document() behaves correctly.

Collinbrown95
authored and
marberts
committed
add simple test function to work through codegen.R

Collinbrown95
authored and
marberts
committed
temporarily "force" build DARROW_R_WITH_AZUREFS build flag.

Collinbrown95
authored and
marberts
committed
Added c++ stub
marberts
committed
Updated codegen
marberts
committed
Added a comment
marberts
committed
cleanup azurefs test function code

Collinbrown95
authored and
marberts
committed
document instructions to start local azurite container

Collinbrown95
authored and
marberts
committed
add arrow_with_azure helper following convention for s3/gcp

Collinbrown95
authored and
marberts
committed
add ARROW_AZURE flag to nixlibs.R

Collinbrown95
authored and
marberts
committed
debug first argument check

Collinbrown95
authored and
marberts
committed
Renamed R6 class correctly
marberts
committed
Added endpoint + key, token, and default authentication
marberts
committed
Finished logical for AzureFileSystem to match pyarrow
marberts
committed
standardize on ARROW_R_WITH_AZURE instead of ARROW_R_WITH_AZUREFS

Collinbrown95
authored and
marberts
committed
standardize on ARROW_R_WITH_AZURE

Collinbrown95
authored and
marberts
committed
Turn on ARROW_AZURE flag in nixlibs.R

Collinbrown95
authored and
marberts
committed
drop temporary arrow env var hack

Collinbrown95
authored and
marberts
committed
temporary documentation of what I've tried so far

Collinbrown95
authored and
marberts
committed
Add TODO note in configure script to remove hard-coded link flags

Collinbrown95
authored and
marberts
committed
initial filesystem tests

Collinbrown95
authored and
marberts
committed
uncomment line 256 of filesystem.cpp

Collinbrown95
authored and
marberts
committed
checkpoint: resolved segfault error

Collinbrown95
authored and
marberts
committed
skip test_filesystem tests that rely on being able to connect directly with URI with Azure.

Collinbrown95
authored and
marberts
committed
Add most test cases from test_filesystem and recreate a couple that were skipped because of the URI issue.

Collinbrown95
authored and
marberts
committed
rename az_bucket to az_container

Collinbrown95
authored and
marberts
committed
check that azurite is installed as precondition for test-azure.R script.

Collinbrown95
authored and
marberts
committed
add setup code to start azurite from the test-azure.R script, then kill the azurite process in a cleanup step.

Collinbrown95
authored and
marberts
committed
run air formatter

Collinbrown95
authored and
marberts
committed
add documentation to az_container.

Collinbrown95
authored and
marberts
committed
docs: Updated documentation for AzureFileSystem and updated vignette (#1)
marberts
committed
Updated installation vignettes to include Azure
marberts
committed
Updated install scripts
marberts
committed
add tests for valid and invalid combinations of options to AzureFileSystem$create method

Collinbrown95
authored and
marberts
committed
Ran pre-commit hooks
marberts
committed
Removed tmp.md
marberts
committed
wrap credential configuration methods with StopIfNotOk

Collinbrown95
authored and
marberts
committed
move link flags to arrow_built_with ARROW_AZURE block in configure script

Collinbrown95
authored and
marberts
committed
fix error message to check in test for empty call to AzureFileSystem$create()

Collinbrown95
authored and
marberts
committed
Updated docs to include libxml2
marberts
committed
add simple test function to work through codegen.R

Collinbrown95
authored and
marberts
committed
cleanup azurefs test function code

Collinbrown95
authored and
marberts
committed
Rerun exports
marberts
committed
Updated filesystem.cpp
marberts
committed
Updated build scripts
marberts
committed
Update configure.win: fix typo

Collinbrown95
authored and
marberts
committed
Updated CI setup scripts for windows
marberts
committed
Trying PKGBUILD and windows build script again
marberts
committed
Updated PKGBUILD
marberts
committed
debug ci: add azure dependencies that CI tries to build from source.

Collinbrown95
authored and
marberts
committed
Removed tmp.md
marberts
committed

Commits on Apr 4, 2026

add install script to build azure-sdk-for-cpp dependencies from source.
Collin Brown
committed

Commits on Apr 26, 2026

Add AzureBlobFileSystem placeholder, verify devtools::document() behaves correctly.

Collinbrown95
authored and
marberts
committed
add simple test function to work through codegen.R

Collinbrown95
authored and
marberts
committed
temporarily "force" build DARROW_R_WITH_AZUREFS build flag.

Collinbrown95
authored and
marberts
committed
Added c++ stub
marberts
committed
Updated codegen
marberts
committed
Added a comment
marberts
committed
cleanup azurefs test function code

Collinbrown95
authored and
marberts
committed
document instructions to start local azurite container

Collinbrown95
authored and
marberts
committed
add arrow_with_azure helper following convention for s3/gcp

Collinbrown95
authored and
marberts
committed
add ARROW_AZURE flag to nixlibs.R

Collinbrown95
authored and
marberts
committed
debug first argument check

Collinbrown95
authored and
marberts
committed
Renamed R6 class correctly
marberts
committed
Added endpoint + key, token, and default authentication
marberts
committed
Finished logical for AzureFileSystem to match pyarrow
marberts
committed
standardize on ARROW_R_WITH_AZURE instead of ARROW_R_WITH_AZUREFS

Collinbrown95
authored and
marberts
committed
standardize on ARROW_R_WITH_AZURE

Collinbrown95
authored and
marberts
committed
Turn on ARROW_AZURE flag in nixlibs.R

Collinbrown95
authored and
marberts
committed
drop temporary arrow env var hack

Collinbrown95
authored and
marberts
committed
temporary documentation of what I've tried so far

Collinbrown95
authored and
marberts
committed
Add TODO note in configure script to remove hard-coded link flags

Collinbrown95
authored and
marberts
committed
initial filesystem tests

Collinbrown95
authored and
marberts
committed
uncomment line 256 of filesystem.cpp

Collinbrown95
authored and
marberts
committed
checkpoint: resolved segfault error

Collinbrown95
authored and
marberts
committed
skip test_filesystem tests that rely on being able to connect directly with URI with Azure.

Collinbrown95
authored and
marberts
committed
Add most test cases from test_filesystem and recreate a couple that were skipped because of the URI issue.

Collinbrown95
authored and
marberts
committed
rename az_bucket to az_container

Collinbrown95
authored and
marberts
committed
check that azurite is installed as precondition for test-azure.R script.

Collinbrown95
authored and
marberts
committed
add setup code to start azurite from the test-azure.R script, then kill the azurite process in a cleanup step.

Collinbrown95
authored and
marberts
committed
run air formatter

Collinbrown95
authored and
marberts
committed
add documentation to az_container.

Collinbrown95
authored and
marberts
committed
docs: Updated documentation for AzureFileSystem and updated vignette (#1)
marberts
committed
Updated installation vignettes to include Azure
marberts
committed
Updated install scripts
marberts
committed
add tests for valid and invalid combinations of options to AzureFileSystem$create method

Collinbrown95
authored and
marberts
committed
Ran pre-commit hooks
marberts
committed
Removed tmp.md
marberts
committed
wrap credential configuration methods with StopIfNotOk

Collinbrown95
authored and
marberts
committed
move link flags to arrow_built_with ARROW_AZURE block in configure script

Collinbrown95
authored and
marberts
committed
fix error message to check in test for empty call to AzureFileSystem$create()

Collinbrown95
authored and
marberts
committed
Updated docs to include libxml2
marberts
committed
add simple test function to work through codegen.R

Collinbrown95
authored and
marberts
committed
cleanup azurefs test function code

Collinbrown95
authored and
marberts
committed
Updated filesystem.cpp
marberts
committed
Updated build scripts
marberts
committed
Update configure.win: fix typo

Collinbrown95
authored and
marberts
committed
Updated CI setup scripts for windows
marberts
committed
Trying PKGBUILD and windows build script again
marberts
committed
Updated PKGBUILD
marberts
committed
debug ci: add azure dependencies that CI tries to build from source.

Collinbrown95
authored and
marberts
committed
Removed tmp.md
marberts
committed

Commits on Apr 27, 2026

Commits on Apr 28, 2026

Disable azure in configure.win
marberts
committed

Commits on May 9, 2026