Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
110 commits
Select commit Hold shift + click to select a range
262d267
Add AzureBlobFileSystem placeholder, verify devtools::document() beha…
Collinbrown95 Mar 3, 2026
7c753b7
add simple test function to work through codegen.R
Collinbrown95 Mar 5, 2026
b25de5e
temporarily "force" build DARROW_R_WITH_AZUREFS build flag.
Collinbrown95 Mar 5, 2026
f0400ee
Added c++ stub
marberts Mar 5, 2026
5ce9fb0
Updated codegen
marberts Mar 5, 2026
eda0eb4
Added a comment
marberts Mar 5, 2026
9b5429d
cleanup azurefs test function code
Collinbrown95 Mar 5, 2026
cf574ff
document instructions to start local azurite container
Collinbrown95 Mar 5, 2026
b5e301c
add arrow_with_azure helper following convention for s3/gcp
Collinbrown95 Mar 5, 2026
09a58a8
add ARROW_AZURE flag to nixlibs.R
Collinbrown95 Mar 5, 2026
68ad5eb
debug first argument check
Collinbrown95 Mar 5, 2026
7406a6c
Renamed R6 class correctly
marberts Mar 11, 2026
be95eb6
Added endpoint + key, token, and default authentication
marberts Mar 11, 2026
b287725
Finished logical for AzureFileSystem to match pyarrow
marberts Mar 11, 2026
ea9b36e
standardize on ARROW_R_WITH_AZURE instead of ARROW_R_WITH_AZUREFS
Collinbrown95 Mar 13, 2026
c05d0fc
standardize on ARROW_R_WITH_AZURE
Collinbrown95 Mar 13, 2026
bbc9483
Turn on ARROW_AZURE flag in nixlibs.R
Collinbrown95 Mar 13, 2026
8d5828d
drop temporary arrow env var hack
Collinbrown95 Mar 13, 2026
0b716d1
temporary documentation of what I've tried so far
Collinbrown95 Mar 13, 2026
ab3231f
Add TODO note in configure script to remove hard-coded link flags
Collinbrown95 Mar 13, 2026
183c81a
initial filesystem tests
Collinbrown95 Mar 14, 2026
f6ba049
uncomment line 256 of filesystem.cpp
Collinbrown95 Mar 15, 2026
18415a7
checkpoint: resolved segfault error
Collinbrown95 Mar 15, 2026
6c2230c
skip test_filesystem tests that rely on being able to connect directl…
Collinbrown95 Mar 15, 2026
1a2951b
Add most test cases from test_filesystem and recreate a couple that w…
Collinbrown95 Mar 15, 2026
c2ba7fd
rename az_bucket to az_container
Collinbrown95 Mar 15, 2026
3f8a31c
check that azurite is installed as precondition for test-azure.R script.
Collinbrown95 Mar 15, 2026
4624fe8
add setup code to start azurite from the test-azure.R script, then ki…
Collinbrown95 Mar 15, 2026
16c1ddf
run air formatter
Collinbrown95 Mar 15, 2026
e751769
add documentation to az_container.
Collinbrown95 Mar 15, 2026
9ef4990
docs: Updated documentation for AzureFileSystem and updated vignette …
marberts Mar 17, 2026
2a9e153
Updated installation vignettes to include Azure
marberts Mar 18, 2026
dd1d118
Updated install scripts
marberts Mar 18, 2026
e465b6d
add tests for valid and invalid combinations of options to AzureFileS…
Collinbrown95 Mar 18, 2026
212d9cf
Ran pre-commit hooks
marberts Mar 19, 2026
2d78fed
Removed tmp.md
marberts Mar 19, 2026
c8437a2
wrap credential configuration methods with StopIfNotOk
Collinbrown95 Mar 19, 2026
d908ca5
move link flags to arrow_built_with ARROW_AZURE block in configure sc…
Collinbrown95 Mar 19, 2026
e31db25
fix error message to check in test for empty call to AzureFileSystem$…
Collinbrown95 Mar 19, 2026
49c1cd7
Updated docs to include libxml2
marberts Mar 24, 2026
8ec6357
add simple test function to work through codegen.R
Collinbrown95 Mar 5, 2026
1a6f1e8
cleanup azurefs test function code
Collinbrown95 Mar 5, 2026
8755ca2
Rerun exports
marberts Mar 25, 2026
ae11517
Updated filesystem.cpp
marberts Mar 25, 2026
577fbdf
Updated build scripts
marberts Mar 25, 2026
93504d6
Update configure.win: fix typo
Collinbrown95 Mar 25, 2026
29b739f
Updated CI setup scripts for windows
marberts Mar 27, 2026
c0182fd
Trying PKGBUILD and windows build script again
marberts Mar 27, 2026
482e26a
Updated PKGBUILD
marberts Mar 27, 2026
bb44e20
debug ci: add azure dependencies that CI tries to build from source.
Collinbrown95 Mar 29, 2026
8cd7e27
Removed tmp.md
marberts Apr 1, 2026
f224990
add install script to build azure-sdk-for-cpp dependencies from source.
Apr 4, 2026
a456472
Add AzureBlobFileSystem placeholder, verify devtools::document() beha…
Collinbrown95 Mar 3, 2026
f158a51
add simple test function to work through codegen.R
Collinbrown95 Mar 5, 2026
e257c5a
temporarily "force" build DARROW_R_WITH_AZUREFS build flag.
Collinbrown95 Mar 5, 2026
0d3ee6e
Added c++ stub
marberts Mar 5, 2026
1bbe524
Updated codegen
marberts Mar 5, 2026
8fa2e01
Added a comment
marberts Mar 5, 2026
0b985c5
cleanup azurefs test function code
Collinbrown95 Mar 5, 2026
cbe4215
document instructions to start local azurite container
Collinbrown95 Mar 5, 2026
20fc215
add arrow_with_azure helper following convention for s3/gcp
Collinbrown95 Mar 5, 2026
10f1ba8
add ARROW_AZURE flag to nixlibs.R
Collinbrown95 Mar 5, 2026
2c5d645
debug first argument check
Collinbrown95 Mar 5, 2026
4d9d1b8
Renamed R6 class correctly
marberts Mar 11, 2026
4d3665c
Added endpoint + key, token, and default authentication
marberts Mar 11, 2026
002dbf4
Finished logical for AzureFileSystem to match pyarrow
marberts Mar 11, 2026
cf906c6
standardize on ARROW_R_WITH_AZURE instead of ARROW_R_WITH_AZUREFS
Collinbrown95 Mar 13, 2026
4f5684b
standardize on ARROW_R_WITH_AZURE
Collinbrown95 Mar 13, 2026
734a93d
Turn on ARROW_AZURE flag in nixlibs.R
Collinbrown95 Mar 13, 2026
31497a5
drop temporary arrow env var hack
Collinbrown95 Mar 13, 2026
9cc5641
temporary documentation of what I've tried so far
Collinbrown95 Mar 13, 2026
200df49
Add TODO note in configure script to remove hard-coded link flags
Collinbrown95 Mar 13, 2026
c64e3fe
initial filesystem tests
Collinbrown95 Mar 14, 2026
00ec254
uncomment line 256 of filesystem.cpp
Collinbrown95 Mar 15, 2026
3185eb5
checkpoint: resolved segfault error
Collinbrown95 Mar 15, 2026
a91abc8
skip test_filesystem tests that rely on being able to connect directl…
Collinbrown95 Mar 15, 2026
dee8d83
Add most test cases from test_filesystem and recreate a couple that w…
Collinbrown95 Mar 15, 2026
5024eb8
rename az_bucket to az_container
Collinbrown95 Mar 15, 2026
d788709
check that azurite is installed as precondition for test-azure.R script.
Collinbrown95 Mar 15, 2026
d0b6a18
add setup code to start azurite from the test-azure.R script, then ki…
Collinbrown95 Mar 15, 2026
9ee8e0d
run air formatter
Collinbrown95 Mar 15, 2026
b959f1e
add documentation to az_container.
Collinbrown95 Mar 15, 2026
7286ec5
docs: Updated documentation for AzureFileSystem and updated vignette …
marberts Mar 17, 2026
26116f7
Updated installation vignettes to include Azure
marberts Mar 18, 2026
f73a158
Updated install scripts
marberts Mar 18, 2026
c0aaeba
add tests for valid and invalid combinations of options to AzureFileS…
Collinbrown95 Mar 18, 2026
9f6ad93
Ran pre-commit hooks
marberts Mar 19, 2026
43960c6
Removed tmp.md
marberts Mar 19, 2026
f75a277
wrap credential configuration methods with StopIfNotOk
Collinbrown95 Mar 19, 2026
7dd1dc0
move link flags to arrow_built_with ARROW_AZURE block in configure sc…
Collinbrown95 Mar 19, 2026
657ccf4
fix error message to check in test for empty call to AzureFileSystem$…
Collinbrown95 Mar 19, 2026
140db63
Updated docs to include libxml2
marberts Mar 24, 2026
731d18d
add simple test function to work through codegen.R
Collinbrown95 Mar 5, 2026
4fba310
cleanup azurefs test function code
Collinbrown95 Mar 5, 2026
561fbbb
Updated filesystem.cpp
marberts Mar 25, 2026
b950cf3
Updated build scripts
marberts Mar 25, 2026
ccb22de
Update configure.win: fix typo
Collinbrown95 Mar 25, 2026
1a79e10
Updated CI setup scripts for windows
marberts Mar 27, 2026
f8d9f6d
Trying PKGBUILD and windows build script again
marberts Mar 27, 2026
42733a0
Updated PKGBUILD
marberts Mar 27, 2026
9579343
debug ci: add azure dependencies that CI tries to build from source.
Collinbrown95 Mar 29, 2026
93c06c9
Removed tmp.md
marberts Apr 1, 2026
72a3ccc
Removed windows build and added macos
marberts Apr 27, 2026
535a678
GH-49807: [CI] Remove obsolete test-ubuntu-22.04-cpp-20 job (#49827)
raulcd Apr 27, 2026
5f3659c
azure off for windows ci
marberts Apr 27, 2026
b1d6040
Disable azure in configure.win
marberts Apr 28, 2026
620a239
Merge branch '32123-expose-azure-blob-filesystem' of https://github.c…
May 9, 2026
3ca4eee
Add placeholder comment to flag present issues with MinGW and the Azu…
Collinbrown95 May 9, 2026
d9fad48
remove debugging script to install azure sdk from source
Collinbrown95 May 10, 2026
af3fc9f
Updated vignettes to reflect Azure off on Windows
marberts May 12, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions ci/scripts/PKGBUILD
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,7 @@ url="https://arrow.apache.org/"
license=("Apache-2.0")
depends=("${MINGW_PACKAGE_PREFIX}-bzip2"
"${MINGW_PACKAGE_PREFIX}-curl" # for google-cloud-cpp bundled build
"${MINGW_PACKAGE_PREFIX}-libxml2" # for azure
"${MINGW_PACKAGE_PREFIX}-libutf8proc"
"${MINGW_PACKAGE_PREFIX}-re2"
"${MINGW_PACKAGE_PREFIX}-snappy"
Expand Down Expand Up @@ -122,6 +123,7 @@ build() {
-DARROW_PACKAGE_PREFIX="${MINGW_PREFIX}" \
-DARROW_PARQUET=ON \
-DARROW_S3=ON \
-DARROW_AZURE=OFF \
-DARROW_SNAPPY_USE_SHARED=OFF \
-DARROW_USE_GLOG=OFF \
-DARROW_UTF8PROC_USE_SHARED=OFF \
Expand Down
6 changes: 3 additions & 3 deletions ci/scripts/r_windows_build.sh
Original file line number Diff line number Diff line change
Expand Up @@ -66,23 +66,23 @@ if [ -d mingw64/lib/ ]; then
# Move the 64-bit versions of libarrow into the expected location
mv mingw64/lib/*.a $DST_DIR/lib/x64
# These are from https://dl.bintray.com/rtools/mingw{32,64}/
cp $MSYS_LIB_DIR/mingw64/lib/lib{snappy,zstd,lz4,brotli*,bz2,crypto,curl,ss*,utf8proc,re2,nghttp2}.a $DST_DIR/lib/x64
cp $MSYS_LIB_DIR/mingw64/lib/lib{snappy,zstd,lz4,brotli*,bz2,crypto,curl,ss*,utf8proc,re2,nghttp2,xml2}.a $DST_DIR/lib/x64
fi

# Same for the 32-bit versions
if [ -d mingw32/lib/ ]; then
ls $MSYS_LIB_DIR/mingw32/lib/
mkdir -p $DST_DIR/lib/i386
mv mingw32/lib/*.a $DST_DIR/lib/i386
cp $MSYS_LIB_DIR/mingw32/lib/lib{snappy,zstd,lz4,brotli*,bz2,crypto,curl,ss*,utf8proc,re2,nghttp2}.a $DST_DIR/lib/i386
cp $MSYS_LIB_DIR/mingw32/lib/lib{snappy,zstd,lz4,brotli*,bz2,crypto,curl,ss*,utf8proc,re2,nghttp2,xml2}.a $DST_DIR/lib/i386
fi

# Do the same also for ucrt64
if [ -d ucrt64/lib/ ]; then
ls $MSYS_LIB_DIR/ucrt64/lib/
mkdir -p $DST_DIR/lib/x64-ucrt
mv ucrt64/lib/*.a $DST_DIR/lib/x64-ucrt
cp $MSYS_LIB_DIR/ucrt64/lib/lib{snappy,zstd,lz4,brotli*,bz2,crypto,curl,ss*,utf8proc,re2,nghttp2}.a $DST_DIR/lib/x64-ucrt
cp $MSYS_LIB_DIR/ucrt64/lib/lib{snappy,zstd,lz4,brotli*,bz2,crypto,curl,ss*,utf8proc,re2,nghttp2,xml2}.a $DST_DIR/lib/x64-ucrt
fi

# Create build artifact
Expand Down
Loading
Loading