Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chunk read at for files read through object_store #2681

Closed
wants to merge 1 commit into from
Closed

chunk read at for files read through object_store #2681

wants to merge 1 commit into from

Conversation

onursatici
Copy link
Contributor

No description provided.

@onursatici onursatici changed the title chunk read at for local object store files chunk read at for files read through object_store Mar 13, 2025
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Mar 13, 2025 •
edited
Loading

Benchmarks: TPC-H on NVME

Table of Results
name PR 51df144 base e764a7a ratio (PR/base) unit
tpch_q01/arrow 43770629 48842064 0.896167 ns
tpch_q02/arrow 46793783 52481760 0.89162 ns
tpch_q03/arrow 29851369 33116855 0.901395 ns
tpch_q04/arrow 23248417 25322133 0.918107 ns
tpch_q05/arrow 47184874 52535299 0.898156 ns
tpch_q06/arrow 10851735 11482418 0.945074 ns
tpch_q07/arrow 74069687 83359968 0.888552 ns
tpch_q08/arrow 55288968 61449230 0.89975 ns
tpch_q09/arrow 68213412 75206184 0.907019 ns
tpch_q10/arrow 43794000 50741266 0.863084 ns
tpch_q11/arrow 22808424 25752832 0.885667 ns
tpch_q12/arrow 29002071 30045239 0.96528 ns
tpch_q13/arrow 15341950 18226867 0.841722 ns
tpch_q14/arrow 13267310 16737906 0.792651 ns
tpch_q15/arrow 25671295 32023415 0.801641 ns
tpch_q16/arrow 21226319 24616259 0.862289 ns
tpch_q17/arrow 57819563 66107261 0.874633 ns
tpch_q18/arrow 98034723 106921799 0.916882 ns
tpch_q19/arrow 26054376 30924024 0.842529 ns
tpch_q20/arrow 35590875 40974935 0.868601 ns
tpch_q21/arrow 109224511 125395743 0.871038 ns
tpch_q22/arrow 14856399 16151150 0.919835 ns
tpch_q01/parquet 113153983 130167646 0.869294 ns
tpch_q02/parquet 114948354 124482074 0.923413 ns
tpch_q03/parquet 102832860 118836810 0.865328 ns
tpch_q04/parquet 61145958 67193131 0.910003 ns
tpch_q05/parquet 119035195 127140749 0.936247 ns
tpch_q06/parquet 25053578 28519670 0.878467 ns
tpch_q07/parquet 130833911 151231542 0.865123 ns
tpch_q08/parquet 156218565 177685385 0.879186 ns
tpch_q09/parquet 208665847 226301454 0.92207 ns
tpch_q10/parquet 127428430 145788340 0.874065 ns
tpch_q11/parquet 53992336 59139616 0.912964 ns
tpch_q12/parquet 91826412 101560020 0.904159 ns
tpch_q13/parquet 150442334 164122073 0.916649 ns
tpch_q14/parquet 44409585 50617756 0.877352 ns
tpch_q15/parquet 65707802 78766550 0.834209 ns
tpch_q16/parquet 51269105 57352567 0.893929 ns
tpch_q17/parquet 128660548 149087342 0.862988 ns
tpch_q18/parquet 189227423 209185254 0.904593 ns
tpch_q19/parquet 75421455 81069329 0.930333 ns
tpch_q20/parquet 95084265 106490594 0.892889 ns
tpch_q21/parquet 181587665 204756597 0.886846 ns
tpch_q22/parquet 49505014 55468376 0.892491 ns
tpch_q01/vortex-file-compressed 34736841 38498685 0.902286 ns
tpch_q02/vortex-file-compressed 55599409 65321659 0.851163 ns
tpch_q03/vortex-file-compressed 29150408 33625855 0.866905 ns
tpch_q04/vortex-file-compressed 18886101 20094040 0.939886 ns
tpch_q05/vortex-file-compressed 43590630 49615551 0.878568 ns
tpch_q06/vortex-file-compressed 9590227 9919086 0.966846 ns
tpch_q07/vortex-file-compressed 65448579 75549086 0.866305 ns
tpch_q08/vortex-file-compressed 52991399 60214621 0.880042 ns
tpch_q09/vortex-file-compressed 65751243 77032018 0.853557 ns
tpch_q10/vortex-file-compressed 48994542 57340774 0.854445 ns
tpch_q11/vortex-file-compressed 23965404 29547329 0.811085 ns
tpch_q12/vortex-file-compressed 20833103 23902283 0.871595 ns
tpch_q13/vortex-file-compressed 23763839 26218870 0.906364 ns
tpch_q14/vortex-file-compressed 12109200 14071918 0.860522 ns
tpch_q15/vortex-file-compressed 29713339 31331160 0.948364 ns
tpch_q16/vortex-file-compressed 28393768 30849343 0.920401 ns
tpch_q17/vortex-file-compressed 55995036 63416843 0.882968 ns
tpch_q18/vortex-file-compressed 85118300 97668215 0.871505 ns
tpch_q19/vortex-file-compressed 30084393 33572139 0.896112 ns
tpch_q20/vortex-file-compressed 37129254 41944245 0.885205 ns
tpch_q21/vortex-file-compressed 87091829 97101174 0.896918 ns
tpch_q22/vortex-file-compressed 27052744 32037525 0.844408 ns

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Mar 13, 2025 •
edited
Loading

Benchmarks: TPC-H on S3

Table of Results
name PR 51df144 base e764a7a ratio (PR/base) unit
tpch_q01/parquet 264463666 268003707 0.986791 ns
tpch_q02/parquet 675377079 711314701 0.949477 ns
tpch_q03/parquet 430067421 426975027 1.00724 ns
tpch_q04/parquet 234167461 229015448 1.0225 ns
tpch_q05/parquet 576555865 584654102 0.986149 ns
tpch_q06/parquet 181096930 177749888 1.01883 ns
tpch_q07/parquet 636659603 628041932 1.01372 ns
tpch_q08/parquet 774713834 769395124 1.00691 ns
tpch_q09/parquet 683135896 677995955 1.00758 ns
tpch_q10/parquet 546390866 530518715 1.02992 ns
tpch_q11/parquet 286060212 281574597 1.01593 ns
tpch_q12/parquet 279769324 268986964 1.04009 ns
tpch_q13/parquet 386693408 387282686 0.998478 ns
tpch_q14/parquet 245549073 242440505 1.01282 ns
tpch_q15/parquet 479750424 455359853 1.05356 ns
tpch_q16/parquet 269082627 283604383 0.948796 ns
tpch_q17/parquet 399171424 399079036 1.00023 ns
tpch_q18/parquet 532352460 540028126 0.985787 ns
tpch_q19/parquet 280335860 278866978 1.00527 ns
tpch_q20/parquet 523621923 523591327 1.00006 ns
tpch_q21/parquet 632647418 627250064 1.0086 ns
tpch_q22/parquet 272296304 273227105 0.996593 ns
tpch_q01/vortex-file-compressed 127678927 141326826 0.90343 ns
tpch_q02/vortex-file-compressed 333756042 336763359 0.99107 ns
tpch_q03/vortex-file-compressed 202192676 203097084 0.995547 ns
tpch_q04/vortex-file-compressed 124618307 122712786 1.01553 ns
tpch_q05/vortex-file-compressed 268326285 277865477 0.96567 ns
tpch_q06/vortex-file-compressed 102147109 104787771 0.9748 ns
tpch_q07/vortex-file-compressed 316862476 317728375 0.997275 ns
tpch_q08/vortex-file-compressed 372997878 363716847 1.02552 ns
tpch_q09/vortex-file-compressed 391576587 376704280 1.03948 ns
tpch_q10/vortex-file-compressed 341431338 341481158 0.999854 ns
tpch_q11/vortex-file-compressed 130815538 126930211 1.03061 ns
tpch_q12/vortex-file-compressed 163165138 166600557 0.979379 ns
tpch_q13/vortex-file-compressed 207581423 202246972 1.02638 ns
tpch_q14/vortex-file-compressed 122018214 124395504 0.980889 ns
tpch_q15/vortex-file-compressed 278427543 275504514 1.01061 ns
tpch_q16/vortex-file-compressed 110242395 113024064 0.975389 ns
tpch_q17/vortex-file-compressed 167841743 171028604 0.981367 ns
tpch_q18/vortex-file-compressed 286073952 302271414 0.946414 ns
tpch_q19/vortex-file-compressed 163219366 162585710 1.0039 ns
tpch_q20/vortex-file-compressed 224712329 226340059 0.992808 ns
tpch_q21/vortex-file-compressed 344327315 345227186 0.997393 ns
tpch_q22/vortex-file-compressed 119558252 122973669 0.972226 ns

@github-actions GitHub Actions
Copy link
Contributor

Benchmarks: Clickbench on NVME

Table of Results
name PR 51df144 base e764a7a ratio (PR/base) unit
clickbench_q00/parquet 2499456 2256870 1.10749 ns
clickbench_q01/parquet 33010640 32568456 1.01358 ns
clickbench_q02/parquet 63313650 64764080 0.977604 ns
clickbench_q03/parquet 52485073 52147666 1.00647 ns
clickbench_q04/parquet 321012161 307866068 1.0427 ns
clickbench_q05/parquet 311220159 299394541 1.0395 ns
clickbench_q06/parquet 2344709 1936578 1.21075 ns
clickbench_q07/parquet 32090656 31108356 1.03158 ns
clickbench_q08/parquet 370739120 380988939 0.973097 ns
clickbench_q09/parquet 562537951 557077620 1.0098 ns
clickbench_q10/parquet 119926476 115129614 1.04166 ns
clickbench_q11/parquet 142445272 145661031 0.977923 ns
clickbench_q12/parquet 309791790 318678671 0.972113 ns
clickbench_q13/parquet 483055241 472565476 1.0222 ns
clickbench_q14/parquet 317765426 310709264 1.02271 ns
clickbench_q15/parquet 351030840 342758899 1.02413 ns
clickbench_q16/parquet 763778569 753207255 1.01404 ns
clickbench_q17/parquet 707545252 647779056 1.09226 ns
clickbench_q18/parquet 1556968452 1501960739 1.03662 ns
clickbench_q19/parquet 46077815 40937882 1.12555 ns
clickbench_q20/parquet 556196768 545033900 1.02048 ns
clickbench_q21/parquet 600873229 623717537 0.963374 ns
clickbench_q22/parquet 975296488 943745577 1.03343 ns
clickbench_q23/parquet 3861964612 3812826592 1.01289 ns
clickbench_q24/parquet 204822190 190799081 1.0735 ns
clickbench_q25/parquet 179016044 169305753 1.05735 ns
clickbench_q26/parquet 228213939 218276662 1.04553 ns
clickbench_q27/parquet 766269891 731007997 1.04824 ns
clickbench_q28/parquet 4532567425 4323587193 1.04833 ns
clickbench_q29/parquet 258719487 247703252 1.04447 ns
clickbench_q30/parquet 328699192 318271989 1.03276 ns
clickbench_q31/parquet 371855414 370535612 1.00356 ns
clickbench_q32/parquet 1848816739 1815244613 1.01849 ns
clickbench_q33/parquet 1522366708 1485266723 1.02498 ns
clickbench_q34/parquet 1465041339 1476997066 0.991905 ns
clickbench_q35/parquet 509888251 505392332 1.0089 ns
clickbench_q36/parquet 150500547 147963115 1.01715 ns
clickbench_q37/parquet 70667068 67486976 1.04712 ns
clickbench_q38/parquet 98751675 92952069 1.06239 ns
clickbench_q39/parquet 277604364 278918340 0.995289 ns
clickbench_q40/parquet 46117125 44556326 1.03503 ns
clickbench_q41/parquet 42045310 40834933 1.02964 ns
clickbench_q42/parquet 52729546 50776022 1.03847 ns
clickbench_q00/vortex-file-compressed 3990768 4027506 0.990878 ns
clickbench_q01/vortex-file-compressed 19218956 18382146 1.04552 ns
clickbench_q02/vortex-file-compressed 32625991 32198522 1.01328 ns
clickbench_q03/vortex-file-compressed 43165680 42153763 1.02401 ns
clickbench_q04/vortex-file-compressed 356903337 324518914 1.09979 ns
clickbench_q05/vortex-file-compressed 334915966 328878959 1.01836 ns
clickbench_q06/vortex-file-compressed 5119219 4657273 1.09919 ns
clickbench_q07/vortex-file-compressed 20875774 22321269 0.935241 ns
clickbench_q08/vortex-file-compressed 403710112 388624519 1.03882 ns
clickbench_q09/vortex-file-compressed 490578441 481378495 1.01911 ns
clickbench_q10/vortex-file-compressed 66190620 61549924 1.0754 ns
clickbench_q11/vortex-file-compressed 71422134 70653620 1.01088 ns
clickbench_q12/vortex-file-compressed 267909130 259067244 1.03413 ns
clickbench_q13/vortex-file-compressed 370844147 364874706 1.01636 ns
clickbench_q14/vortex-file-compressed 261315632 261602183 0.998905 ns
clickbench_q15/vortex-file-compressed 404294559 386426329 1.04624 ns
clickbench_q16/vortex-file-compressed 768494224 772490016 0.994827 ns
clickbench_q17/vortex-file-compressed 760368832 768164263 0.989852 ns
clickbench_q18/vortex-file-compressed 1263321679 1260889058 1.00193 ns
clickbench_q19/vortex-file-compressed 28697465 26179437 1.09618 ns
clickbench_q20/vortex-file-compressed 244690067 241802331 1.01194 ns
clickbench_q21/vortex-file-compressed 277299101 275371384 1.007 ns
clickbench_q22/vortex-file-compressed 467036302 471607116 0.990308 ns
clickbench_q23/vortex-file-compressed 827846544 826883156 1.00117 ns
clickbench_q24/vortex-file-compressed 84602993 85503683 0.989466 ns
clickbench_q25/vortex-file-compressed 100383760 96528098 1.03994 ns
clickbench_q26/vortex-file-compressed 118444486 117808913 1.00539 ns
clickbench_q27/vortex-file-compressed 552564429 522712712 1.05711 ns
clickbench_q28/vortex-file-compressed 5035156905 4989730679 1.0091 ns
clickbench_q29/vortex-file-compressed 251246226 225316596 1.11508 ns
clickbench_q30/vortex-file-compressed 224442056 224679268 0.998944 ns
clickbench_q31/vortex-file-compressed 227496432 236156812 0.963328 ns
clickbench_q32/vortex-file-compressed 1292684608 1261689592 1.02457 ns
clickbench_q33/vortex-file-compressed 1246932814 1231029555 1.01292 ns
clickbench_q34/vortex-file-compressed 1239534019 1230666281 1.00721 ns
clickbench_q35/vortex-file-compressed 602392836 586597900 1.02693 ns
clickbench_q36/vortex-file-compressed 94476334 93064161 1.01517 ns
clickbench_q37/vortex-file-compressed 62079735 59823383 1.03772 ns
clickbench_q38/vortex-file-compressed 61070775 60263405 1.0134 ns
clickbench_q39/vortex-file-compressed 190879207 183425391 1.04064 ns
clickbench_q40/vortex-file-compressed 43200711 42007966 1.02839 ns
clickbench_q41/vortex-file-compressed 38328114 36987274 1.03625 ns
clickbench_q42/vortex-file-compressed 32310620 32612066 0.990757 ns

@onursatici onursatici closed this Mar 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@onursatici