Skip to content

feat: Full dplyr compatibility: Client-side warning on join explosion, is.na(), roundtrip checks #325

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 4 commits into
base: main
Choose a base branch
from
Draft

feat: Full dplyr compatibility: Client-side warning on join explosion, is.na(), roundtrip checks #325

wants to merge 4 commits into from

Conversation

krlmlr
Copy link
Member

@krlmlr krlmlr commented Nov 4, 2024

No description provided.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Nov 4, 2024

This is how benchmark results would change (along with a 95% confidence interval in relative change) if a1a2dab is merged into main:

  • ✔️001_tpch_01: 24.7ms -> 25.1ms [-2.24%, +5.33%]
  • ❗🐌001_tpch_02: 129ms -> 168ms [+29.11%, +32.63%]
  • ❗🐌001_tpch_03: 67.8ms -> 125ms [+82.31%, +85.54%]
  • ❗🐌001_tpch_04: 24.8ms -> 66.9ms [+166.9%, +173.22%]
  • 🚀001_tpch_05: 125ms -> 113ms [-11.52%, -8.1%]
  • ✔️001_tpch_06: 15.9ms -> 15.9ms [-3.42%, +3.41%]
  • 🚀001_tpch_07: 142ms -> 135ms [-5.88%, -3.97%]
  • ❗🐌001_tpch_08: 163ms -> 200ms [+21.75%, +24.06%]
  • 🚀001_tpch_09: 133ms -> 119ms [-12.75%, -9.36%]
  • ❗🐌001_tpch_10: 78.2ms -> 145ms [+82.76%, +87.32%]
  • ❗🐌001_tpch_11: 64.7ms -> 133ms [+103.63%, +107.77%]
  • ❗🐌001_tpch_12: 59.7ms -> 74.4ms [+22.42%, +26.93%]
  • ❗🐌001_tpch_13: 20.6ms -> 25.2ms [+18.67%, +25.7%]
  • ❗🐌001_tpch_14: 22.3ms -> 64.4ms [+183.9%, +192.79%]
  • ❗🐌001_tpch_15: 64.9ms -> 87.2ms [+32.27%, +36.62%]
  • ❗🐌001_tpch_16: 66.9ms -> 80.7ms [+18.55%, +22.73%]
  • ❗🐌001_tpch_17: 28.1ms -> 76ms [+166.6%, +174.62%]
  • ❗🐌001_tpch_18: 24.1ms -> 68.5ms [+180.77%, +188.6%]
  • ❗🐌001_tpch_19: 129ms -> 141ms [+8.91%, +10.3%]
  • ❗🐌001_tpch_20: 81.8ms -> 143ms [+71.18%, +77.18%]
  • ❗🐌001_tpch_21: 179ms -> 209ms [+15.27%, +18.81%]
  • ❗🐌001_tpch_22: 129ms -> 139ms [+6.22%, +9.36%]
  • ✔️010_tpch_01: 86.9ms -> 82.8ms [-11.96%, +2.57%]
  • ❗🐌010_tpch_02: 75.5ms -> 126ms [+62.33%, +71.24%]
  • ❗🐌010_tpch_03: 69.7ms -> 127ms [+74.07%, +90.06%]
  • ❗🐌010_tpch_04: 52.7ms -> 91.8ms [+66.98%, +81.43%]
  • ❗🐌010_tpch_05: 99.6ms -> 203ms [+98.48%, +109.91%]
  • ✔️010_tpch_06: 36.8ms -> 36.6ms [-6.55%, +5.13%]
  • ❗🐌010_tpch_07: 116ms -> 221ms [+85.65%, +93.95%]
  • ❗🐌010_tpch_08: 137ms -> 322ms [+130.95%, +137.06%]
  • ❗🐌010_tpch_09: 120ms -> 223ms [+81.24%, +88.72%]
  • ❗🐌010_tpch_10: 89ms -> 169ms [+84.08%, +95.45%]
  • ❗🐌010_tpch_11: 39.5ms -> 90.2ms [+123.26%, +134.1%]
  • ❗🐌010_tpch_12: 62.9ms -> 117ms [+80.5%, +90.5%]
  • ❗🐌010_tpch_13: 54.5ms -> 59.2ms [+4.68%, +12.26%]
  • ❗🐌010_tpch_14: 41.8ms -> 66.6ms [+54.02%, +64.65%]
  • ❗🐌010_tpch_15: 61ms -> 130ms [+107.05%, +119.68%]
  • ❗🐌010_tpch_16: 47.1ms -> 67.8ms [+37.76%, +50.01%]
  • ❗🐌010_tpch_17: 59.9ms -> 116ms [+88.17%, +100.44%]
  • ❗🐌010_tpch_18: 56.1ms -> 106ms [+81.98%, +95.76%]
  • ❗🐌010_tpch_19: 124ms -> 157ms [+23.41%, +28.56%]
  • ❗🐌010_tpch_20: 75.7ms -> 125ms [+59.86%, +69.88%]
  • ❗🐌010_tpch_21: 426ms -> 735ms [+69.16%, +75.92%]
  • ❗🐌010_tpch_22: 79.2ms -> 93.9ms [+15.44%, +21.67%]
  • ✔️100_tpch_01: 1.22s -> 1.19s [-6.71%, +2.72%]
  • ❗🐌100_tpch_02: 124ms -> 262ms [+86.56%, +133.64%]
  • ❗🐌100_tpch_03: 1.07s -> 1.29s [+18.7%, +22.06%]
  • ❗🐌100_tpch_04: 1.06s -> 1.23s [+13.37%, +19.84%]
  • ❗🐌100_tpch_05: 1.17s -> 1.54s [+29.05%, +33.52%]
  • ✔️100_tpch_06: 990ms -> 1.01s [-0.69%, +4.62%]
  • ❗🐌100_tpch_07: 1.14s -> 1.51s [+30.5%, +34.89%]
  • ❗🐌100_tpch_08: 1.16s -> 1.83s [+53.78%, +62.61%]
  • ❗🐌100_tpch_09: 1.25s -> 1.85s [+40.81%, +54.34%]
  • ❗🐌100_tpch_10: 1.14s -> 1.42s [+19.33%, +30.36%]
  • ❗🐌100_tpch_11: 83.1ms -> 236ms [+159.48%, +209.16%]
  • ❗🐌100_tpch_12: 1.11s -> 1.33s [+15.78%, +23.1%]
  • ✔️100_tpch_13: 361ms -> 374ms [-0.85%, +7.9%]
  • ❗🐌100_tpch_14: 1.05s -> 1.12s [+5.14%, +7.82%]
  • ❗🐌100_tpch_15: 1.12s -> 1.4s [+23.79%, +27.03%]
  • ❗🐌100_tpch_16: 124ms -> 176ms [+34.4%, +50.54%]
  • 🚀100_tpch_17: 1.05s -> 558ms [-49%, -45.03%]
  • ❗🐌100_tpch_18: 1.1s -> 1.34s [+19.18%, +24.19%]
  • 🚀100_tpch_19: 1.2s -> 569ms [-56.73%, -48.1%]
  • ❗🐌100_tpch_20: 1.08s -> 1.24s [+12.99%, +16.77%]
  • ❗🐌100_tpch_21: 2.23s -> 4.54s [+94.2%, +113.75%]
  • ❗🐌100_tpch_22: 193ms -> 236ms [+10.46%, +33.83%]

Further explanation regarding interpretation and methodology can be found in the documentation.

@krlmlr krlmlr force-pushed the f-join-multi-detect branch from a1a2dab to 2cb895e Compare November 11, 2024 05:27
@github-actions GitHub Actions
Copy link
Contributor

This is how benchmark results would change (along with a 95% confidence interval in relative change) if 2cb895e is merged into main:

  • ✔️001_tpch_01: 23.9ms -> 24.6ms [-0.69%, +6.58%]
  • ❗🐌001_tpch_02: 129ms -> 167ms [+27.24%, +31.47%]
  • ❗🐌001_tpch_03: 66.8ms -> 155ms [+129.47%, +134.05%]
  • ❗🐌001_tpch_04: 24ms -> 67ms [+176.64%, +182.43%]
  • 🚀001_tpch_05: 122ms -> 106ms [-13.99%, -11.92%]
  • ✔️001_tpch_06: 15ms -> 15.1ms [-1.46%, +2.18%]
  • 🚀001_tpch_07: 145ms -> 133ms [-9.64%, -7.34%]
  • ❗🐌001_tpch_08: 168ms -> 195ms [+14.96%, +17.24%]
  • 🚀001_tpch_09: 146ms -> 124ms [-16.27%, -13.43%]
  • ❗🐌001_tpch_10: 85.8ms -> 159ms [+82.53%, +87.05%]
  • ❗🐌001_tpch_11: 71.9ms -> 146ms [+100.5%, +106.35%]
  • ❗🐌001_tpch_12: 31ms -> 84.1ms [+167.49%, +175.89%]
  • ❗🐌001_tpch_13: 21.8ms -> 27.1ms [+21.83%, +27.26%]
  • ❗🐌001_tpch_14: 23.3ms -> 71.6ms [+203.84%, +212.14%]
  • ❗🐌001_tpch_15: 73.7ms -> 98.4ms [+30.96%, +36%]
  • ❗🐌001_tpch_16: 72.9ms -> 88.2ms [+18.82%, +23.4%]
  • ❗🐌001_tpch_17: 27.6ms -> 75.8ms [+168.81%, +180.14%]
  • ❗🐌001_tpch_18: 23.4ms -> 68.6ms [+189.09%, +196.85%]
  • ❗🐌001_tpch_19: 131ms -> 143ms [+7.49%, +10.21%]
  • ❗🐌001_tpch_20: 79ms -> 171ms [+114.55%, +119.51%]
  • ❗🐌001_tpch_21: 175ms -> 205ms [+15.36%, +17.93%]
  • ❗🐌001_tpch_22: 131ms -> 139ms [+4.43%, +8.16%]
  • ✔️010_tpch_01: 82.6ms -> 81.5ms [-4.56%, +1.82%]
  • ❗🐌010_tpch_02: 71.3ms -> 122ms [+67.07%, +76.17%]
  • ❗🐌010_tpch_03: 65.6ms -> 119ms [+76%, +86.29%]
  • ❗🐌010_tpch_04: 48.9ms -> 90.6ms [+80.73%, +90.28%]
  • ❗🐌010_tpch_05: 97.5ms -> 193ms [+93.08%, +102.18%]
  • ✔️010_tpch_06: 37.2ms -> 36.6ms [-10.44%, +7.17%]
  • ❗🐌010_tpch_07: 116ms -> 217ms [+82.61%, +92.45%]
  • ❗🐌010_tpch_08: 133ms -> 310ms [+130.87%, +135.87%]
  • ❗🐌010_tpch_09: 119ms -> 218ms [+79.79%, +86.96%]
  • ❗🐌010_tpch_10: 84.8ms -> 163ms [+89.43%, +95.78%]
  • ❗🐌010_tpch_11: 38.7ms -> 85.9ms [+118.17%, +125.8%]
  • ❗🐌010_tpch_12: 62.3ms -> 113ms [+78.65%, +83.19%]
  • ❗🐌010_tpch_13: 53.7ms -> 58ms [+4.62%, +11.48%]
  • ❗🐌010_tpch_14: 42ms -> 63.4ms [+48.89%, +52.99%]
  • ❗🐌010_tpch_15: 59.3ms -> 134ms [+116.97%, +134.11%]
  • ❗🐌010_tpch_16: 45.4ms -> 65.9ms [+42.15%, +48.32%]
  • ❗🐌010_tpch_17: 57ms -> 116ms [+95.75%, +111.24%]
  • ❗🐌010_tpch_18: 56.5ms -> 104ms [+77.84%, +92.12%]
  • ❗🐌010_tpch_19: 124ms -> 154ms [+23.21%, +26.25%]
  • ❗🐌010_tpch_20: 74.2ms -> 122ms [+59.66%, +68.72%]
  • ❗🐌010_tpch_21: 434ms -> 746ms [+70.04%, +73.68%]
  • ❗🐌010_tpch_22: 78.3ms -> 94ms [+17.57%, +22.53%]
  • ✔️100_tpch_01: 1.2s -> 1.24s [-0.96%, +7.34%]
  • ❗🐌100_tpch_02: 121ms -> 254ms [+100.7%, +117.88%]
  • ❗🐌100_tpch_03: 1.1s -> 1.31s [+16.46%, +21.55%]
  • ❗🐌100_tpch_04: 1.07s -> 1.24s [+13.28%, +17.86%]
  • ❗🐌100_tpch_05: 1.18s -> 1.54s [+27.42%, +33.82%]
  • ✔️100_tpch_06: 1.03s -> 1.02s [-2.86%, +2.33%]
  • ❗🐌100_tpch_07: 1.15s -> 1.51s [+29.07%, +32.66%]
  • ❗🐌100_tpch_08: 1.17s -> 1.86s [+55.97%, +61.95%]
  • ❗🐌100_tpch_09: 1.25s -> 1.88s [+47.3%, +53.22%]
  • ❗🐌100_tpch_10: 1.13s -> 1.42s [+21.73%, +29.72%]
  • ❗🐌100_tpch_11: 87.4ms -> 230ms [+139.76%, +187.74%]
  • ❗🐌100_tpch_12: 1.12s -> 1.33s [+15.83%, +21.58%]
  • ❗🐌100_tpch_13: 317ms -> 335ms [+0.38%, +10.96%]
  • ❗🐌100_tpch_14: 1.04s -> 1.13s [+7.41%, +10.6%]
  • ❗🐌100_tpch_15: 1.13s -> 1.45s [+24.96%, +30.38%]
  • ❗🐌100_tpch_16: 122ms -> 177ms [+37.9%, +52.89%]
  • 🚀100_tpch_17: 1.08s -> 542ms [-51.04%, -48.49%]
  • ❗🐌100_tpch_18: 1.11s -> 1.36s [+20.94%, +24.39%]
  • 🚀100_tpch_19: 1.22s -> 571ms [-55.66%, -50.47%]
  • ❗🐌100_tpch_20: 1.1s -> 1.27s [+11.35%, +19.36%]
  • ❗🐌100_tpch_21: 2.23s -> 4.51s [+97.55%, +107.14%]
  • ❗🐌100_tpch_22: 177ms -> 229ms [+20.96%, +37.95%]

Further explanation regarding interpretation and methodology can be found in the documentation.

@krlmlr krlmlr force-pushed the f-join-multi-detect branch from 2cb895e to 88bd29f Compare December 14, 2024 14:00
@github-actions GitHub Actions
Copy link
Contributor

This is how benchmark results would change (along with a 95% confidence interval in relative change) if 88bd29f is merged into main:

  • ✔️001_tpch_01: 25.5ms -> 25.9ms [-2.94%, +5.75%]
  • ❗🐌001_tpch_02: 138ms -> 177ms [+27.47%, +28.94%]
  • ❗🐌001_tpch_03: 73.3ms -> 169ms [+129.31%, +131.84%]
  • ❗🐌001_tpch_04: 24.8ms -> 71.8ms [+186.39%, +191.53%]
  • 🚀001_tpch_05: 131ms -> 113ms [-14.92%, -13.46%]
  • ✔️001_tpch_06: 16.3ms -> 16.4ms [-2.82%, +3.72%]
  • 🚀001_tpch_07: 151ms -> 136ms [-10.88%, -8.66%]
  • ❗🐌001_tpch_08: 171ms -> 197ms [+14.15%, +16.27%]
  • 🚀001_tpch_09: 142ms -> 120ms [-16.62%, -14.47%]
  • ❗🐌001_tpch_10: 82.3ms -> 151ms [+82.47%, +85.63%]
  • ❗🐌001_tpch_11: 71.1ms -> 180ms [+150.57%, +154.95%]
  • ❗🐌001_tpch_12: 29.8ms -> 79.5ms [+164.52%, +169.28%]
  • ❗🐌001_tpch_13: 21.3ms -> 26.1ms [+20.47%, +25.08%]
  • ❗🐌001_tpch_14: 22.3ms -> 68.3ms [+203.77%, +209.03%]
  • ❗🐌001_tpch_15: 70.7ms -> 93.4ms [+30.85%, +33.58%]
  • ❗🐌001_tpch_16: 71.8ms -> 87.1ms [+19.99%, +22.72%]
  • ❗🐌001_tpch_17: 28.8ms -> 81.6ms [+181.33%, +185.74%]
  • ❗🐌001_tpch_18: 25.1ms -> 75.6ms [+198.91%, +204.82%]
  • ❗🐌001_tpch_19: 139ms -> 153ms [+8.9%, +10.59%]
  • ❗🐌001_tpch_20: 84.7ms -> 185ms [+117.27%, +120.25%]
  • ❗🐌001_tpch_21: 190ms -> 217ms [+13.81%, +15.12%]
  • ❗🐌001_tpch_22: 137ms -> 147ms [+6.36%, +7.83%]
  • ✔️010_tpch_01: 85.3ms -> 84.5ms [-4.42%, +2.67%]
  • ❗🐌010_tpch_02: 74.9ms -> 130ms [+68.81%, +78.09%]
  • ❗🐌010_tpch_03: 67.6ms -> 119ms [+73.96%, +79.34%]
  • ❗🐌010_tpch_04: 48.1ms -> 87.3ms [+77.89%, +85.02%]
  • ❗🐌010_tpch_05: 98.1ms -> 203ms [+102.76%, +112.12%]
  • ✔️010_tpch_06: 38.7ms -> 37.5ms [-11.38%, +5.21%]
  • ❗🐌010_tpch_07: 115ms -> 219ms [+87.07%, +94.3%]
  • ❗🐌010_tpch_08: 137ms -> 323ms [+133.8%, +138.29%]
  • ❗🐌010_tpch_09: 126ms -> 229ms [+78.81%, +84.36%]
  • ❗🐌010_tpch_10: 82ms -> 156ms [+86.26%, +94.19%]
  • ❗🐌010_tpch_11: 40.1ms -> 92.2ms [+121.86%, +138.7%]
  • ❗🐌010_tpch_12: 62.4ms -> 116ms [+79.86%, +91.96%]
  • ❗🐌010_tpch_13: 54.9ms -> 59.9ms [+7.59%, +10.78%]
  • ❗🐌010_tpch_14: 42.3ms -> 65.3ms [+48.23%, +60.37%]
  • ❗🐌010_tpch_15: 58.6ms -> 129ms [+109.91%, +129.18%]
  • ❗🐌010_tpch_16: 46.6ms -> 68.7ms [+43.51%, +51.24%]
  • ❗🐌010_tpch_17: 59.2ms -> 124ms [+102.36%, +116.69%]
  • ❗🐌010_tpch_18: 59.2ms -> 117ms [+90.28%, +106.24%]
  • ❗🐌010_tpch_19: 122ms -> 156ms [+26.1%, +29.59%]
  • ❗🐌010_tpch_20: 74.6ms -> 121ms [+59.4%, +65.68%]
  • ❗🐌010_tpch_21: 405ms -> 752ms [+83.94%, +87.25%]
  • ❗🐌010_tpch_22: 81.1ms -> 97.9ms [+17.6%, +23.89%]
  • ✔️100_tpch_01: 1.27s -> 1.24s [-5.76%, +1.82%]
  • ❗🐌100_tpch_02: 129ms -> 267ms [+94.52%, +121.41%]
  • ❗🐌100_tpch_03: 1.11s -> 1.32s [+15.09%, +21.76%]
  • ❗🐌100_tpch_04: 1.08s -> 1.26s [+12.42%, +19.31%]
  • ❗🐌100_tpch_05: 1.2s -> 1.56s [+27.52%, +33.31%]
  • ✔️100_tpch_06: 1.02s -> 1.02s [-1.86%, +1.39%]
  • ❗🐌100_tpch_07: 1.16s -> 1.5s [+25.18%, +33.74%]
  • ❗🐌100_tpch_08: 1.2s -> 1.88s [+55.8%, +59.11%]
  • ❗🐌100_tpch_09: 1.28s -> 1.92s [+46.77%, +53.55%]
  • ❗🐌100_tpch_10: 1.14s -> 1.39s [+19.23%, +24.53%]
  • ❗🐌100_tpch_11: 85ms -> 245ms [+168.41%, +208.67%]
  • ❗🐌100_tpch_12: 1.11s -> 1.33s [+17.91%, +20.68%]
  • ✔️100_tpch_13: 351ms -> 356ms [-5.31%, +7.79%]
  • ❗🐌100_tpch_14: 1.05s -> 1.13s [+5.11%, +10.25%]
  • ❗🐌100_tpch_15: 1.12s -> 1.43s [+23.32%, +31.32%]
  • ❗🐌100_tpch_16: 129ms -> 195ms [+33.9%, +69.7%]
  • 🚀100_tpch_17: 1.1s -> 608ms [-50.11%, -39.34%]
  • ❗🐌100_tpch_18: 1.14s -> 1.38s [+19.42%, +21.97%]
  • 🚀100_tpch_19: 1.22s -> 592ms [-55.35%, -47.7%]
  • ❗🐌100_tpch_20: 1.09s -> 1.29s [+13.61%, +21.76%]
  • ❗🐌100_tpch_21: 2.36s -> 4.63s [+91.86%, +101.63%]
  • ❗🐌100_tpch_22: 175ms -> 228ms [+25.24%, +35.05%]

Further explanation regarding interpretation and methodology can be found in the documentation.

@krlmlr krlmlr changed the title feat: Client-side warning on join explosion feat: Full dplyr compatibility: Client-side warning on join explosion, is.na(), roundtrip checks Jan 26, 2025
@krlmlr krlmlr force-pushed the f-join-multi-detect branch from 88bd29f to 5be75f1 Compare January 26, 2025 06:29
@github-actions GitHub Actions
Copy link
Contributor

This is how benchmark results would change (along with a 95% confidence interval in relative change) if 3296a22 is merged into main:

  • ✔️001_tpch_01: 23ms -> 23.3ms [-3.03%, +6.04%]
  • ❗🐌001_tpch_02: 67.1ms -> 102ms [+51.39%, +53.47%]
  • ❗🐌001_tpch_03: 38.6ms -> 58.3ms [+50.16%, +52.27%]
  • ❗🐌001_tpch_04: 21.9ms -> 32.2ms [+45.46%, +48.05%]
  • ❗🐌001_tpch_05: 56.2ms -> 109ms [+92.87%, +96.29%]
  • ✔️001_tpch_06: 13.7ms -> 13.6ms [-2.66%, +2.06%]
  • ❗🐌001_tpch_07: 73.8ms -> 132ms [+78.18%, +79.92%]
  • ❗🐌001_tpch_08: 97ms -> 209ms [+114.12%, +117.05%]
  • ❗🐌001_tpch_09: 71.4ms -> 116ms [+60.56%, +63.1%]
  • ❗🐌001_tpch_10: 48.1ms -> 74ms [+52.42%, +54.93%]
  • ❗🐌001_tpch_11: 32ms -> 65.6ms [+103.93%, +106.52%]
  • ❗🐌001_tpch_12: 26.7ms -> 44.6ms [+65.13%, +68.17%]
  • 🚀001_tpch_13: 25.4ms -> 22.9ms [-12.16%, -6.97%]
  • ❗🐌001_tpch_14: 19.9ms -> 29ms [+43.31%, +47.94%]
  • ❗🐌001_tpch_15: 31.3ms -> 56.8ms [+80.27%, +83.14%]
  • ❗🐌001_tpch_16: 39.4ms -> 52.3ms [+32.09%, +33.71%]
  • ❗🐌001_tpch_17: 25.6ms -> 44.8ms [+73.87%, +76.6%]
  • ❗🐌001_tpch_18: 22.1ms -> 34.6ms [+53.52%, +59.14%]
  • ❗🐌001_tpch_19: 65.9ms -> 75ms [+13.23%, +14.4%]
  • ❗🐌001_tpch_20: 49.9ms -> 71.6ms [+42.8%, +44.21%]
  • ❗🐌001_tpch_21: 78.3ms -> 134ms [+69.97%, +73.24%]
  • ❗🐌001_tpch_22: 66.5ms -> 75.1ms [+11.9%, +14.13%]
  • ✔️010_tpch_01: 78.1ms -> 79ms [-2.51%, +4.93%]
  • ❗🐌010_tpch_02: 69.2ms -> 120ms [+71.8%, +75.32%]
  • ❗🐌010_tpch_03: 58.4ms -> 105ms [+76.7%, +82.36%]
  • ❗🐌010_tpch_04: 42.7ms -> 80.9ms [+79.16%, +99.47%]
  • ❗🐌010_tpch_05: 88.9ms -> 184ms [+103.03%, +109.84%]
  • ✔️010_tpch_06: 31.1ms -> 30.5ms [-7.12%, +3.52%]
  • ❗🐌010_tpch_07: 106ms -> 197ms [+84.42%, +88.87%]
  • ❗🐌010_tpch_08: 126ms -> 296ms [+131.06%, +137.48%]
  • ❗🐌010_tpch_09: 113ms -> 209ms [+81.31%, +88.93%]
  • ❗🐌010_tpch_10: 73.7ms -> 142ms [+86.17%, +98.34%]
  • ❗🐌010_tpch_11: 37ms -> 82.6ms [+119.17%, +128.01%]
  • ❗🐌010_tpch_12: 58.2ms -> 104ms [+72.96%, +83.92%]
  • ❗🐌010_tpch_13: 52.2ms -> 56ms [+6.04%, +8.85%]
  • ❗🐌010_tpch_14: 36.8ms -> 58.8ms [+52.62%, +67.13%]
  • ❗🐌010_tpch_15: 55.8ms -> 115ms [+97.65%, +113.83%]
  • ❗🐌010_tpch_16: 43.3ms -> 63.2ms [+42.9%, +48.9%]
  • ❗🐌010_tpch_17: 52.1ms -> 106ms [+96.93%, +108.1%]
  • ❗🐌010_tpch_18: 51.5ms -> 101ms [+86.66%, +107.35%]
  • ❗🐌010_tpch_19: 115ms -> 142ms [+20.75%, +25.6%]
  • ❗🐌010_tpch_20: 64.3ms -> 109ms [+64.77%, +72.71%]
  • ❗🐌010_tpch_21: 237ms -> 565ms [+134.79%, +141.26%]
  • ❗🐌010_tpch_22: 75.4ms -> 92.1ms [+19.84%, +24.44%]
  • ✔️100_tpch_01: 315ms -> 346ms [-0.92%, +20.5%]
  • ❗🐌100_tpch_02: 122ms -> 256ms [+102.52%, +117.74%]
  • ❗🐌100_tpch_03: 168ms -> 363ms [+106.98%, +124.28%]
  • ❗🐌100_tpch_04: 148ms -> 297ms [+80.39%, +119.73%]
  • ❗🐌100_tpch_05: 252ms -> 617ms [+132.72%, +157.44%]
  • ✔️100_tpch_06: 94.7ms -> 97.7ms [-11.37%, +17.7%]
  • ❗🐌100_tpch_07: 237ms -> 552ms [+117.68%, +149.11%]
  • ❗🐌100_tpch_08: 252ms -> 910ms [+247.26%, +274.71%]
  • ❗🐌100_tpch_09: 336ms -> 877ms [+147.6%, +174.9%]
  • ❗🐌100_tpch_10: 208ms -> 474ms [+118.87%, +138.09%]
  • ❗🐌100_tpch_11: 87.4ms -> 243ms [+139.25%, +217.18%]
  • ❗🐌100_tpch_12: 199ms -> 416ms [+91.35%, +127.62%]
  • ✔️100_tpch_13: 303ms -> 307ms [-2.01%, +4.86%]
  • ❗🐌100_tpch_14: 118ms -> 187ms [+46.18%, +70.93%]
  • ❗🐌100_tpch_15: 204ms -> 513ms [+143.96%, +158.59%]
  • ❗🐌100_tpch_16: 121ms -> 176ms [+36.17%, +56.02%]
  • ❗🐌100_tpch_17: 177ms -> 499ms [+169.78%, +193.56%]
  • ❗🐌100_tpch_18: 185ms -> 413ms [+116.92%, +130.32%]
  • ❗🐌100_tpch_19: 309ms -> 476ms [+33.48%, +74.29%]
  • ❗🐌100_tpch_20: 173ms -> 338ms [+83.55%, +106.46%]
  • ❗🐌100_tpch_21: 1.31s -> 3.45s [+156.98%, +169.62%]
  • ❗🐌100_tpch_22: 167ms -> 217ms [+26.56%, +33.85%]

Further explanation regarding interpretation and methodology can be found in the documentation.

@krlmlr krlmlr force-pushed the f-join-multi-detect branch 2 times, most recently from 21c7bcb to 645f5ff Compare January 31, 2025 20:13
@github-actions github-actions bot mentioned this pull request Jan 31, 2025
Closed
@github-actions GitHub Actions
Copy link
Contributor

This is how benchmark results would change (along with a 95% confidence interval in relative change) if 645f5ff is merged into main:

  • ✔️001_tpch_01: 22ms -> 21.7ms [-6.28%, +3.74%]
  • ❗🐌001_tpch_02: 63.7ms -> 103ms [+61%, +62.57%]
  • ❗🐌001_tpch_03: 39.4ms -> 57.9ms [+46.05%, +48.41%]
  • ❗🐌001_tpch_04: 22.3ms -> 39.1ms [+73.44%, +77.47%]
  • ❗🐌001_tpch_05: 57.4ms -> 110ms [+89.6%, +93.37%]
  • ✔️001_tpch_06: 11.6ms -> 11.8ms [-1.45%, +4.72%]
  • ❗🐌001_tpch_07: 71.1ms -> 124ms [+73.91%, +75.45%]
  • ❗🐌001_tpch_08: 97.9ms -> 210ms [+113.14%, +116.77%]
  • ❗🐌001_tpch_09: 68.5ms -> 116ms [+68.84%, +71.02%]
  • ❗🐌001_tpch_10: 42.4ms -> 74ms [+73.25%, +76.25%]
  • ❗🐌001_tpch_11: 38.6ms -> 65.6ms [+67.05%, +73.1%]
  • ❗🐌001_tpch_12: 20.9ms -> 39.9ms [+88.21%, +94.05%]
  • ❗🐌001_tpch_13: 18ms -> 22.6ms [+20.41%, +30.76%]
  • ❗🐌001_tpch_14: 16.6ms -> 31.8ms [+89.63%, +94.53%]
  • ❗🐌001_tpch_15: 35.6ms -> 56.1ms [+56.43%, +59.01%]
  • ❗🐌001_tpch_16: 35.2ms -> 48.7ms [+36.9%, +40.1%]
  • ❗🐌001_tpch_17: 31.1ms -> 45.5ms [+43.4%, +49.3%]
  • ❗🐌001_tpch_18: 21.9ms -> 41.7ms [+88.06%, +93.06%]
  • ❗🐌001_tpch_19: 44ms -> 54.4ms [+22.65%, +24.91%]
  • ❗🐌001_tpch_20: 50.6ms -> 72.6ms [+41.83%, +45.02%]
  • ❗🐌001_tpch_21: 71.5ms -> 136ms [+87.43%, +92.55%]
  • ❗🐌001_tpch_22: 45.8ms -> 48.9ms [+5.84%, +7.53%]
  • ✔️010_tpch_01: 77.4ms -> 78.6ms [-2.3%, +5.21%]
  • ❗🐌010_tpch_02: 70.8ms -> 119ms [+62.1%, +74.43%]
  • ❗🐌010_tpch_03: 57ms -> 105ms [+81.2%, +86.59%]
  • ❗🐌010_tpch_04: 41.9ms -> 79.6ms [+83.99%, +96.05%]
  • ❗🐌010_tpch_05: 89.2ms -> 188ms [+105.94%, +115.7%]
  • ✔️010_tpch_06: 29.3ms -> 28.8ms [-9.72%, +6.21%]
  • ❗🐌010_tpch_07: 101ms -> 195ms [+87.86%, +97.32%]
  • ❗🐌010_tpch_08: 125ms -> 300ms [+136.37%, +142.71%]
  • ❗🐌010_tpch_09: 114ms -> 210ms [+79.94%, +87.61%]
  • ❗🐌010_tpch_10: 72.2ms -> 141ms [+92.06%, +99.09%]
  • ❗🐌010_tpch_11: 37.7ms -> 82.4ms [+113.97%, +123.47%]
  • ❗🐌010_tpch_12: 50.6ms -> 97.3ms [+88.13%, +96.17%]
  • ❗🐌010_tpch_13: 49.4ms -> 54.8ms [+9.9%, +11.96%]
  • ❗🐌010_tpch_14: 33ms -> 54.3ms [+59.95%, +69.18%]
  • ❗🐌010_tpch_15: 52.6ms -> 116ms [+111.01%, +129.09%]
  • ❗🐌010_tpch_16: 39.7ms -> 57.4ms [+38.85%, +50.39%]
  • ❗🐌010_tpch_17: 51.1ms -> 106ms [+100.85%, +113.88%]
  • ❗🐌010_tpch_18: 53.1ms -> 104ms [+85.08%, +106.37%]
  • ❗🐌010_tpch_19: 82ms -> 113ms [+35.51%, +39.78%]
  • ❗🐌010_tpch_20: 66.6ms -> 107ms [+55.25%, +65.16%]
  • ❗🐌010_tpch_21: 237ms -> 569ms [+136.38%, +144.49%]
  • ❗🐌010_tpch_22: 51.6ms -> 69.6ms [+29.17%, +40.33%]
  • ✔️100_tpch_01: 315ms -> 328ms [-13.95%, +21.86%]
  • ❗🐌100_tpch_02: 136ms -> 250ms [+67.33%, +100.39%]
  • ❗🐌100_tpch_03: 176ms -> 361ms [+92.43%, +117.54%]
  • ❗🐌100_tpch_04: 150ms -> 296ms [+81.1%, +113.91%]
  • ❗🐌100_tpch_05: 253ms -> 613ms [+122.63%, +160.67%]
  • ✔️100_tpch_06: 101ms -> 97.5ms [-13.74%, +7.25%]
  • ❗🐌100_tpch_07: 228ms -> 554ms [+138.15%, +146.78%]
  • ❗🐌100_tpch_08: 255ms -> 881ms [+232.46%, +258.76%]
  • ❗🐌100_tpch_09: 331ms -> 887ms [+143.11%, +192.33%]
  • ❗🐌100_tpch_10: 219ms -> 461ms [+96.81%, +123.7%]
  • ❗🐌100_tpch_11: 84.1ms -> 248ms [+169.91%, +220.68%]
  • ❗🐌100_tpch_12: 180ms -> 410ms [+118.49%, +137.05%]
  • ✔️100_tpch_13: 306ms -> 312ms [-0.51%, +4.82%]
  • ❗🐌100_tpch_14: 113ms -> 179ms [+39.83%, +76.16%]
  • ❗🐌100_tpch_15: 205ms -> 498ms [+132.16%, +152.55%]
  • ❗🐌100_tpch_16: 125ms -> 181ms [+28.67%, +61.18%]
  • ❗🐌100_tpch_17: 178ms -> 489ms [+157.17%, +191.32%]
  • ❗🐌100_tpch_18: 187ms -> 431ms [+117.96%, +143.38%]
  • ❗🐌100_tpch_19: 271ms -> 475ms [+60.05%, +91.07%]
  • ❗🐌100_tpch_20: 178ms -> 325ms [+63.72%, +101.91%]
  • ❗🐌100_tpch_21: 1.31s -> 3.48s [+161.39%, +170.28%]
  • ❗🐌100_tpch_22: 148ms -> 203ms [+32.45%, +42.26%]

Further explanation regarding interpretation and methodology can be found in the documentation.

@krlmlr krlmlr force-pushed the f-join-multi-detect branch 2 times, most recently from aa07e1e to d0e3cc1 Compare February 1, 2025 05:21
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Feb 1, 2025

This is how benchmark results would change (along with a 95% confidence interval in relative change) if bd31e45 is merged into main:

  • ✔️001_tpch_01: 21.8ms -> 22.3ms [-3.09%, +7.83%]
  • ❗🐌001_tpch_02: 62.9ms -> 102ms [+61.26%, +63.54%]
  • ❗🐌001_tpch_03: 42.1ms -> 61.2ms [+41.68%, +48.92%]
  • ❗🐌001_tpch_04: 22.9ms -> 40.1ms [+72.58%, +78.58%]
  • ❗🐌001_tpch_05: 57.3ms -> 104ms [+80.42%, +83.96%]
  • ✔️001_tpch_06: 11.7ms -> 11.5ms [-3.94%, +1.37%]
  • ❗🐌001_tpch_07: 70.5ms -> 123ms [+73.28%, +76.42%]
  • ❗🐌001_tpch_08: 97.3ms -> 208ms [+112.54%, +115.52%]
  • ❗🐌001_tpch_09: 68.4ms -> 116ms [+68.61%, +71.89%]
  • ❗🐌001_tpch_10: 42.1ms -> 72.7ms [+71.57%, +74.07%]
  • ❗🐌001_tpch_11: 38ms -> 64.4ms [+67.67%, +71.17%]
  • ❗🐌001_tpch_12: 20.6ms -> 39.5ms [+88.67%, +94.76%]
  • ❗🐌001_tpch_13: 18.1ms -> 22.1ms [+20.34%, +24.38%]
  • ❗🐌001_tpch_14: 17.1ms -> 32.7ms [+88.13%, +95.34%]
  • ❗🐌001_tpch_15: 38.1ms -> 60.3ms [+55.06%, +61.63%]
  • ❗🐌001_tpch_16: 37.2ms -> 51.8ms [+36.01%, +42.68%]
  • ❗🐌001_tpch_17: 31.1ms -> 45.4ms [+42.38%, +49.48%]
  • ❗🐌001_tpch_18: 21.9ms -> 41.5ms [+84.01%, +94.38%]
  • ❗🐌001_tpch_19: 43.8ms -> 53.9ms [+21.59%, +24.15%]
  • ❗🐌001_tpch_20: 49.6ms -> 71.1ms [+41.8%, +44.55%]
  • ❗🐌001_tpch_21: 71ms -> 134ms [+86.29%, +91.35%]
  • ❗🐌001_tpch_22: 45.6ms -> 48.5ms [+5.47%, +7.47%]
  • ✔️010_tpch_01: 80.6ms -> 78.1ms [-13.44%, +7.25%]
  • ❗🐌010_tpch_02: 69.4ms -> 121ms [+70.35%, +79.29%]
  • ❗🐌010_tpch_03: 57.3ms -> 106ms [+80.96%, +89.8%]
  • ❗🐌010_tpch_04: 42.8ms -> 80.2ms [+76.72%, +97.96%]
  • ❗🐌010_tpch_05: 87.6ms -> 186ms [+108.66%, +115.92%]
  • ✔️010_tpch_06: 29.6ms -> 29.9ms [-6.59%, +8.45%]
  • ❗🐌010_tpch_07: 102ms -> 196ms [+87.15%, +95.75%]
  • ❗🐌010_tpch_08: 126ms -> 297ms [+132.23%, +140.57%]
  • ❗🐌010_tpch_09: 114ms -> 211ms [+81.86%, +88.88%]
  • ❗🐌010_tpch_10: 73.3ms -> 140ms [+87.75%, +94.91%]
  • ❗🐌010_tpch_11: 36.4ms -> 82.7ms [+123.64%, +130.82%]
  • ❗🐌010_tpch_12: 51.4ms -> 98.3ms [+85.26%, +96.92%]
  • ❗🐌010_tpch_13: 49.8ms -> 55.8ms [+10.8%, +13.29%]
  • ❗🐌010_tpch_14: 34.3ms -> 52.4ms [+44.98%, +61.02%]
  • ❗🐌010_tpch_15: 53.1ms -> 112ms [+101.94%, +119.37%]
  • ❗🐌010_tpch_16: 38.6ms -> 56.8ms [+40.12%, +54.78%]
  • ❗🐌010_tpch_17: 52.9ms -> 106ms [+91.44%, +108.06%]
  • ❗🐌010_tpch_18: 54.6ms -> 101ms [+78.27%, +92.29%]
  • ❗🐌010_tpch_19: 82.5ms -> 114ms [+34.19%, +41.22%]
  • ❗🐌010_tpch_20: 64.9ms -> 106ms [+58.03%, +68.08%]
  • ❗🐌010_tpch_21: 234ms -> 569ms [+138.7%, +147.84%]
  • ❗🐌010_tpch_22: 52.3ms -> 68.4ms [+26.85%, +34.43%]
  • ✔️100_tpch_01: 289ms -> 313ms [-7.51%, +24.3%]
  • ❗🐌100_tpch_02: 125ms -> 257ms [+96.46%, +115%]
  • ❗🐌100_tpch_03: 170ms -> 367ms [+111.44%, +120.29%]
  • ❗🐌100_tpch_04: 150ms -> 298ms [+80.36%, +117.72%]
  • ❗🐌100_tpch_05: 258ms -> 633ms [+133.1%, +157.87%]
  • ✔️100_tpch_06: 104ms -> 103ms [-19.6%, +17.91%]
  • ❗🐌100_tpch_07: 233ms -> 559ms [+134.4%, +145.81%]
  • ❗🐌100_tpch_08: 253ms -> 888ms [+233.2%, +268.09%]
  • ❗🐌100_tpch_09: 332ms -> 890ms [+152.81%, +183.99%]
  • ❗🐌100_tpch_10: 210ms -> 483ms [+116.33%, +144.15%]
  • ❗🐌100_tpch_11: 87.8ms -> 231ms [+139.3%, +186.1%]
  • ❗🐌100_tpch_12: 172ms -> 396ms [+116.85%, +144.92%]
  • ✔️100_tpch_13: 307ms -> 335ms [-1.86%, +19.57%]
  • ❗🐌100_tpch_14: 109ms -> 184ms [+51.3%, +86.69%]
  • ❗🐌100_tpch_15: 201ms -> 498ms [+140.36%, +154.08%]
  • ❗🐌100_tpch_16: 117ms -> 171ms [+36.79%, +56.46%]
  • ❗🐌100_tpch_17: 176ms -> 495ms [+164.27%, +197.05%]
  • ❗🐌100_tpch_18: 188ms -> 424ms [+116.8%, +133.3%]
  • ❗🐌100_tpch_19: 254ms -> 456ms [+65.58%, +94.09%]
  • ❗🐌100_tpch_20: 167ms -> 332ms [+93.6%, +103.37%]
  • ❗🐌100_tpch_21: 1.33s -> 3.45s [+154.74%, +164.53%]
  • ❗🐌100_tpch_22: 151ms -> 201ms [+25.42%, +40.47%]

Further explanation regarding interpretation and methodology can be found in the documentation.

@krlmlr krlmlr force-pushed the f-join-multi-detect branch from bd31e45 to 6c291e1 Compare February 1, 2025 07:09
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Feb 1, 2025

This is how benchmark results would change (along with a 95% confidence interval in relative change) if 6c291e1 is merged into main:

  • ✔️001_tpch_01: 22.3ms -> 22.6ms [-2.89%, +5.54%]
  • ❗🐌001_tpch_02: 66.3ms -> 108ms [+61.51%, +65.82%]
  • ❗🐌001_tpch_03: 42.2ms -> 61.3ms [+42.88%, +47.51%]
  • ❗🐌001_tpch_04: 22.9ms -> 40.3ms [+74.01%, +78.63%]
  • ❗🐌001_tpch_05: 58.8ms -> 106ms [+78.68%, +81.06%]
  • ✔️001_tpch_06: 11.8ms -> 12ms [-2.25%, +4.6%]
  • ❗🐌001_tpch_07: 72.9ms -> 127ms [+70.01%, +77.23%]
  • ❗🐌001_tpch_08: 103ms -> 220ms [+111.88%, +116.37%]
  • ❗🐌001_tpch_09: 71ms -> 121ms [+68.16%, +72.29%]
  • ❗🐌001_tpch_10: 43.3ms -> 75.9ms [+73.52%, +76.98%]
  • ❗🐌001_tpch_11: 39.2ms -> 67.4ms [+69.39%, +74.32%]
  • ❗🐌001_tpch_12: 21.7ms -> 40.5ms [+83.18%, +90.31%]
  • ❗🐌001_tpch_13: 18.8ms -> 23.1ms [+20.15%, +26.22%]
  • ❗🐌001_tpch_14: 16.7ms -> 32.8ms [+94.04%, +98.6%]
  • ❗🐌001_tpch_15: 36.3ms -> 56.9ms [+55.29%, +58.12%]
  • ❗🐌001_tpch_16: 35.6ms -> 49.2ms [+36.51%, +39.35%]
  • ❗🐌001_tpch_17: 31.1ms -> 45.8ms [+45.72%, +48.36%]
  • ❗🐌001_tpch_18: 22.5ms -> 43ms [+88.81%, +93.71%]
  • ❗🐌001_tpch_19: 45.6ms -> 55.7ms [+20.4%, +23.71%]
  • ❗🐌001_tpch_20: 53ms -> 74.9ms [+39.32%, +43.66%]
  • ❗🐌001_tpch_21: 73.9ms -> 141ms [+88%, +92.8%]
  • ❗🐌001_tpch_22: 49.3ms -> 52.4ms [+4.99%, +7.76%]
  • ✔️010_tpch_01: 79.4ms -> 78.2ms [-6.03%, +2.96%]
  • ❗🐌010_tpch_02: 70.1ms -> 121ms [+71.06%, +75.59%]
  • ❗🐌010_tpch_03: 57.4ms -> 108ms [+83.88%, +90.91%]
  • ❗🐌010_tpch_04: 42.5ms -> 81.2ms [+84.97%, +97.3%]
  • ❗🐌010_tpch_05: 88.1ms -> 188ms [+109.21%, +116.71%]
  • ✔️010_tpch_06: 29.8ms -> 29.4ms [-6.16%, +3.5%]
  • ❗🐌010_tpch_07: 105ms -> 200ms [+87.36%, +94.76%]
  • ❗🐌010_tpch_08: 129ms -> 305ms [+131.52%, +142.66%]
  • ❗🐌010_tpch_09: 115ms -> 211ms [+79.82%, +87.08%]
  • ❗🐌010_tpch_10: 75.3ms -> 141ms [+82.48%, +92.06%]
  • ❗🐌010_tpch_11: 37.2ms -> 84.6ms [+123.7%, +131.43%]
  • ❗🐌010_tpch_12: 53.2ms -> 99.5ms [+79.27%, +95.15%]
  • ❗🐌010_tpch_13: 50.5ms -> 57.4ms [+9.91%, +17.77%]
  • ❗🐌010_tpch_14: 34ms -> 54.4ms [+54.14%, +66.17%]
  • ❗🐌010_tpch_15: 51.5ms -> 117ms [+118.16%, +137.73%]
  • ❗🐌010_tpch_16: 38.5ms -> 57.8ms [+45.8%, +53.92%]
  • ❗🐌010_tpch_17: 51.5ms -> 107ms [+101.65%, +113.23%]
  • ❗🐌010_tpch_18: 56.4ms -> 104ms [+80.06%, +90.25%]
  • ❗🐌010_tpch_19: 83.4ms -> 115ms [+34.98%, +40.33%]
  • ❗🐌010_tpch_20: 63.7ms -> 110ms [+68.44%, +76.33%]
  • ❗🐌010_tpch_21: 242ms -> 574ms [+133.24%, +141.08%]
  • ❗🐌010_tpch_22: 52.8ms -> 70.5ms [+31.19%, +35.89%]
  • ✔️100_tpch_01: 320ms -> 320ms [-22.55%, +22.12%]
  • ❗🐌100_tpch_02: 125ms -> 255ms [+94.42%, +113.95%]
  • ❗🐌100_tpch_03: 180ms -> 365ms [+91.6%, +114.71%]
  • ❗🐌100_tpch_04: 153ms -> 308ms [+89.55%, +111.89%]
  • ❗🐌100_tpch_05: 275ms -> 647ms [+120.05%, +150.1%]
  • ✔️100_tpch_06: 102ms -> 93.2ms [-29.35%, +12.14%]
  • ❗🐌100_tpch_07: 228ms -> 550ms [+130.72%, +151.21%]
  • ❗🐌100_tpch_08: 272ms -> 888ms [+221.74%, +231.94%]
  • ❗🐌100_tpch_09: 331ms -> 920ms [+158.09%, +198.08%]
  • ❗🐌100_tpch_10: 212ms -> 479ms [+119.58%, +131.58%]
  • ❗🐌100_tpch_11: 87.1ms -> 242ms [+150.28%, +205.32%]
  • ❗🐌100_tpch_12: 186ms -> 390ms [+89.23%, +130.25%]
  • ✔️100_tpch_13: 332ms -> 346ms [-3.21%, +11.88%]
  • ❗🐌100_tpch_14: 117ms -> 178ms [+40.17%, +62.25%]
  • ❗🐌100_tpch_15: 202ms -> 493ms [+135.76%, +151.12%]
  • ❗🐌100_tpch_16: 120ms -> 172ms [+34.53%, +51.79%]
  • ❗🐌100_tpch_17: 186ms -> 508ms [+159.55%, +187.13%]
  • ❗🐌100_tpch_18: 198ms -> 441ms [+120.51%, +125.31%]
  • ❗🐌100_tpch_19: 258ms -> 474ms [+74.24%, +93.21%]
  • ❗🐌100_tpch_20: 174ms -> 330ms [+73.91%, +105.88%]
  • ❗🐌100_tpch_21: 1.31s -> 3.52s [+159.14%, +177.55%]
  • ❗🐌100_tpch_22: 153ms -> 206ms [+22.92%, +47%]

Further explanation regarding interpretation and methodology can be found in the documentation.

krlmlr added 4 commits February 1, 2025 17:37
@krlmlr
feat: Client-side warning on join explosion
026b19d
@krlmlr
Squashed commit of the following:
b3a8932 
commit db5d405
Author: Kirill Müller <[email protected]>
Date:   Sun Jan 26 06:54:20 2025 +0100

    Sync

commit 7bd1872
Author: Kirill Müller <[email protected]>
Date:   Fri Jan 24 21:23:24 2025 +0100

    Remove dplyr compat code

commit 8d6a573
Author: Kirill Müller <[email protected]>
Date:   Wed Jan 22 16:55:00 2025 +0100

    fix: Avoid forwarding `is.na()` to `is.nan()` to support non-numeric data
@krlmlr
Tests
198d4f7
@krlmlr
Compat: Translate is.na() to isnan()
ec6b80d
@krlmlr krlmlr force-pushed the f-join-multi-detect branch from 6c291e1 to ec6b80d Compare February 1, 2025 16:37
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Feb 1, 2025

This is how benchmark results would change (along with a 95% confidence interval in relative change) if ec6b80d is merged into main:

  • ✔️001_tpch_01: 22.2ms -> 22.4ms [-3.67%, +5.16%]
  • ❗🐌001_tpch_02: 65.6ms -> 108ms [+61.45%, +66.28%]
  • ❗🐌001_tpch_03: 40.1ms -> 58.7ms [+44.5%, +48.11%]
  • ❗🐌001_tpch_04: 22.7ms -> 40.3ms [+74.85%, +80.4%]
  • ❗🐌001_tpch_05: 58.1ms -> 105ms [+78.89%, +81.47%]
  • ✔️001_tpch_06: 12.1ms -> 11.8ms [-5.42%, +0.87%]
  • ❗🐌001_tpch_07: 71.7ms -> 125ms [+72.31%, +75.24%]
  • ❗🐌001_tpch_08: 97.2ms -> 211ms [+115.06%, +118.35%]
  • ❗🐌001_tpch_09: 68.6ms -> 117ms [+69.24%, +72.17%]
  • ❗🐌001_tpch_10: 44.2ms -> 77.3ms [+71.46%, +78.41%]
  • ❗🐌001_tpch_11: 39.8ms -> 68.5ms [+69.14%, +74.91%]
  • ❗🐌001_tpch_12: 21.4ms -> 40.6ms [+86.58%, +93.18%]
  • ❗🐌001_tpch_13: 18.8ms -> 23.1ms [+20.41%, +25.12%]
  • ❗🐌001_tpch_14: 16.7ms -> 32.1ms [+90.74%, +94.77%]
  • ❗🐌001_tpch_15: 36.3ms -> 56.9ms [+55.32%, +58.07%]
  • ❗🐌001_tpch_16: 35.8ms -> 48.9ms [+33.59%, +39.19%]
  • ❗🐌001_tpch_17: 32.2ms -> 47.6ms [+43.65%, +52.49%]
  • ❗🐌001_tpch_18: 22.9ms -> 43.3ms [+85.99%, +92.86%]
  • ❗🐌001_tpch_19: 44.6ms -> 54.4ms [+20.88%, +23.47%]
  • ❗🐌001_tpch_20: 52.1ms -> 74.4ms [+39.42%, +46.19%]
  • ❗🐌001_tpch_21: 74.1ms -> 141ms [+87.95%, +92.51%]
  • ❗🐌001_tpch_22: 47.5ms -> 50.9ms [+5.46%, +9.04%]
  • ✔️010_tpch_01: 78.4ms -> 76.7ms [-7.86%, +3.43%]
  • ❗🐌010_tpch_02: 68.6ms -> 120ms [+71.93%, +76.91%]
  • ❗🐌010_tpch_03: 57.6ms -> 106ms [+79.79%, +88.18%]
  • ❗🐌010_tpch_04: 41.7ms -> 77.7ms [+83.39%, +88.97%]
  • ❗🐌010_tpch_05: 87.6ms -> 186ms [+108.25%, +117.1%]
  • ✔️010_tpch_06: 30.8ms -> 31ms [-8.5%, +9.73%]
  • ❗🐌010_tpch_07: 104ms -> 201ms [+87.89%, +97.86%]
  • ❗🐌010_tpch_08: 128ms -> 304ms [+131.5%, +142.53%]
  • ❗🐌010_tpch_09: 117ms -> 215ms [+78.08%, +89.1%]
  • ❗🐌010_tpch_10: 73.7ms -> 146ms [+94.22%, +102.43%]
  • ❗🐌010_tpch_11: 38.9ms -> 84.4ms [+111.75%, +122.1%]
  • ❗🐌010_tpch_12: 52.3ms -> 102ms [+88.02%, +100.49%]
  • ❗🐌010_tpch_13: 51.1ms -> 59.2ms [+11.42%, +20.2%]
  • ❗🐌010_tpch_14: 34.4ms -> 53.2ms [+52.65%, +56.94%]
  • ❗🐌010_tpch_15: 52.9ms -> 117ms [+114.8%, +127.85%]
  • ❗🐌010_tpch_16: 41.3ms -> 60.3ms [+41.45%, +50.65%]
  • ❗🐌010_tpch_17: 57.3ms -> 111ms [+82.35%, +104.79%]
  • ❗🐌010_tpch_18: 52.3ms -> 107ms [+97.37%, +112.94%]
  • ❗🐌010_tpch_19: 83ms -> 115ms [+35.09%, +42.09%]
  • ❗🐌010_tpch_20: 64.5ms -> 111ms [+66.37%, +79.06%]
  • ❗🐌010_tpch_21: 238ms -> 573ms [+136.76%, +145.71%]
  • ❗🐌010_tpch_22: 53ms -> 68.9ms [+25.9%, +33.79%]
  • ✔️100_tpch_01: 316ms -> 321ms [-19.83%, +22.51%]
  • ❗🐌100_tpch_02: 124ms -> 257ms [+98.16%, +115.79%]
  • ❗🐌100_tpch_03: 172ms -> 357ms [+97.01%, +118.68%]
  • ❗🐌100_tpch_04: 149ms -> 302ms [+95.09%, +109.87%]
  • ❗🐌100_tpch_05: 284ms -> 622ms [+108.17%, +129.46%]
  • ✔️100_tpch_06: 98.4ms -> 94.6ms [-19.89%, +12.14%]
  • ❗🐌100_tpch_07: 235ms -> 562ms [+124.25%, +153.67%]
  • ❗🐌100_tpch_08: 257ms -> 902ms [+240.57%, +260.75%]
  • ❗🐌100_tpch_09: 337ms -> 894ms [+149.14%, +181.92%]
  • ❗🐌100_tpch_10: 210ms -> 474ms [+118.05%, +133.96%]
  • ❗🐌100_tpch_11: 86.5ms -> 234ms [+155.32%, +184.5%]
  • ❗🐌100_tpch_12: 175ms -> 372ms [+102.44%, +121.53%]
  • ✔️100_tpch_13: 328ms -> 337ms [-11.25%, +16.48%]
  • ❗🐌100_tpch_14: 118ms -> 185ms [+38.36%, +75.95%]
  • ❗🐌100_tpch_15: 204ms -> 490ms [+133.28%, +146.99%]
  • ❗🐌100_tpch_16: 119ms -> 173ms [+34.46%, +57.81%]
  • ❗🐌100_tpch_17: 172ms -> 504ms [+178.85%, +205.78%]
  • ❗🐌100_tpch_18: 191ms -> 423ms [+112.84%, +129.3%]
  • ❗🐌100_tpch_19: 267ms -> 477ms [+66.95%, +90.94%]
  • ❗🐌100_tpch_20: 171ms -> 329ms [+81.54%, +103.71%]
  • ❗🐌100_tpch_21: 1.27s -> 3.53s [+169.51%, +187.56%]
  • ❗🐌100_tpch_22: 149ms -> 198ms [+30.08%, +36.12%]

Further explanation regarding interpretation and methodology can be found in the documentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@krlmlr