Simplify error types, remove kind from struct by robert3005 · Pull Request #10080 · vortex-data/vortex

robert3005 · 2026-09-26T21:32:45Z

Instead of error being an enum we convert an error to be a struct with message and error kind. I had followed the structure of Python errors which have couple error categories https://docs.python.org/3/builtins/exceptions.html#exception-hierarchy majority of which don't apply to this project

ghost · 2026-09-26T21:45:26Z

Merging this PR will regress 19 benchmarks

4 warnings, 1 note

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ Unable to measure the execution of 2 benchmarks

These benchmarks measured no execution time, so their results are not comparable and count as unchanged. This usually happens when the compiler removes the code under test.

Prevent compiler optimizations

See affected benchmarks

⚠️ 17 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚠️ Base and head ran on different runner types

Some benchmarks with significant performance changes were compared across different runner types, so the changes might not come from the code. Run base and head on the same runner type, or use CodSpeed Macro Runners for more stable results.

Learn more about Macro Runners

Open the report in CodSpeed to investigate

ℹ️ 40 benchmarks have no flamegraph

The flamegraph wasn't generated: the symbols of the profiling trace could not be resolved, because no information about the language frames was collected.

See affected benchmarks

⚡ 17 improved benchmarks
❌ 19 regressed benchmarks
✅ 2372 untouched benchmarks
⏩ 12 skipped benchmarks¹
🗄️ 43 archived benchmarks run²

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
❌	CPU Simulation	`decode_bool_nullable[10000_2_alternating_mostly_valid]`	357.9 µs	470 µs	-23.84%
❌	CPU Simulation	`decode_bool_nullable[10000_10_mostly_true_mostly_valid]`	88 µs	110.4 µs	-20.31%
❌	CPU Simulation	`decode_bool_nullable[10000_10_alternating_mostly_null]`	88.5 µs	111 µs	-20.31%
❌	CPU Simulation	`decode_bool_nullable[10000_10_alternating_half_valid]`	105.3 µs	127 µs	-17.08%
❌	CPU Simulation	`decode_bool_nullable[10000_10_mostly_true_half_valid]`	107.7 µs	129.2 µs	-16.63%
❌	CPU Simulation	`decode_bool_nullable[10000_10_mostly_true_mostly_null]`	107.8 µs	128.8 µs	-16.29%
❌	CPU Simulation	`decode_bool_nullable[10000_10_alternating_mostly_valid]`	116.9 µs	138.8 µs	-15.83%
❌	CPU Simulation	`filter_powerlaw_by_mostly_true[250000]`	161.2 µs	189.9 µs	-15.12%
❌	CPU Simulation	`filter_powerlaw_by_mostly_true[100000]`	62.6 µs	73.5 µs	-14.78%
❌	CPU Simulation	`density_sweep_dense_runs[0.9]`	67.2 µs	77.6 µs	-13.38%
❌	CPU Simulation	`filter_random_by_mostly_true[250000]`	197.7 µs	226.3 µs	-12.62%
❌	CPU Simulation	`filter_powerlaw_by_random[250000]`	152.8 µs	174.6 µs	-12.48%
❌	CPU Simulation	`rank_indices[(0.05, 0.05, "self_sparse_rank_sparse")]`	49.2 µs	55.9 µs	-12.09%
❌	CPU Simulation	`density_sweep_dense_runs[0.001]`	52.6 µs	59.8 µs	-11.99%
❌	CPU Simulation	`filter_random_by_random[250000]`	183.2 µs	205.1 µs	-10.64%
❌	CPU Simulation	`split[(65536, Microseconds)]`	2.1 ms	2.4 ms	-10.39%
❌	CPU Simulation	`density_sweep_random[0.9]`	93.8 µs	104.5 µs	-10.25%
❌	CPU Simulation	`density_sweep_random[0.95]`	94.3 µs	104.9 µs	-10.13%
❌	CPU Simulation	`filter_random_by_mostly_true[100000]`	93.9 µs	104.5 µs	-10.13%
⚡	Walltime	`filter_neon[8]`	1,374 ns	897 ns	+53.18%
...	...	...	...	...	...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

_{Comparing claude/affectionate-keller-4j7w5g (be70183) with develop (e5a4e66)}

12 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
43 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them. ↩

ghost · 2026-10-06T16:36:31Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`803a0e9`	random-access-bench	1	Explore Profiling Data
🟢 Done	`803a0e9`	statpopgen	1	Explore Profiling Data
🟢 Done	`803a0e9`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`803a0e9`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`803a0e9`	tpch-s3-10	1	Explore Profiling Data
🟢 Done	`803a0e9`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`803a0e9`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`803a0e9`	appian-nvme	1	Explore Profiling Data
🟢 Done	`803a0e9`	fineweb	1	Explore Profiling Data
🟢 Done	`803a0e9`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`803a0e9`	tpch-s3	1	Explore Profiling Data
🟢 Done	`803a0e9`	polarsignals	1	Explore Profiling Data
🟢 Done	`803a0e9`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`803a0e9`	string-bench	1	Explore Profiling Data
🟢 Done	`803a0e9`	compress-bench	1	Explore Profiling Data

Powered by Polar Signals Cloud

ghost · 2026-10-06T16:38:44Z

Benchmarks: PolarSignals Profiling 📖

Commits: PR 803a0e97 vs base d14fa267
Vortex (geomean): hot 0.995x ➖ · cold 0.953x ➖

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed	57521773 / 57317544 / +0.4%	99524679 / 97928868 / +1.6%	0.58 / 0.59 / -1.3%
polarsignals_q01/datafusion:vortex-file-compressed	63442686 / 63142532 / +0.5%	122528124 / 118107090 / +3.7%	0.52 / 0.53 / -3.1%
polarsignals_q02/datafusion:vortex-file-compressed	71275080 / 74991928 / -5.0%	111561998 / 110897201 / +0.6%	0.64 / 0.68 / -5.5%
polarsignals_q03/datafusion:vortex-file-compressed	78889984 / 79309482 / -0.5%	136988726 / 139390394 / -1.7%	0.58 / 0.57 / +1.2%
polarsignals_q04/datafusion:vortex-file-compressed	9529780 / 9450924 / +0.8%	43929606 / 50285914 / -12.6% 🟢	0.22 / 0.19 / +15.4%
polarsignals_q05/datafusion:vortex-file-compressed	23988265 / 24455828 / -1.9%	61632006 / 66156092 / -6.8%	0.39 / 0.37 / +5.3%
polarsignals_q06/datafusion:vortex-file-compressed	21259022 / 21618406 / -1.7%	58853774 / 64157934 / -8.3%	0.36 / 0.34 / +7.2%
polarsignals_q07/datafusion:vortex-file-compressed	40051986 / 39355384 / +1.8%	74963116 / 80330419 / -6.7%	0.53 / 0.49 / +9.1%
polarsignals_q08/datafusion:vortex-file-compressed	98490302 / 98283526 / +0.2%	160065656 / 162508232 / -1.5%	0.62 / 0.60 / +1.7%
polarsignals_q09/datafusion:vortex-file-compressed	10047554 / 10035842 / +0.1%	43936494 / 50814345 / -13.5% 🟢	0.23 / 0.20 / +15.8%

No file size changes detected.

ghost · 2026-10-06T16:39:25Z

Benchmarks: String Encoding 📖

Commits: PR 803a0e97 vs base d14fa267

vortex / vortex-file-compressed / ms (0.997x ➖, 0↑ 0↓)

name	ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst	32.918642 / 32.992732 / -0.2%
read/clickbench/URL/shard-0/onpair-12	21.026052 / 21.216838 / -0.9%
read/tpch/l_comment/fsst	57.587585 / 57.772318 / -0.3%
read/tpch/l_comment/onpair-12	53.143772 / 53.666464 / -1.0%
write/clickbench/URL/shard-0/fsst	590.274547 / 590.551082 / -0.0%
write/clickbench/URL/shard-0/onpair-12	964.199331 / 966.462135 / -0.2%
write/tpch/l_comment/fsst	1898.41622 / 1907.62489 / -0.5%
write/tpch/l_comment/onpair-12	2091.86152 / 2077.97297 / +0.7%

vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)

name	% (PR / base / %diff)
size/clickbench/URL/shard-0/fsst	47.4055438 / 47.4055438 / +0.0%
size/clickbench/URL/shard-0/onpair-12	30.2301956 / 30.2301956 / +0.0%
size/tpch/l_comment/fsst	30.5819725 / 30.5819725 / +0.0%
size/tpch/l_comment/onpair-12	25.8644092 / 25.8644092 / +0.0%

ghost · 2026-10-06T16:39:30Z

Benchmarks: FineWeb NVMe 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.5%
Engines: DataFusion No clear signal (-5.3%, low confidence) · DuckDB No clear signal (+10.9%, low confidence)
Vortex (geomean): hot 1.017x ➖ · cold 0.976x ➖
Parquet (geomean): hot 0.992x ➖ · cold 0.986x ➖
Shifts: Parquet (control) -0.8% · Median polish +0.7%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	6810289 / 6877636 / -1.0%	19975354 / 20518940 / -2.6%	0.34 / 0.34 / +1.7%
fineweb_q01/datafusion:vortex-file-compressed	11694139 / 11614300 / +0.7%	48845164 / 46509928 / +5.0%	0.24 / 0.25 / -4.1%
fineweb_q02/datafusion:vortex-file-compressed	13304257 / 13579799 / -2.0%	48839280 / 52307664 / -6.6%	0.27 / 0.26 / +4.9%
fineweb_q03/datafusion:vortex-file-compressed	22363004 / 22520587 / -0.7%	109988428 / 111958005 / -1.8%	0.20 / 0.20 / +1.1%
fineweb_q04/datafusion:vortex-file-compressed	80999596 / 80821634 / +0.2%	162928651 / 176250399 / -7.6%	0.50 / 0.46 / +8.4%
fineweb_q05/datafusion:vortex-file-compressed	69559064 / 69251003 / +0.4%	150884364 / 149472847 / +0.9%	0.46 / 0.46 / -0.5%
fineweb_q06/datafusion:vortex-file-compressed	18893584 / 20024614 / -5.6%	112980497 / 113214716 / -0.2%	0.17 / 0.18 / -5.5%
fineweb_q07/datafusion:vortex-file-compressed	18641258 / 18366988 / +1.5%	109847777 / 109964816 / -0.1%	0.17 / 0.17 / +1.6%
fineweb_q08/datafusion:vortex-file-compressed	10270002 / 9488287 / +8.2%	47174717 / 51199262 / -7.9%	0.22 / 0.19 / +17.5%

datafusion / vortex-compact / ns (0.911x ➖, 2↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	7023609 / 6933958 / +1.3%	19597719 / 19216778 / +2.0%	0.36 / 0.36 / -0.7%
fineweb_q01/datafusion:vortex-compact	44600887 / 76671738 / -41.8% 🟢	76115063 / 80915414 / -5.9%	0.59 / 0.95 / -38.2%
fineweb_q02/datafusion:vortex-compact	44461360 / 75146860 / -40.8% 🟢	78238524 / 81459730 / -4.0%	0.57 / 0.92 / -38.4%
fineweb_q03/datafusion:vortex-compact	157068960 / 156861436 / +0.1%	234349012 / 229391648 / +2.2%	0.67 / 0.68 / -2.0%
fineweb_q04/datafusion:vortex-compact	190005529 / 164760918 / +15.3% 🔴	243188736 / 248840106 / -2.3%	0.78 / 0.66 / +18.0%
fineweb_q05/datafusion:vortex-compact	152976576 / 156094488 / -2.0%	229075783 / 233789180 / -2.0%	0.67 / 0.67 / +0.0%
fineweb_q06/datafusion:vortex-compact	86795716 / 87172252 / -0.4%	171685154 / 158664667 / +8.2%	0.51 / 0.55 / -8.0%
fineweb_q07/datafusion:vortex-compact	87446550 / 87955427 / -0.6%	161888840 / 154508824 / +4.8%	0.54 / 0.57 / -5.1%
fineweb_q08/datafusion:vortex-compact	9440290 / 8544773 / +10.5% 🔴	34679965 / 38295498 / -9.4%	0.27 / 0.22 / +22.0%

datafusion / parquet / ns (1.008x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	9356237 / 9216540 / +1.5%	34066924 / 34984218 / -2.6%	0.27 / 0.26 / +4.2%
fineweb_q01/datafusion:parquet	75321341 / 74705005 / +0.8%	166294368 / 163715212 / +1.6%	0.45 / 0.46 / -0.7%
fineweb_q02/datafusion:parquet	73989936 / 75109586 / -1.5%	162864758 / 171914108 / -5.3%	0.45 / 0.44 / +4.0%
fineweb_q03/datafusion:parquet	74156138 / 74041848 / +0.2%	161222024 / 161934348 / -0.4%	0.46 / 0.46 / +0.6%
fineweb_q04/datafusion:parquet	82972330 / 81954217 / +1.2%	163517720 / 164122823 / -0.4%	0.51 / 0.50 / +1.6%
fineweb_q05/datafusion:parquet	80359899 / 80319829 / +0.0%	161566387 / 161271505 / +0.2%	0.50 / 0.50 / -0.1%
fineweb_q06/datafusion:parquet	77481474 / 76627324 / +1.1%	166526708 / 163519557 / +1.8%	0.47 / 0.47 / -0.7%
fineweb_q07/datafusion:parquet	77989012 / 75117928 / +3.8%	164695022 / 175294568 / -6.0%	0.47 / 0.43 / +10.5%
fineweb_q08/datafusion:parquet	73457736 / 73228698 / +0.3%	159591219 / 165713482 / -3.7%	0.46 / 0.44 / +4.2%

duckdb / vortex-file-compressed / ns (1.072x ➖, 1↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	2395498 / 1996238 / +20.0% 🔴	4745807 / 8563761 / -44.6% 🟢	0.50 / 0.23 / +116.5%
fineweb_q01/duckdb:vortex-file-compressed	20578084 / 20614678 / -0.2%	59317932 / 60627423 / -2.2%	0.35 / 0.34 / +2.0%
fineweb_q02/duckdb:vortex-file-compressed	21490088 / 21433524 / +0.3%	50353940 / 62278797 / -19.1% 🟢	0.43 / 0.34 / +24.0%
fineweb_q03/duckdb:vortex-file-compressed	22539143 / 27384763 / -17.7% 🟢	90405418 / 99019023 / -8.7%	0.25 / 0.28 / -9.9%
fineweb_q04/duckdb:vortex-file-compressed	98994122 / 92563890 / +6.9%	187261156 / 205578133 / -8.9%	0.53 / 0.45 / +17.4%
fineweb_q05/duckdb:vortex-file-compressed	66463570 / 71161496 / -6.6%	112522920 / 121753589 / -7.6%	0.59 / 0.58 / +1.1%
fineweb_q06/duckdb:vortex-file-compressed	50839372 / 37521218 / +35.5% 🔴	137514143 / 118973203 / +15.6% 🔴	0.37 / 0.32 / +17.2%
fineweb_q07/duckdb:vortex-file-compressed	43312344 / 30302681 / +42.9% 🔴	120836321 / 98872508 / +22.2% 🔴	0.36 / 0.31 / +17.0%
fineweb_q08/duckdb:vortex-file-compressed	6401110 / 6532296 / -2.0%	15806817 / 14647467 / +7.9%	0.40 / 0.45 / -9.2%

duckdb / vortex-compact / ns (1.093x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	3748414 / 2203808 / +70.1% 🔴	4999846 / 5222609 / -4.3%	0.75 / 0.42 / +77.7%
fineweb_q01/duckdb:vortex-compact	56173930 / 51222292 / +9.7%	102005815 / 84297220 / +21.0% 🔴	0.55 / 0.61 / -9.4%
fineweb_q02/duckdb:vortex-compact	47173482 / 51024425 / -7.5%	71484680 / 81502346 / -12.3% 🟢	0.66 / 0.63 / +5.4%
fineweb_q03/duckdb:vortex-compact	188195326 / 183415626 / +2.6%	270354480 / 293256715 / -7.8%	0.70 / 0.63 / +11.3%
fineweb_q04/duckdb:vortex-compact	202908492 / 192641918 / +5.3%	216379298 / 219572840 / -1.5%	0.94 / 0.88 / +6.9%
fineweb_q05/duckdb:vortex-compact	189989976 / 178456040 / +6.5%	212719373 / 203997044 / +4.3%	0.89 / 0.87 / +2.1%
fineweb_q06/duckdb:vortex-compact	117276656 / 105687334 / +11.0% 🔴	211894740 / 187288006 / +13.1% 🔴	0.55 / 0.56 / -1.9%
fineweb_q07/duckdb:vortex-compact	116802202 / 106831414 / +9.3%	207913244 / 167036769 / +24.5% 🔴	0.56 / 0.64 / -12.2%
fineweb_q08/duckdb:vortex-compact	6039769 / 6508628 / -7.2%	11278156 / 13907663 / -18.9% 🟢	0.54 / 0.47 / +14.4%

duckdb / parquet / ns (0.977x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	21522692 / 23909568 / -10.0%	23409326 / 23353558 / +0.2%	0.92 / 1.02 / -10.2%
fineweb_q01/duckdb:parquet	44403416 / 44907796 / -1.1%	54944654 / 54334055 / +1.1%	0.81 / 0.83 / -2.2%
fineweb_q02/duckdb:parquet	44029645 / 44407357 / -0.9%	52896076 / 56968068 / -7.1%	0.83 / 0.78 / +6.8%
fineweb_q03/duckdb:parquet	94648662 / 94195542 / +0.5%	180497705 / 187225344 / -3.6%	0.52 / 0.50 / +4.2%
fineweb_q04/duckdb:parquet	151465774 / 153598481 / -1.4%	199624246 / 213207338 / -6.4%	0.76 / 0.72 / +5.3%
fineweb_q05/duckdb:parquet	143424534 / 143199828 / +0.2%	187750843 / 192941215 / -2.7%	0.76 / 0.74 / +2.9%
fineweb_q06/duckdb:parquet	71151942 / 72442141 / -1.8%	125957442 / 122688323 / +2.7%	0.56 / 0.59 / -4.3%
fineweb_q07/duckdb:parquet	72276541 / 73003458 / -1.0%	159484975 / 152103411 / +4.9%	0.45 / 0.48 / -5.6%
fineweb_q08/duckdb:parquet	24080871 / 25382006 / -5.1%	23916590 / 23699025 / +0.9%	1.01 / 1.07 / -6.0%

No file size changes detected.

ghost · 2026-10-06T16:40:21Z

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-1.2%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.987x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	16339184 / 16596111 / -1.5%	45714833 / 45362999 / +0.8%	0.36 / 0.37 / -2.3%
tpch_q02/datafusion:vortex-file-compressed	17285731 / 17246066 / +0.2%	35827852 / 36194628 / -1.0%	0.48 / 0.48 / +1.3%
tpch_q03/datafusion:vortex-file-compressed	19272347 / 19267747 / +0.0%	47800939 / 45834358 / +4.3%	0.40 / 0.42 / -4.1%
tpch_q04/datafusion:vortex-file-compressed	10327574 / 9941807 / +3.9%	31573267 / 30647990 / +3.0%	0.33 / 0.32 / +0.8%
tpch_q05/datafusion:vortex-file-compressed	36843357 / 37070594 / -0.6%	64567024 / 64286558 / +0.4%	0.57 / 0.58 / -1.0%
tpch_q06/datafusion:vortex-file-compressed	6362680 / 6246992 / +1.9%	28906200 / 28671378 / +0.8%	0.22 / 0.22 / +1.0%
tpch_q07/datafusion:vortex-file-compressed	51738759 / 51525410 / +0.4%	80570232 / 81460410 / -1.1%	0.64 / 0.63 / +1.5%
tpch_q08/datafusion:vortex-file-compressed	51874353 / 52712844 / -1.6%	80084344 / 82884300 / -3.4%	0.65 / 0.64 / +1.8%
tpch_q09/datafusion:vortex-file-compressed	49864859 / 48840919 / +2.1%	77973224 / 75757643 / +2.9%	0.64 / 0.64 / -0.8%
tpch_q10/datafusion:vortex-file-compressed	16876994 / 16987350 / -0.6%	50188698 / 48616738 / +3.2%	0.34 / 0.35 / -3.8%
tpch_q11/datafusion:vortex-file-compressed	15235051 / 15340333 / -0.7%	33397312 / 34291896 / -2.6%	0.46 / 0.45 / +2.0%
tpch_q12/datafusion:vortex-file-compressed	22058047 / 22016513 / +0.2%	44192405 / 45119695 / -2.1%	0.50 / 0.49 / +2.3%
tpch_q13/datafusion:vortex-file-compressed	20202965 / 20144546 / +0.3%	40755495 / 40549276 / +0.5%	0.50 / 0.50 / -0.2%
tpch_q14/datafusion:vortex-file-compressed	14913367 / 14652541 / +1.8%	38042481 / 40415630 / -5.9%	0.39 / 0.36 / +8.1%
tpch_q15/datafusion:vortex-file-compressed	18661263 / 18606073 / +0.3%	45411696 / 46720872 / -2.8%	0.41 / 0.40 / +3.2%
tpch_q16/datafusion:vortex-file-compressed	18667764 / 18656902 / +0.1%	38114730 / 37907576 / +0.5%	0.49 / 0.49 / -0.5%
tpch_q17/datafusion:vortex-file-compressed	28624531 / 28247576 / +1.3%	57299326 / 60044628 / -4.6%	0.50 / 0.47 / +6.2%
tpch_q18/datafusion:vortex-file-compressed	36495990 / 36347210 / +0.4%	57675251 / 56285511 / +2.5%	0.63 / 0.65 / -2.0%
tpch_q19/datafusion:vortex-file-compressed	13550936 / 13555612 / -0.0%	36379227 / 38696101 / -6.0%	0.37 / 0.35 / +6.3%
tpch_q20/datafusion:vortex-file-compressed	20716834 / 20769001 / -0.3%	44583553 / 44108855 / +1.1%	0.46 / 0.47 / -1.3%
tpch_q21/datafusion:vortex-file-compressed	39838130 / 39142457 / +1.8%	67288636 / 66470665 / +1.2%	0.59 / 0.59 / +0.5%
tpch_q22/datafusion:vortex-file-compressed	11280279 / 11170710 / +1.0%	30882722 / 31768096 / -2.8%	0.37 / 0.35 / +3.9%

datafusion / vortex-compact / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	17380703 / 17433703 / -0.3%	43405688 / 42991175 / +1.0%	0.40 / 0.41 / -1.3%
tpch_q02/datafusion:vortex-compact	19786117 / 19825696 / -0.2%	36908465 / 37369698 / -1.2%	0.54 / 0.53 / +1.0%
tpch_q03/datafusion:vortex-compact	20196510 / 20308443 / -0.6%	46290053 / 44759053 / +3.4%	0.44 / 0.45 / -3.8%
tpch_q04/datafusion:vortex-compact	11884761 / 11394410 / +4.3%	32849673 / 30792348 / +6.7%	0.36 / 0.37 / -2.2%
tpch_q05/datafusion:vortex-compact	37755272 / 38021015 / -0.7%	62706228 / 64261749 / -2.4%	0.60 / 0.59 / +1.8%
tpch_q06/datafusion:vortex-compact	6721533 / 6869516 / -2.2%	27502182 / 28827183 / -4.6%	0.24 / 0.24 / +2.6%
tpch_q07/datafusion:vortex-compact	52334216 / 52479236 / -0.3%	81186839 / 80039553 / +1.4%	0.64 / 0.66 / -1.7%
tpch_q08/datafusion:vortex-compact	52561030 / 52879198 / -0.6%	83336970 / 82398367 / +1.1%	0.63 / 0.64 / -1.7%
tpch_q09/datafusion:vortex-compact	51095909 / 51551240 / -0.9%	76634014 / 75271582 / +1.8%	0.67 / 0.68 / -2.6%
tpch_q10/datafusion:vortex-compact	18955237 / 19188621 / -1.2%	46672379 / 49344559 / -5.4%	0.41 / 0.39 / +4.4%
tpch_q11/datafusion:vortex-compact	15915617 / 16567052 / -3.9%	33780587 / 35038612 / -3.6%	0.47 / 0.47 / -0.4%
tpch_q12/datafusion:vortex-compact	24089740 / 23790837 / +1.3%	45539906 / 45343948 / +0.4%	0.53 / 0.52 / +0.8%
tpch_q13/datafusion:vortex-compact	21101334 / 20687020 / +2.0%	41265634 / 39622301 / +4.1%	0.51 / 0.52 / -2.1%
tpch_q14/datafusion:vortex-compact	16335489 / 16485717 / -0.9%	42333919 / 40345247 / +4.9%	0.39 / 0.41 / -5.6%
tpch_q15/datafusion:vortex-compact	19654657 / 19610332 / +0.2%	45795753 / 46133844 / -0.7%	0.43 / 0.43 / +1.0%
tpch_q16/datafusion:vortex-compact	19366118 / 18859009 / +2.7%	39124421 / 38812468 / +0.8%	0.49 / 0.49 / +1.9%
tpch_q17/datafusion:vortex-compact	28812203 / 28843313 / -0.1%	55927560 / 58322572 / -4.1%	0.52 / 0.49 / +4.2%
tpch_q18/datafusion:vortex-compact	38185493 / 37685147 / +1.3%	57017603 / 58750865 / -3.0%	0.67 / 0.64 / +4.4%
tpch_q19/datafusion:vortex-compact	16201513 / 16555675 / -2.1%	40705905 / 41008422 / -0.7%	0.40 / 0.40 / -1.4%
tpch_q20/datafusion:vortex-compact	21931723 / 21927610 / +0.0%	44209523 / 45778930 / -3.4%	0.50 / 0.48 / +3.6%
tpch_q21/datafusion:vortex-compact	42145663 / 41491053 / +1.6%	67934766 / 70010720 / -3.0%	0.62 / 0.59 / +4.7%
tpch_q22/datafusion:vortex-compact	11366768 / 11659635 / -2.5%	31135542 / 31792399 / -2.1%	0.37 / 0.37 / -0.5%

datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	72158776 / 72490481 / -0.5%	89647292 / 89984748 / -0.4%	0.80 / 0.81 / -0.1%
tpch_q02/datafusion:parquet	57516829 / 57492562 / +0.0%	76818495 / 76137334 / +0.9%	0.75 / 0.76 / -0.8%
tpch_q03/datafusion:parquet	84329250 / 84151754 / +0.2%	106203074 / 107115518 / -0.9%	0.79 / 0.79 / +1.1%
tpch_q04/datafusion:parquet	46519598 / 46923988 / -0.9%	66131914 / 67076007 / -1.4%	0.70 / 0.70 / +0.6%
tpch_q05/datafusion:parquet	99722453 / 98916511 / +0.8%	128590069 / 131305903 / -2.1%	0.78 / 0.75 / +2.9%
tpch_q06/datafusion:parquet	31833220 / 31960243 / -0.4%	50033820 / 51513089 / -2.9%	0.64 / 0.62 / +2.5%
tpch_q07/datafusion:parquet	108711511 / 105231696 / +3.3%	136346784 / 134985035 / +1.0%	0.80 / 0.78 / +2.3%
tpch_q08/datafusion:parquet	112901811 / 112468236 / +0.4%	136287871 / 136874847 / -0.4%	0.83 / 0.82 / +0.8%
tpch_q09/datafusion:parquet	130110663 / 130674630 / -0.4%	158972076 / 159447190 / -0.3%	0.82 / 0.82 / -0.1%
tpch_q10/datafusion:parquet	104215837 / 103991190 / +0.2%	132190898 / 132853613 / -0.5%	0.79 / 0.78 / +0.7%
tpch_q11/datafusion:parquet	41557920 / 42303074 / -1.8%	65120583 / 65258651 / -0.2%	0.64 / 0.65 / -1.6%
tpch_q12/datafusion:parquet	68870619 / 68664940 / +0.3%	90511502 / 91557426 / -1.1%	0.76 / 0.75 / +1.5%
tpch_q13/datafusion:parquet	186906651 / 186888037 / +0.0%	209724870 / 209181913 / +0.3%	0.89 / 0.89 / -0.2%
tpch_q14/datafusion:parquet	47935462 / 47986868 / -0.1%	79277801 / 73378678 / +8.0%	0.60 / 0.65 / -7.5%
tpch_q15/datafusion:parquet	54266255 / 54301500 / -0.1%	75711452 / 76064907 / -0.5%	0.72 / 0.71 / +0.4%
tpch_q16/datafusion:parquet	40814332 / 40900391 / -0.2%	59516020 / 61115408 / -2.6%	0.69 / 0.67 / +2.5%
tpch_q17/datafusion:parquet	128759008 / 128527288 / +0.2%	152788726 / 150761137 / +1.3%	0.84 / 0.85 / -1.1%
tpch_q18/datafusion:parquet	129701299 / 131479924 / -1.4%	154050481 / 151032090 / +2.0%	0.84 / 0.87 / -3.3%
tpch_q19/datafusion:parquet	59786304 / 58705825 / +1.8%	84941242 / 85739356 / -0.9%	0.70 / 0.68 / +2.8%
tpch_q20/datafusion:parquet	67669408 / 68354339 / -1.0%	94124388 / 89852788 / +4.8%	0.72 / 0.76 / -5.5%
tpch_q21/datafusion:parquet	107747175 / 109015245 / -1.2%	131571081 / 130313995 / +1.0%	0.82 / 0.84 / -2.1%
tpch_q22/datafusion:parquet	46860430 / 47296791 / -0.9%	63430152 / 67537966 / -6.1%	0.74 / 0.70 / +5.5%

duckdb / vortex-file-compressed / ns (0.980x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	11405947 / 10906572 / +4.6%	18620981 / 20413658 / -8.8%	0.61 / 0.53 / +14.6%
tpch_q02/duckdb:vortex-file-compressed	17254389 / 17264906 / -0.1%	27900379 / 26731875 / +4.4%	0.62 / 0.65 / -4.2%
tpch_q03/duckdb:vortex-file-compressed	18446664 / 18609317 / -0.9%	33940292 / 34112601 / -0.5%	0.54 / 0.55 / -0.4%
tpch_q04/duckdb:vortex-file-compressed	17160835 / 17834409 / -3.8%	30511112 / 30585262 / -0.2%	0.56 / 0.58 / -3.5%
tpch_q05/duckdb:vortex-file-compressed	22140735 / 22160205 / -0.1%	35158045 / 35572108 / -1.2%	0.63 / 0.62 / +1.1%
tpch_q06/duckdb:vortex-file-compressed	5665099 / 7640009 / -25.8% 🟢	16983792 / 14428469 / +17.7% 🔴	0.33 / 0.53 / -37.0%
tpch_q07/duckdb:vortex-file-compressed	19956205 / 20913159 / -4.6%	40387779 / 41985402 / -3.8%	0.49 / 0.50 / -0.8%
tpch_q08/duckdb:vortex-file-compressed	23044435 / 23832345 / -3.3%	38763146 / 41846014 / -7.4%	0.59 / 0.57 / +4.4%
tpch_q09/duckdb:vortex-file-compressed	30558774 / 30256866 / +1.0%	46987739 / 50302071 / -6.6%	0.65 / 0.60 / +8.1%
tpch_q10/duckdb:vortex-file-compressed	27477779 / 27471895 / +0.0%	39540150 / 46478272 / -14.9% 🟢	0.69 / 0.59 / +17.6%
tpch_q11/duckdb:vortex-file-compressed	8591376 / 8580147 / +0.1%	13315353 / 14668079 / -9.2%	0.65 / 0.58 / +10.3%
tpch_q12/duckdb:vortex-file-compressed	15906176 / 16570924 / -4.0%	29304325 / 34014973 / -13.8% 🟢	0.54 / 0.49 / +11.4%
tpch_q13/duckdb:vortex-file-compressed	21898208 / 23227058 / -5.7%	39862437 / 40556588 / -1.7%	0.55 / 0.57 / -4.1%
tpch_q14/duckdb:vortex-file-compressed	13182443 / 13085101 / +0.7%	25791953 / 26368107 / -2.2%	0.51 / 0.50 / +3.0%
tpch_q15/duckdb:vortex-file-compressed	9724043 / 9535676 / +2.0%	18483283 / 19517850 / -5.3%	0.53 / 0.49 / +7.7%
tpch_q16/duckdb:vortex-file-compressed	18360641 / 18330454 / +0.2%	25632732 / 25956170 / -1.2%	0.72 / 0.71 / +1.4%
tpch_q17/duckdb:vortex-file-compressed	16689878 / 15438035 / +8.1%	36211359 / 31627782 / +14.5% 🔴	0.46 / 0.49 / -5.6%
tpch_q18/duckdb:vortex-file-compressed	25270777 / 26131185 / -3.3%	34792080 / 34732042 / +0.2%	0.73 / 0.75 / -3.5%
tpch_q19/duckdb:vortex-file-compressed	22904877 / 23455919 / -2.3%	31059765 / 34636633 / -10.3% 🟢	0.74 / 0.68 / +8.9%
tpch_q20/duckdb:vortex-file-compressed	16854035 / 16980464 / -0.7%	34141276 / 35674941 / -4.3%	0.49 / 0.48 / +3.7%
tpch_q21/duckdb:vortex-file-compressed	66803383 / 67343025 / -0.8%	89457923 / 82191398 / +8.8%	0.75 / 0.82 / -8.9%
tpch_q22/duckdb:vortex-file-compressed	12222450 / 12270267 / -0.4%	19855726 / 22690097 / -12.5% 🟢	0.62 / 0.54 / +13.8%

duckdb / vortex-compact / ns (0.988x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	14253767 / 13947326 / +2.2%	23246565 / 23765110 / -2.2%	0.61 / 0.59 / +4.5%
tpch_q02/duckdb:vortex-compact	20017362 / 19985865 / +0.2%	31273027 / 27492796 / +13.7% 🔴	0.64 / 0.73 / -11.9%
tpch_q03/duckdb:vortex-compact	18621378 / 19843289 / -6.2%	36833498 / 37221156 / -1.0%	0.51 / 0.53 / -5.2%
tpch_q04/duckdb:vortex-compact	17807355 / 18692772 / -4.7%	30762011 / 31358282 / -1.9%	0.58 / 0.60 / -2.9%
tpch_q05/duckdb:vortex-compact	22476583 / 23933396 / -6.1%	34667689 / 38398062 / -9.7%	0.65 / 0.62 / +4.0%
tpch_q06/duckdb:vortex-compact	6142978 / 6321427 / -2.8%	14681250 / 14887081 / -1.4%	0.42 / 0.42 / -1.5%
tpch_q07/duckdb:vortex-compact	21405576 / 21820174 / -1.9%	36462819 / 41428341 / -12.0% 🟢	0.59 / 0.53 / +11.5%
tpch_q08/duckdb:vortex-compact	26538635 / 25331366 / +4.8%	37377294 / 43291999 / -13.7% 🟢	0.71 / 0.59 / +21.3%
tpch_q09/duckdb:vortex-compact	29919558 / 31106296 / -3.8%	50682654 / 49243623 / +2.9%	0.59 / 0.63 / -6.5%
tpch_q10/duckdb:vortex-compact	29228115 / 30379711 / -3.8%	43138345 / 45514203 / -5.2%	0.68 / 0.67 / +1.5%
tpch_q11/duckdb:vortex-compact	9970852 / 9757666 / +2.2%	16489850 / 15587313 / +5.8%	0.60 / 0.63 / -3.4%
tpch_q12/duckdb:vortex-compact	17344886 / 18501496 / -6.3%	29800303 / 31315201 / -4.8%	0.58 / 0.59 / -1.5%
tpch_q13/duckdb:vortex-compact	22040993 / 23800934 / -7.4%	40750980 / 43888745 / -7.1%	0.54 / 0.54 / -0.3%
tpch_q14/duckdb:vortex-compact	14246801 / 14692385 / -3.0%	25187485 / 26487558 / -4.9%	0.57 / 0.55 / +2.0%
tpch_q15/duckdb:vortex-compact	10103096 / 9761737 / +3.5%	24208579 / 21276595 / +13.8% 🔴	0.42 / 0.46 / -9.0%
tpch_q16/duckdb:vortex-compact	20419188 / 19557895 / +4.4%	25098008 / 26479979 / -5.2%	0.81 / 0.74 / +10.2%
tpch_q17/duckdb:vortex-compact	16480536 / 16215602 / +1.6%	32956315 / 31119594 / +5.9%	0.50 / 0.52 / -4.0%
tpch_q18/duckdb:vortex-compact	26069732 / 26144818 / -0.3%	35897453 / 34147006 / +5.1%	0.73 / 0.77 / -5.1%
tpch_q19/duckdb:vortex-compact	23721636 / 23437105 / +1.2%	35664932 / 35138762 / +1.5%	0.67 / 0.67 / -0.3%
tpch_q20/duckdb:vortex-compact	18997604 / 19387090 / -2.0%	35289580 / 33617163 / +5.0%	0.54 / 0.58 / -6.7%
tpch_q21/duckdb:vortex-compact	70082577 / 68328769 / +2.6%	81890847 / 80618925 / +1.6%	0.86 / 0.85 / +1.0%
tpch_q22/duckdb:vortex-compact	12992818 / 12987189 / +0.0%	21009435 / 22384284 / -6.1%	0.62 / 0.58 / +6.6%

duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	62868834 / 63226797 / -0.6%	69263741 / 69543769 / -0.4%	0.91 / 0.91 / -0.2%
tpch_q02/duckdb:parquet	37515840 / 37434191 / +0.2%	45030212 / 46841003 / -3.9%	0.83 / 0.80 / +4.2%
tpch_q03/duckdb:parquet	67560197 / 67414204 / +0.2%	77674604 / 78544290 / -1.1%	0.87 / 0.86 / +1.3%
tpch_q04/duckdb:parquet	46511877 / 46185848 / +0.7%	55483215 / 55256755 / +0.4%	0.84 / 0.84 / +0.3%
tpch_q05/duckdb:parquet	65730481 / 66050362 / -0.5%	76885871 / 76878291 / +0.0%	0.85 / 0.86 / -0.5%
tpch_q06/duckdb:parquet	21777281 / 21828505 / -0.2%	27753376 / 26665421 / +4.1%	0.78 / 0.82 / -4.1%
tpch_q07/duckdb:parquet	64935295 / 64991488 / -0.1%	74957786 / 74911643 / +0.1%	0.87 / 0.87 / -0.1%
tpch_q08/duckdb:parquet	79816682 / 79959028 / -0.2%	91416511 / 91832984 / -0.5%	0.87 / 0.87 / +0.3%
tpch_q09/duckdb:parquet	119621687 / 119432720 / +0.2%	131822344 / 133766433 / -1.5%	0.91 / 0.89 / +1.6%
tpch_q10/duckdb:parquet	118858853 / 119243919 / -0.3%	130212763 / 130439119 / -0.2%	0.91 / 0.91 / -0.1%
tpch_q11/duckdb:parquet	21322173 / 21297687 / +0.1%	25398851 / 28744153 / -11.6% 🟢	0.84 / 0.74 / +13.3%
tpch_q12/duckdb:parquet	44302142 / 44201856 / +0.2%	51311649 / 51616037 / -0.6%	0.86 / 0.86 / +0.8%
tpch_q13/duckdb:parquet	242431884 / 242096762 / +0.1%	254672442 / 251193763 / +1.4%	0.95 / 0.96 / -1.2%
tpch_q14/duckdb:parquet	47157237 / 47030563 / +0.3%	54803913 / 55098893 / -0.5%	0.86 / 0.85 / +0.8%
tpch_q15/duckdb:parquet	26561410 / 29275297 / -9.3%	32453050 / 32708042 / -0.8%	0.82 / 0.90 / -8.6%
tpch_q16/duckdb:parquet	51896478 / 52226118 / -0.6%	60028606 / 59870591 / +0.3%	0.86 / 0.87 / -0.9%
tpch_q17/duckdb:parquet	49095925 / 48959711 / +0.3%	58238392 / 61883237 / -5.9%	0.84 / 0.79 / +6.6%
tpch_q18/duckdb:parquet	95542195 / 95495907 / +0.0%	104568861 / 103833447 / +0.7%	0.91 / 0.92 / -0.7%
tpch_q19/duckdb:parquet	65070941 / 64917225 / +0.2%	73868269 / 74484502 / -0.8%	0.88 / 0.87 / +1.1%
tpch_q20/duckdb:parquet	61536671 / 61496849 / +0.1%	72406416 / 73055585 / -0.9%	0.85 / 0.84 / +1.0%
tpch_q21/duckdb:parquet	142063520 / 141932025 / +0.1%	152783289 / 152439847 / +0.2%	0.93 / 0.93 / -0.1%
tpch_q22/duckdb:parquet	51444242 / 51336285 / +0.2%	58548654 / 59099130 / -0.9%	0.88 / 0.87 / +1.2%

No file size changes detected.

ghost · 2026-10-06T16:42:18Z

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 803a0e97 vs base dd1ce26a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-1.1%, low confidence) · DuckDB No clear signal (+0.8%, environment too noisy confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.002x ➖
Parquet (geomean): hot 1.004x ➖ · cold 1.021x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed	167655828 / 190144248 / -11.8% 🟢	629295052 / 545867244 / +15.3% 🔴	0.27 / 0.35 / -23.5%
clickbench-sorted_q24/datafusion:vortex-file-compressed	10574008 / 11166129 / -5.3%	48595295 / 52353647 / -7.2%	0.22 / 0.21 / +2.0%
clickbench-sorted_q26/datafusion:vortex-file-compressed	11591698 / 10835729 / +7.0%	50219610 / 51558021 / -2.6%	0.23 / 0.21 / +9.8%
clickbench-sorted_q36/datafusion:vortex-file-compressed	22856470 / 23026188 / -0.7%	71964778 / 70075250 / +2.7%	0.32 / 0.33 / -3.3%
clickbench-sorted_q37/datafusion:vortex-file-compressed	18303496 / 17966572 / +1.9%	62520987 / 61370733 / +1.9%	0.29 / 0.29 / +0.0%
clickbench-sorted_q38/datafusion:vortex-file-compressed	18539392 / 17583128 / +5.4%	61996113 / 58428649 / +6.1%	0.30 / 0.30 / -0.6%
clickbench-sorted_q39/datafusion:vortex-file-compressed	39464068 / 39555784 / -0.2%	92695941 / 89524721 / +3.5%	0.43 / 0.44 / -3.6%
clickbench-sorted_q40/datafusion:vortex-file-compressed	12112592 / 12139970 / -0.2%	46863389 / 44514296 / +5.3%	0.26 / 0.27 / -5.2%
clickbench-sorted_q41/datafusion:vortex-file-compressed	12001617 / 11947370 / +0.5%	43347470 / 43189993 / +0.4%	0.28 / 0.28 / +0.1%
clickbench-sorted_q42/datafusion:vortex-file-compressed	9953880 / 9985144 / -0.3%	37053689 / 36355078 / +1.9%	0.27 / 0.27 / -2.2%

datafusion / vortex-compact / ns (1.003x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact	211197805 / 189080834 / +11.7% 🔴	572220846 / 401613176 / +42.5% 🔴	0.37 / 0.47 / -21.6%
clickbench-sorted_q24/datafusion:vortex-compact	22122652 / 22733390 / -2.7%	51410464 / 51602467 / -0.4%	0.43 / 0.44 / -2.3%
clickbench-sorted_q26/datafusion:vortex-compact	23018477 / 22340106 / +3.0%	54180307 / 53106752 / +2.0%	0.42 / 0.42 / +1.0%
clickbench-sorted_q36/datafusion:vortex-compact	25522129 / 25748740 / -0.9%	70747910 / 67553424 / +4.7%	0.36 / 0.38 / -5.4%
clickbench-sorted_q37/datafusion:vortex-compact	21742205 / 21825621 / -0.4%	72269579 / 67122620 / +7.7%	0.30 / 0.33 / -7.5%
clickbench-sorted_q38/datafusion:vortex-compact	22480754 / 21449082 / +4.8%	67923741 / 66375177 / +2.3%	0.33 / 0.32 / +2.4%
clickbench-sorted_q39/datafusion:vortex-compact	43216404 / 43916824 / -1.6%	86379602 / 82779525 / +4.3%	0.50 / 0.53 / -5.7%
clickbench-sorted_q40/datafusion:vortex-compact	13400594 / 14392416 / -6.9%	44233880 / 43995419 / +0.5%	0.30 / 0.33 / -7.4%
clickbench-sorted_q41/datafusion:vortex-compact	13905818 / 14400740 / -3.4%	45553950 / 47264706 / -3.6%	0.31 / 0.30 / +0.2%
clickbench-sorted_q42/datafusion:vortex-compact	11028984 / 10960670 / +0.6%	36614532 / 37957063 / -3.5%	0.30 / 0.29 / +4.3%

datafusion / parquet / ns (1.011x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet	761199730 / 763306886 / -0.3%	977155011 / 957336268 / +2.1%	0.78 / 0.80 / -2.3%
clickbench-sorted_q24/datafusion:parquet	9663438 / 8916212 / +8.4%	72885997 / 71638898 / +1.7%	0.13 / 0.12 / +6.5%
clickbench-sorted_q26/datafusion:parquet	9225714 / 9270016 / -0.5%	72727746 / 71408139 / +1.8%	0.13 / 0.13 / -2.3%
clickbench-sorted_q36/datafusion:parquet	94350874 / 93997156 / +0.4%	173610727 / 170960005 / +1.6%	0.54 / 0.55 / -1.2%
clickbench-sorted_q37/datafusion:parquet	64505414 / 64309912 / +0.3%	132425585 / 131501268 / +0.7%	0.49 / 0.49 / -0.4%
clickbench-sorted_q38/datafusion:parquet	88380003 / 87995890 / +0.4%	163567476 / 160129090 / +2.1%	0.54 / 0.55 / -1.7%
clickbench-sorted_q39/datafusion:parquet	160441554 / 159826091 / +0.4%	241028137 / 235206664 / +2.5%	0.67 / 0.68 / -2.0%
clickbench-sorted_q40/datafusion:parquet	45083960 / 44349988 / +1.7%	116907972 / 113137652 / +3.3%	0.39 / 0.39 / -1.6%
clickbench-sorted_q41/datafusion:parquet	42370710 / 41957374 / +1.0%	115596961 / 108377207 / +6.7%	0.37 / 0.39 / -5.3%
clickbench-sorted_q42/datafusion:parquet	25957441 / 26205634 / -0.9%	87076442 / 84176155 / +3.4%	0.30 / 0.31 / -4.2%

duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed	58269134 / 57733680 / +0.9%	74683380 / 77094443 / -3.1%	0.78 / 0.75 / +4.2%
clickbench-sorted_q24/duckdb:vortex-file-compressed	18332684 / 19847460 / -7.6%	29358795 / 32710170 / -10.2% 🟢	0.62 / 0.61 / +2.9%
clickbench-sorted_q26/duckdb:vortex-file-compressed	14635429 / 15076375 / -2.9%	26309983 / 37887060 / -30.6% 🟢	0.56 / 0.40 / +39.8%
clickbench-sorted_q36/duckdb:vortex-file-compressed	30040812 / 29301758 / +2.5%	64265422 / 62637223 / +2.6%	0.47 / 0.47 / -0.1%
clickbench-sorted_q37/duckdb:vortex-file-compressed	22854636 / 22744930 / +0.5%	56164920 / 54828194 / +2.4%	0.41 / 0.41 / -1.9%
clickbench-sorted_q38/duckdb:vortex-file-compressed	26734899 / 26406218 / +1.2%	58658446 / 59699254 / -1.7%	0.46 / 0.44 / +3.0%
clickbench-sorted_q39/duckdb:vortex-file-compressed	48460342 / 48262654 / +0.4%	100363903 / 101928390 / -1.5%	0.48 / 0.47 / +2.0%
clickbench-sorted_q40/duckdb:vortex-file-compressed	15206593 / 14955536 / +1.7%	39670221 / 39721330 / -0.1%	0.38 / 0.38 / +1.8%
clickbench-sorted_q41/duckdb:vortex-file-compressed	15394919 / 15108482 / +1.9%	40500530 / 38992562 / +3.9%	0.38 / 0.39 / -1.9%
clickbench-sorted_q42/duckdb:vortex-file-compressed	12214416 / 12507782 / -2.3%	33566413 / 31331447 / +7.1%	0.36 / 0.40 / -8.8%

duckdb / vortex-compact / ns (1.014x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact	63833233 / 65074958 / -1.9%	84194235 / 103504549 / -18.7% 🟢	0.76 / 0.63 / +20.6%
clickbench-sorted_q24/duckdb:vortex-compact	24250160 / 23850592 / +1.7%	36602705 / 34780521 / +5.2%	0.66 / 0.69 / -3.4%
clickbench-sorted_q26/duckdb:vortex-compact	19351581 / 16657504 / +16.2% 🔴	29407101 / 33890538 / -13.2% 🟢	0.66 / 0.49 / +33.9%
clickbench-sorted_q36/duckdb:vortex-compact	36660560 / 33624626 / +9.0%	70894320 / 71244827 / -0.5%	0.52 / 0.47 / +9.6%
clickbench-sorted_q37/duckdb:vortex-compact	28684481 / 29217740 / -1.8%	64584295 / 62615931 / +3.1%	0.44 / 0.47 / -4.8%
clickbench-sorted_q38/duckdb:vortex-compact	29377582 / 28856905 / +1.8%	65729486 / 68180949 / -3.6%	0.45 / 0.42 / +5.6%
clickbench-sorted_q39/duckdb:vortex-compact	60615634 / 60171908 / +0.7%	107766347 / 104319448 / +3.3%	0.56 / 0.58 / -2.5%
clickbench-sorted_q40/duckdb:vortex-compact	17698009 / 18508974 / -4.4%	39351034 / 39409189 / -0.1%	0.45 / 0.47 / -4.2%
clickbench-sorted_q41/duckdb:vortex-compact	17546261 / 19147310 / -8.4%	39054993 / 40228829 / -2.9%	0.45 / 0.48 / -5.6%
clickbench-sorted_q42/duckdb:vortex-compact	13533866 / 13130794 / +3.1%	32095595 / 31141437 / +3.1%	0.42 / 0.42 / +0.0%

duckdb / parquet / ns (0.997x ➖, 2↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet	127658844 / 127300972 / +0.3%	139003296 / 140559406 / -1.1%	0.92 / 0.91 / +1.4%
clickbench-sorted_q24/duckdb:parquet	17701716 / 18387751 / -3.7%	30546704 / 31798887 / -3.9%	0.58 / 0.58 / +0.2%
clickbench-sorted_q26/duckdb:parquet	14881196 / 12527069 / +18.8% 🔴	20421138 / 21905045 / -6.8%	0.73 / 0.57 / +27.4%
clickbench-sorted_q36/duckdb:parquet	46706033 / 43125587 / +8.3%	65033683 / 61426834 / +5.9%	0.72 / 0.70 / +2.3%
clickbench-sorted_q37/duckdb:parquet	31465368 / 31657658 / -0.6%	49515806 / 50242276 / -1.4%	0.64 / 0.63 / +0.9%
clickbench-sorted_q38/duckdb:parquet	38305716 / 42680514 / -10.3% 🟢	62223722 / 58119542 / +7.1%	0.62 / 0.73 / -16.2%
clickbench-sorted_q39/duckdb:parquet	72287544 / 73340448 / -1.4%	86812565 / 83788327 / +3.6%	0.83 / 0.88 / -4.9%
clickbench-sorted_q40/duckdb:parquet	17127991 / 17245859 / -0.7%	47764984 / 44587199 / +7.1%	0.36 / 0.39 / -7.3%
clickbench-sorted_q41/duckdb:parquet	16434103 / 16473978 / -0.2%	44693081 / 44042419 / +1.5%	0.37 / 0.37 / -1.7%
clickbench-sorted_q42/duckdb:parquet	11292345 / 12563783 / -10.1% 🟢	23954071 / 22823678 / +5.0%	0.47 / 0.55 / -14.4%

File Size Changes (200 files changed, -0.0% overall, 99↑ 101↓)

File	Scale	Format	Base	HEAD	Change	%
hits_001.vortex	1.0	vortex-file-compressed	188.80 MB	193.07 MB	+4.28 MB	+2.3%
hits_065.vortex	1.0	vortex-compact	123.95 MB	125.42 MB	+1.47 MB	+1.2%
hits_087.vortex	1.0	vortex-compact	123.88 MB	125.27 MB	+1.39 MB	+1.1%
hits_001.vortex	1.0	vortex-compact	137.67 MB	139.19 MB	+1.53 MB	+1.1%
hits_039.vortex	1.0	vortex-compact	123.90 MB	125.18 MB	+1.28 MB	+1.0%
hits_000.vortex	1.0	vortex-compact	97.40 MB	98.39 MB	+1010.80 KB	+1.0%
hits_097.vortex	1.0	vortex-file-compressed	192.57 MB	194.34 MB	+1.77 MB	+0.9%
hits_030.vortex	1.0	vortex-compact	98.22 MB	99.08 MB	+880.62 KB	+0.9%
hits_004.vortex	1.0	vortex-compact	97.89 MB	98.73 MB	+856.80 KB	+0.9%
hits_090.vortex	1.0	vortex-compact	140.00 MB	141.15 MB	+1.14 MB	+0.8%
hits_006.vortex	1.0	vortex-compact	95.47 MB	96.00 MB	+544.41 KB	+0.6%
hits_024.vortex	1.0	vortex-compact	122.74 MB	123.42 MB	+694.93 KB	+0.6%
hits_034.vortex	1.0	vortex-compact	132.36 MB	133.09 MB	+749.19 KB	+0.6%
hits_048.vortex	1.0	vortex-file-compressed	199.57 MB	200.58 MB	+1.01 MB	+0.5%
hits_055.vortex	1.0	vortex-compact	152.63 MB	153.26 MB	+640.45 KB	+0.4%
hits_040.vortex	1.0	vortex-file-compressed	144.07 MB	144.66 MB	+601.40 KB	+0.4%
hits_062.vortex	1.0	vortex-file-compressed	171.21 MB	171.81 MB	+613.12 KB	+0.3%
hits_081.vortex	1.0	vortex-compact	152.87 MB	153.40 MB	+542.06 KB	+0.3%
hits_033.vortex	1.0	vortex-file-compressed	199.91 MB	200.59 MB	+692.83 KB	+0.3%
hits_010.vortex	1.0	vortex-compact	123.14 MB	123.41 MB	+271.98 KB	+0.2%
hits_029.vortex	1.0	vortex-compact	153.22 MB	153.54 MB	+323.19 KB	+0.2%
hits_076.vortex	1.0	vortex-compact	124.52 MB	124.78 MB	+261.80 KB	+0.2%
hits_042.vortex	1.0	vortex-file-compressed	202.17 MB	202.58 MB	+416.84 KB	+0.2%
hits_052.vortex	1.0	vortex-compact	97.40 MB	97.59 MB	+195.34 KB	+0.2%
hits_068.vortex	1.0	vortex-file-compressed	160.28 MB	160.59 MB	+319.31 KB	+0.2%
hits_012.vortex	1.0	vortex-compact	138.71 MB	138.95 MB	+247.42 KB	+0.2%
hits_008.vortex	1.0	vortex-file-compressed	139.26 MB	139.49 MB	+232.82 KB	+0.2%
hits_043.vortex	1.0	vortex-compact	94.04 MB	94.19 MB	+150.61 KB	+0.2%
hits_009.vortex	1.0	vortex-file-compressed	101.00 MB	101.15 MB	+150.14 KB	+0.1%
hits_067.vortex	1.0	vortex-compact	98.53 MB	98.66 MB	+131.75 KB	+0.1%
hits_014.vortex	1.0	vortex-file-compressed	172.74 MB	172.96 MB	+230.21 KB	+0.1%
hits_074.vortex	1.0	vortex-compact	153.03 MB	153.23 MB	+199.28 KB	+0.1%
hits_072.vortex	1.0	vortex-file-compressed	101.85 MB	101.98 MB	+130.03 KB	+0.1%
hits_011.vortex	1.0	vortex-file-compressed	200.19 MB	200.44 MB	+254.02 KB	+0.1%
hits_022.vortex	1.0	vortex-compact	152.99 MB	153.17 MB	+190.10 KB	+0.1%
hits_079.vortex	1.0	vortex-compact	127.68 MB	127.84 MB	+157.79 KB	+0.1%
hits_031.vortex	1.0	vortex-compact	111.15 MB	111.29 MB	+136.59 KB	+0.1%
hits_074.vortex	1.0	vortex-file-compressed	200.05 MB	200.27 MB	+231.13 KB	+0.1%
hits_044.vortex	1.0	vortex-compact	153.52 MB	153.68 MB	+169.37 KB	+0.1%
hits_088.vortex	1.0	vortex-compact	134.42 MB	134.56 MB	+142.77 KB	+0.1%
hits_056.vortex	1.0	vortex-compact	100.73 MB	100.83 MB	+99.92 KB	+0.1%
hits_029.vortex	1.0	vortex-file-compressed	200.79 MB	200.98 MB	+193.68 KB	+0.1%
hits_004.vortex	1.0	vortex-file-compressed	130.81 MB	130.92 MB	+117.92 KB	+0.1%
hits_057.vortex	1.0	vortex-compact	111.53 MB	111.62 MB	+87.61 KB	+0.1%
hits_007.vortex	1.0	vortex-file-compressed	199.76 MB	199.91 MB	+152.98 KB	+0.1%
hits_072.vortex	1.0	vortex-compact	75.54 MB	75.59 MB	+55.68 KB	+0.1%
hits_020.vortex	1.0	vortex-file-compressed	160.08 MB	160.20 MB	+115.08 KB	+0.1%
hits_078.vortex	1.0	vortex-file-compressed	130.24 MB	130.33 MB	+86.89 KB	+0.1%
hits_062.vortex	1.0	vortex-compact	132.52 MB	132.61 MB	+87.84 KB	+0.1%
hits_080.vortex	1.0	vortex-compact	96.04 MB	96.09 MB	+55.94 KB	+0.1%
hits_040.vortex	1.0	vortex-compact	109.99 MB	110.05 MB	+63.11 KB	+0.1%
hits_017.vortex	1.0	vortex-file-compressed	147.18 MB	147.25 MB	+77.75 KB	+0.1%
hits_056.vortex	1.0	vortex-file-compressed	134.99 MB	135.06 MB	+68.86 KB	+0.0%
hits_043.vortex	1.0	vortex-file-compressed	126.80 MB	126.86 MB	+63.93 KB	+0.0%
hits_033.vortex	1.0	vortex-compact	153.49 MB	153.56 MB	+77.13 KB	+0.0%
hits_079.vortex	1.0	vortex-file-compressed	180.60 MB	180.69 MB	+90.38 KB	+0.0%
hits_013.vortex	1.0	vortex-compact	123.89 MB	123.94 MB	+56.92 KB	+0.0%
hits_018.vortex	1.0	vortex-file-compressed	200.77 MB	200.85 MB	+89.65 KB	+0.0%
hits_015.vortex	1.0	vortex-file-compressed	130.28 MB	130.34 MB	+57.55 KB	+0.0%
hits_098.vortex	1.0	vortex-compact	102.40 MB	102.44 MB	+43.68 KB	+0.0%
hits_041.vortex	1.0	vortex-file-compressed	130.21 MB	130.26 MB	+49.70 KB	+0.0%
hits_067.vortex	1.0	vortex-file-compressed	130.97 MB	131.02 MB	+48.59 KB	+0.0%
hits_045.vortex	1.0	vortex-compact	105.60 MB	105.64 MB	+38.15 KB	+0.0%
hits_037.vortex	1.0	vortex-file-compressed	178.09 MB	178.16 MB	+64.33 KB	+0.0%
hits_085.vortex	1.0	vortex-compact	153.40 MB	153.45 MB	+51.27 KB	+0.0%
hits_073.vortex	1.0	vortex-file-compressed	173.05 MB	173.10 MB	+57.08 KB	+0.0%
hits_035.vortex	1.0	vortex-file-compressed	102.00 MB	102.04 MB	+32.77 KB	+0.0%
hits_092.vortex	1.0	vortex-compact	153.32 MB	153.37 MB	+47.62 KB	+0.0%
hits_069.vortex	1.0	vortex-file-compressed	143.10 MB	143.14 MB	+44.13 KB	+0.0%
hits_034.vortex	1.0	vortex-file-compressed	181.73 MB	181.78 MB	+54.54 KB	+0.0%
hits_022.vortex	1.0	vortex-file-compressed	200.10 MB	200.16 MB	+58.25 KB	+0.0%
hits_035.vortex	1.0	vortex-compact	75.91 MB	75.93 MB	+22.04 KB	+0.0%
hits_013.vortex	1.0	vortex-file-compressed	161.89 MB	161.93 MB	+46.07 KB	+0.0%
hits_057.vortex	1.0	vortex-file-compressed	159.74 MB	159.78 MB	+45.16 KB	+0.0%
hits_098.vortex	1.0	vortex-file-compressed	137.78 MB	137.81 MB	+38.11 KB	+0.0%
hits_053.vortex	1.0	vortex-compact	138.32 MB	138.36 MB	+33.18 KB	+0.0%
hits_050.vortex	1.0	vortex-compact	125.02 MB	125.04 MB	+27.95 KB	+0.0%
hits_091.vortex	1.0	vortex-file-compressed	147.40 MB	147.44 MB	+32.09 KB	+0.0%
hits_021.vortex	1.0	vortex-compact	110.60 MB	110.62 MB	+22.50 KB	+0.0%
hits_025.vortex	1.0	vortex-file-compressed	172.26 MB	172.29 MB	+34.43 KB	+0.0%
hits_058.vortex	1.0	vortex-compact	111.03 MB	111.05 MB	+19.70 KB	+0.0%
hits_054.vortex	1.0	vortex-file-compressed	147.30 MB	147.33 MB	+24.73 KB	+0.0%
hits_042.vortex	1.0	vortex-compact	136.19 MB	136.21 MB	+20.41 KB	+0.0%
hits_053.vortex	1.0	vortex-file-compressed	189.47 MB	189.49 MB	+26.24 KB	+0.0%
hits_006.vortex	1.0	vortex-file-compressed	126.59 MB	126.61 MB	+16.14 KB	+0.0%
hits_071.vortex	1.0	vortex-compact	105.57 MB	105.58 MB	+10.19 KB	+0.0%
hits_082.vortex	1.0	vortex-file-compressed	139.26 MB	139.27 MB	+12.52 KB	+0.0%
hits_090.vortex	1.0	vortex-file-compressed	192.29 MB	192.31 MB	+17.13 KB	+0.0%
hits_096.vortex	1.0	vortex-file-compressed	200.37 MB	200.39 MB	+17.45 KB	+0.0%
hits_082.vortex	1.0	vortex-compact	105.71 MB	105.72 MB	+8.20 KB	+0.0%
hits_037.vortex	1.0	vortex-compact	132.16 MB	132.17 MB	+10.18 KB	+0.0%
hits_039.vortex	1.0	vortex-file-compressed	161.73 MB	161.74 MB	+12.45 KB	+0.0%
hits_030.vortex	1.0	vortex-file-compressed	131.09 MB	131.10 MB	+5.47 KB	+0.0%
hits_095.vortex	1.0	vortex-compact	110.60 MB	110.60 MB	+4.30 KB	+0.0%
hits_012.vortex	1.0	vortex-file-compressed	190.76 MB	190.76 MB	+5.59 KB	+0.0%
hits_060.vortex	1.0	vortex-file-compressed	192.83 MB	192.83 MB	+2.63 KB	+0.0%
hits_093.vortex	1.0	vortex-compact	98.13 MB	98.13 MB	+824 B	+0.0%
hits_091.vortex	1.0	vortex-compact	111.83 MB	111.83 MB	+544 B	+0.0%
hits_002.vortex	1.0	vortex-compact	123.84 MB	123.84 MB	+472 B	+0.0%
hits_009.vortex	1.0	vortex-compact	75.21 MB	75.21 MB	8 B	-0.0%
hits_036.vortex	1.0	vortex-file-compressed	172.06 MB	172.06 MB	4.43 KB	-0.0%
hits_003.vortex	1.0	vortex-file-compressed	136.52 MB	136.52 MB	3.70 KB	-0.0%
hits_084.vortex	1.0	vortex-file-compressed	153.89 MB	153.88 MB	11.47 KB	-0.0%
hits_066.vortex	1.0	vortex-compact	117.42 MB	117.42 MB	10.09 KB	-0.0%
hits_047.vortex	1.0	vortex-compact	110.46 MB	110.45 MB	10.00 KB	-0.0%
hits_051.vortex	1.0	vortex-compact	133.98 MB	133.97 MB	13.00 KB	-0.0%
hits_017.vortex	1.0	vortex-compact	111.83 MB	111.81 MB	15.32 KB	-0.0%
hits_085.vortex	1.0	vortex-file-compressed	200.71 MB	200.68 MB	29.97 KB	-0.0%
hits_000.vortex	1.0	vortex-file-compressed	130.65 MB	130.63 MB	19.57 KB	-0.0%
hits_075.vortex	1.0	vortex-compact	137.84 MB	137.82 MB	20.70 KB	-0.0%
hits_049.vortex	1.0	vortex-compact	139.32 MB	139.29 MB	22.20 KB	-0.0%
hits_014.vortex	1.0	vortex-compact	133.90 MB	133.87 MB	21.44 KB	-0.0%
hits_032.vortex	1.0	vortex-compact	110.61 MB	110.59 MB	18.44 KB	-0.0%
hits_046.vortex	1.0	vortex-compact	74.95 MB	74.94 MB	12.68 KB	-0.0%
hits_051.vortex	1.0	vortex-file-compressed	173.08 MB	173.05 MB	30.04 KB	-0.0%
hits_024.vortex	1.0	vortex-file-compressed	161.09 MB	161.06 MB	30.53 KB	-0.0%
hits_049.vortex	1.0	vortex-file-compressed	191.15 MB	191.11 MB	37.59 KB	-0.0%
hits_070.vortex	1.0	vortex-file-compressed	201.00 MB	200.96 MB	40.70 KB	-0.0%
hits_094.vortex	1.0	vortex-compact	110.71 MB	110.69 MB	23.03 KB	-0.0%
hits_066.vortex	1.0	vortex-file-compressed	163.09 MB	163.05 MB	38.64 KB	-0.0%
hits_080.vortex	1.0	vortex-file-compressed	127.11 MB	127.08 MB	31.49 KB	-0.0%
hits_084.vortex	1.0	vortex-compact	110.68 MB	110.65 MB	29.71 KB	-0.0%
hits_028.vortex	1.0	vortex-compact	115.18 MB	115.15 MB	31.64 KB	-0.0%
hits_052.vortex	1.0	vortex-file-compressed	130.21 MB	130.17 MB	39.56 KB	-0.0%
hits_083.vortex	1.0	vortex-file-compressed	156.34 MB	156.29 MB	48.80 KB	-0.0%
hits_086.vortex	1.0	vortex-file-compressed	191.79 MB	191.72 MB	69.93 KB	-0.0%
hits_038.vortex	1.0	vortex-compact	139.36 MB	139.30 MB	53.62 KB	-0.0%
hits_019.vortex	1.0	vortex-compact	105.98 MB	105.94 MB	42.39 KB	-0.0%
hits_002.vortex	1.0	vortex-file-compressed	161.81 MB	161.74 MB	66.52 KB	-0.0%
hits_099.vortex	1.0	vortex-file-compressed	171.88 MB	171.81 MB	74.27 KB	-0.0%
hits_097.vortex	1.0	vortex-compact	141.15 MB	141.09 MB	65.01 KB	-0.0%
hits_086.vortex	1.0	vortex-compact	140.56 MB	140.49 MB	71.69 KB	-0.0%
hits_083.vortex	1.0	vortex-compact	110.12 MB	110.06 MB	59.85 KB	-0.1%
hits_088.vortex	1.0	vortex-file-compressed	172.70 MB	172.60 MB	104.76 KB	-0.1%
hits_050.vortex	1.0	vortex-file-compressed	161.67 MB	161.57 MB	102.70 KB	-0.1%
hits_003.vortex	1.0	vortex-compact	104.58 MB	104.51 MB	69.86 KB	-0.1%
hits_016.vortex	1.0	vortex-compact	127.41 MB	127.32 MB	86.28 KB	-0.1%
hits_089.vortex	1.0	vortex-file-compressed	130.73 MB	130.65 MB	89.25 KB	-0.1%
hits_020.vortex	1.0	vortex-compact	111.72 MB	111.64 MB	77.68 KB	-0.1%
hits_075.vortex	1.0	vortex-file-compressed	189.18 MB	189.06 MB	131.61 KB	-0.1%
hits_044.vortex	1.0	vortex-file-compressed	201.22 MB	201.08 MB	142.84 KB	-0.1%
hits_094.vortex	1.0	vortex-file-compressed	158.33 MB	158.22 MB	114.41 KB	-0.1%
hits_025.vortex	1.0	vortex-compact	133.83 MB	133.73 MB	100.73 KB	-0.1%
hits_032.vortex	1.0	vortex-file-compressed	153.96 MB	153.85 MB	117.02 KB	-0.1%
hits_069.vortex	1.0	vortex-compact	99.76 MB	99.68 MB	78.95 KB	-0.1%
hits_026.vortex	1.0	vortex-file-compressed	130.57 MB	130.47 MB	103.80 KB	-0.1%
hits_027.vortex	1.0	vortex-file-compressed	189.67 MB	189.53 MB	152.16 KB	-0.1%
hits_011.vortex	1.0	vortex-compact	153.04 MB	152.91 MB	123.80 KB	-0.1%
hits_093.vortex	1.0	vortex-file-compressed	130.92 MB	130.81 MB	106.45 KB	-0.1%
hits_007.vortex	1.0	vortex-compact	153.58 MB	153.46 MB	125.66 KB	-0.1%
hits_036.vortex	1.0	vortex-compact	133.37 MB	133.26 MB	109.43 KB	-0.1%
hits_027.vortex	1.0	vortex-compact	138.04 MB	137.92 MB	118.51 KB	-0.1%
hits_070.vortex	1.0	vortex-compact	153.86 MB	153.73 MB	133.88 KB	-0.1%
hits_095.vortex	1.0	vortex-file-compressed	153.85 MB	153.72 MB	135.92 KB	-0.1%
hits_010.vortex	1.0	vortex-file-compressed	169.00 MB	168.83 MB	170.07 KB	-0.1%
hits_081.vortex	1.0	vortex-file-compressed	201.18 MB	200.98 MB	203.85 KB	-0.1%
hits_061.vortex	1.0	vortex-file-compressed	161.61 MB	161.44 MB	173.54 KB	-0.1%
hits_046.vortex	1.0	vortex-file-compressed	100.71 MB	100.60 MB	111.38 KB	-0.1%
hits_096.vortex	1.0	vortex-compact	153.26 MB	153.09 MB	180.20 KB	-0.1%
hits_058.vortex	1.0	vortex-file-compressed	154.57 MB	154.39 MB	185.66 KB	-0.1%
hits_073.vortex	1.0	vortex-compact	134.21 MB	134.04 MB	170.70 KB	-0.1%
hits_008.vortex	1.0	vortex-compact	105.79 MB	105.65 MB	146.02 KB	-0.1%
hits_099.vortex	1.0	vortex-compact	133.18 MB	132.99 MB	187.73 KB	-0.1%
hits_015.vortex	1.0	vortex-compact	98.41 MB	98.26 MB	144.50 KB	-0.1%
hits_031.vortex	1.0	vortex-file-compressed	159.36 MB	159.13 MB	237.51 KB	-0.1%
hits_018.vortex	1.0	vortex-compact	152.98 MB	152.73 MB	257.06 KB	-0.2%
hits_063.vortex	1.0	vortex-file-compressed	130.97 MB	130.75 MB	227.27 KB	-0.2%
hits_077.vortex	1.0	vortex-file-compressed	173.35 MB	173.05 MB	313.79 KB	-0.2%
hits_059.vortex	1.0	vortex-compact	153.06 MB	152.78 MB	281.92 KB	-0.2%
hits_061.vortex	1.0	vortex-compact	123.69 MB	123.47 MB	228.58 KB	-0.2%
hits_065.vortex	1.0	vortex-file-compressed	162.12 MB	161.82 MB	301.59 KB	-0.2%
hits_047.vortex	1.0	vortex-file-compressed	154.09 MB	153.80 MB	293.13 KB	-0.2%
hits_054.vortex	1.0	vortex-compact	111.92 MB	111.70 MB	215.80 KB	-0.2%
hits_016.vortex	1.0	vortex-file-compressed	180.04 MB	179.69 MB	358.56 KB	-0.2%
hits_071.vortex	1.0	vortex-file-compressed	139.99 MB	139.70 MB	294.88 KB	-0.2%
hits_005.vortex	1.0	vortex-compact	116.08 MB	115.81 MB	285.34 KB	-0.2%
hits_005.vortex	1.0	vortex-file-compressed	167.63 MB	167.20 MB	444.13 KB	-0.3%
hits_068.vortex	1.0	vortex-compact	112.21 MB	111.90 MB	318.95 KB	-0.3%
hits_089.vortex	1.0	vortex-compact	98.67 MB	98.38 MB	294.91 KB	-0.3%
hits_077.vortex	1.0	vortex-compact	134.61 MB	134.18 MB	436.59 KB	-0.3%
hits_063.vortex	1.0	vortex-compact	98.47 MB	98.15 MB	321.61 KB	-0.3%
hits_045.vortex	1.0	vortex-file-compressed	139.99 MB	139.49 MB	512.14 KB	-0.4%
hits_019.vortex	1.0	vortex-file-compressed	140.65 MB	140.08 MB	585.74 KB	-0.4%
hits_021.vortex	1.0	vortex-file-compressed	154.33 MB	153.69 MB	654.80 KB	-0.4%
hits_060.vortex	1.0	vortex-compact	140.84 MB	140.15 MB	711.96 KB	-0.5%
hits_048.vortex	1.0	vortex-compact	153.37 MB	152.62 MB	776.77 KB	-0.5%
hits_092.vortex	1.0	vortex-file-compressed	200.66 MB	199.65 MB	1.01 MB	-0.5%
hits_023.vortex	1.0	vortex-compact	142.40 MB	141.68 MB	736.68 KB	-0.5%
hits_041.vortex	1.0	vortex-compact	98.34 MB	97.83 MB	521.90 KB	-0.5%
hits_064.vortex	1.0	vortex-compact	139.90 MB	139.14 MB	772.25 KB	-0.5%
hits_028.vortex	1.0	vortex-file-compressed	153.04 MB	152.16 MB	896.09 KB	-0.6%
hits_038.vortex	1.0	vortex-file-compressed	191.99 MB	190.78 MB	1.21 MB	-0.6%
hits_055.vortex	1.0	vortex-file-compressed	200.63 MB	199.34 MB	1.29 MB	-0.6%
hits_059.vortex	1.0	vortex-file-compressed	200.08 MB	198.73 MB	1.36 MB	-0.7%
hits_078.vortex	1.0	vortex-compact	97.95 MB	97.16 MB	800.88 KB	-0.8%
hits_026.vortex	1.0	vortex-compact	99.20 MB	98.22 MB	1006.47 KB	-1.0%
hits_023.vortex	1.0	vortex-file-compressed	196.92 MB	194.88 MB	2.04 MB	-1.0%
hits_076.vortex	1.0	vortex-file-compressed	161.59 MB	159.89 MB	1.71 MB	-1.1%
hits_087.vortex	1.0	vortex-file-compressed	161.83 MB	160.11 MB	1.72 MB	-1.1%
hits_064.vortex	1.0	vortex-file-compressed	192.66 MB	190.57 MB	2.08 MB	-1.1%

Totals:

vortex-compact: 11.91 GB → 11.91 GB (+0.0%)
vortex-file-compressed: 15.97 GB → 15.96 GB (-0.0%)

ghost · 2026-10-06T16:43:08Z

Benchmarks: FineWeb S3 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +16.0%
Engines: DataFusion No clear signal (+10.9%, environment too noisy confidence) · DuckDB No clear signal (+21.3%, environment too noisy confidence)
Vortex (geomean): hot 0.847x ➖ · cold 0.869x ➖
Parquet (geomean): hot 0.730x ➖ · cold 0.781x ➖
Shifts: Parquet (control) -27.0% · Median polish -20.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.797x ➖, 2↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	53282960 / 55871006 / -4.6%	136038083 / 190334754 / -28.5%	0.39 / 0.29 / +33.4%
fineweb_q01/datafusion:vortex-file-compressed	448419130 / 507839658 / -11.7%	892450496 / 921046450 / -3.1%	0.50 / 0.55 / -8.9%
fineweb_q02/datafusion:vortex-file-compressed	387951747 / 652971506 / -40.6% 🟢	609660121 / 723408321 / -15.7%	0.64 / 0.90 / -29.5%
fineweb_q03/datafusion:vortex-file-compressed	642731158 / 796206290 / -19.3%	862156528 / 1693490173 / -49.1% 🟢	0.75 / 0.47 / +58.6%
fineweb_q04/datafusion:vortex-file-compressed	438626726 / 1243085108 / -64.7% 🟢	587421139 / 1014293397 / -42.1% 🟢	0.75 / 1.23 / -39.1%
fineweb_q05/datafusion:vortex-file-compressed	493421213 / 513193388 / -3.9%	590346362 / 668821213 / -11.7%	0.84 / 0.77 / +8.9%
fineweb_q06/datafusion:vortex-file-compressed	900940926 / 841165994 / +7.1%	821897553 / 951540030 / -13.6%	1.10 / 0.88 / +24.0%
fineweb_q07/datafusion:vortex-file-compressed	623823376 / 622077738 / +0.3%	841563557 / 623957166 / +34.9% 🔴	0.74 / 1.00 / -25.6%
fineweb_q08/datafusion:vortex-file-compressed	330520022 / 373590978 / -11.5%	236562567 / 375456845 / -37.0% 🟢	1.40 / 1.00 / +40.4%

datafusion / vortex-compact / ns (0.824x ➖, 2↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	40898434 / 53005767 / -22.8%	144974552 / 184389857 / -21.4%	0.28 / 0.29 / -1.9%
fineweb_q01/datafusion:vortex-compact	540292164 / 443906886 / +21.7%	941136130 / 897026254 / +4.9%	0.57 / 0.49 / +16.0%
fineweb_q02/datafusion:vortex-compact	418076425 / 598525230 / -30.1% 🟢	496700261 / 698450840 / -28.9%	0.84 / 0.86 / -1.8%
fineweb_q03/datafusion:vortex-compact	550365017 / 570406006 / -3.5%	865211941 / 976284442 / -11.4%	0.64 / 0.58 / +8.9%
fineweb_q04/datafusion:vortex-compact	477322472 / 621684028 / -23.2%	552474643 / 719570612 / -23.2%	0.86 / 0.86 / +0.0%
fineweb_q05/datafusion:vortex-compact	436179034 / 541437648 / -19.4%	556411689 / 504997158 / +10.2%	0.78 / 1.07 / -26.9%
fineweb_q06/datafusion:vortex-compact	733680624 / 917947189 / -20.1%	588078761 / 932554053 / -36.9% 🟢	1.25 / 0.98 / +26.7%
fineweb_q07/datafusion:vortex-compact	584234141 / 588911118 / -0.8%	760527696 / 501895581 / +51.5% 🔴	0.77 / 1.17 / -34.5%
fineweb_q08/datafusion:vortex-compact	220651815 / 392181465 / -43.7% 🟢	258932517 / 469720933 / -44.9% 🟢	0.85 / 0.83 / +2.1%

datafusion / parquet / ns (0.731x ➖, 5↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	808467942 / 1328407074 / -39.1% 🟢	1716352516 / 1539124533 / +11.5%	0.47 / 0.86 / -45.4%
fineweb_q01/datafusion:parquet	1165072797 / 2623398592 / -55.6% 🟢	1554263589 / 3063726038 / -49.3% 🟢	0.75 / 0.86 / -12.5%
fineweb_q02/datafusion:parquet	1238241556 / 2405296232 / -48.5% 🟢	1518542099 / 2427508775 / -37.4% 🟢	0.82 / 0.99 / -17.7%
fineweb_q03/datafusion:parquet	1149577500 / 2170907264 / -47.0% 🟢	1342036674 / 3083565030 / -56.5% 🟢	0.86 / 0.70 / +21.7%
fineweb_q04/datafusion:parquet	1502463450 / 1457746482 / +3.1%	1309096005 / 2328037341 / -43.8% 🟢	1.15 / 0.63 / +83.3%
fineweb_q05/datafusion:parquet	1565355274 / 1399082232 / +11.9%	1521093308 / 1141126778 / +33.3% 🔴	1.03 / 1.23 / -16.1%
fineweb_q06/datafusion:parquet	1630506328 / 1454197488 / +12.1%	1342461459 / 971839805 / +38.1% 🔴	1.21 / 1.50 / -18.8%
fineweb_q07/datafusion:parquet	932731475 / 1438777350 / -35.2% 🟢	1650750840 / 1257592777 / +31.3% 🔴	0.57 / 1.14 / -50.6%
fineweb_q08/datafusion:parquet	1081250668 / 1124693890 / -3.9%	1071645974 / 1729336555 / -38.0% 🟢	1.01 / 0.65 / +55.1%

duckdb / vortex-file-compressed / ns (0.859x ➖, 2↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	63812200 / 67868649 / -6.0%	73745472 / 69530800 / +6.1%	0.87 / 0.98 / -11.4%
fineweb_q01/duckdb:vortex-file-compressed	437302354 / 630799404 / -30.7% 🟢	683745939 / 577967885 / +18.3%	0.64 / 1.09 / -41.4%
fineweb_q02/duckdb:vortex-file-compressed	844405642 / 1063908956 / -20.6%	758654188 / 1127798111 / -32.7% 🟢	1.11 / 0.94 / +18.0%
fineweb_q03/duckdb:vortex-file-compressed	1056771220 / 1008143688 / +4.8%	1458232522 / 1380416154 / +5.6%	0.72 / 0.73 / -0.8%
fineweb_q04/duckdb:vortex-file-compressed	1021132300 / 972953840 / +5.0%	1002295373 / 1070150796 / -6.3%	1.02 / 0.91 / +12.1%
fineweb_q05/duckdb:vortex-file-compressed	895470200 / 1092541976 / -18.0%	973009191 / 1156464508 / -15.9%	0.92 / 0.94 / -2.6%
fineweb_q06/duckdb:vortex-file-compressed	1215339726 / 1289941818 / -5.8%	1247829117 / 1342185560 / -7.0%	0.97 / 0.96 / +1.3%
fineweb_q07/duckdb:vortex-file-compressed	1043222747 / 1158692802 / -10.0%	1100918437 / 1530841108 / -28.1%	0.95 / 0.76 / +25.2%
fineweb_q08/duckdb:vortex-file-compressed	394393720 / 613830060 / -35.7% 🟢	467954285 / 633515801 / -26.1%	0.84 / 0.97 / -13.0%

duckdb / vortex-compact / ns (0.912x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	62361300 / 72863538 / -14.4%	92050694 / 57529374 / +60.0% 🔴	0.68 / 1.27 / -46.5%
fineweb_q01/duckdb:vortex-compact	405428422 / 512840262 / -20.9%	577618776 / 900136923 / -35.8% 🟢	0.70 / 0.57 / +23.2%
fineweb_q02/duckdb:vortex-compact	584331728 / 683228132 / -14.5%	596017460 / 837302504 / -28.8%	0.98 / 0.82 / +20.1%
fineweb_q03/duckdb:vortex-compact	1209380102 / 1189000686 / +1.7%	1369908217 / 1335305751 / +2.6%	0.88 / 0.89 / -0.9%
fineweb_q04/duckdb:vortex-compact	1066060632 / 1117868158 / -4.6%	1090207676 / 1112024391 / -2.0%	0.98 / 1.01 / -2.7%
fineweb_q05/duckdb:vortex-compact	1017747152 / 1012769804 / +0.5%	1114623363 / 1087399177 / +2.5%	0.91 / 0.93 / -2.0%
fineweb_q06/duckdb:vortex-compact	1413140968 / 1230414175 / +14.9%	1410030239 / 1220136395 / +15.6%	1.00 / 1.01 / -0.6%
fineweb_q07/duckdb:vortex-compact	1019332387 / 1022450110 / -0.3%	1059240774 / 1067938893 / -0.8%	0.96 / 0.96 / +0.5%
fineweb_q08/duckdb:vortex-compact	375749318 / 553303810 / -32.1% 🟢	485965348 / 591874719 / -17.9%	0.77 / 0.93 / -17.3%

duckdb / parquet / ns (0.730x ➖, 2↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	516900590 / 704729912 / -26.7%	641597379 / 745098036 / -13.9%	0.81 / 0.95 / -14.8%
fineweb_q01/duckdb:parquet	638646498 / 793998823 / -19.6%	593801792 / 854399788 / -30.5% 🟢	1.08 / 0.93 / +15.7%
fineweb_q02/duckdb:parquet	720655640 / 990933780 / -27.3%	640841759 / 819419079 / -21.8%	1.12 / 1.21 / -7.0%
fineweb_q03/duckdb:parquet	1807368178 / 3075846570 / -41.2% 🟢	3148173425 / 2216772417 / +42.0% 🔴	0.57 / 1.39 / -58.6%
fineweb_q04/duckdb:parquet	1051108656 / 1145937154 / -8.3%	987746698 / 1185082685 / -16.7%	1.06 / 0.97 / +10.0%
fineweb_q05/duckdb:parquet	999015159 / 1251627930 / -20.2%	979089757 / 1446438228 / -32.3% 🟢	1.02 / 0.87 / +17.9%
fineweb_q06/duckdb:parquet	2091656518 / 2873302577 / -27.2%	1924227831 / 2915595997 / -34.0% 🟢	1.09 / 0.99 / +10.3%
fineweb_q07/duckdb:parquet	1446537563 / 2398972708 / -39.7% 🟢	1223526295 / 2471353195 / -50.5% 🟢	1.18 / 0.97 / +21.8%
fineweb_q08/duckdb:parquet	629961823 / 869485442 / -27.5%	577614818 / 789944447 / -26.9%	1.09 / 1.10 / -0.9%

ghost · 2026-10-06T16:43:54Z

Benchmarks: Appian on NVME 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 0.998x ➖
Parquet (geomean): hot 1.013x ➖ · cold 1.000x ➖
Shifts: Parquet (control) +1.3% · Median polish +0.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact	52577905 / 51727866 / +1.6%	72852230 / 70986485 / +2.6%	0.72 / 0.73 / -1.0%
appian_q02/datafusion:vortex-compact	233117246 / 236990716 / -1.6%	267026735 / 265991237 / +0.4%	0.87 / 0.89 / -2.0%
appian_q03/datafusion:vortex-compact	146413692 / 149204208 / -1.9%	183310106 / 188022391 / -2.5%	0.80 / 0.79 / +0.7%
appian_q04/datafusion:vortex-compact	9861545925 / 9880213610 / -0.2%	9849832265 / 9829525121 / +0.2%	1.00 / 1.01 / -0.4%
appian_q05/datafusion:vortex-compact	136192425 / 136901425 / -0.5%	161412735 / 163799100 / -1.5%	0.84 / 0.84 / +1.0%
appian_q06/datafusion:vortex-compact	142115762 / 143413462 / -0.9%	161643129 / 161089664 / +0.3%	0.88 / 0.89 / -1.2%
appian_q07/datafusion:vortex-compact	164044269 / 165464331 / -0.9%	192645301 / 194860475 / -1.1%	0.85 / 0.85 / +0.3%
appian_q08/datafusion:vortex-compact	567661705 / 543577837 / +4.4%	580342774 / 595005787 / -2.5%	0.98 / 0.91 / +7.1%

datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet	73855854 / 73134745 / +1.0%	93248559 / 93174916 / +0.1%	0.79 / 0.78 / +0.9%
appian_q02/datafusion:parquet	304865330 / 302134702 / +0.9%	335353556 / 337644613 / -0.7%	0.91 / 0.89 / +1.6%
appian_q03/datafusion:parquet	190317808 / 188907499 / +0.7%	232526010 / 230927586 / +0.7%	0.82 / 0.82 / +0.1%
appian_q04/datafusion:parquet	9910116938 / 9907750458 / +0.0%	9885561962 / 9819126324 / +0.7%	1.00 / 1.01 / -0.6%
appian_q05/datafusion:parquet	198758447 / 197545848 / +0.6%	223505991 / 222396546 / +0.5%	0.89 / 0.89 / +0.1%
appian_q06/datafusion:parquet	170355057 / 170287476 / +0.0%	191265175 / 197519426 / -3.2%	0.89 / 0.86 / +3.3%
appian_q07/datafusion:parquet	210806099 / 209690488 / +0.5%	242273612 / 249242450 / -2.8%	0.87 / 0.84 / +3.4%
appian_q08/datafusion:parquet	658155386 / 668736073 / -1.6%	688213111 / 689642953 / -0.2%	0.96 / 0.97 / -1.4%

duckdb / vortex-compact / ns (1.010x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact	91293043 / 90937239 / +0.4%	106387659 / 103398654 / +2.9%	0.86 / 0.88 / -2.4%
appian_q02/duckdb:vortex-compact	212345700 / 212361390 / -0.0%	226517762 / 228128203 / -0.7%	0.94 / 0.93 / +0.7%
appian_q03/duckdb:vortex-compact	122523707 / 121303851 / +1.0%	134551944 / 139150371 / -3.3%	0.91 / 0.87 / +4.5%
appian_q04/duckdb:vortex-compact	571486858 / 563285251 / +1.5%	617450609 / 595520235 / +3.7%	0.93 / 0.95 / -2.1%
appian_q05/duckdb:vortex-compact	132690520 / 127865073 / +3.8%	148181243 / 149484866 / -0.9%	0.90 / 0.86 / +4.7%
appian_q06/duckdb:vortex-compact	402156200 / 405864680 / -0.9%	413150063 / 395115322 / +4.6%	0.97 / 1.03 / -5.2%
appian_q07/duckdb:vortex-compact	136602455 / 135779939 / +0.6%	152970897 / 161334860 / -5.2%	0.89 / 0.84 / +6.1%
appian_q08/duckdb:vortex-compact	430414755 / 422495996 / +1.9%	473723730 / 475995563 / -0.5%	0.91 / 0.89 / +2.4%

duckdb / parquet / ns (1.023x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet	98403744 / 99511483 / -1.1%	112081018 / 111854668 / +0.2%	0.88 / 0.89 / -1.3%
appian_q02/duckdb:parquet	197209474 / 198017774 / -0.4%	197268778 / 196022306 / +0.6%	1.00 / 1.01 / -1.0%
appian_q03/duckdb:parquet	124020478 / 124150550 / -0.1%	134765537 / 136493822 / -1.3%	0.92 / 0.91 / +1.2%
appian_q04/duckdb:parquet	470075557 / 434063866 / +8.3%	442673467 / 469650350 / -5.7%	1.06 / 0.92 / +14.9%
appian_q05/duckdb:parquet	143292691 / 142192091 / +0.8%	161021403 / 167412675 / -3.8%	0.89 / 0.85 / +4.8%
appian_q06/duckdb:parquet	261940341 / 236007548 / +11.0% 🔴	273905527 / 258794240 / +5.8%	0.96 / 0.91 / +4.9%
appian_q07/duckdb:parquet	152947747 / 154009908 / -0.7%	171085740 / 166463295 / +2.8%	0.89 / 0.93 / -3.4%
appian_q08/duckdb:parquet	382100596 / 376056867 / +1.6%	387219174 / 359307719 / +7.8%	0.99 / 1.05 / -5.7%

No file size changes detected.

ghost · 2026-10-06T16:44:50Z

Benchmarks: Clickbench on NVME 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.997x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.008x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.6%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1240358 / 1249580 / -0.7%	20416822 / 20036317 / +1.9%	0.06 / 0.06 / -2.6%
clickbench_q01/datafusion:vortex-file-compressed	5783830 / 5889498 / -1.8%	34266386 / 33868384 / +1.2%	0.17 / 0.17 / -2.9%
clickbench_q02/datafusion:vortex-file-compressed	10182535 / 10792590 / -5.7%	40979000 / 34005596 / +20.5% 🔴	0.25 / 0.32 / -21.7%
clickbench_q03/datafusion:vortex-file-compressed	11410408 / 11899434 / -4.1%	51877919 / 51864303 / +0.0%	0.22 / 0.23 / -4.1%
clickbench_q04/datafusion:vortex-file-compressed	57177532 / 55872838 / +2.3%	89718796 / 91651986 / -2.1%	0.64 / 0.61 / +4.5%
clickbench_q05/datafusion:vortex-file-compressed	72964529 / 76330074 / -4.4%	117800578 / 118255219 / -0.4%	0.62 / 0.65 / -4.0%
clickbench_q06/datafusion:vortex-file-compressed	1264631 / 1274556 / -0.8%	19814956 / 19519982 / +1.5%	0.06 / 0.07 / -2.3%
clickbench_q07/datafusion:vortex-file-compressed	9959361 / 9685148 / +2.8%	34867645 / 32923404 / +5.9%	0.29 / 0.29 / -2.9%
clickbench_q08/datafusion:vortex-file-compressed	77464156 / 76258483 / +1.6%	113623931 / 116691785 / -2.6%	0.68 / 0.65 / +4.3%
clickbench_q09/datafusion:vortex-file-compressed	174639688 / 169945406 / +2.8%	205641705 / 209910806 / -2.0%	0.85 / 0.81 / +4.9%
clickbench_q10/datafusion:vortex-file-compressed	24208578 / 22850638 / +5.9%	66979520 / 65197246 / +2.7%	0.36 / 0.35 / +3.1%
clickbench_q11/datafusion:vortex-file-compressed	26516486 / 26139548 / +1.4%	67360624 / 67742676 / -0.6%	0.39 / 0.39 / +2.0%
clickbench_q12/datafusion:vortex-file-compressed	71766950 / 73291654 / -2.1%	111005720 / 115952583 / -4.3%	0.65 / 0.63 / +2.3%
clickbench_q13/datafusion:vortex-file-compressed	117125318 / 122170292 / -4.1%	180031696 / 177248102 / +1.6%	0.65 / 0.69 / -5.6%
clickbench_q14/datafusion:vortex-file-compressed	75900435 / 73952986 / +2.6%	116759260 / 122363714 / -4.6%	0.65 / 0.60 / +7.6%
clickbench_q15/datafusion:vortex-file-compressed	60121373 / 61775468 / -2.7%	96821944 / 97176843 / -0.4%	0.62 / 0.64 / -2.3%
clickbench_q16/datafusion:vortex-file-compressed	148238053 / 150741948 / -1.7%	206477330 / 203003680 / +1.7%	0.72 / 0.74 / -3.3%
clickbench_q17/datafusion:vortex-file-compressed	147872486 / 149997310 / -1.4%	207081153 / 217142100 / -4.6%	0.71 / 0.69 / +3.4%
clickbench_q18/datafusion:vortex-file-compressed	294758242 / 297505684 / -0.9%	367087397 / 393123729 / -6.6%	0.80 / 0.76 / +6.1%
clickbench_q19/datafusion:vortex-file-compressed	7993292 / 7630376 / +4.8%	46555774 / 46098523 / +1.0%	0.17 / 0.17 / +3.7%
clickbench_q20/datafusion:vortex-file-compressed	63396650 / 62792220 / +1.0%	232412870 / 229621871 / +1.2%	0.27 / 0.27 / -0.2%
clickbench_q21/datafusion:vortex-file-compressed	89526438 / 89281480 / +0.3%	270279046 / 266807706 / +1.3%	0.33 / 0.33 / -1.0%
clickbench_q22/datafusion:vortex-file-compressed	103710448 / 104378916 / -0.6%	348193467 / 342697313 / +1.6%	0.30 / 0.30 / -2.2%
clickbench_q23/datafusion:vortex-file-compressed	203260084 / 202535990 / +0.4%	502210999 / 521563870 / -3.7%	0.40 / 0.39 / +4.2%
clickbench_q24/datafusion:vortex-file-compressed	16186426 / 16075032 / +0.7%	62259163 / 61683665 / +0.9%	0.26 / 0.26 / -0.2%
clickbench_q25/datafusion:vortex-file-compressed	18005272 / 18410250 / -2.2%	58686161 / 55569176 / +5.6%	0.31 / 0.33 / -7.4%
clickbench_q26/datafusion:vortex-file-compressed	15526077 / 16546016 / -6.2%	63669157 / 62809405 / +1.4%	0.24 / 0.26 / -7.4%
clickbench_q27/datafusion:vortex-file-compressed	98152974 / 98459634 / -0.3%	242929172 / 243589675 / -0.3%	0.40 / 0.40 / -0.0%
clickbench_q28/datafusion:vortex-file-compressed	577425619 / 571915230 / +1.0%	613468947 / 613801553 / -0.1%	0.94 / 0.93 / +1.0%
clickbench_q29/datafusion:vortex-file-compressed	23043296 / 23156228 / -0.5%	53447407 / 49557492 / +7.8%	0.43 / 0.47 / -7.7%
clickbench_q30/datafusion:vortex-file-compressed	59319511 / 60327033 / -1.7%	104131609 / 104053729 / +0.1%	0.57 / 0.58 / -1.7%
clickbench_q31/datafusion:vortex-file-compressed	72319728 / 69965874 / +3.4%	150022594 / 150258051 / -0.2%	0.48 / 0.47 / +3.5%
clickbench_q32/datafusion:vortex-file-compressed	299613772 / 304941036 / -1.7%	380324172 / 386665929 / -1.6%	0.79 / 0.79 / -0.1%
clickbench_q33/datafusion:vortex-file-compressed	326262584 / 334969755 / -2.6%	434527490 / 429622840 / +1.1%	0.75 / 0.78 / -3.7%
clickbench_q34/datafusion:vortex-file-compressed	334789304 / 330222658 / +1.4%	442105274 / 428948607 / +3.1%	0.76 / 0.77 / -1.6%
clickbench_q35/datafusion:vortex-file-compressed	55995574 / 56008884 / -0.0%	84621703 / 89778162 / -5.7%	0.66 / 0.62 / +6.1%
clickbench_q36/datafusion:vortex-file-compressed	37219002 / 37709698 / -1.3%	65131459 / 63783498 / +2.1%	0.57 / 0.59 / -3.3%
clickbench_q37/datafusion:vortex-file-compressed	21605962 / 21974754 / -1.7%	46322259 / 46697871 / -0.8%	0.47 / 0.47 / -0.9%
clickbench_q38/datafusion:vortex-file-compressed	11743497 / 11853115 / -0.9%	37259656 / 37441569 / -0.5%	0.32 / 0.32 / -0.4%
clickbench_q39/datafusion:vortex-file-compressed	77968762 / 77558183 / +0.5%	108135157 / 108847364 / -0.7%	0.72 / 0.71 / +1.2%
clickbench_q40/datafusion:vortex-file-compressed	11234232 / 11152808 / +0.7%	35097777 / 35492182 / -1.1%	0.32 / 0.31 / +1.9%
clickbench_q41/datafusion:vortex-file-compressed	10835074 / 10718374 / +1.1%	34608722 / 35122743 / -1.5%	0.31 / 0.31 / +2.6%
clickbench_q42/datafusion:vortex-file-compressed	10994302 / 11134559 / -1.3%	34628462 / 34638661 / -0.0%	0.32 / 0.32 / -1.2%

datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact	1220954 / 1232110 / -0.9%	19350844 / 18769268 / +3.1%	0.06 / 0.07 / -3.9%
clickbench_q01/datafusion:vortex-compact	7415636 / 7087571 / +4.6%	29802963 / 32097023 / -7.1%	0.25 / 0.22 / +12.7%
clickbench_q02/datafusion:vortex-compact	19330828 / 20126522 / -4.0%	41762161 / 42084250 / -0.8%	0.46 / 0.48 / -3.2%
clickbench_q03/datafusion:vortex-compact	14303057 / 13811178 / +3.6%	39300077 / 37628046 / +4.4%	0.36 / 0.37 / -0.8%
clickbench_q04/datafusion:vortex-compact	58444818 / 58247847 / +0.3%	88598656 / 86841052 / +2.0%	0.66 / 0.67 / -1.7%
clickbench_q05/datafusion:vortex-compact	83769445 / 83727388 / +0.1%	125282627 / 123508722 / +1.4%	0.67 / 0.68 / -1.4%
clickbench_q06/datafusion:vortex-compact	1256608 / 1244617 / +1.0%	19509546 / 19131773 / +2.0%	0.06 / 0.07 / -1.0%
clickbench_q07/datafusion:vortex-compact	12322650 / 11900135 / +3.6%	36287973 / 34047604 / +6.6%	0.34 / 0.35 / -2.8%
clickbench_q08/datafusion:vortex-compact	85067720 / 84628232 / +0.5%	117495386 / 121835744 / -3.6%	0.72 / 0.69 / +4.2%
clickbench_q09/datafusion:vortex-compact	185946208 / 190197788 / -2.2%	222614759 / 209176133 / +6.4%	0.84 / 0.91 / -8.1%
clickbench_q10/datafusion:vortex-compact	43198696 / 42915499 / +0.7%	70798743 / 70624381 / +0.2%	0.61 / 0.61 / +0.4%
clickbench_q11/datafusion:vortex-compact	55401488 / 55218550 / +0.3%	83515632 / 79325106 / +5.3%	0.66 / 0.70 / -4.7%
clickbench_q12/datafusion:vortex-compact	85417280 / 85601866 / -0.2%	128940775 / 128625931 / +0.2%	0.66 / 0.67 / -0.5%
clickbench_q13/datafusion:vortex-compact	136382802 / 133909640 / +1.8%	178721616 / 185315891 / -3.6%	0.76 / 0.72 / +5.6%
clickbench_q14/datafusion:vortex-compact	91681492 / 92338117 / -0.7%	125283147 / 126548538 / -1.0%	0.73 / 0.73 / +0.3%
clickbench_q15/datafusion:vortex-compact	64226520 / 62771078 / +2.3%	92165700 / 96450516 / -4.4%	0.70 / 0.65 / +7.1%
clickbench_q16/datafusion:vortex-compact	163193385 / 165247806 / -1.2%	212697967 / 215536087 / -1.3%	0.77 / 0.77 / +0.1%
clickbench_q17/datafusion:vortex-compact	165381960 / 169969575 / -2.7%	215303654 / 220358237 / -2.3%	0.77 / 0.77 / -0.4%
clickbench_q18/datafusion:vortex-compact	303020482 / 303626766 / -0.2%	366444551 / 388357381 / -5.6%	0.83 / 0.78 / +5.8%
clickbench_q19/datafusion:vortex-compact	10117308 / 10716654 / -5.6%	39059550 / 38051565 / +2.6%	0.26 / 0.28 / -8.0%
clickbench_q20/datafusion:vortex-compact	71289916 / 71302170 / -0.0%	188888735 / 187134027 / +0.9%	0.38 / 0.38 / -0.9%
clickbench_q21/datafusion:vortex-compact	115848866 / 117156266 / -1.1%	228952623 / 224652633 / +1.9%	0.51 / 0.52 / -3.0%
clickbench_q22/datafusion:vortex-compact	183622932 / 183852206 / -0.1%	272761556 / 268055568 / +1.8%	0.67 / 0.69 / -1.8%
clickbench_q23/datafusion:vortex-compact	520968550 / 540009438 / -3.5%	637690595 / 642607046 / -0.8%	0.82 / 0.84 / -2.8%
clickbench_q24/datafusion:vortex-compact	28338457 / 28057257 / +1.0%	59738047 / 56175289 / +6.3%	0.47 / 0.50 / -5.0%
clickbench_q25/datafusion:vortex-compact	35416590 / 36057444 / -1.8%	66682149 / 63615959 / +4.8%	0.53 / 0.57 / -6.3%
clickbench_q26/datafusion:vortex-compact	28624488 / 28365823 / +0.9%	58131347 / 61342821 / -5.2%	0.49 / 0.46 / +6.5%
clickbench_q27/datafusion:vortex-compact	102460234 / 104946672 / -2.4%	210880557 / 208976221 / +0.9%	0.49 / 0.50 / -3.3%
clickbench_q28/datafusion:vortex-compact	588117764 / 581078008 / +1.2%	613346424 / 619838114 / -1.0%	0.96 / 0.94 / +2.3%
clickbench_q29/datafusion:vortex-compact	30764388 / 31526811 / -2.4%	54438296 / 54013106 / +0.8%	0.57 / 0.58 / -3.2%
clickbench_q30/datafusion:vortex-compact	92601072 / 92057988 / +0.6%	135912702 / 123057397 / +10.4% 🔴	0.68 / 0.75 / -8.9%
clickbench_q31/datafusion:vortex-compact	101510080 / 100412848 / +1.1%	148577480 / 149732962 / -0.8%	0.68 / 0.67 / +1.9%
clickbench_q32/datafusion:vortex-compact	298180690 / 305045644 / -2.3%	378753597 / 375686315 / +0.8%	0.79 / 0.81 / -3.0%
clickbench_q33/datafusion:vortex-compact	337910558 / 344255844 / -1.8%	415777677 / 421969975 / -1.5%	0.81 / 0.82 / -0.4%
clickbench_q34/datafusion:vortex-compact	344347854 / 336681576 / +2.3%	417376693 / 414840605 / +0.6%	0.83 / 0.81 / +1.7%
clickbench_q35/datafusion:vortex-compact	63052366 / 62641234 / +0.7%	89651630 / 93119592 / -3.7%	0.70 / 0.67 / +4.5%
clickbench_q36/datafusion:vortex-compact	38221573 / 38335112 / -0.3%	65286064 / 65690832 / -0.6%	0.59 / 0.58 / +0.3%
clickbench_q37/datafusion:vortex-compact	22317760 / 22754389 / -1.9%	46406617 / 47032969 / -1.3%	0.48 / 0.48 / -0.6%
clickbench_q38/datafusion:vortex-compact	13312149 / 12365676 / +7.7%	38370145 / 38030636 / +0.9%	0.35 / 0.33 / +6.7%
clickbench_q39/datafusion:vortex-compact	78523078 / 79395584 / -1.1%	109243979 / 108937619 / +0.3%	0.72 / 0.73 / -1.4%
clickbench_q40/datafusion:vortex-compact	12907049 / 12103972 / +6.6%	34710213 / 35474889 / -2.2%	0.37 / 0.34 / +9.0%
clickbench_q41/datafusion:vortex-compact	13100345 / 12954328 / +1.1%	36824527 / 36367673 / +1.3%	0.36 / 0.36 / -0.1%
clickbench_q42/datafusion:vortex-compact	11287576 / 11406804 / -1.0%	34404361 / 33830917 / +1.7%	0.33 / 0.34 / -2.7%

datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1262818 / 1289588 / -2.1%	49699583 / 48909109 / +1.6%	0.03 / 0.03 / -3.6%
clickbench_q01/datafusion:parquet	16081844 / 16480226 / -2.4%	75431179 / 72809448 / +3.6%	0.21 / 0.23 / -5.8%
clickbench_q02/datafusion:parquet	19115450 / 18953249 / +0.9%	82416055 / 82341328 / +0.1%	0.23 / 0.23 / +0.8%
clickbench_q03/datafusion:parquet	17666656 / 17081338 / +3.4%	80975437 / 79007107 / +2.5%	0.22 / 0.22 / +0.9%
clickbench_q04/datafusion:parquet	62370507 / 63406664 / -1.6%	126155595 / 127269961 / -0.9%	0.49 / 0.50 / -0.8%
clickbench_q05/datafusion:parquet	89473128 / 89177864 / +0.3%	160411631 / 156743761 / +2.3%	0.56 / 0.57 / -2.0%
clickbench_q06/datafusion:parquet	1258448 / 1280207 / -1.7%	50037458 / 47903684 / +4.5%	0.03 / 0.03 / -5.9%
clickbench_q07/datafusion:parquet	17025870 / 16805517 / +1.3%	69291827 / 67859795 / +2.1%	0.25 / 0.25 / -0.8%
clickbench_q08/datafusion:parquet	85388976 / 84508339 / +1.0%	167868576 / 158307064 / +6.0%	0.51 / 0.53 / -4.7%
clickbench_q09/datafusion:parquet	196017124 / 192189802 / +2.0%	278737714 / 261735014 / +6.5%	0.70 / 0.73 / -4.2%
clickbench_q10/datafusion:parquet	36157888 / 36675928 / -1.4%	102841889 / 102332039 / +0.5%	0.35 / 0.36 / -1.9%
clickbench_q11/datafusion:parquet	43611576 / 42487289 / +2.6%	112089689 / 108315428 / +3.5%	0.39 / 0.39 / -0.8%
clickbench_q12/datafusion:parquet	96953356 / 95683156 / +1.3%	164869034 / 159252315 / +3.5%	0.59 / 0.60 / -2.1%
clickbench_q13/datafusion:parquet	146804632 / 148311256 / -1.0%	230703008 / 228887541 / +0.8%	0.64 / 0.65 / -1.8%
clickbench_q14/datafusion:parquet	102865286 / 102133570 / +0.7%	177522787 / 169921607 / +4.5%	0.58 / 0.60 / -3.6%
clickbench_q15/datafusion:parquet	70185516 / 72446806 / -3.1%	134533580 / 133840396 / +0.5%	0.52 / 0.54 / -3.6%
clickbench_q16/datafusion:parquet	156653758 / 156512776 / +0.1%	233125255 / 233963480 / -0.4%	0.67 / 0.67 / +0.4%
clickbench_q17/datafusion:parquet	155675149 / 156044409 / -0.2%	240143156 / 237955941 / +0.9%	0.65 / 0.66 / -1.1%
clickbench_q18/datafusion:parquet	320082664 / 313456361 / +2.1%	423554901 / 423201184 / +0.1%	0.76 / 0.74 / +2.0%
clickbench_q19/datafusion:parquet	18498757 / 18549596 / -0.3%	73287555 / 76046995 / -3.6%	0.25 / 0.24 / +3.5%
clickbench_q20/datafusion:parquet	178009818 / 178949371 / -0.5%	276926957 / 275901456 / +0.4%	0.64 / 0.65 / -0.9%
clickbench_q21/datafusion:parquet	174893410 / 173759716 / +0.7%	290913098 / 289926976 / +0.3%	0.60 / 0.60 / +0.3%
clickbench_q22/datafusion:parquet	261110200 / 264572822 / -1.3%	413929691 / 414538974 / -0.1%	0.63 / 0.64 / -1.2%
clickbench_q23/datafusion:parquet	1144405700 / 1125978872 / +1.6%	1230742164 / 1242186213 / -0.9%	0.93 / 0.91 / +2.6%
clickbench_q24/datafusion:parquet	29650625 / 29815080 / -0.6%	87474390 / 87486024 / -0.0%	0.34 / 0.34 / -0.5%
clickbench_q25/datafusion:parquet	37407612 / 37740208 / -0.9%	99978645 / 99133622 / +0.9%	0.37 / 0.38 / -1.7%
clickbench_q26/datafusion:parquet	30985430 / 30710062 / +0.9%	87627077 / 87500183 / +0.1%	0.35 / 0.35 / +0.8%
clickbench_q27/datafusion:parquet	193871732 / 195700772 / -0.9%	284455353 / 281351880 / +1.1%	0.68 / 0.70 / -2.0%
clickbench_q28/datafusion:parquet	624655658 / 625302290 / -0.1%	700749185 / 704503847 / -0.5%	0.89 / 0.89 / +0.4%
clickbench_q29/datafusion:parquet	29022786 / 29525132 / -1.7%	90684031 / 91275708 / -0.6%	0.32 / 0.32 / -1.1%
clickbench_q30/datafusion:parquet	91661094 / 91432473 / +0.3%	167204297 / 168689232 / -0.9%	0.55 / 0.54 / +1.1%
clickbench_q31/datafusion:parquet	103373554 / 103310595 / +0.1%	195420548 / 189175320 / +3.3%	0.53 / 0.55 / -3.1%
clickbench_q32/datafusion:parquet	329981251 / 323794608 / +1.9%	424198564 / 429977294 / -1.3%	0.78 / 0.75 / +3.3%
clickbench_q33/datafusion:parquet	383637914 / 386085860 / -0.6%	476414772 / 478861324 / -0.5%	0.81 / 0.81 / -0.1%
clickbench_q34/datafusion:parquet	384567133 / 383258482 / +0.3%	475107015 / 476708755 / -0.3%	0.81 / 0.80 / +0.7%
clickbench_q35/datafusion:parquet	64901756 / 63809140 / +1.7%	125067471 / 123250885 / +1.5%	0.52 / 0.52 / +0.2%
clickbench_q36/datafusion:parquet	73518942 / 73386966 / +0.2%	135060914 / 134690546 / +0.3%	0.54 / 0.54 / -0.1%
clickbench_q37/datafusion:parquet	35633926 / 35526824 / +0.3%	91847710 / 91068855 / +0.9%	0.39 / 0.39 / -0.5%
clickbench_q38/datafusion:parquet	47519013 / 47711766 / -0.4%	106503305 / 106002081 / +0.5%	0.45 / 0.45 / -0.9%
clickbench_q39/datafusion:parquet	143478670 / 143717356 / -0.2%	207321789 / 206715653 / +0.3%	0.69 / 0.70 / -0.5%
clickbench_q40/datafusion:parquet	20100786 / 20165370 / -0.3%	77911205 / 77111850 / +1.0%	0.26 / 0.26 / -1.3%
clickbench_q41/datafusion:parquet	19016762 / 18843507 / +0.9%	76738911 / 76557672 / +0.2%	0.25 / 0.25 / +0.7%
clickbench_q42/datafusion:parquet	19306990 / 19396166 / -0.5%	75266488 / 75264354 / +0.0%	0.26 / 0.26 / -0.5%

duckdb / vortex-file-compressed / ns (0.977x ➖, 3↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	1692608 / 1836864 / -7.9%	26225059 / 27061740 / -3.1%	0.06 / 0.07 / -4.9%
clickbench_q01/duckdb:vortex-file-compressed	12591209 / 12071954 / +4.3%	29534797 / 28414956 / +3.9%	0.43 / 0.42 / +0.3%
clickbench_q02/duckdb:vortex-file-compressed	12948728 / 13040298 / -0.7%	35279333 / 36446621 / -3.2%	0.37 / 0.36 / +2.6%
clickbench_q03/duckdb:vortex-file-compressed	17362109 / 17425599 / -0.4%	43942856 / 50000373 / -12.1% 🟢	0.40 / 0.35 / +13.4%
clickbench_q04/duckdb:vortex-file-compressed	71765754 / 72138494 / -0.5%	104827711 / 100460614 / +4.3%	0.68 / 0.72 / -4.7%
clickbench_q05/duckdb:vortex-file-compressed	66499518 / 68567545 / -3.0%	90587505 / 93002522 / -2.6%	0.73 / 0.74 / -0.4%
clickbench_q06/duckdb:vortex-file-compressed	2036926 / 2114441 / -3.7%	30008126 / 30382868 / -1.2%	0.07 / 0.07 / -2.5%
clickbench_q07/duckdb:vortex-file-compressed	15016934 / 17013892 / -11.7% 🟢	34369721 / 33303470 / +3.2%	0.44 / 0.51 / -14.5%
clickbench_q08/duckdb:vortex-file-compressed	84380779 / 82167791 / +2.7%	122053115 / 121392677 / +0.5%	0.69 / 0.68 / +2.1%
clickbench_q09/duckdb:vortex-file-compressed	106485234 / 106477976 / +0.0%	143454309 / 145421146 / -1.4%	0.74 / 0.73 / +1.4%
clickbench_q10/duckdb:vortex-file-compressed	33341295 / 33713214 / -1.1%	66475064 / 66352305 / +0.2%	0.50 / 0.51 / -1.3%
clickbench_q11/duckdb:vortex-file-compressed	35521965 / 35614890 / -0.3%	69645784 / 71419617 / -2.5%	0.51 / 0.50 / +2.3%
clickbench_q12/duckdb:vortex-file-compressed	73997724 / 74946157 / -1.3%	102267482 / 102766894 / -0.5%	0.72 / 0.73 / -0.8%
clickbench_q13/duckdb:vortex-file-compressed	134341688 / 146867472 / -8.5%	178380540 / 175183581 / +1.8%	0.75 / 0.84 / -10.2%
clickbench_q14/duckdb:vortex-file-compressed	77238618 / 81303078 / -5.0%	106289627 / 113025505 / -6.0%	0.73 / 0.72 / +1.0%
clickbench_q15/duckdb:vortex-file-compressed	91602512 / 93272616 / -1.8%	129236265 / 127472964 / +1.4%	0.71 / 0.73 / -3.1%
clickbench_q16/duckdb:vortex-file-compressed	160409971 / 162803808 / -1.5%	210776373 / 211855227 / -0.5%	0.76 / 0.77 / -1.0%
clickbench_q17/duckdb:vortex-file-compressed	166113577 / 162443481 / +2.3%	206886626 / 212582524 / -2.7%	0.80 / 0.76 / +5.1%
clickbench_q18/duckdb:vortex-file-compressed	318773290 / 317752902 / +0.3%	413144843 / 385964711 / +7.0%	0.77 / 0.82 / -6.3%
clickbench_q19/duckdb:vortex-file-compressed	17307562 / 18597064 / -6.9%	40937432 / 40913577 / +0.1%	0.42 / 0.45 / -7.0%
clickbench_q20/duckdb:vortex-file-compressed	108818951 / 109376061 / -0.5%	186371624 / 187233839 / -0.5%	0.58 / 0.58 / -0.0%
clickbench_q21/duckdb:vortex-file-compressed	159528131 / 154609275 / +3.2%	287186589 / 283304761 / +1.4%	0.56 / 0.55 / +1.8%
clickbench_q22/duckdb:vortex-file-compressed	237926618 / 241226646 / -1.4%	421580786 / 430742913 / -2.1%	0.56 / 0.56 / +0.8%
clickbench_q23/duckdb:vortex-file-compressed	57618471 / 65858724 / -12.5% 🟢	106038112 / 102277418 / +3.7%	0.54 / 0.64 / -15.6%
clickbench_q24/duckdb:vortex-file-compressed	25587806 / 24116778 / +6.1%	44797547 / 48881585 / -8.4%	0.57 / 0.49 / +15.8%
clickbench_q25/duckdb:vortex-file-compressed	32484120 / 31976459 / +1.6%	54421449 / 56846606 / -4.3%	0.60 / 0.56 / +6.1%
clickbench_q26/duckdb:vortex-file-compressed	20706504 / 20691604 / +0.1%	35010769 / 37080016 / -5.6%	0.59 / 0.56 / +6.0%
clickbench_q27/duckdb:vortex-file-compressed	135544462 / 135906534 / -0.3%	239919271 / 234448761 / +2.3%	0.56 / 0.58 / -2.5%
clickbench_q28/duckdb:vortex-file-compressed	597254580 / 727988280 / -18.0% 🟢	669710653 / 678852822 / -1.3%	0.89 / 1.07 / -16.8%
clickbench_q29/duckdb:vortex-file-compressed	17116770 / 18962210 / -9.7%	36209301 / 39356650 / -8.0%	0.47 / 0.48 / -1.9%
clickbench_q30/duckdb:vortex-file-compressed	65137258 / 67898211 / -4.1%	107837131 / 107404024 / +0.4%	0.60 / 0.63 / -4.5%
clickbench_q31/duckdb:vortex-file-compressed	124506758 / 126295404 / -1.4%	197350517 / 175615261 / +12.4% 🔴	0.63 / 0.72 / -12.3%
clickbench_q32/duckdb:vortex-file-compressed	449614256 / 464470786 / -3.2%	496718848 / 503705764 / -1.4%	0.91 / 0.92 / -1.8%
clickbench_q33/duckdb:vortex-file-compressed	390612552 / 404230217 / -3.4%	495088139 / 492885821 / +0.4%	0.79 / 0.82 / -3.8%
clickbench_q34/duckdb:vortex-file-compressed	415161512 / 425260408 / -2.4%	525261270 / 536514435 / -2.1%	0.79 / 0.79 / -0.3%
clickbench_q35/duckdb:vortex-file-compressed	104523307 / 103044661 / +1.4%	141074180 / 137770603 / +2.4%	0.74 / 0.75 / -0.9%
clickbench_q36/duckdb:vortex-file-compressed	15663764 / 16772802 / -6.6%	32808888 / 32910716 / -0.3%	0.48 / 0.51 / -6.3%
clickbench_q37/duckdb:vortex-file-compressed	11958158 / 11811265 / +1.2%	27749509 / 28475606 / -2.5%	0.43 / 0.41 / +3.9%
clickbench_q38/duckdb:vortex-file-compressed	13343788 / 13377614 / -0.3%	27220082 / 31096820 / -12.5% 🟢	0.49 / 0.43 / +14.0%
clickbench_q39/duckdb:vortex-file-compressed	23004176 / 23486948 / -2.1%	43042762 / 39304475 / +9.5%	0.53 / 0.60 / -10.6%
clickbench_q40/duckdb:vortex-file-compressed	12043168 / 11171942 / +7.8%	27905809 / 30994396 / -10.0%	0.43 / 0.36 / +19.7%
clickbench_q41/duckdb:vortex-file-compressed	11075244 / 11063062 / +0.1%	30114543 / 28549188 / +5.5%	0.37 / 0.39 / -5.1%
clickbench_q42/duckdb:vortex-file-compressed	11253428 / 11728062 / -4.0%	29215417 / 32448760 / -10.0%	0.39 / 0.36 / +6.6%

duckdb / vortex-compact / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact	1786248 / 1793690 / -0.4%	24113109 / 27629201 / -12.7% 🟢	0.07 / 0.06 / +14.1%
clickbench_q01/duckdb:vortex-compact	13327628 / 13620851 / -2.2%	32995854 / 30159535 / +9.4%	0.40 / 0.45 / -10.6%
clickbench_q02/duckdb:vortex-compact	19598658 / 18190091 / +7.7%	38883088 / 39579258 / -1.8%	0.50 / 0.46 / +9.7%
clickbench_q03/duckdb:vortex-compact	20153090 / 20531846 / -1.8%	47873885 / 50642232 / -5.5%	0.42 / 0.41 / +3.8%
clickbench_q04/duckdb:vortex-compact	72822886 / 73675637 / -1.2%	96713719 / 104852323 / -7.8%	0.75 / 0.70 / +7.2%
clickbench_q05/duckdb:vortex-compact	75661716 / 78402824 / -3.5%	102309467 / 116226608 / -12.0% 🟢	0.74 / 0.67 / +9.6%
clickbench_q06/duckdb:vortex-compact	1962257 / 2067716 / -5.1%	32919916 / 30935739 / +6.4%	0.06 / 0.07 / -10.8%
clickbench_q07/duckdb:vortex-compact	16803165 / 15633952 / +7.5%	33062944 / 34782695 / -4.9%	0.51 / 0.45 / +13.1%
clickbench_q08/duckdb:vortex-compact	96953072 / 97779750 / -0.8%	132194148 / 131999486 / +0.1%	0.73 / 0.74 / -1.0%
clickbench_q09/duckdb:vortex-compact	140093444 / 142459044 / -1.7%	181419083 / 177343725 / +2.3%	0.77 / 0.80 / -3.9%
clickbench_q10/duckdb:vortex-compact	51888168 / 53052380 / -2.2%	85421637 / 87852204 / -2.8%	0.61 / 0.60 / +0.6%
clickbench_q11/duckdb:vortex-compact	64878758 / 64703626 / +0.3%	104765123 / 105629259 / -0.8%	0.62 / 0.61 / +1.1%
clickbench_q12/duckdb:vortex-compact	86921708 / 89095512 / -2.4%	120870199 / 125338547 / -3.6%	0.72 / 0.71 / +1.2%
clickbench_q13/duckdb:vortex-compact	161533912 / 162451547 / -0.6%	206564042 / 205604693 / +0.5%	0.78 / 0.79 / -1.0%
clickbench_q14/duckdb:vortex-compact	97747762 / 101503686 / -3.7%	134746406 / 131159181 / +2.7%	0.73 / 0.77 / -6.3%
clickbench_q15/duckdb:vortex-compact	95395799 / 96366458 / -1.0%	138151556 / 131497479 / +5.1%	0.69 / 0.73 / -5.8%
clickbench_q16/duckdb:vortex-compact	178473026 / 181029448 / -1.4%	231639787 / 239608333 / -3.3%	0.77 / 0.76 / +2.0%
clickbench_q17/duckdb:vortex-compact	181536614 / 181328530 / +0.1%	225330299 / 228868768 / -1.5%	0.81 / 0.79 / +1.7%
clickbench_q18/duckdb:vortex-compact	328653136 / 342322146 / -4.0%	384186881 / 379426328 / +1.3%	0.86 / 0.90 / -5.2%
clickbench_q19/duckdb:vortex-compact	17503736 / 16815600 / +4.1%	40841669 / 37653691 / +8.5%	0.43 / 0.45 / -4.0%
clickbench_q20/duckdb:vortex-compact	104521064 / 104165632 / +0.3%	173409035 / 161427362 / +7.4%	0.60 / 0.65 / -6.6%
clickbench_q21/duckdb:vortex-compact	171230958 / 169502944 / +1.0%	291052629 / 284200472 / +2.4%	0.59 / 0.60 / -1.4%
clickbench_q22/duckdb:vortex-compact	345804780 / 344983468 / +0.2%	509279973 / 495835596 / +2.7%	0.68 / 0.70 / -2.4%
clickbench_q23/duckdb:vortex-compact	94988862 / 96592811 / -1.7%	132325375 / 133332976 / -0.8%	0.72 / 0.72 / -0.9%
clickbench_q24/duckdb:vortex-compact	30713470 / 31069894 / -1.1%	43730597 / 46645093 / -6.2%	0.70 / 0.67 / +5.4%
clickbench_q25/duckdb:vortex-compact	47516568 / 46779940 / +1.6%	68856604 / 67449934 / +2.1%	0.69 / 0.69 / -0.5%
clickbench_q26/duckdb:vortex-compact	24692022 / 24384462 / +1.3%	39098442 / 41058878 / -4.8%	0.63 / 0.59 / +6.3%
clickbench_q27/duckdb:vortex-compact	191530579 / 193932872 / -1.2%	295816194 / 308736664 / -4.2%	0.65 / 0.63 / +3.1%
clickbench_q28/duckdb:vortex-compact	591089680 / 580779046 / +1.8%	703279739 / 677229814 / +3.8%	0.84 / 0.86 / -2.0%
clickbench_q29/duckdb:vortex-compact	23916996 / 23891181 / +0.1%	44329439 / 46931878 / -5.5%	0.54 / 0.51 / +6.0%
clickbench_q30/duckdb:vortex-compact	112708137 / 114824741 / -1.8%	145953716 / 150731180 / -3.2%	0.77 / 0.76 / +1.4%
clickbench_q31/duckdb:vortex-compact	172233758 / 175891491 / -2.1%	231848021 / 239962996 / -3.4%	0.74 / 0.73 / +1.3%
clickbench_q32/duckdb:vortex-compact	443728258 / 457095228 / -2.9%	532234890 / 542313235 / -1.9%	0.83 / 0.84 / -1.1%
clickbench_q33/duckdb:vortex-compact	393722626 / 393834328 / -0.0%	497827727 / 494525489 / +0.7%	0.79 / 0.80 / -0.7%
clickbench_q34/duckdb:vortex-compact	408197300 / 418012632 / -2.3%	522362753 / 529556997 / -1.4%	0.78 / 0.79 / -1.0%
clickbench_q35/duckdb:vortex-compact	110642168 / 108079404 / +2.4%	143140291 / 144877415 / -1.2%	0.77 / 0.75 / +3.6%
clickbench_q36/duckdb:vortex-compact	16054481 / 17557084 / -8.6%	34517764 / 33976686 / +1.6%	0.47 / 0.52 / -10.0%
clickbench_q37/duckdb:vortex-compact	14031816 / 13145780 / +6.7%	29581795 / 30731742 / -3.7%	0.47 / 0.43 / +10.9%
clickbench_q38/duckdb:vortex-compact	13566016 / 13604092 / -0.3%	30246509 / 29562227 / +2.3%	0.45 / 0.46 / -2.5%
clickbench_q39/duckdb:vortex-compact	25226472 / 25886020 / -2.5%	41829349 / 43348831 / -3.5%	0.60 / 0.60 / +1.0%
clickbench_q40/duckdb:vortex-compact	13984406 / 12910010 / +8.3%	29566413 / 30867191 / -4.2%	0.47 / 0.42 / +13.1%
clickbench_q41/duckdb:vortex-compact	13192132 / 12931977 / +2.0%	31773141 / 29585350 / +7.4%	0.42 / 0.44 / -5.0%
clickbench_q42/duckdb:vortex-compact	11832770 / 12798249 / -7.5%	28788014 / 27787026 / +3.6%	0.41 / 0.46 / -10.8%

duckdb / parquet / ns (0.992x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	8661944 / 9326516 / -7.1%	19664303 / 22383912 / -12.1% 🟢	0.44 / 0.42 / +5.7%
clickbench_q01/duckdb:parquet	9133014 / 9099087 / +0.4%	22039913 / 19402292 / +13.6% 🔴	0.41 / 0.47 / -11.6%
clickbench_q02/duckdb:parquet	15441034 / 16431441 / -6.0%	35238090 / 31125767 / +13.2% 🔴	0.44 / 0.53 / -17.0%
clickbench_q03/duckdb:parquet	15783563 / 16830374 / -6.2%	50767524 / 52043079 / -2.5%	0.31 / 0.32 / -3.9%
clickbench_q04/duckdb:parquet	70077364 / 70874420 / -1.1%	93596924 / 89803201 / +4.2%	0.75 / 0.79 / -5.1%
clickbench_q05/duckdb:parquet	82494938 / 82383564 / +0.1%	121005055 / 128249269 / -5.6%	0.68 / 0.64 / +6.1%
clickbench_q06/duckdb:parquet	15374898 / 15550944 / -1.1%	23872475 / 25975966 / -8.1%	0.64 / 0.60 / +7.6%
clickbench_q07/duckdb:parquet	10964337 / 10970186 / -0.1%	21230824 / 20913784 / +1.5%	0.52 / 0.52 / -1.5%
clickbench_q08/duckdb:parquet	86259672 / 87199133 / -1.1%	123708281 / 131336836 / -5.8%	0.70 / 0.66 / +5.0%
clickbench_q09/duckdb:parquet	116623996 / 113785691 / +2.5%	157728885 / 154800625 / +1.9%	0.74 / 0.74 / +0.6%
clickbench_q10/duckdb:parquet	35859910 / 33989945 / +5.5%	67675301 / 69534655 / -2.7%	0.53 / 0.49 / +8.4%
clickbench_q11/duckdb:parquet	36367588 / 39996906 / -9.1%	75177656 / 74560279 / +0.8%	0.48 / 0.54 / -9.8%
clickbench_q12/duckdb:parquet	89561520 / 95980882 / -6.7%	130956043 / 129409513 / +1.2%	0.68 / 0.74 / -7.8%
clickbench_q13/duckdb:parquet	143987676 / 146728782 / -1.9%	210869029 / 208008161 / +1.4%	0.68 / 0.71 / -3.2%
clickbench_q14/duckdb:parquet	103320261 / 99556076 / +3.8%	141225298 / 138196991 / +2.2%	0.73 / 0.72 / +1.6%
clickbench_q15/duckdb:parquet	92302428 / 93544543 / -1.3%	133860869 / 124062675 / +7.9%	0.69 / 0.75 / -8.6%
clickbench_q16/duckdb:parquet	169713098 / 172855424 / -1.8%	231320700 / 227891177 / +1.5%	0.73 / 0.76 / -3.3%
clickbench_q17/duckdb:parquet	186102314 / 184041023 / +1.1%	223474494 / 233379541 / -4.2%	0.83 / 0.79 / +5.6%
clickbench_q18/duckdb:parquet	336298612 / 343294260 / -2.0%	407831618 / 407122123 / +0.2%	0.82 / 0.84 / -2.2%
clickbench_q19/duckdb:parquet	13354386 / 13735671 / -2.8%	39684386 / 40491623 / -2.0%	0.34 / 0.34 / -0.8%
clickbench_q20/duckdb:parquet	135254082 / 134691646 / +0.4%	244160114 / 244858040 / -0.3%	0.55 / 0.55 / +0.7%
clickbench_q21/duckdb:parquet	183920172 / 178369008 / +3.1%	324266992 / 318883642 / +1.7%	0.57 / 0.56 / +1.4%
clickbench_q22/duckdb:parquet	241527034 / 236995670 / +1.9%	408103970 / 410323940 / -0.5%	0.59 / 0.58 / +2.5%
clickbench_q23/duckdb:parquet	143973842 / 149559228 / -3.7%	163365791 / 166946816 / -2.1%	0.88 / 0.90 / -1.6%
clickbench_q24/duckdb:parquet	43849734 / 43473176 / +0.9%	60462441 / 63076389 / -4.1%	0.73 / 0.69 / +5.2%
clickbench_q25/duckdb:parquet	40276068 / 40222516 / +0.1%	87429780 / 88090551 / -0.8%	0.46 / 0.46 / +0.9%
clickbench_q26/duckdb:parquet	29251172 / 29720882 / -1.6%	47086981 / 48020292 / -1.9%	0.62 / 0.62 / +0.4%
clickbench_q27/duckdb:parquet	142317266 / 143660425 / -0.9%	258065313 / 251599852 / +2.6%	0.55 / 0.57 / -3.4%
clickbench_q28/duckdb:parquet	906763970 / 900066016 / +0.7%	1010945700 / 982869373 / +2.9%	0.90 / 0.92 / -2.1%
clickbench_q29/duckdb:parquet	19050499 / 16843048 / +13.1% 🔴	29934065 / 31160437 / -3.9%	0.64 / 0.54 / +17.7%
clickbench_q30/duckdb:parquet	90442136 / 97479522 / -7.2%	170031276 / 178163067 / -4.6%	0.53 / 0.55 / -2.8%
clickbench_q31/duckdb:parquet	144917618 / 145024890 / -0.1%	288848547 / 290132455 / -0.4%	0.50 / 0.50 / +0.4%
clickbench_q32/duckdb:parquet	458305914 / 453581266 / +1.0%	496566193 / 514216671 / -3.4%	0.92 / 0.88 / +4.6%
clickbench_q33/duckdb:parquet	448828128 / 457389068 / -1.9%	491586698 / 472158687 / +4.1%	0.91 / 0.97 / -5.7%
clickbench_q34/duckdb:parquet	460227352 / 452249592 / +1.8%	500266723 / 499756002 / +0.1%	0.92 / 0.90 / +1.7%
clickbench_q35/duckdb:parquet	101050230 / 99355702 / +1.7%	119086977 / 117717243 / +1.2%	0.85 / 0.84 / +0.5%
clickbench_q36/duckdb:parquet	31200801 / 31558568 / -1.1%	41579400 / 42137145 / -1.3%	0.75 / 0.75 / +0.2%
clickbench_q37/duckdb:parquet	22827856 / 23203655 / -1.6%	32789008 / 32457433 / +1.0%	0.70 / 0.71 / -2.6%
clickbench_q38/duckdb:parquet	24253746 / 24113094 / +0.6%	33138790 / 35152382 / -5.7%	0.73 / 0.69 / +6.7%
clickbench_q39/duckdb:parquet	56409942 / 57041933 / -1.1%	66488357 / 66949634 / -0.7%	0.85 / 0.85 / -0.4%
clickbench_q40/duckdb:parquet	13342110 / 13655188 / -2.3%	24617689 / 22478647 / +9.5%	0.54 / 0.61 / -10.8%
clickbench_q41/duckdb:parquet	13148256 / 13234063 / -0.6%	23339740 / 23596808 / -1.1%	0.56 / 0.56 / +0.4%
clickbench_q42/duckdb:parquet	14777308 / 14723638 / +0.4%	33575924 / 25294327 / +32.7% 🔴	0.44 / 0.58 / -24.4%

No file size changes detected.

ghost · 2026-10-06T16:44:52Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-0.1%, environment too noisy confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.974x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.004x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed	24091405 / 24344356 / -1.0%	44357865 / 42879444 / +3.4%	0.54 / 0.57 / -4.3%
tpcds_q02/datafusion:vortex-file-compressed	45323406 / 44993424 / +0.7%	61227484 / 62988393 / -2.8%	0.74 / 0.71 / +3.6%
tpcds_q03/datafusion:vortex-file-compressed	11954883 / 11544521 / +3.6%	28639149 / 29135950 / -1.7%	0.42 / 0.40 / +5.4%
tpcds_q04/datafusion:vortex-file-compressed	113197056 / 114826468 / -1.4%	141397081 / 145191876 / -2.6%	0.80 / 0.79 / +1.2%
tpcds_q05/datafusion:vortex-file-compressed	59640382 / 60465814 / -1.4%	82943114 / 83033472 / -0.1%	0.72 / 0.73 / -1.3%
tpcds_q06/datafusion:vortex-file-compressed	23392014 / 23709166 / -1.3%	45915604 / 47390393 / -3.1%	0.51 / 0.50 / +1.8%
tpcds_q07/datafusion:vortex-file-compressed	32608362 / 32658506 / -0.2%	55101823 / 57646180 / -4.4%	0.59 / 0.57 / +4.5%
tpcds_q08/datafusion:vortex-file-compressed	25351619 / 25218445 / +0.5%	44230353 / 43454634 / +1.8%	0.57 / 0.58 / -1.2%
tpcds_q09/datafusion:vortex-file-compressed	17243492 / 17216820 / +0.2%	36047101 / 35587493 / +1.3%	0.48 / 0.48 / -1.1%
tpcds_q10/datafusion:vortex-file-compressed	28932770 / 29044938 / -0.4%	49443467 / 50528109 / -2.1%	0.59 / 0.57 / +1.8%
tpcds_q11/datafusion:vortex-file-compressed	62712209 / 62445762 / +0.4%	90097221 / 89100784 / +1.1%	0.70 / 0.70 / -0.7%
tpcds_q12/datafusion:vortex-file-compressed	16247040 / 16547732 / -1.8%	33015274 / 32407171 / +1.9%	0.49 / 0.51 / -3.6%
tpcds_q13/datafusion:vortex-file-compressed	34075128 / 33612870 / +1.4%	51376063 / 53673737 / -4.3%	0.66 / 0.63 / +5.9%
tpcds_q14/datafusion:vortex-file-compressed	89990076 / 91114763 / -1.2%	116440092 / 123914865 / -6.0%	0.77 / 0.74 / +5.1%
tpcds_q15/datafusion:vortex-file-compressed	23755622 / 24169404 / -1.7%	41932611 / 45336787 / -7.5%	0.57 / 0.53 / +6.3%
tpcds_q16/datafusion:vortex-file-compressed	20506541 / 20411873 / +0.5%	38891733 / 41956980 / -7.3%	0.53 / 0.49 / +8.4%
tpcds_q17/datafusion:vortex-file-compressed	64261914 / 53772270 / +19.5% 🔴	76150993 / 78028690 / -2.4%	0.84 / 0.69 / +22.5%
tpcds_q18/datafusion:vortex-file-compressed	68636030 / 68756032 / -0.2%	92808726 / 93749651 / -1.0%	0.74 / 0.73 / +0.8%
tpcds_q19/datafusion:vortex-file-compressed	18439590 / 18312048 / +0.7%	39060117 / 40550091 / -3.7%	0.47 / 0.45 / +4.5%
tpcds_q20/datafusion:vortex-file-compressed	17924072 / 17471370 / +2.6%	35335211 / 35527123 / -0.5%	0.51 / 0.49 / +3.1%
tpcds_q21/datafusion:vortex-file-compressed	16568284 / 17385109 / -4.7%	41300426 / 40031658 / +3.2%	0.40 / 0.43 / -7.6%
tpcds_q22/datafusion:vortex-file-compressed	49434758 / 50523239 / -2.2%	71687103 / 71493527 / +0.3%	0.69 / 0.71 / -2.4%
tpcds_q23/datafusion:vortex-file-compressed	73006893 / 73555616 / -0.7%	96628655 / 100517102 / -3.9%	0.76 / 0.73 / +3.2%
tpcds_q24/datafusion:vortex-file-compressed	70178068 / 70541610 / -0.5%	96044222 / 94337051 / +1.8%	0.73 / 0.75 / -2.3%
tpcds_q25/datafusion:vortex-file-compressed	56161000 / 56076676 / +0.2%	73234256 / 76892728 / -4.8%	0.77 / 0.73 / +5.2%
tpcds_q26/datafusion:vortex-file-compressed	30205868 / 30213982 / -0.0%	52273187 / 52344954 / -0.1%	0.58 / 0.58 / +0.1%
tpcds_q27/datafusion:vortex-file-compressed	62311786 / 64370135 / -3.2%	88753810 / 91613165 / -3.1%	0.70 / 0.70 / -0.1%
tpcds_q28/datafusion:vortex-file-compressed	18002140 / 17854772 / +0.8%	35328419 / 36724204 / -3.8%	0.51 / 0.49 / +4.8%
tpcds_q29/datafusion:vortex-file-compressed	61413164 / 54759010 / +12.2% 🔴	86545461 / 84522697 / +2.4%	0.71 / 0.65 / +9.5%
tpcds_q30/datafusion:vortex-file-compressed	27477982 / 27346374 / +0.5%	44544077 / 48596664 / -8.3%	0.62 / 0.56 / +9.6%
tpcds_q31/datafusion:vortex-file-compressed	64061479 / 64516010 / -0.7%	89674543 / 92129214 / -2.7%	0.71 / 0.70 / +2.0%
tpcds_q32/datafusion:vortex-file-compressed	13813844 / 13526222 / +2.1%	31107148 / 31774736 / -2.1%	0.44 / 0.43 / +4.3%
tpcds_q33/datafusion:vortex-file-compressed	26938290 / 26942224 / -0.0%	47782077 / 48921405 / -2.3%	0.56 / 0.55 / +2.4%
tpcds_q34/datafusion:vortex-file-compressed	17980520 / 17952772 / +0.2%	38847889 / 40554094 / -4.2%	0.46 / 0.44 / +4.6%
tpcds_q35/datafusion:vortex-file-compressed	35386623 / 35609448 / -0.6%	56483625 / 58860319 / -4.0%	0.63 / 0.60 / +3.6%
tpcds_q36/datafusion:vortex-file-compressed	47983200 / 48127686 / -0.3%	74982908 / 70059684 / +7.0%	0.64 / 0.69 / -6.8%
tpcds_q37/datafusion:vortex-file-compressed	13738144 / 13394022 / +2.6%	33479841 / 33581158 / -0.3%	0.41 / 0.40 / +2.9%
tpcds_q38/datafusion:vortex-file-compressed	29872034 / 29997800 / -0.4%	52439821 / 52833249 / -0.7%	0.57 / 0.57 / +0.3%
tpcds_q39/datafusion:vortex-file-compressed	65216312 / 65472038 / -0.4%	89996324 / 92444995 / -2.6%	0.72 / 0.71 / +2.3%
tpcds_q40/datafusion:vortex-file-compressed	24690992 / 25068990 / -1.5%	45347539 / 47244401 / -4.0%	0.54 / 0.53 / +2.6%
tpcds_q41/datafusion:vortex-file-compressed	16536748 / 16647745 / -0.7%	31219236 / 31559274 / -1.1%	0.53 / 0.53 / +0.4%
tpcds_q42/datafusion:vortex-file-compressed	11407110 / 11374718 / +0.3%	27434920 / 28188330 / -2.7%	0.42 / 0.40 / +3.0%
tpcds_q43/datafusion:vortex-file-compressed	13308138 / 13197498 / +0.8%	31207121 / 32673176 / -4.5%	0.43 / 0.40 / +5.6%
tpcds_q44/datafusion:vortex-file-compressed	26482360 / 26231978 / +1.0%	50095411 / 52418117 / -4.4%	0.53 / 0.50 / +5.6%
tpcds_q45/datafusion:vortex-file-compressed	27727692 / 27198330 / +1.9%	47330612 / 47874309 / -1.1%	0.59 / 0.57 / +3.1%
tpcds_q46/datafusion:vortex-file-compressed	25077804 / 24517945 / +2.3%	48173390 / 48487550 / -0.6%	0.52 / 0.51 / +3.0%
tpcds_q47/datafusion:vortex-file-compressed	77325752 / 78201440 / -1.1%	104896552 / 107087306 / -2.0%	0.74 / 0.73 / +0.9%
tpcds_q48/datafusion:vortex-file-compressed	31217191 / 31667364 / -1.4%	51666335 / 52369854 / -1.3%	0.60 / 0.60 / -0.1%
tpcds_q49/datafusion:vortex-file-compressed	59395796 / 59639552 / -0.4%	88858549 / 84842029 / +4.7%	0.67 / 0.70 / -4.9%
tpcds_q50/datafusion:vortex-file-compressed	34734282 / 34316221 / +1.2%	54312013 / 55952960 / -2.9%	0.64 / 0.61 / +4.3%
tpcds_q51/datafusion:vortex-file-compressed	60256964 / 60544353 / -0.5%	81772033 / 84650902 / -3.4%	0.74 / 0.72 / +3.0%
tpcds_q52/datafusion:vortex-file-compressed	11830792 / 11697074 / +1.1%	28361942 / 28759296 / -1.4%	0.42 / 0.41 / +2.6%
tpcds_q53/datafusion:vortex-file-compressed	18430558 / 18292290 / +0.8%	37146543 / 38627270 / -3.8%	0.50 / 0.47 / +4.8%
tpcds_q54/datafusion:vortex-file-compressed	33038162 / 33799959 / -2.3%	56476985 / 62576296 / -9.7%	0.58 / 0.54 / +8.3%
tpcds_q55/datafusion:vortex-file-compressed	11252369 / 11365167 / -1.0%	26590749 / 28257374 / -5.9%	0.42 / 0.40 / +5.2%
tpcds_q56/datafusion:vortex-file-compressed	26434074 / 27278212 / -3.1%	48707941 / 50585614 / -3.7%	0.54 / 0.54 / +0.6%
tpcds_q57/datafusion:vortex-file-compressed	72967319 / 73362100 / -0.5%	96315205 / 98672333 / -2.4%	0.76 / 0.74 / +1.9%
tpcds_q58/datafusion:vortex-file-compressed	40844864 / 40391609 / +1.1%	65533834 / 68558978 / -4.4%	0.62 / 0.59 / +5.8%
tpcds_q59/datafusion:vortex-file-compressed	32266380 / 32442666 / -0.5%	52304202 / 53876762 / -2.9%	0.62 / 0.60 / +2.4%
tpcds_q60/datafusion:vortex-file-compressed	26577208 / 26668362 / -0.3%	49356666 / 49527115 / -0.3%	0.54 / 0.54 / +0.0%
tpcds_q61/datafusion:vortex-file-compressed	23290098 / 25281959 / -7.9%	47779966 / 48234495 / -0.9%	0.49 / 0.52 / -7.0%
tpcds_q62/datafusion:vortex-file-compressed	16987324 / 17114051 / -0.7%	34992520 / 36853947 / -5.1%	0.49 / 0.46 / +4.5%
tpcds_q63/datafusion:vortex-file-compressed	18513468 / 18565620 / -0.3%	37580738 / 39263874 / -4.3%	0.49 / 0.47 / +4.2%
tpcds_q64/datafusion:vortex-file-compressed	322239472 / 325038038 / -0.9%	359652213 / 362693057 / -0.8%	0.90 / 0.90 / -0.0%
tpcds_q65/datafusion:vortex-file-compressed	74567114 / 75874534 / -1.7%	94246567 / 95503911 / -1.3%	0.79 / 0.79 / -0.4%
tpcds_q66/datafusion:vortex-file-compressed	52349052 / 53393693 / -2.0%	74451751 / 77487493 / -3.9%	0.70 / 0.69 / +2.0%
tpcds_q67/datafusion:vortex-file-compressed	55034074 / 55145078 / -0.2%	84613991 / 85695839 / -1.3%	0.65 / 0.64 / +1.1%
tpcds_q68/datafusion:vortex-file-compressed	24617627 / 24591852 / +0.1%	48221082 / 48825982 / -1.2%	0.51 / 0.50 / +1.4%
tpcds_q69/datafusion:vortex-file-compressed	28123942 / 28293990 / -0.6%	47751505 / 50391413 / -5.2%	0.59 / 0.56 / +4.9%
tpcds_q70/datafusion:vortex-file-compressed	71582618 / 70704912 / +1.2%	92444637 / 94959819 / -2.6%	0.77 / 0.74 / +4.0%
tpcds_q71/datafusion:vortex-file-compressed	18638666 / 19303914 / -3.4%	36507581 / 41023821 / -11.0% 🟢	0.51 / 0.47 / +8.5%
tpcds_q72/datafusion:vortex-file-compressed	466012688 / 474533372 / -1.8%	519551073 / 544668389 / -4.6%	0.90 / 0.87 / +3.0%
tpcds_q73/datafusion:vortex-file-compressed	17590328 / 17091560 / +2.9%	37469437 / 38074906 / -1.6%	0.47 / 0.45 / +4.6%
tpcds_q74/datafusion:vortex-file-compressed	45885308 / 46712126 / -1.8%	69237158 / 70978535 / -2.5%	0.66 / 0.66 / +0.7%
tpcds_q75/datafusion:vortex-file-compressed	130151094 / 132856423 / -2.0%	156159191 / 162451544 / -3.9%	0.83 / 0.82 / +1.9%
tpcds_q76/datafusion:vortex-file-compressed	43575558 / 43904166 / -0.7%	63682937 / 62947374 / +1.2%	0.68 / 0.70 / -1.9%
tpcds_q77/datafusion:vortex-file-compressed	35168770 / 35950424 / -2.2%	60263290 / 60463837 / -0.3%	0.58 / 0.59 / -1.8%
tpcds_q78/datafusion:vortex-file-compressed	79673142 / 80278525 / -0.8%	107208814 / 111380232 / -3.7%	0.74 / 0.72 / +3.1%
tpcds_q79/datafusion:vortex-file-compressed	21419302 / 21260376 / +0.7%	43581054 / 43181431 / +0.9%	0.49 / 0.49 / -0.2%
tpcds_q80/datafusion:vortex-file-compressed	77236702 / 77855872 / -0.8%	108899769 / 112837261 / -3.5%	0.71 / 0.69 / +2.8%
tpcds_q81/datafusion:vortex-file-compressed	28200788 / 28718102 / -1.8%	44484725 / 46388046 / -4.1%	0.63 / 0.62 / +2.4%
tpcds_q82/datafusion:vortex-file-compressed	13584599 / 13716240 / -1.0%	35517846 / 34724354 / +2.3%	0.38 / 0.40 / -3.2%
tpcds_q83/datafusion:vortex-file-compressed	35944444 / 35928202 / +0.0%	57285817 / 60107826 / -4.7%	0.63 / 0.60 / +5.0%
tpcds_q84/datafusion:vortex-file-compressed	11906230 / 11973410 / -0.6%	26995016 / 29874606 / -9.6%	0.44 / 0.40 / +10.0%
tpcds_q85/datafusion:vortex-file-compressed	59226550 / 59554116 / -0.6%	83533106 / 83712906 / -0.2%	0.71 / 0.71 / -0.3%
tpcds_q86/datafusion:vortex-file-compressed	16308578 / 16551240 / -1.5%	32462154 / 33545962 / -3.2%	0.50 / 0.49 / +1.8%
tpcds_q87/datafusion:vortex-file-compressed	30067922 / 29473130 / +2.0%	52194757 / 52991778 / -1.5%	0.58 / 0.56 / +3.6%
tpcds_q88/datafusion:vortex-file-compressed	34795522 / 34559866 / +0.7%	63038379 / 61606163 / +2.3%	0.55 / 0.56 / -1.6%
tpcds_q89/datafusion:vortex-file-compressed	21391723 / 21110544 / +1.3%	41423749 / 41328056 / +0.2%	0.52 / 0.51 / +1.1%
tpcds_q90/datafusion:vortex-file-compressed	10255676 / 10370904 / -1.1%	26588974 / 27328517 / -2.7%	0.39 / 0.38 / +1.6%
tpcds_q91/datafusion:vortex-file-compressed	17205376 / 16423180 / +4.8%	32417384 / 36483702 / -11.1% 🟢	0.53 / 0.45 / +17.9%
tpcds_q92/datafusion:vortex-file-compressed	13789770 / 13814409 / -0.2%	30966768 / 31980212 / -3.2%	0.45 / 0.43 / +3.1%
tpcds_q93/datafusion:vortex-file-compressed	23856195 / 24410842 / -2.3%	45664808 / 47331606 / -3.5%	0.52 / 0.52 / +1.3%
tpcds_q94/datafusion:vortex-file-compressed	19615070 / 19929351 / -1.6%	38830639 / 40836898 / -4.9%	0.51 / 0.49 / +3.5%
tpcds_q95/datafusion:vortex-file-compressed	46339115 / 45817740 / +1.1%	65598311 / 69265284 / -5.3%	0.71 / 0.66 / +6.8%
tpcds_q96/datafusion:vortex-file-compressed	9487205 / 9648550 / -1.7%	24234733 / 26224164 / -7.6%	0.39 / 0.37 / +6.4%
tpcds_q97/datafusion:vortex-file-compressed	21048524 / 21334876 / -1.3%	42099123 / 44999634 / -6.4%	0.50 / 0.47 / +5.5%
tpcds_q98/datafusion:vortex-file-compressed	16736678 / 17129082 / -2.3%	36936419 / 38053793 / -2.9%	0.45 / 0.45 / +0.7%
tpcds_q99/datafusion:vortex-file-compressed	19519962 / 19640776 / -0.6%	37340224 / 39344738 / -5.1%	0.52 / 0.50 / +4.7%

datafusion / vortex-compact / ns (0.992x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact	25574158 / 26173707 / -2.3%	44896071 / 45657477 / -1.7%	0.57 / 0.57 / -0.6%
tpcds_q02/datafusion:vortex-compact	48504912 / 48934883 / -0.9%	66943875 / 67880269 / -1.4%	0.72 / 0.72 / +0.5%
tpcds_q03/datafusion:vortex-compact	12849982 / 12960428 / -0.9%	33518852 / 33445633 / +0.2%	0.38 / 0.39 / -1.1%
tpcds_q04/datafusion:vortex-compact	122866010 / 121650488 / +1.0%	156269409 / 150377994 / +3.9%	0.79 / 0.81 / -2.8%
tpcds_q05/datafusion:vortex-compact	62057837 / 62509919 / -0.7%	85594332 / 84408515 / +1.4%	0.73 / 0.74 / -2.1%
tpcds_q06/datafusion:vortex-compact	26531690 / 26427104 / +0.4%	47703243 / 47067247 / +1.4%	0.56 / 0.56 / -0.9%
tpcds_q07/datafusion:vortex-compact	35712107 / 34696702 / +2.9%	54371430 / 56949151 / -4.5%	0.66 / 0.61 / +7.8%
tpcds_q08/datafusion:vortex-compact	30634734 / 30624438 / +0.0%	47721579 / 49435793 / -3.5%	0.64 / 0.62 / +3.6%
tpcds_q09/datafusion:vortex-compact	22307040 / 21749544 / +2.6%	41303618 / 40239968 / +2.6%	0.54 / 0.54 / -0.1%
tpcds_q10/datafusion:vortex-compact	37588358 / 37274377 / +0.8%	58596221 / 60275389 / -2.8%	0.64 / 0.62 / +3.7%
tpcds_q11/datafusion:vortex-compact	66494776 / 70819390 / -6.1%	91596537 / 95047432 / -3.6%	0.73 / 0.75 / -2.6%
tpcds_q12/datafusion:vortex-compact	20544583 / 20766926 / -1.1%	38523676 / 39636559 / -2.8%	0.53 / 0.52 / +1.8%
tpcds_q13/datafusion:vortex-compact	55334835 / 55177779 / +0.3%	74478921 / 73940523 / +0.7%	0.74 / 0.75 / -0.4%
tpcds_q14/datafusion:vortex-compact	96662988 / 98638866 / -2.0%	122430757 / 121748689 / +0.6%	0.79 / 0.81 / -2.5%
tpcds_q15/datafusion:vortex-compact	27174393 / 27426986 / -0.9%	45307689 / 47687153 / -5.0%	0.60 / 0.58 / +4.3%
tpcds_q16/datafusion:vortex-compact	23186222 / 23873722 / -2.9%	43536391 / 44270282 / -1.7%	0.53 / 0.54 / -1.2%
tpcds_q17/datafusion:vortex-compact	66581227 / 67693734 / -1.6%	93360508 / 99046790 / -5.7%	0.71 / 0.68 / +4.3%
tpcds_q18/datafusion:vortex-compact	68816458 / 68770829 / +0.1%	91352532 / 91559881 / -0.2%	0.75 / 0.75 / +0.3%
tpcds_q19/datafusion:vortex-compact	21173583 / 21667534 / -2.3%	42833447 / 43344364 / -1.2%	0.49 / 0.50 / -1.1%
tpcds_q20/datafusion:vortex-compact	22278794 / 22808194 / -2.3%	40494945 / 42684640 / -5.1%	0.55 / 0.53 / +3.0%
tpcds_q21/datafusion:vortex-compact	18018072 / 19022148 / -5.3%	39898800 / 42966753 / -7.1%	0.45 / 0.44 / +2.0%
tpcds_q22/datafusion:vortex-compact	50039607 / 50157156 / -0.2%	72712974 / 72876656 / -0.2%	0.69 / 0.69 / -0.0%
tpcds_q23/datafusion:vortex-compact	75741552 / 77862540 / -2.7%	102302759 / 104863924 / -2.4%	0.74 / 0.74 / -0.3%
tpcds_q24/datafusion:vortex-compact	77144402 / 77018493 / +0.2%	103329474 / 100832741 / +2.5%	0.75 / 0.76 / -2.3%
tpcds_q25/datafusion:vortex-compact	60046536 / 62774353 / -4.3%	85456479 / 83359600 / +2.5%	0.70 / 0.75 / -6.7%
tpcds_q26/datafusion:vortex-compact	31921298 / 33256342 / -4.0%	52847219 / 52621688 / +0.4%	0.60 / 0.63 / -4.4%
tpcds_q27/datafusion:vortex-compact	64086760 / 61398628 / +4.4%	86876117 / 85097948 / +2.1%	0.74 / 0.72 / +2.2%
tpcds_q28/datafusion:vortex-compact	27571628 / 28150418 / -2.1%	47095313 / 51650986 / -8.8%	0.59 / 0.55 / +7.4%
tpcds_q29/datafusion:vortex-compact	61405330 / 65995170 / -7.0%	81583781 / 96404490 / -15.4% 🟢	0.75 / 0.68 / +9.9%
tpcds_q30/datafusion:vortex-compact	30398920 / 30710394 / -1.0%	47115628 / 48607485 / -3.1%	0.65 / 0.63 / +2.1%
tpcds_q31/datafusion:vortex-compact	77686099 / 76150178 / +2.0%	103013339 / 106482029 / -3.3%	0.75 / 0.72 / +5.5%
tpcds_q32/datafusion:vortex-compact	16237309 / 16756886 / -3.1%	35451765 / 35271059 / +0.5%	0.46 / 0.48 / -3.6%
tpcds_q33/datafusion:vortex-compact	28571232 / 29538684 / -3.3%	50113060 / 52426456 / -4.4%	0.57 / 0.56 / +1.2%
tpcds_q34/datafusion:vortex-compact	20829524 / 21166470 / -1.6%	44166161 / 41122550 / +7.4%	0.47 / 0.51 / -8.4%
tpcds_q35/datafusion:vortex-compact	41697553 / 40590379 / +2.7%	66816091 / 64980135 / +2.8%	0.62 / 0.62 / -0.1%
tpcds_q36/datafusion:vortex-compact	52613926 / 51480242 / +2.2%	77327825 / 76981712 / +0.4%	0.68 / 0.67 / +1.7%
tpcds_q37/datafusion:vortex-compact	15678897 / 15259903 / +2.7%	38371921 / 41846088 / -8.3%	0.41 / 0.36 / +12.0%
tpcds_q38/datafusion:vortex-compact	34878330 / 34378246 / +1.5%	57842541 / 56935854 / +1.6%	0.60 / 0.60 / -0.1%
tpcds_q39/datafusion:vortex-compact	66506445 / 68518509 / -2.9%	88937633 / 92647274 / -4.0%	0.75 / 0.74 / +1.1%
tpcds_q40/datafusion:vortex-compact	27886028 / 28276860 / -1.4%	48470606 / 50795673 / -4.6%	0.58 / 0.56 / +3.3%
tpcds_q41/datafusion:vortex-compact	18567236 / 18701685 / -0.7%	31646562 / 33037690 / -4.2%	0.59 / 0.57 / +3.6%
tpcds_q42/datafusion:vortex-compact	12482914 / 12441157 / +0.3%	30972122 / 32815007 / -5.6%	0.40 / 0.38 / +6.3%
tpcds_q43/datafusion:vortex-compact	15345256 / 16234473 / -5.5%	33206518 / 34285371 / -3.1%	0.46 / 0.47 / -2.4%
tpcds_q44/datafusion:vortex-compact	30490216 / 30777993 / -0.9%	54238131 / 55176520 / -1.7%	0.56 / 0.56 / +0.8%
tpcds_q45/datafusion:vortex-compact	30532627 / 30460932 / +0.2%	48938634 / 51740420 / -5.4%	0.62 / 0.59 / +6.0%
tpcds_q46/datafusion:vortex-compact	30368395 / 28096908 / +8.1%	54936352 / 52127351 / +5.4%	0.55 / 0.54 / +2.6%
tpcds_q47/datafusion:vortex-compact	88884674 / 86862414 / +2.3%	116857749 / 116791218 / +0.1%	0.76 / 0.74 / +2.3%
tpcds_q48/datafusion:vortex-compact	50588599 / 61670102 / -18.0% 🟢	68900098 / 70426774 / -2.2%	0.73 / 0.88 / -16.2%
tpcds_q49/datafusion:vortex-compact	64056048 / 66148970 / -3.2%	88039313 / 95281281 / -7.6%	0.73 / 0.69 / +4.8%
tpcds_q50/datafusion:vortex-compact	36109694 / 36070784 / +0.1%	61410135 / 56907240 / +7.9%	0.59 / 0.63 / -7.2%
tpcds_q51/datafusion:vortex-compact	63367804 / 63610674 / -0.4%	84715729 / 86433184 / -2.0%	0.75 / 0.74 / +1.6%
tpcds_q52/datafusion:vortex-compact	13311288 / 13716992 / -3.0%	32993528 / 32802155 / +0.6%	0.40 / 0.42 / -3.5%
tpcds_q53/datafusion:vortex-compact	22139666 / 23176976 / -4.5%	40390072 / 43354426 / -6.8%	0.55 / 0.53 / +2.5%
tpcds_q54/datafusion:vortex-compact	39236902 / 40182869 / -2.4%	66042009 / 65310316 / +1.1%	0.59 / 0.62 / -3.4%
tpcds_q55/datafusion:vortex-compact	13094716 / 12394286 / +5.7%	30934008 / 32093749 / -3.6%	0.42 / 0.39 / +9.6%
tpcds_q56/datafusion:vortex-compact	29824538 / 28014362 / +6.5%	49080831 / 51653289 / -5.0%	0.61 / 0.54 / +12.0%
tpcds_q57/datafusion:vortex-compact	79860459 / 79833421 / +0.0%	108282456 / 108106166 / +0.2%	0.74 / 0.74 / -0.1%
tpcds_q58/datafusion:vortex-compact	48248896 / 48312100 / -0.1%	72058194 / 76311813 / -5.6%	0.67 / 0.63 / +5.8%
tpcds_q59/datafusion:vortex-compact	40157566 / 39837550 / +0.8%	60625138 / 61013635 / -0.6%	0.66 / 0.65 / +1.4%
tpcds_q60/datafusion:vortex-compact	28801548 / 28097520 / +2.5%	51178971 / 51892181 / -1.4%	0.56 / 0.54 / +3.9%
tpcds_q61/datafusion:vortex-compact	27687600 / 28129000 / -1.6%	49732413 / 48367822 / +2.8%	0.56 / 0.58 / -4.3%
tpcds_q62/datafusion:vortex-compact	17766567 / 17781088 / -0.1%	35693580 / 36108579 / -1.1%	0.50 / 0.49 / +1.1%
tpcds_q63/datafusion:vortex-compact	23524370 / 23493690 / +0.1%	42183597 / 43578962 / -3.2%	0.56 / 0.54 / +3.4%
tpcds_q64/datafusion:vortex-compact	448959130 / 446587424 / +0.5%	460227729 / 454249370 / +1.3%	0.98 / 0.98 / -0.8%
tpcds_q65/datafusion:vortex-compact	81631654 / 80590066 / +1.3%	99680858 / 102417873 / -2.7%	0.82 / 0.79 / +4.1%
tpcds_q66/datafusion:vortex-compact	55103559 / 55318138 / -0.4%	75187025 / 77025571 / -2.4%	0.73 / 0.72 / +2.0%
tpcds_q67/datafusion:vortex-compact	58361812 / 59319942 / -1.6%	88583501 / 90179797 / -1.8%	0.66 / 0.66 / +0.2%
tpcds_q68/datafusion:vortex-compact	27224056 / 27637102 / -1.5%	51626429 / 51691468 / -0.1%	0.53 / 0.53 / -1.4%
tpcds_q69/datafusion:vortex-compact	36461864 / 37890678 / -3.8%	58392817 / 60583722 / -3.6%	0.62 / 0.63 / -0.2%
tpcds_q70/datafusion:vortex-compact	75735586 / 76274654 / -0.7%	95973378 / 97212155 / -1.3%	0.79 / 0.78 / +0.6%
tpcds_q71/datafusion:vortex-compact	19389553 / 19319936 / +0.4%	41104997 / 41733257 / -1.5%	0.47 / 0.46 / +1.9%
tpcds_q72/datafusion:vortex-compact	468839290 / 476719140 / -1.7%	476726699 / 490022628 / -2.7%	0.98 / 0.97 / +1.1%
tpcds_q73/datafusion:vortex-compact	19632018 / 19507392 / +0.6%	39887545 / 41846093 / -4.7%	0.49 / 0.47 / +5.6%
tpcds_q74/datafusion:vortex-compact	50164099 / 51269482 / -2.2%	75909242 / 76888065 / -1.3%	0.66 / 0.67 / -0.9%
tpcds_q75/datafusion:vortex-compact	139097086 / 137048248 / +1.5%	157715642 / 168805700 / -6.6%	0.88 / 0.81 / +8.6%
tpcds_q76/datafusion:vortex-compact	41489894 / 42245534 / -1.8%	62826741 / 60153679 / +4.4%	0.66 / 0.70 / -6.0%
tpcds_q77/datafusion:vortex-compact	38349899 / 37843781 / +1.3%	63680603 / 64010116 / -0.5%	0.60 / 0.59 / +1.9%
tpcds_q78/datafusion:vortex-compact	85884758 / 86847047 / -1.1%	112096407 / 115317105 / -2.8%	0.77 / 0.75 / +1.7%
tpcds_q79/datafusion:vortex-compact	25016359 / 24483821 / +2.2%	45722961 / 51880967 / -11.9% 🟢	0.55 / 0.47 / +15.9%
tpcds_q80/datafusion:vortex-compact	79190573 / 79302510 / -0.1%	110033395 / 110537774 / -0.5%	0.72 / 0.72 / +0.3%
tpcds_q81/datafusion:vortex-compact	30499792 / 30330518 / +0.6%	47260573 / 47081993 / +0.4%	0.65 / 0.64 / +0.2%
tpcds_q82/datafusion:vortex-compact	15654162 / 15640688 / +0.1%	39444218 / 43438860 / -9.2%	0.40 / 0.36 / +10.2%
tpcds_q83/datafusion:vortex-compact	36796431 / 37202978 / -1.1%	59654438 / 59298495 / +0.6%	0.62 / 0.63 / -1.7%
tpcds_q84/datafusion:vortex-compact	12943558 / 13276838 / -2.5%	28481149 / 29453305 / -3.3%	0.45 / 0.45 / +0.8%
tpcds_q85/datafusion:vortex-compact	102782162 / 103825266 / -1.0%	126040472 / 127634739 / -1.2%	0.82 / 0.81 / +0.2%
tpcds_q86/datafusion:vortex-compact	16429450 / 16631698 / -1.2%	35469600 / 36609294 / -3.1%	0.46 / 0.45 / +2.0%
tpcds_q87/datafusion:vortex-compact	33579202 / 33361089 / +0.7%	54814130 / 56381300 / -2.8%	0.61 / 0.59 / +3.5%
tpcds_q88/datafusion:vortex-compact	41147011 / 41313464 / -0.4%	68275541 / 69330629 / -1.5%	0.60 / 0.60 / +1.1%
tpcds_q89/datafusion:vortex-compact	25902442 / 25883650 / +0.1%	45033442 / 46951097 / -4.1%	0.58 / 0.55 / +4.3%
tpcds_q90/datafusion:vortex-compact	11196474 / 11332713 / -1.2%	28089040 / 28674375 / -2.0%	0.40 / 0.40 / +0.9%
tpcds_q91/datafusion:vortex-compact	26523739 / 27325378 / -2.9%	45281169 / 48020696 / -5.7%	0.59 / 0.57 / +2.9%
tpcds_q92/datafusion:vortex-compact	15317812 / 15752174 / -2.8%	33317611 / 35090246 / -5.1%	0.46 / 0.45 / +2.4%
tpcds_q93/datafusion:vortex-compact	25049989 / 25406306 / -1.4%	46978660 / 45039086 / +4.3%	0.53 / 0.56 / -5.5%
tpcds_q94/datafusion:vortex-compact	21846588 / 22051122 / -0.9%	41469982 / 42143826 / -1.6%	0.53 / 0.52 / +0.7%
tpcds_q95/datafusion:vortex-compact	50138628 / 49620810 / +1.0%	69851770 / 71759661 / -2.7%	0.72 / 0.69 / +3.8%
tpcds_q96/datafusion:vortex-compact	10681193 / 10807670 / -1.2%	26267166 / 26446181 / -0.7%	0.41 / 0.41 / -0.5%
tpcds_q97/datafusion:vortex-compact	25348776 / 24654181 / +2.8%	45310429 / 46773362 / -3.1%	0.56 / 0.53 / +6.1%
tpcds_q98/datafusion:vortex-compact	21541710 / 21833484 / -1.3%	42032683 / 44121145 / -4.7%	0.51 / 0.49 / +3.6%
tpcds_q99/datafusion:vortex-compact	20834995 / 21230934 / -1.9%	39235822 / 40642714 / -3.5%	0.53 / 0.52 / +1.7%

datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet	31642828 / 32193134 / -1.7%	47012685 / 51593813 / -8.9%	0.67 / 0.62 / +7.9%
tpcds_q02/datafusion:parquet	39563161 / 40106574 / -1.4%	57609235 / 57357946 / +0.4%	0.69 / 0.70 / -1.8%
tpcds_q03/datafusion:parquet	16424247 / 16540580 / -0.7%	30930531 / 31141307 / -0.7%	0.53 / 0.53 / -0.0%
tpcds_q04/datafusion:parquet	200780681 / 200766016 / +0.0%	228673410 / 231962930 / -1.4%	0.88 / 0.87 / +1.4%
tpcds_q05/datafusion:parquet	72390021 / 72434648 / -0.1%	98762380 / 95497380 / +3.4%	0.73 / 0.76 / -3.4%
tpcds_q06/datafusion:parquet	28407938 / 28191417 / +0.8%	48148479 / 50616678 / -4.9%	0.59 / 0.56 / +5.9%
tpcds_q07/datafusion:parquet	47460585 / 46458502 / +2.2%	67809339 / 70461885 / -3.8%	0.70 / 0.66 / +6.2%
tpcds_q08/datafusion:parquet	31653896 / 31837240 / -0.6%	48345719 / 49133359 / -1.6%	0.65 / 0.65 / +1.0%
tpcds_q09/datafusion:parquet	28527654 / 30145840 / -5.4%	38515726 / 37543423 / +2.6%	0.74 / 0.80 / -7.8%
tpcds_q10/datafusion:parquet	41904340 / 41572853 / +0.8%	63272458 / 61462265 / +2.9%	0.66 / 0.68 / -2.1%
tpcds_q11/datafusion:parquet	95710360 / 96019852 / -0.3%	119400595 / 121911947 / -2.1%	0.80 / 0.79 / +1.8%
tpcds_q12/datafusion:parquet	21577202 / 22087666 / -2.3%	34678499 / 35729841 / -2.9%	0.62 / 0.62 / +0.7%
tpcds_q13/datafusion:parquet	43123679 / 41917650 / +2.9%	67101714 / 66279406 / +1.2%	0.64 / 0.63 / +1.6%
tpcds_q14/datafusion:parquet	127825136 / 127300681 / +0.4%	150341217 / 154297468 / -2.6%	0.85 / 0.83 / +3.1%
tpcds_q15/datafusion:parquet	33162966 / 33409010 / -0.7%	49563398 / 48675494 / +1.8%	0.67 / 0.69 / -2.5%
tpcds_q16/datafusion:parquet	37354705 / 37531299 / -0.5%	53076786 / 53794860 / -1.3%	0.70 / 0.70 / +0.9%
tpcds_q17/datafusion:parquet	78522318 / 76628335 / +2.5%	102840353 / 103880584 / -1.0%	0.76 / 0.74 / +3.5%
tpcds_q18/datafusion:parquet	58709308 / 61717988 / -4.9%	78040235 / 80912083 / -3.5%	0.75 / 0.76 / -1.4%
tpcds_q19/datafusion:parquet	26571242 / 26521066 / +0.2%	44388591 / 46404836 / -4.3%	0.60 / 0.57 / +4.7%
tpcds_q20/datafusion:parquet	22813108 / 22659596 / +0.7%	37517555 / 36679286 / +2.3%	0.61 / 0.62 / -1.6%
tpcds_q21/datafusion:parquet	18447873 / 18100330 / +1.9%	32254317 / 33198320 / -2.8%	0.57 / 0.55 / +4.9%
tpcds_q22/datafusion:parquet	74772044 / 75468630 / -0.9%	90752566 / 89897762 / +1.0%	0.82 / 0.84 / -1.9%
tpcds_q23/datafusion:parquet	109088470 / 107171152 / +1.8%	136593497 / 138677254 / -1.5%	0.80 / 0.77 / +3.3%
tpcds_q24/datafusion:parquet	95790142 / 96526930 / -0.8%	124303887 / 123398751 / +0.7%	0.77 / 0.78 / -1.5%
tpcds_q25/datafusion:parquet	79745857 / 77804962 / +2.5%	104399650 / 105713964 / -1.2%	0.76 / 0.74 / +3.8%
tpcds_q26/datafusion:parquet	44895118 / 44618133 / +0.6%	62181636 / 62666563 / -0.8%	0.72 / 0.71 / +1.4%
tpcds_q27/datafusion:parquet	74846660 / 75564924 / -1.0%	95401990 / 100794690 / -5.4%	0.78 / 0.75 / +4.6%
tpcds_q28/datafusion:parquet	28008400 / 27639130 / +1.3%	43836393 / 45768610 / -4.2%	0.64 / 0.60 / +5.8%
tpcds_q29/datafusion:parquet	79408937 / 78670019 / +0.9%	105852125 / 106074733 / -0.2%	0.75 / 0.74 / +1.2%
tpcds_q30/datafusion:parquet	44087118 / 43606824 / +1.1%	62686212 / 67228665 / -6.8%	0.70 / 0.65 / +8.4%
tpcds_q31/datafusion:parquet	80597329 / 80350442 / +0.3%	102464857 / 105509294 / -2.9%	0.79 / 0.76 / +3.3%
tpcds_q32/datafusion:parquet	23668524 / 23473266 / +0.8%	40861075 / 40558871 / +0.7%	0.58 / 0.58 / +0.1%
tpcds_q33/datafusion:parquet	33280820 / 33548364 / -0.8%	51450210 / 51657424 / -0.4%	0.65 / 0.65 / -0.4%
tpcds_q34/datafusion:parquet	23208692 / 22745654 / +2.0%	38635585 / 38462792 / +0.4%	0.60 / 0.59 / +1.6%
tpcds_q35/datafusion:parquet	51853326 / 49609160 / +4.5%	70031768 / 72334149 / -3.2%	0.74 / 0.69 / +8.0%
tpcds_q36/datafusion:parquet	53896692 / 52881124 / +1.9%	72897399 / 76422148 / -4.6%	0.74 / 0.69 / +6.8%
tpcds_q37/datafusion:parquet	22471994 / 22807922 / -1.5%	37808271 / 38522342 / -1.9%	0.59 / 0.59 / +0.4%
tpcds_q38/datafusion:parquet	43528944 / 43881712 / -0.8%	64270033 / 64677121 / -0.6%	0.68 / 0.68 / -0.2%
tpcds_q39/datafusion:parquet	71721703 / 71887034 / -0.2%	89483608 / 86917245 / +3.0%	0.80 / 0.83 / -3.1%
tpcds_q40/datafusion:parquet	29497722 / 30968234 / -4.7%	50807106 / 49620286 / +2.4%	0.58 / 0.62 / -7.0%
tpcds_q41/datafusion:parquet	17425024 / 17218924 / +1.2%	28771551 / 28451826 / +1.1%	0.61 / 0.61 / +0.1%
tpcds_q42/datafusion:parquet	15381931 / 15234257 / +1.0%	28718240 / 29115124 / -1.4%	0.54 / 0.52 / +2.4%
tpcds_q43/datafusion:parquet	17775952 / 17510014 / +1.5%	31962806 / 32521362 / -1.7%	0.56 / 0.54 / +3.3%
tpcds_q44/datafusion:parquet	33228098 / 33665100 / -1.3%	51396980 / 53571172 / -4.1%	0.65 / 0.63 / +2.9%
tpcds_q45/datafusion:parquet	37353506 / 37217536 / +0.4%	53763218 / 53600611 / +0.3%	0.69 / 0.69 / +0.1%
tpcds_q46/datafusion:parquet	28453546 / 28438854 / +0.1%	49442893 / 50330379 / -1.8%	0.58 / 0.57 / +1.8%
tpcds_q47/datafusion:parquet	95748916 / 95987674 / -0.2%	122488654 / 125113615 / -2.1%	0.78 / 0.77 / +1.9%
tpcds_q48/datafusion:parquet	39374898 / 39185256 / +0.5%	59447084 / 57740887 / +3.0%	0.66 / 0.68 / -2.4%
tpcds_q49/datafusion:parquet	73688642 / 75652764 / -2.6%	103907712 / 96779951 / +7.4%	0.71 / 0.78 / -9.3%
tpcds_q50/datafusion:parquet	50632704 / 51150980 / -1.0%	71652170 / 71362391 / +0.4%	0.71 / 0.72 / -1.4%
tpcds_q51/datafusion:parquet	66992905 / 67001768 / -0.0%	88857090 / 91454908 / -2.8%	0.75 / 0.73 / +2.9%
tpcds_q52/datafusion:parquet	15780903 / 15840271 / -0.4%	30467699 / 30794836 / -1.1%	0.52 / 0.51 / +0.7%
tpcds_q53/datafusion:parquet	21860944 / 21697714 / +0.8%	38554517 / 38778952 / -0.6%	0.57 / 0.56 / +1.3%
tpcds_q54/datafusion:parquet	46062676 / 45423444 / +1.4%	69249835 / 66321987 / +4.4%	0.67 / 0.68 / -2.9%
tpcds_q55/datafusion:parquet	15757704 / 15524225 / +1.5%	28717965 / 29603190 / -3.0%	0.55 / 0.52 / +4.6%
tpcds_q56/datafusion:parquet	30947264 / 31329062 / -1.2%	53975551 / 51721617 / +4.4%	0.57 / 0.61 / -5.3%
tpcds_q57/datafusion:parquet	99046018 / 98804223 / +0.2%	121716350 / 123026216 / -1.1%	0.81 / 0.80 / +1.3%
tpcds_q58/datafusion:parquet	64779146 / 65097936 / -0.5%	85616713 / 87208951 / -1.8%	0.76 / 0.75 / +1.4%
tpcds_q59/datafusion:parquet	42858284 / 42777760 / +0.2%	63894075 / 64354884 / -0.7%	0.67 / 0.66 / +0.9%
tpcds_q60/datafusion:parquet	32372832 / 30943329 / +4.6%	52059699 / 53523773 / -2.7%	0.62 / 0.58 / +7.6%
tpcds_q61/datafusion:parquet	34091011 / 33415304 / +2.0%	55602275 / 55201021 / +0.7%	0.61 / 0.61 / +1.3%
tpcds_q62/datafusion:parquet	24128862 / 24088340 / +0.2%	38763479 / 39349050 / -1.5%	0.62 / 0.61 / +1.7%
tpcds_q63/datafusion:parquet	22019756 / 21500376 / +2.4%	38338038 / 39141226 / -2.1%	0.57 / 0.55 / +4.6%
tpcds_q64/datafusion:parquet	205333428 / 201258087 / +2.0%	243276288 / 239196878 / +1.7%	0.84 / 0.84 / +0.3%
tpcds_q65/datafusion:parquet	39041766 / 38660654 / +1.0%	60871529 / 60629815 / +0.4%	0.64 / 0.64 / +0.6%
tpcds_q66/datafusion:parquet	61743520 / 62271947 / -0.8%	78245456 / 79549731 / -1.6%	0.79 / 0.78 / +0.8%
tpcds_q67/datafusion:parquet	69619128 / 69684785 / -0.1%	95981686 / 97094986 / -1.1%	0.73 / 0.72 / +1.1%
tpcds_q68/datafusion:parquet	29330382 / 28945978 / +1.3%	50294473 / 52500902 / -4.2%	0.58 / 0.55 / +5.8%
tpcds_q69/datafusion:parquet	40545923 / 42896362 / -5.5%	59770185 / 59477417 / +0.5%	0.68 / 0.72 / -5.9%
tpcds_q70/datafusion:parquet	32626921 / 32317643 / +1.0%	55345867 / 56311933 / -1.7%	0.59 / 0.57 / +2.7%
tpcds_q71/datafusion:parquet	22931458 / 23500122 / -2.4%	39177100 / 38725887 / +1.2%	0.59 / 0.61 / -3.5%
tpcds_q72/datafusion:parquet	551675382 / 549276922 / +0.4%	569001313 / 574801498 / -1.0%	0.97 / 0.96 / +1.5%
tpcds_q73/datafusion:parquet	22449344 / 21942422 / +2.3%	38254015 / 38403214 / -0.4%	0.59 / 0.57 / +2.7%
tpcds_q74/datafusion:parquet	66377785 / 66709030 / -0.5%	84283896 / 88564633 / -4.8%	0.79 / 0.75 / +4.6%
tpcds_q75/datafusion:parquet	147481276 / 149676739 / -1.5%	173241820 / 174177362 / -0.5%	0.85 / 0.86 / -0.9%
tpcds_q76/datafusion:parquet	47662206 / 48613137 / -2.0%	66599528 / 67804157 / -1.8%	0.72 / 0.72 / -0.2%
tpcds_q77/datafusion:parquet	53636796 / 52317268 / +2.5%	74212234 / 74249062 / -0.0%	0.72 / 0.70 / +2.6%
tpcds_q78/datafusion:parquet	92275257 / 91622188 / +0.7%	124248537 / 125114114 / -0.7%	0.74 / 0.73 / +1.4%
tpcds_q79/datafusion:parquet	25648838 / 25503970 / +0.6%	45057155 / 46378293 / -2.8%	0.57 / 0.55 / +3.5%
tpcds_q80/datafusion:parquet	81848882 / 83885424 / -2.4%	113512983 / 113600947 / -0.1%	0.72 / 0.74 / -2.4%
tpcds_q81/datafusion:parquet	38871396 / 39047937 / -0.5%	59089399 / 61311211 / -3.6%	0.66 / 0.64 / +3.3%
tpcds_q82/datafusion:parquet	25712677 / 25268415 / +1.8%	39694127 / 40153038 / -1.1%	0.65 / 0.63 / +2.9%
tpcds_q83/datafusion:parquet	47449761 / 47741840 / -0.6%	68065708 / 68015797 / +0.1%	0.70 / 0.70 / -0.7%
tpcds_q84/datafusion:parquet	28786050 / 29876194 / -3.6%	45982572 / 44132896 / +4.2%	0.63 / 0.68 / -7.5%
tpcds_q85/datafusion:parquet	87677258 / 87304253 / +0.4%	110070606 / 108766625 / +1.2%	0.80 / 0.80 / -0.8%
tpcds_q86/datafusion:parquet	20763342 / 21190204 / -2.0%	33911996 / 33686295 / +0.7%	0.61 / 0.63 / -2.7%
tpcds_q87/datafusion:parquet	42958548 / 43942481 / -2.2%	62610657 / 60058042 / +4.3%	0.69 / 0.73 / -6.2%
tpcds_q88/datafusion:parquet	38392822 / 38647036 / -0.7%	63085387 / 57821083 / +9.1%	0.61 / 0.67 / -8.9%
tpcds_q89/datafusion:parquet	25419887 / 25562753 / -0.6%	42827990 / 43132662 / -0.7%	0.59 / 0.59 / +0.1%
tpcds_q90/datafusion:parquet	15796901 / 15689754 / +0.7%	29327881 / 30134285 / -2.7%	0.54 / 0.52 / +3.5%
tpcds_q91/datafusion:parquet	31388307 / 32275253 / -2.7%	50233068 / 48438645 / +3.7%	0.62 / 0.67 / -6.2%
tpcds_q92/datafusion:parquet	23704304 / 23579980 / +0.5%	40436478 / 40712281 / -0.7%	0.59 / 0.58 / +1.2%
tpcds_q93/datafusion:parquet	27974566 / 27855154 / +0.4%	49271535 / 49177777 / +0.2%	0.57 / 0.57 / +0.2%
tpcds_q94/datafusion:parquet	31643321 / 31781467 / -0.4%	48234400 / 49716059 / -3.0%	0.66 / 0.64 / +2.6%
tpcds_q95/datafusion:parquet	65214917 / 65101614 / +0.2%	81265512 / 84187548 / -3.5%	0.80 / 0.77 / +3.8%
tpcds_q96/datafusion:parquet	12877933 / 12680849 / +1.6%	27649677 / 28407169 / -2.7%	0.47 / 0.45 / +4.3%
tpcds_q97/datafusion:parquet	31822118 / 32283688 / -1.4%	51648706 / 52624699 / -1.9%	0.62 / 0.61 / +0.4%
tpcds_q98/datafusion:parquet	22510683 / 22707494 / -0.9%	37683950 / 39146881 / -3.7%	0.60 / 0.58 / +3.0%
tpcds_q99/datafusion:parquet	28632677 / 28290862 / +1.2%	43610810 / 42257588 / +3.2%	0.66 / 0.67 / -1.9%

duckdb / vortex-file-compressed / ns (1.000x ➖, 2↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed	15074509 / 15028140 / +0.3%	24207984 / 22641719 / +6.9%	0.62 / 0.66 / -6.2%
tpcds_q02/duckdb:vortex-file-compressed	14897858 / 15002612 / -0.7%	19900239 / 20679468 / -3.8%	0.75 / 0.73 / +3.2%
tpcds_q03/duckdb:vortex-file-compressed	10779768 / 10806488 / -0.2%	22191619 / 20075461 / +10.5% 🔴	0.49 / 0.54 / -9.8%
tpcds_q04/duckdb:vortex-file-compressed	50634940 / 50451815 / +0.4%	59204378 / 60966437 / -2.9%	0.86 / 0.83 / +3.4%
tpcds_q05/duckdb:vortex-file-compressed	18464966 / 18821514 / -1.9%	25189650 / 25659140 / -1.8%	0.73 / 0.73 / -0.1%
tpcds_q06/duckdb:vortex-file-compressed	28058616 / 26858796 / +4.5%	39272655 / 40718353 / -3.6%	0.71 / 0.66 / +8.3%
tpcds_q07/duckdb:vortex-file-compressed	17437992 / 15440860 / +12.9% 🔴	29233650 / 29726715 / -1.7%	0.60 / 0.52 / +14.8%
tpcds_q08/duckdb:vortex-file-compressed	19059634 / 19039492 / +0.1%	26547989 / 28146145 / -5.7%	0.72 / 0.68 / +6.1%
tpcds_q09/duckdb:vortex-file-compressed	13674472 / 13401422 / +2.0%	21507510 / 22668446 / -5.1%	0.64 / 0.59 / +7.5%
tpcds_q10/duckdb:vortex-file-compressed	27417998 / 27281964 / +0.5%	42400914 / 41417778 / +2.4%	0.65 / 0.66 / -1.8%
tpcds_q11/duckdb:vortex-file-compressed	40175268 / 39957194 / +0.5%	49438121 / 54310548 / -9.0%	0.81 / 0.74 / +10.5%
tpcds_q12/duckdb:vortex-file-compressed	10151506 / 11656934 / -12.9% 🟢	15559264 / 18517877 / -16.0% 🟢	0.65 / 0.63 / +3.6%
tpcds_q13/duckdb:vortex-file-compressed	21846979 / 21014958 / +4.0%	34979346 / 35470883 / -1.4%	0.62 / 0.59 / +5.4%
tpcds_q14/duckdb:vortex-file-compressed	58963722 / 59028498 / -0.1%	71896671 / 72505242 / -0.8%	0.82 / 0.81 / +0.7%
tpcds_q15/duckdb:vortex-file-compressed	20614840 / 20596530 / +0.1%	27314118 / 27522140 / -0.8%	0.75 / 0.75 / +0.9%
tpcds_q16/duckdb:vortex-file-compressed	17135429 / 17374886 / -1.4%	25238038 / 27729864 / -9.0%	0.68 / 0.63 / +8.4%
tpcds_q17/duckdb:vortex-file-compressed	29499663 / 29747970 / -0.8%	43562180 / 44175084 / -1.4%	0.68 / 0.67 / +0.6%
tpcds_q18/duckdb:vortex-file-compressed	28330438 / 28377612 / -0.2%	37148911 / 38473160 / -3.4%	0.76 / 0.74 / +3.4%
tpcds_q19/duckdb:vortex-file-compressed	23549701 / 24026610 / -2.0%	38184657 / 34247219 / +11.5% 🔴	0.62 / 0.70 / -12.1%
tpcds_q20/duckdb:vortex-file-compressed	10791353 / 10527186 / +2.5%	15142271 / 18556364 / -18.4% 🟢	0.71 / 0.57 / +25.6%
tpcds_q21/duckdb:vortex-file-compressed	9572742 / 9644187 / -0.7%	20278426 / 21274338 / -4.7%	0.47 / 0.45 / +4.1%
tpcds_q22/duckdb:vortex-file-compressed	29810105 / 29659088 / +0.5%	44783710 / 39714170 / +12.8% 🔴	0.67 / 0.75 / -10.9%
tpcds_q23/duckdb:vortex-file-compressed	37104991 / 38009054 / -2.4%	45861941 / 49539317 / -7.4%	0.81 / 0.77 / +5.4%
tpcds_q24/duckdb:vortex-file-compressed	28272957 / 27755722 / +1.9%	37462644 / 43149335 / -13.2% 🟢	0.75 / 0.64 / +17.3%
tpcds_q25/duckdb:vortex-file-compressed	25368870 / 25088730 / +1.1%	40422107 / 43169548 / -6.4%	0.63 / 0.58 / +8.0%
tpcds_q26/duckdb:vortex-file-compressed	13194501 / 13180300 / +0.1%	19770112 / 20828203 / -5.1%	0.67 / 0.63 / +5.5%
tpcds_q27/duckdb:vortex-file-compressed	18583854 / 17531542 / +6.0%	29935843 / 30732755 / -2.6%	0.62 / 0.57 / +8.8%
tpcds_q28/duckdb:vortex-file-compressed	12654409 / 12351023 / +2.5%	24497245 / 18896077 / +29.6% 🔴	0.52 / 0.65 / -21.0%
tpcds_q29/duckdb:vortex-file-compressed	28372308 / 28181886 / +0.7%	41275295 / 46858447 / -11.9% 🟢	0.69 / 0.60 / +14.3%
tpcds_q30/duckdb:vortex-file-compressed	18956624 / 19241618 / -1.5%	26884905 / 28523118 / -5.7%	0.71 / 0.67 / +4.5%
tpcds_q31/duckdb:vortex-file-compressed	18855056 / 19056245 / -1.1%	26053169 / 28617848 / -9.0%	0.72 / 0.67 / +8.7%
tpcds_q32/duckdb:vortex-file-compressed	9632388 / 9750236 / -1.2%	16072126 / 15956933 / +0.7%	0.60 / 0.61 / -1.9%
tpcds_q33/duckdb:vortex-file-compressed	16533037 / 16563572 / -0.2%	26077177 / 28268703 / -7.8%	0.63 / 0.59 / +8.2%
tpcds_q34/duckdb:vortex-file-compressed	15417420 / 15508022 / -0.6%	19679601 / 21953340 / -10.4% 🟢	0.78 / 0.71 / +10.9%
tpcds_q35/duckdb:vortex-file-compressed	46395685 / 45753544 / +1.4%	63667203 / 59657612 / +6.7%	0.73 / 0.77 / -5.0%
tpcds_q36/duckdb:vortex-file-compressed	15978064 / 15023648 / +6.4%	28595553 / 30983771 / -7.7%	0.56 / 0.48 / +15.2%
tpcds_q37/duckdb:vortex-file-compressed	13720983 / 13887742 / -1.2%	24502969 / 26256457 / -6.7%	0.56 / 0.53 / +5.9%
tpcds_q38/duckdb:vortex-file-compressed	22137665 / 22572280 / -1.9%	29272086 / 28768592 / +1.8%	0.76 / 0.78 / -3.6%
tpcds_q39/duckdb:vortex-file-compressed	18148004 / 18161864 / -0.1%	26070565 / 31005840 / -15.9% 🟢	0.70 / 0.59 / +18.8%
tpcds_q40/duckdb:vortex-file-compressed	13262100 / 12984422 / +2.1%	18418730 / 19963876 / -7.7%	0.72 / 0.65 / +10.7%
tpcds_q41/duckdb:vortex-file-compressed	6409373 / 6420614 / -0.2%	9554931 / 9327083 / +2.4%	0.67 / 0.69 / -2.6%
tpcds_q42/duckdb:vortex-file-compressed	7824372 / 8353295 / -6.3%	18496358 / 17677511 / +4.6%	0.42 / 0.47 / -10.5%
tpcds_q43/duckdb:vortex-file-compressed	10167201 / 10081731 / +0.8%	17560187 / 18389739 / -4.5%	0.58 / 0.55 / +5.6%
tpcds_q44/duckdb:vortex-file-compressed	15892332 / 15021975 / +5.8%	23753111 / 29506471 / -19.5% 🟢	0.67 / 0.51 / +31.4%
tpcds_q45/duckdb:vortex-file-compressed	22044558 / 22048853 / -0.0%	29383482 / 29865760 / -1.6%	0.75 / 0.74 / +1.6%
tpcds_q46/duckdb:vortex-file-compressed	18444536 / 18747524 / -1.6%	28676848 / 30045228 / -4.6%	0.64 / 0.62 / +3.1%
tpcds_q47/duckdb:vortex-file-compressed	30717294 / 31074586 / -1.1%	42984891 / 42117555 / +2.1%	0.71 / 0.74 / -3.1%
tpcds_q48/duckdb:vortex-file-compressed	18825807 / 19029018 / -1.1%	28343234 / 30842583 / -8.1%	0.66 / 0.62 / +7.7%
tpcds_q49/duckdb:vortex-file-compressed	16540313 / 16853259 / -1.9%	27480280 / 31114280 / -11.7% 🟢	0.60 / 0.54 / +11.1%
tpcds_q50/duckdb:vortex-file-compressed	16633533 / 16586608 / +0.3%	26048563 / 28452513 / -8.4%	0.64 / 0.58 / +9.5%
tpcds_q51/duckdb:vortex-file-compressed	76354736 / 75822298 / +0.7%	61813767 / 87821918 / -29.6% 🟢	1.24 / 0.86 / +43.1%
tpcds_q52/duckdb:vortex-file-compressed	9812732 / 9311128 / +5.4%	17567359 / 21673351 / -18.9% 🟢	0.56 / 0.43 / +30.0%
tpcds_q53/duckdb:vortex-file-compressed	14083777 / 14158006 / -0.5%	23041919 / 24785266 / -7.0%	0.61 / 0.57 / +7.0%
tpcds_q54/duckdb:vortex-file-compressed	19909131 / 20034388 / -0.6%	30548656 / 31497364 / -3.0%	0.65 / 0.64 / +2.5%
tpcds_q55/duckdb:vortex-file-compressed	8542916 / 8366954 / +2.1%	19698322 / 20814479 / -5.4%	0.43 / 0.40 / +7.9%
tpcds_q56/duckdb:vortex-file-compressed	17106058 / 16850216 / +1.5%	28128549 / 30375117 / -7.4%	0.61 / 0.55 / +9.6%
tpcds_q57/duckdb:vortex-file-compressed	24057788 / 26326620 / -8.6%	34083038 / 33919611 / +0.5%	0.71 / 0.78 / -9.1%
tpcds_q58/duckdb:vortex-file-compressed	17714074 / 17359000 / +2.0%	26520684 / 28079592 / -5.6%	0.67 / 0.62 / +8.0%
tpcds_q59/duckdb:vortex-file-compressed	18550013 / 18303160 / +1.3%	27892059 / 28077733 / -0.7%	0.67 / 0.65 / +2.0%
tpcds_q60/duckdb:vortex-file-compressed	18089192 / 18034662 / +0.3%	27494901 / 30217600 / -9.0%	0.66 / 0.60 / +10.2%
tpcds_q61/duckdb:vortex-file-compressed	19097854 / 19482374 / -2.0%	29613050 / 32535964 / -9.0%	0.64 / 0.60 / +7.7%
tpcds_q62/duckdb:vortex-file-compressed	10218268 / 10268040 / -0.5%	17569188 / 15927685 / +10.3% 🔴	0.58 / 0.64 / -9.8%
tpcds_q63/duckdb:vortex-file-compressed	13294360 / 13624705 / -2.4%	23541184 / 23570729 / -0.1%	0.56 / 0.58 / -2.3%
tpcds_q64/duckdb:vortex-file-compressed	61818920 / 61753098 / +0.1%	76623131 / 78911023 / -2.9%	0.81 / 0.78 / +3.1%
tpcds_q65/duckdb:vortex-file-compressed	16071002 / 15480352 / +3.8%	24715486 / 27377719 / -9.7%	0.65 / 0.57 / +15.0%
tpcds_q66/duckdb:vortex-file-compressed	20884004 / 20910322 / -0.1%	32558081 / 29436065 / +10.6% 🔴	0.64 / 0.71 / -9.7%
tpcds_q67/duckdb:vortex-file-compressed	66134476 / 65205254 / +1.4%	82437333 / 81475265 / +1.2%	0.80 / 0.80 / +0.2%
tpcds_q68/duckdb:vortex-file-compressed	17994411 / 18139630 / -0.8%	27945079 / 31012984 / -9.9%	0.64 / 0.58 / +10.1%
tpcds_q69/duckdb:vortex-file-compressed	28479939 / 28644785 / -0.6%	41144887 / 42804962 / -3.9%	0.69 / 0.67 / +3.4%
tpcds_q70/duckdb:vortex-file-compressed	18640200 / 18568400 / +0.4%	33062291 / 29187503 / +13.3% 🔴	0.56 / 0.64 / -11.4%
tpcds_q71/duckdb:vortex-file-compressed	12554730 / 12385923 / +1.4%	24575273 / 24596899 / -0.1%	0.51 / 0.50 / +1.5%
tpcds_q72/duckdb:vortex-file-compressed	62087840 / 61703726 / +0.6%	76893831 / 77436233 / -0.7%	0.81 / 0.80 / +1.3%
tpcds_q73/duckdb:vortex-file-compressed	14740968 / 14660914 / +0.5%	19370940 / 20829802 / -7.0%	0.76 / 0.70 / +8.1%
tpcds_q74/duckdb:vortex-file-compressed	27179545 / 27392072 / -0.8%	35666124 / 38183594 / -6.6%	0.76 / 0.72 / +6.2%
tpcds_q75/duckdb:vortex-file-compressed	29024506 / 27888947 / +4.1%	41342012 / 39515421 / +4.6%	0.70 / 0.71 / -0.5%
tpcds_q76/duckdb:vortex-file-compressed	12336252 / 12047214 / +2.4%	22273203 / 26276573 / -15.2% 🟢	0.55 / 0.46 / +20.8%
tpcds_q77/duckdb:vortex-file-compressed	15940506 / 15897432 / +0.3%	22908106 / 24555184 / -6.7%	0.70 / 0.65 / +7.5%
tpcds_q78/duckdb:vortex-file-compressed	36751632 / 37448453 / -1.9%	45921337 / 48380874 / -5.1%	0.80 / 0.77 / +3.4%
tpcds_q79/duckdb:vortex-file-compressed	14216353 / 17176802 / -17.2% 🟢	22647251 / 26216231 / -13.6% 🟢	0.63 / 0.66 / -4.2%
tpcds_q80/duckdb:vortex-file-compressed	27139724 / 27691296 / -2.0%	40035136 / 46292762 / -13.5% 🟢	0.68 / 0.60 / +13.3%
tpcds_q81/duckdb:vortex-file-compressed	22216588 / 22271072 / -0.2%	30231958 / 32289923 / -6.4%	0.73 / 0.69 / +6.5%
tpcds_q82/duckdb:vortex-file-compressed	31987156 / 32001928 / -0.0%	39130678 / 39684580 / -1.4%	0.82 / 0.81 / +1.4%
tpcds_q83/duckdb:vortex-file-compressed	19550728 / 19697421 / -0.7%	24984721 / 25551810 / -2.2%	0.78 / 0.77 / +1.5%
tpcds_q84/duckdb:vortex-file-compressed	12602726 / 12694464 / -0.7%	21959754 / 21835235 / +0.6%	0.57 / 0.58 / -1.3%
tpcds_q85/duckdb:vortex-file-compressed	30745602 / 30770178 / -0.1%	38485985 / 39918952 / -3.6%	0.80 / 0.77 / +3.6%
tpcds_q86/duckdb:vortex-file-compressed	10606876 / 10559662 / +0.4%	17715770 / 19629786 / -9.8%	0.60 / 0.54 / +11.3%
tpcds_q87/duckdb:vortex-file-compressed	24188143 / 24437154 / -1.0%	30145980 / 35797484 / -15.8% 🟢	0.80 / 0.68 / +17.5%
tpcds_q88/duckdb:vortex-file-compressed	31959110 / 33891269 / -5.7%	42862149 / 47658761 / -10.1% 🟢	0.75 / 0.71 / +4.9%
tpcds_q89/duckdb:vortex-file-compressed	13930525 / 15251348 / -8.7%	25854781 / 23597257 / +9.6%	0.54 / 0.65 / -16.6%
tpcds_q90/duckdb:vortex-file-compressed	8064072 / 8083491 / -0.2%	14449242 / 14889054 / -3.0%	0.56 / 0.54 / +2.8%
tpcds_q91/duckdb:vortex-file-compressed	15086230 / 15063928 / +0.1%	20991554 / 22473537 / -6.6%	0.72 / 0.67 / +7.2%
tpcds_q92/duckdb:vortex-file-compressed	12598099 / 12724530 / -1.0%	20266629 / 21302334 / -4.9%	0.62 / 0.60 / +4.1%
tpcds_q93/duckdb:vortex-file-compressed	16703366 / 17517696 / -4.6%	26305232 / 23595211 / +11.5% 🔴	0.63 / 0.74 / -14.5%
tpcds_q94/duckdb:vortex-file-compressed	15945480 / 16115204 / -1.1%	24979448 / 26610971 / -6.1%	0.64 / 0.61 / +5.4%
tpcds_q95/duckdb:vortex-file-compressed	45340841 / 43772506 / +3.6%	53258433 / 51382986 / +3.6%	0.85 / 0.85 / -0.1%
tpcds_q96/duckdb:vortex-file-compressed	9046177 / 7117592 / +27.1% 🔴	16140989 / 15422856 / +4.7%	0.56 / 0.46 / +21.4%
tpcds_q97/duckdb:vortex-file-compressed	22095796 / 22160806 / -0.3%	28906164 / 29958681 / -3.5%	0.76 / 0.74 / +3.3%
tpcds_q98/duckdb:vortex-file-compressed	13270918 / 13368110 / -0.7%	20732597 / 22268092 / -6.9%	0.64 / 0.60 / +6.6%
tpcds_q99/duckdb:vortex-file-compressed	13339126 / 13365266 / -0.2%	19131121 / 21641836 / -11.6% 🟢	0.70 / 0.62 / +12.9%

duckdb / vortex-compact / ns (1.000x ➖, 4↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact	16468488 / 16581244 / -0.7%	22567719 / 24064630 / -6.2%	0.73 / 0.69 / +5.9%
tpcds_q02/duckdb:vortex-compact	16474358 / 16245346 / +1.4%	21371761 / 21828182 / -2.1%	0.77 / 0.74 / +3.6%
tpcds_q03/duckdb:vortex-compact	21665004 / 21512062 / +0.7%	34001815 / 36682083 / -7.3%	0.64 / 0.59 / +8.6%
tpcds_q04/duckdb:vortex-compact	53797834 / 53269976 / +1.0%	72277891 / 64389809 / +12.3% 🔴	0.74 / 0.83 / -10.0%
tpcds_q05/duckdb:vortex-compact	24087096 / 23703534 / +1.6%	29773041 / 32057568 / -7.1%	0.81 / 0.74 / +9.4%
tpcds_q06/duckdb:vortex-compact	34141971 / 33341482 / +2.4%	45820378 / 46356538 / -1.2%	0.75 / 0.72 / +3.6%
tpcds_q07/duckdb:vortex-compact	25285148 / 25729087 / -1.7%	34695647 / 34355796 / +1.0%	0.73 / 0.75 / -2.7%
tpcds_q08/duckdb:vortex-compact	48595730 / 49492784 / -1.8%	55442038 / 57080166 / -2.9%	0.88 / 0.87 / +1.1%
tpcds_q09/duckdb:vortex-compact	18876107 / 19382008 / -2.6%	26464678 / 28354949 / -6.7%	0.71 / 0.68 / +4.3%
tpcds_q10/duckdb:vortex-compact	45025708 / 45395650 / -0.8%	56934415 / 57070678 / -0.2%	0.79 / 0.80 / -0.6%
tpcds_q11/duckdb:vortex-compact	45429412 / 45666854 / -0.5%	55695855 / 58439911 / -4.7%	0.82 / 0.78 / +4.4%
tpcds_q12/duckdb:vortex-compact	13568342 / 13384122 / +1.4%	19585530 / 19539899 / +0.2%	0.69 / 0.68 / +1.1%
tpcds_q13/duckdb:vortex-compact	35618384 / 35928688 / -0.9%	48210414 / 47390072 / +1.7%	0.74 / 0.76 / -2.6%
tpcds_q14/duckdb:vortex-compact	65527782 / 67603035 / -3.1%	81616440 / 78321198 / +4.2%	0.80 / 0.86 / -7.0%
tpcds_q15/duckdb:vortex-compact	25943526 / 26106490 / -0.6%	31846102 / 31932043 / -0.3%	0.81 / 0.82 / -0.4%
tpcds_q16/duckdb:vortex-compact	28398071 / 24384883 / +16.5% 🔴	44352608 / 35470422 / +25.0% 🔴	0.64 / 0.69 / -6.9%
tpcds_q17/duckdb:vortex-compact	44794382 / 45064081 / -0.6%	56892666 / 57631077 / -1.3%	0.79 / 0.78 / +0.7%
tpcds_q18/duckdb:vortex-compact	35793842 / 35561983 / +0.7%	44456739 / 45588346 / -2.5%	0.81 / 0.78 / +3.2%
tpcds_q19/duckdb:vortex-compact	35589513 / 36315351 / -2.0%	43619674 / 43752012 / -0.3%	0.82 / 0.83 / -1.7%
tpcds_q20/duckdb:vortex-compact	14249846 / 13812651 / +3.2%	19226524 / 18957539 / +1.4%	0.74 / 0.73 / +1.7%
tpcds_q21/duckdb:vortex-compact	13718090 / 10357162 / +32.5% 🔴	18180320 / 21555193 / -15.7% 🟢	0.75 / 0.48 / +57.0%
tpcds_q22/duckdb:vortex-compact	30616973 / 35803342 / -14.5% 🟢	39286909 / 40750033 / -3.6%	0.78 / 0.88 / -11.3%
tpcds_q23/duckdb:vortex-compact	43475530 / 43335170 / +0.3%	54143915 / 52908169 / +2.3%	0.80 / 0.82 / -2.0%
tpcds_q24/duckdb:vortex-compact	39627020 / 39626235 / +0.0%	47762633 / 52695767 / -9.4%	0.83 / 0.75 / +10.3%
tpcds_q25/duckdb:vortex-compact	43386264 / 42673014 / +1.7%	60944826 / 55200904 / +10.4% 🔴	0.71 / 0.77 / -7.9%
tpcds_q26/duckdb:vortex-compact	22291188 / 22224346 / +0.3%	27227354 / 27074531 / +0.6%	0.82 / 0.82 / -0.3%
tpcds_q27/duckdb:vortex-compact	29941284 / 28433770 / +5.3%	36910266 / 43760037 / -15.7% 🟢	0.81 / 0.65 / +24.8%
tpcds_q28/duckdb:vortex-compact	22323364 / 22283394 / +0.2%	31723352 / 34526274 / -8.1%	0.70 / 0.65 / +9.0%
tpcds_q29/duckdb:vortex-compact	43973014 / 44350607 / -0.9%	62468972 / 56294268 / +11.0% 🔴	0.70 / 0.79 / -10.7%
tpcds_q30/duckdb:vortex-compact	22520642 / 22410322 / +0.5%	29556848 / 30469930 / -3.0%	0.76 / 0.74 / +3.6%
tpcds_q31/duckdb:vortex-compact	23556896 / 23493624 / +0.3%	32359336 / 30518241 / +6.0%	0.73 / 0.77 / -5.4%
tpcds_q32/duckdb:vortex-compact	13957647 / 14168964 / -1.5%	19773203 / 21730241 / -9.0%	0.71 / 0.65 / +8.3%
tpcds_q33/duckdb:vortex-compact	22882114 / 23161904 / -1.2%	31771286 / 34949553 / -9.1%	0.72 / 0.66 / +8.7%
tpcds_q34/duckdb:vortex-compact	23134120 / 21972506 / +5.3%	28457391 / 29347850 / -3.0%	0.81 / 0.75 / +8.6%
tpcds_q35/duckdb:vortex-compact	61310735 / 61267740 / +0.1%	73492003 / 77596996 / -5.3%	0.83 / 0.79 / +5.7%
tpcds_q36/duckdb:vortex-compact	22213260 / 21992498 / +1.0%	32513721 / 31303369 / +3.9%	0.68 / 0.70 / -2.8%
tpcds_q37/duckdb:vortex-compact	14880092 / 15469520 / -3.8%	27318964 / 25107712 / +8.8%	0.54 / 0.62 / -11.6%
tpcds_q38/duckdb:vortex-compact	26243690 / 26595508 / -1.3%	32734385 / 32315603 / +1.3%	0.80 / 0.82 / -2.6%
tpcds_q39/duckdb:vortex-compact	19885066 / 19514934 / +1.9%	28329203 / 27626922 / +2.5%	0.70 / 0.71 / -0.6%
tpcds_q40/duckdb:vortex-compact	16070874 / 15944485 / +0.8%	20941795 / 21352533 / -1.9%	0.77 / 0.75 / +2.8%
tpcds_q41/duckdb:vortex-compact	7779488 / 7459492 / +4.3%	10895146 / 10366269 / +5.1%	0.71 / 0.72 / -0.8%
tpcds_q42/duckdb:vortex-compact	11892248 / 11787250 / +0.9%	19344449 / 20361820 / -5.0%	0.61 / 0.58 / +6.2%
tpcds_q43/duckdb:vortex-compact	16087400 / 16171238 / -0.5%	22842083 / 25149217 / -9.2%	0.70 / 0.64 / +9.5%
tpcds_q44/duckdb:vortex-compact	22782812 / 22539606 / +1.1%	33367329 / 34212952 / -2.5%	0.68 / 0.66 / +3.6%
tpcds_q45/duckdb:vortex-compact	27216758 / 27181128 / +0.1%	33173985 / 32419242 / +2.3%	0.82 / 0.84 / -2.1%
tpcds_q46/duckdb:vortex-compact	28746522 / 33060026 / -13.0% 🟢	51443012 / 38585922 / +33.3% 🔴	0.56 / 0.86 / -34.8%
tpcds_q47/duckdb:vortex-compact	37028244 / 36283784 / +2.1%	52298051 / 46434322 / +12.6% 🔴	0.71 / 0.78 / -9.4%
tpcds_q48/duckdb:vortex-compact	32785106 / 32954236 / -0.5%	47466860 / 46249528 / +2.6%	0.69 / 0.71 / -3.1%
tpcds_q49/duckdb:vortex-compact	23276522 / 24267008 / -4.1%	34906696 / 36314050 / -3.9%	0.67 / 0.67 / -0.2%
tpcds_q50/duckdb:vortex-compact	26839654 / 27510532 / -2.4%	34308742 / 35332825 / -2.9%	0.78 / 0.78 / +0.5%
tpcds_q51/duckdb:vortex-compact	53308593 / 54052336 / -1.4%	62416541 / 65913274 / -5.3%	0.85 / 0.82 / +4.1%
tpcds_q52/duckdb:vortex-compact	13295486 / 11786770 / +12.8% 🔴	19264835 / 20981309 / -8.2%	0.69 / 0.56 / +22.9%
tpcds_q53/duckdb:vortex-compact	21010878 / 21067218 / -0.3%	28602247 / 28994496 / -1.4%	0.73 / 0.73 / +1.1%
tpcds_q54/duckdb:vortex-compact	27367680 / 27179272 / +0.7%	34839815 / 34868786 / -0.1%	0.79 / 0.78 / +0.8%
tpcds_q55/duckdb:vortex-compact	11992536 / 14189044 / -15.5% 🟢	20365428 / 21659760 / -6.0%	0.59 / 0.66 / -10.1%
tpcds_q56/duckdb:vortex-compact	23508794 / 24166286 / -2.7%	31801734 / 35515838 / -10.5% 🟢	0.74 / 0.68 / +8.6%
tpcds_q57/duckdb:vortex-compact	28623380 / 27943973 / +2.4%	35953081 / 36089785 / -0.4%	0.80 / 0.77 / +2.8%
tpcds_q58/duckdb:vortex-compact	24037094 / 24169703 / -0.5%	35378515 / 33207306 / +6.5%	0.68 / 0.73 / -6.7%
tpcds_q59/duckdb:vortex-compact	23236228 / 23094405 / +0.6%	28658135 / 29396248 / -2.5%	0.81 / 0.79 / +3.2%
tpcds_q60/duckdb:vortex-compact	24180830 / 24534628 / -1.4%	33560225 / 38559468 / -13.0% 🟢	0.72 / 0.64 / +13.2%
tpcds_q61/duckdb:vortex-compact	33422306 / 31776826 / +5.2%	43104303 / 44094210 / -2.2%	0.78 / 0.72 / +7.6%
tpcds_q62/duckdb:vortex-compact	11533340 / 11766502 / -2.0%	18669987 / 22312165 / -16.3% 🟢	0.62 / 0.53 / +17.1%
tpcds_q63/duckdb:vortex-compact	20086822 / 20325150 / -1.2%	32447284 / 30613587 / +6.0%	0.62 / 0.66 / -6.8%
tpcds_q64/duckdb:vortex-compact	84754260 / 84326551 / +0.5%	95556379 / 97797542 / -2.3%	0.89 / 0.86 / +2.9%
tpcds_q65/duckdb:vortex-compact	20477851 / 19257690 / +6.3%	30568736 / 28913186 / +5.7%	0.67 / 0.67 / +0.6%
tpcds_q66/duckdb:vortex-compact	25130054 / 25856089 / -2.8%	36167177 / 34311322 / +5.4%	0.69 / 0.75 / -7.8%
tpcds_q67/duckdb:vortex-compact	71763054 / 71621513 / +0.2%	85885794 / 92886660 / -7.5%	0.84 / 0.77 / +8.4%
tpcds_q68/duckdb:vortex-compact	30262289 / 28731184 / +5.3%	39469875 / 41818998 / -5.6%	0.77 / 0.69 / +11.6%
tpcds_q69/duckdb:vortex-compact	46334908 / 46757061 / -0.9%	59682246 / 60619767 / -1.5%	0.78 / 0.77 / +0.7%
tpcds_q70/duckdb:vortex-compact	30902692 / 31157466 / -0.8%	38776432 / 39796889 / -2.6%	0.80 / 0.78 / +1.8%
tpcds_q71/duckdb:vortex-compact	19689246 / 22219510 / -11.4% 🟢	29479726 / 29586144 / -0.4%	0.67 / 0.75 / -11.1%
tpcds_q72/duckdb:vortex-compact	70202730 / 68550550 / +2.4%	83689898 / 81692322 / +2.4%	0.84 / 0.84 / -0.0%
tpcds_q73/duckdb:vortex-compact	21486178 / 21327240 / +0.7%	29312025 / 31609398 / -7.3%	0.73 / 0.67 / +8.6%
tpcds_q74/duckdb:vortex-compact	31836652 / 31826664 / +0.0%	43762356 / 41612298 / +5.2%	0.73 / 0.76 / -4.9%
tpcds_q75/duckdb:vortex-compact	33383970 / 32937250 / +1.4%	43473210 / 46721068 / -7.0%	0.77 / 0.70 / +8.9%
tpcds_q76/duckdb:vortex-compact	16439334 / 16638721 / -1.2%	25933159 / 27259749 / -4.9%	0.63 / 0.61 / +3.9%
tpcds_q77/duckdb:vortex-compact	22317134 / 22716558 / -1.8%	29901021 / 31714907 / -5.7%	0.75 / 0.72 / +4.2%
tpcds_q78/duckdb:vortex-compact	41774846 / 41652114 / +0.3%	53657475 / 51955106 / +3.3%	0.78 / 0.80 / -2.9%
tpcds_q79/duckdb:vortex-compact	37456446 / 37415058 / +0.1%	47000391 / 49660221 / -5.4%	0.80 / 0.75 / +5.8%
tpcds_q80/duckdb:vortex-compact	36102922 / 36932048 / -2.2%	48710512 / 56354344 / -13.6% 🟢	0.74 / 0.66 / +13.1%
tpcds_q81/duckdb:vortex-compact	24470696 / 24264452 / +0.8%	31415816 / 32038329 / -1.9%	0.78 / 0.76 / +2.8%
tpcds_q82/duckdb:vortex-compact	35843272 / 35979625 / -0.4%	42566361 / 43056898 / -1.1%	0.84 / 0.84 / +0.8%
tpcds_q83/duckdb:vortex-compact	28468392 / 29356466 / -3.0%	32181029 / 33593788 / -4.2%	0.88 / 0.87 / +1.2%
tpcds_q84/duckdb:vortex-compact	15073359 / 16468202 / -8.5%	24111827 / 22141931 / +8.9%	0.63 / 0.74 / -15.9%
tpcds_q85/duckdb:vortex-compact	41297425 / 41271176 / +0.1%	49339428 / 50072850 / -1.5%	0.84 / 0.82 / +1.6%
tpcds_q86/duckdb:vortex-compact	13105677 / 11984870 / +9.4%	19082764 / 18329482 / +4.1%	0.69 / 0.65 / +5.0%
tpcds_q87/duckdb:vortex-compact	28159026 / 28011252 / +0.5%	34481013 / 34737313 / -0.7%	0.82 / 0.81 / +1.3%
tpcds_q88/duckdb:vortex-compact	66900464 / 68327674 / -2.1%	79733420 / 83782338 / -4.8%	0.84 / 0.82 / +2.9%
tpcds_q89/duckdb:vortex-compact	20471643 / 21045858 / -2.7%	27911018 / 29162815 / -4.3%	0.73 / 0.72 / +1.6%
tpcds_q90/duckdb:vortex-compact	12598417 / 13527467 / -6.9%	18299692 / 20253491 / -9.6%	0.69 / 0.67 / +3.1%
tpcds_q91/duckdb:vortex-compact	30087944 / 30262048 / -0.6%	38445345 / 37675571 / +2.0%	0.78 / 0.80 / -2.6%
tpcds_q92/duckdb:vortex-compact	20205864 / 20176920 / +0.1%	26210818 / 28225549 / -7.1%	0.77 / 0.71 / +7.8%
tpcds_q93/duckdb:vortex-compact	19703630 / 18795296 / +4.8%	25646030 / 29880221 / -14.2% 🟢	0.77 / 0.63 / +22.1%
tpcds_q94/duckdb:vortex-compact	21873552 / 22107170 / -1.1%	35590651 / 30875124 / +15.3% 🔴	0.61 / 0.72 / -14.2%
tpcds_q95/duckdb:vortex-compact	46858677 / 46608886 / +0.5%	57426135 / 55722195 / +3.1%	0.82 / 0.84 / -2.4%
tpcds_q96/duckdb:vortex-compact	16837968 / 17070303 / -1.4%	25199339 / 23821804 / +5.8%	0.67 / 0.72 / -6.8%
tpcds_q97/duckdb:vortex-compact	25517410 / 25023855 / +2.0%	30945194 / 33280889 / -7.0%	0.82 / 0.75 / +9.7%
tpcds_q98/duckdb:vortex-compact	18256940 / 18093285 / +0.9%	26845004 / 27908546 / -3.8%	0.68 / 0.65 / +4.9%
tpcds_q99/duckdb:vortex-compact	16875823 / 16770814 / +0.6%	23220479 / 25799815 / -10.0%	0.73 / 0.65 / +11.8%

duckdb / parquet / ns (1.001x ➖, 3↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet	25615496 / 24799706 / +3.3%	34252928 / 33973745 / +0.8%	0.75 / 0.73 / +2.4%
tpcds_q02/duckdb:parquet	15828953 / 15595350 / +1.5%	20608357 / 21421456 / -3.8%	0.77 / 0.73 / +5.5%
tpcds_q03/duckdb:parquet	9240298 / 9203844 / +0.4%	16665908 / 18993709 / -12.3% 🟢	0.55 / 0.48 / +14.4%
tpcds_q04/duckdb:parquet	129684427 / 130334692 / -0.5%	134587551 / 135666042 / -0.8%	0.96 / 0.96 / +0.3%
tpcds_q05/duckdb:parquet	22521614 / 22295806 / +1.0%	25680386 / 25751991 / -0.3%	0.88 / 0.87 / +1.3%
tpcds_q06/duckdb:parquet	27587226 / 26990814 / +2.2%	39083274 / 36719081 / +6.4%	0.71 / 0.74 / -4.0%
tpcds_q07/duckdb:parquet	15476352 / 15426707 / +0.3%	26822833 / 22549616 / +19.0% 🔴	0.58 / 0.68 / -15.7%
tpcds_q08/duckdb:parquet	25959386 / 25793890 / +0.6%	32972404 / 33190348 / -0.7%	0.79 / 0.78 / +1.3%
tpcds_q09/duckdb:parquet	19267307 / 20233794 / -4.8%	23178097 / 23470567 / -1.2%	0.83 / 0.86 / -3.6%
tpcds_q10/duckdb:parquet	28097738 / 27845434 / +0.9%	39162460 / 39465143 / -0.8%	0.72 / 0.71 / +1.7%
tpcds_q11/duckdb:parquet	73487764 / 73297578 / +0.3%	79939076 / 77877334 / +2.6%	0.92 / 0.94 / -2.3%
tpcds_q12/duckdb:parquet	12759844 / 12728890 / +0.2%	17809611 / 18326345 / -2.8%	0.72 / 0.69 / +3.2%
tpcds_q13/duckdb:parquet	24384714 / 24166047 / +0.9%	30683179 / 31221856 / -1.7%	0.79 / 0.77 / +2.7%
tpcds_q14/duckdb:parquet	61958501 / 61496660 / +0.8%	74076804 / 68384298 / +8.3%	0.84 / 0.90 / -7.0%
tpcds_q15/duckdb:parquet	25289580 / 25449328 / -0.6%	31062721 / 29937281 / +3.8%	0.81 / 0.85 / -4.2%
tpcds_q16/duckdb:parquet	20962731 / 20947666 / +0.1%	29816062 / 28860696 / +3.3%	0.70 / 0.73 / -3.1%
tpcds_q17/duckdb:parquet	32712297 / 32626910 / +0.3%	41195521 / 40301401 / +2.2%	0.79 / 0.81 / -1.9%
tpcds_q18/duckdb:parquet	40106549 / 39842378 / +0.7%	51920977 / 52278085 / -0.7%	0.77 / 0.76 / +1.4%
tpcds_q19/duckdb:parquet	25213717 / 25249459 / -0.1%	32432283 / 32150363 / +0.9%	0.78 / 0.79 / -1.0%
tpcds_q20/duckdb:parquet	13998260 / 14074144 / -0.5%	19189903 / 20349838 / -5.7%	0.73 / 0.69 / +5.5%
tpcds_q21/duckdb:parquet	9421938 / 9446975 / -0.3%	13255794 / 12271953 / +8.0%	0.71 / 0.77 / -7.7%
tpcds_q22/duckdb:parquet	35268740 / 35901548 / -1.8%	39429319 / 38866514 / +1.4%	0.89 / 0.92 / -3.2%
tpcds_q23/duckdb:parquet	41468490 / 41074246 / +1.0%	48064655 / 47767347 / +0.6%	0.86 / 0.86 / +0.3%
tpcds_q24/duckdb:parquet	33756314 / 33754053 / +0.0%	42177373 / 41597072 / +1.4%	0.80 / 0.81 / -1.4%
tpcds_q25/duckdb:parquet	31668606 / 31248726 / +1.3%	40624079 / 39531531 / +2.8%	0.78 / 0.79 / -1.4%
tpcds_q26/duckdb:parquet	31725532 / 33342213 / -4.8%	39052602 / 41510183 / -5.9%	0.81 / 0.80 / +1.1%
tpcds_q27/duckdb:parquet	32909566 / 31669525 / +3.9%	41314677 / 43320391 / -4.6%	0.80 / 0.73 / +9.0%
tpcds_q28/duckdb:parquet	17719202 / 17440830 / +1.6%	22439405 / 21873998 / +2.6%	0.79 / 0.80 / -1.0%
tpcds_q29/duckdb:parquet	31276865 / 31104839 / +0.6%	38763405 / 39158562 / -1.0%	0.81 / 0.79 / +1.6%
tpcds_q30/duckdb:parquet	34677648 / 35145693 / -1.3%	44104535 / 42287984 / +4.3%	0.79 / 0.83 / -5.4%
tpcds_q31/duckdb:parquet	20620956 / 20823129 / -1.0%	25728501 / 25833304 / -0.4%	0.80 / 0.81 / -0.6%
tpcds_q32/duckdb:parquet	12322894 / 12097980 / +1.9%	21893114 / 18807459 / +16.4% 🔴	0.56 / 0.64 / -12.5%
tpcds_q33/duckdb:parquet	16407532 / 17085736 / -4.0%	23363923 / 23415365 / -0.2%	0.70 / 0.73 / -3.8%
tpcds_q34/duckdb:parquet	16458078 / 16501632 / -0.3%	22741191 / 28770759 / -21.0% 🟢	0.72 / 0.57 / +26.2%
tpcds_q35/duckdb:parquet	48731666 / 46707000 / +4.3%	58707389 / 57458475 / +2.2%	0.83 / 0.81 / +2.1%
tpcds_q36/duckdb:parquet	15994591 / 17474426 / -8.5%	26590046 / 23464228 / +13.3% 🔴	0.60 / 0.74 / -19.2%
tpcds_q37/duckdb:parquet	12366522 / 12315961 / +0.4%	19748413 / 18772882 / +5.2%	0.63 / 0.66 / -4.5%
tpcds_q38/duckdb:parquet	26977206 / 27074973 / -0.4%	31367556 / 30336090 / +3.4%	0.86 / 0.89 / -3.6%
tpcds_q39/duckdb:parquet	24485290 / 25257954 / -3.1%	32205808 / 30666490 / +5.0%	0.76 / 0.82 / -7.7%
tpcds_q40/duckdb:parquet	16512386 / 16186580 / +2.0%	22225730 / 20723947 / +7.2%	0.74 / 0.78 / -4.9%
tpcds_q41/duckdb:parquet	7937770 / 11125332 / -28.7% 🟢	13598345 / 15393160 / -11.7% 🟢	0.58 / 0.72 / -19.2%
tpcds_q42/duckdb:parquet	8767334 / 8647851 / +1.4%	15814163 / 15160638 / +4.3%	0.55 / 0.57 / -2.8%
tpcds_q43/duckdb:parquet	11159532 / 10658221 / +4.7%	15089403 / 14743622 / +2.3%	0.74 / 0.72 / +2.3%
tpcds_q44/duckdb:parquet	15905592 / 15986550 / -0.5%	22086192 / 21453803 / +2.9%	0.72 / 0.75 / -3.4%
tpcds_q45/duckdb:parquet	23851318 / 23413451 / +1.9%	29261455 / 29678502 / -1.4%	0.82 / 0.79 / +3.3%
tpcds_q46/duckdb:parquet	36923098 / 36866265 / +0.2%	45441978 / 45044513 / +0.9%	0.81 / 0.82 / -0.7%
tpcds_q47/duckdb:parquet	31439873 / 32918090 / -4.5%	36819704 / 36642537 / +0.5%	0.85 / 0.90 / -5.0%
tpcds_q48/duckdb:parquet	22540998 / 21069292 / +7.0%	28766387 / 27368047 / +5.1%	0.78 / 0.77 / +1.8%
tpcds_q49/duckdb:parquet	20300514 / 20273190 / +0.1%	30789746 / 28242749 / +9.0%	0.66 / 0.72 / -8.1%
tpcds_q50/duckdb:parquet	17890426 / 18006310 / -0.6%	24066614 / 27878532 / -13.7% 🟢	0.74 / 0.65 / +15.1%
tpcds_q51/duckdb:parquet	53534650 / 53441748 / +0.2%	60330155 / 60401283 / -0.1%	0.89 / 0.88 / +0.3%
tpcds_q52/duckdb:parquet	8950996 / 8996118 / -0.5%	15821639 / 15843617 / -0.1%	0.57 / 0.57 / -0.4%
tpcds_q53/duckdb:parquet	11883608 / 11834697 / +0.4%	16304445 / 16765598 / -2.8%	0.73 / 0.71 / +3.3%
tpcds_q54/duckdb:parquet	20701797 / 20765080 / -0.3%	30710534 / 29122585 / +5.5%	0.67 / 0.71 / -5.5%
tpcds_q55/duckdb:parquet	8842098 / 9412998 / -6.1%	16330654 / 15659297 / +4.3%	0.54 / 0.60 / -9.9%
tpcds_q56/duckdb:parquet	16959332 / 17289522 / -1.9%	24440867 / 24287983 / +0.6%	0.69 / 0.71 / -2.5%
tpcds_q57/duckdb:parquet	28884141 / 28986668 / -0.4%	36708521 / 34574520 / +6.2%	0.79 / 0.84 / -6.1%
tpcds_q58/duckdb:parquet	19258642 / 19066670 / +1.0%	26965143 / 26551339 / +1.6%	0.71 / 0.72 / -0.5%
tpcds_q59/duckdb:parquet	20057730 / 21531438 / -6.8%	24691716 / 28323049 / -12.8% 🟢	0.81 / 0.76 / +6.9%
tpcds_q60/duckdb:parquet	17791988 / 17754246 / +0.2%	24542548 / 24506289 / +0.1%	0.72 / 0.72 / +0.1%
tpcds_q61/duckdb:parquet	22048850 / 22138218 / -0.4%	29493859 / 28946614 / +1.9%	0.75 / 0.76 / -2.3%
tpcds_q62/duckdb:parquet	10810482 / 10971472 / -1.5%	14943469 / 15069390 / -0.8%	0.72 / 0.73 / -0.6%
tpcds_q63/duckdb:parquet	11243916 / 11298816 / -0.5%	16047668 / 16587926 / -3.3%	0.70 / 0.68 / +2.9%
tpcds_q64/duckdb:parquet	55115772 / 53497124 / +3.0%	67676626 / 67228978 / +0.7%	0.81 / 0.80 / +2.3%
tpcds_q65/duckdb:parquet	14692012 / 16760106 / -12.3% 🟢	23625927 / 23473281 / +0.7%	0.62 / 0.71 / -12.9%
tpcds_q66/duckdb:parquet	24986200 / 24845591 / +0.6%	33754090 / 32132872 / +5.0%	0.74 / 0.77 / -4.3%
tpcds_q67/duckdb:parquet	79556938 / 76404608 / +4.1%	99969514 / 83043886 / +20.4% 🔴	0.80 / 0.92 / -13.5%
tpcds_q68/duckdb:parquet	30254507 / 30186614 / +0.2%	43484401 / 39695430 / +9.5%	0.70 / 0.76 / -8.5%
tpcds_q69/duckdb:parquet	29725255 / 28997830 / +2.5%	42050533 / 38957784 / +7.9%	0.71 / 0.74 / -5.0%
tpcds_q70/duckdb:parquet	17203572 / 18739124 / -8.2%	27353576 / 22176480 / +23.3% 🔴	0.63 / 0.84 / -25.6%
tpcds_q71/duckdb:parquet	15076094 / 15134582 / -0.4%	21172443 / 21513821 / -1.6%	0.71 / 0.70 / +1.2%
tpcds_q72/duckdb:parquet	81472795 / 81863636 / -0.5%	85923901 / 93246028 / -7.9%	0.95 / 0.88 / +8.0%
tpcds_q73/duckdb:parquet	14391396 / 13742968 / +4.7%	22575834 / 19333610 / +16.8% 🔴	0.64 / 0.71 / -10.3%
tpcds_q74/duckdb:parquet	99575110 / 100275076 / -0.7%	107525386 / 109440411 / -1.7%	0.93 / 0.92 / +1.1%
tpcds_q75/duckdb:parquet	40845587 / 40707938 / +0.3%	51196552 / 50883273 / +0.6%	0.80 / 0.80 / -0.3%
tpcds_q76/duckdb:parquet	15007364 / 14226689 / +5.5%	21457825 / 21539709 / -0.4%	0.70 / 0.66 / +5.9%
tpcds_q77/duckdb:parquet	17858298 / 17783934 / +0.4%	25413321 / 25344941 / +0.3%	0.70 / 0.70 / +0.1%
tpcds_q78/duckdb:parquet	48758128 / 48387212 / +0.8%	55865784 / 53552256 / +4.3%	0.87 / 0.90 / -3.4%
tpcds_q79/duckdb:parquet	21478178 / 21131570 / +1.6%	29112392 / 28948652 / +0.6%	0.74 / 0.73 / +1.1%
tpcds_q80/duckdb:parquet	33205478 / 32780630 / +1.3%	39488428 / 39985729 / -1.2%	0.84 / 0.82 / +2.6%
tpcds_q81/duckdb:parquet	31349337 / 31333040 / +0.1%	39900496 / 40153412 / -0.6%	0.79 / 0.78 / +0.7%
tpcds_q82/duckdb:parquet	13808598 / 12491846 / +10.5% 🔴	20497124 / 17519203 / +17.0% 🔴	0.67 / 0.71 / -5.5%
tpcds_q83/duckdb:parquet	16680460 / 16536560 / +0.9%	21882771 / 23390245 / -6.4%	0.76 / 0.71 / +7.8%
tpcds_q84/duckdb:parquet	18697686 / 18670196 / +0.1%	24709320 / 24224540 / +2.0%	0.76 / 0.77 / -1.8%
tpcds_q85/duckdb:parquet	35909071 / 35263324 / +1.8%	45287575 / 45401585 / -0.3%	0.79 / 0.78 / +2.1%
tpcds_q86/duckdb:parquet	14359929 / 11369504 / +26.3% 🔴	18840506 / 16179461 / +16.4% 🔴	0.76 / 0.70 / +8.5%
tpcds_q87/duckdb:parquet	28488694 / 28620512 / -0.5%	36596768 / 32386554 / +13.0% 🔴	0.78 / 0.88 / -11.9%
tpcds_q88/duckdb:parquet	27096292 / 26974264 / +0.5%	34092044 / 31342222 / +8.8%	0.79 / 0.86 / -7.6%
tpcds_q89/duckdb:parquet	12930794 / 12856356 / +0.6%	18291082 / 19015913 / -3.8%	0.71 / 0.68 / +4.6%
tpcds_q90/duckdb:parquet	6934815 / 7017885 / -1.2%	11266819 / 12159718 / -7.3%	0.62 / 0.58 / +6.6%
tpcds_q91/duckdb:parquet	21709325 / 24169744 / -10.2% 🟢	29684120 / 28842113 / +2.9%	0.73 / 0.84 / -12.7%
tpcds_q92/duckdb:parquet	12598422 / 12693616 / -0.7%	19512090 / 19249637 / +1.4%	0.65 / 0.66 / -2.1%
tpcds_q93/duckdb:parquet	21843562 / 21293196 / +2.6%	26848309 / 26820049 / +0.1%	0.81 / 0.79 / +2.5%
tpcds_q94/duckdb:parquet	16946028 / 17041956 / -0.6%	25705410 / 29038419 / -11.5% 🟢	0.66 / 0.59 / +12.3%
tpcds_q95/duckdb:parquet	93783788 / 90874498 / +3.2%	98060337 / 97958202 / +0.1%	0.96 / 0.93 / +3.1%
tpcds_q96/duckdb:parquet	7853055 / 7010989 / +12.0% 🔴	11317746 / 10386486 / +9.0%	0.69 / 0.68 / +2.8%
tpcds_q97/duckdb:parquet	25963510 / 25783124 / +0.7%	35626527 / 32280172 / +10.4% 🔴	0.73 / 0.80 / -8.8%
tpcds_q98/duckdb:parquet	17838302 / 15364954 / +16.1% 🔴	22263998 / 22682260 / -1.8%	0.80 / 0.68 / +18.3%
tpcds_q99/duckdb:parquet	17355813 / 17301222 / +0.3%	21518695 / 21296544 / +1.0%	0.81 / 0.81 / -0.7%

No file size changes detected.

ghost · 2026-10-06T16:44:59Z

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 803a0e97 vs base dd1ce26a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.942x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.977x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	97833882 / 98832712 / -1.0%	169707460 / 172765445 / -1.8%	0.58 / 0.57 / +0.8%
tpch_q02/datafusion:vortex-file-compressed	64445081 / 65045046 / -0.9%	93381848 / 98755290 / -5.4%	0.69 / 0.66 / +4.8%
tpch_q03/datafusion:vortex-file-compressed	65092855 / 64792659 / +0.5%	114576084 / 120836496 / -5.2%	0.57 / 0.54 / +6.0%
tpch_q04/datafusion:vortex-file-compressed	34916807 / 35761806 / -2.4%	81916004 / 80236133 / +2.1%	0.43 / 0.45 / -4.4%
tpch_q05/datafusion:vortex-file-compressed	117950038 / 120839361 / -2.4%	185975135 / 184479455 / +0.8%	0.63 / 0.66 / -3.2%
tpch_q06/datafusion:vortex-file-compressed	14828650 / 14542748 / +2.0%	70047557 / 72808513 / -3.8%	0.21 / 0.20 / +6.0%
tpch_q07/datafusion:vortex-file-compressed	138972295 / 137353086 / +1.2%	182022814 / 206378015 / -11.8% 🟢	0.76 / 0.67 / +14.7%
tpch_q08/datafusion:vortex-file-compressed	140765872 / 146048250 / -3.6%	199989474 / 217256241 / -7.9%	0.70 / 0.67 / +4.7%
tpch_q09/datafusion:vortex-file-compressed	185108277 / 185179538 / -0.0%	257790449 / 271464841 / -5.0%	0.72 / 0.68 / +5.3%
tpch_q10/datafusion:vortex-file-compressed	73416143 / 74753594 / -1.8%	137354720 / 143992344 / -4.6%	0.53 / 0.52 / +3.0%
tpch_q11/datafusion:vortex-file-compressed	43718434 / 43141635 / +1.3%	70417333 / 72178656 / -2.4%	0.62 / 0.60 / +3.9%
tpch_q12/datafusion:vortex-file-compressed	43621787 / 45038011 / -3.1%	92639819 / 95455432 / -2.9%	0.47 / 0.47 / -0.2%
tpch_q13/datafusion:vortex-file-compressed	46988076 / 47029458 / -0.1%	83004733 / 78731860 / +5.4%	0.57 / 0.60 / -5.2%
tpch_q14/datafusion:vortex-file-compressed	24728277 / 25212031 / -1.9%	92417326 / 103220833 / -10.5% 🟢	0.27 / 0.24 / +9.5%
tpch_q15/datafusion:vortex-file-compressed	36498246 / 36589229 / -0.2%	97624318 / 103274015 / -5.5%	0.37 / 0.35 / +5.5%
tpch_q16/datafusion:vortex-file-compressed	37118794 / 37188919 / -0.2%	65022729 / 70627139 / -7.9%	0.57 / 0.53 / +8.4%
tpch_q17/datafusion:vortex-file-compressed	177005039 / 178259274 / -0.7%	224890988 / 231362284 / -2.8%	0.79 / 0.77 / +2.2%
tpch_q18/datafusion:vortex-file-compressed	200088251 / 201362440 / -0.6%	258255083 / 265318382 / -2.7%	0.77 / 0.76 / +2.1%
tpch_q19/datafusion:vortex-file-compressed	34047418 / 34113429 / -0.2%	95636977 / 93601979 / +2.2%	0.36 / 0.36 / -2.3%
tpch_q20/datafusion:vortex-file-compressed	62936609 / 63192994 / -0.4%	120057387 / 122265749 / -1.8%	0.52 / 0.52 / +1.4%
tpch_q21/datafusion:vortex-file-compressed	184168923 / 186184946 / -1.1%	239888999 / 246008657 / -2.5%	0.77 / 0.76 / +1.4%
tpch_q22/datafusion:vortex-file-compressed	25646666 / 25645735 / +0.0%	55374888 / 58634516 / -5.6%	0.46 / 0.44 / +5.9%

datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	98838442 / 100274632 / -1.4%	149838932 / 163845103 / -8.5%	0.66 / 0.61 / +7.8%
tpch_q02/datafusion:vortex-compact	65855172 / 64731955 / +1.7%	92423605 / 96000432 / -3.7%	0.71 / 0.67 / +5.7%
tpch_q03/datafusion:vortex-compact	65486441 / 66016144 / -0.8%	107998302 / 103609829 / +4.2%	0.61 / 0.64 / -4.8%
tpch_q04/datafusion:vortex-compact	41420959 / 41525546 / -0.3%	80413335 / 80811367 / -0.5%	0.52 / 0.51 / +0.2%
tpch_q05/datafusion:vortex-compact	117296926 / 117744948 / -0.4%	164322353 / 183082702 / -10.2% 🟢	0.71 / 0.64 / +11.0%
tpch_q06/datafusion:vortex-compact	17880135 / 18015515 / -0.8%	64893568 / 66519092 / -2.4%	0.28 / 0.27 / +1.7%
tpch_q07/datafusion:vortex-compact	144135678 / 141888270 / +1.6%	179038433 / 187689015 / -4.6%	0.81 / 0.76 / +6.5%
tpch_q08/datafusion:vortex-compact	144588004 / 142793887 / +1.3%	195459197 / 199088491 / -1.8%	0.74 / 0.72 / +3.1%
tpch_q09/datafusion:vortex-compact	183273079 / 184148043 / -0.5%	242102435 / 248964821 / -2.8%	0.76 / 0.74 / +2.3%
tpch_q10/datafusion:vortex-compact	77994003 / 80101847 / -2.6%	124638093 / 128240201 / -2.8%	0.63 / 0.62 / +0.2%
tpch_q11/datafusion:vortex-compact	43598001 / 43701427 / -0.2%	67417588 / 66929962 / +0.7%	0.65 / 0.65 / -1.0%
tpch_q12/datafusion:vortex-compact	56963177 / 57008306 / -0.1%	94329746 / 95068166 / -0.8%	0.60 / 0.60 / +0.7%
tpch_q13/datafusion:vortex-compact	52964533 / 54124936 / -2.1%	77848609 / 79774414 / -2.4%	0.68 / 0.68 / +0.3%
tpch_q14/datafusion:vortex-compact	27219290 / 26812408 / +1.5%	93074170 / 99111086 / -6.1%	0.29 / 0.27 / +8.1%
tpch_q15/datafusion:vortex-compact	44533421 / 44748067 / -0.5%	101496570 / 103089345 / -1.5%	0.44 / 0.43 / +1.1%
tpch_q16/datafusion:vortex-compact	40044199 / 40377968 / -0.8%	70546405 / 68944834 / +2.3%	0.57 / 0.59 / -3.1%
tpch_q17/datafusion:vortex-compact	171389018 / 169860277 / +0.9%	217176461 / 217873291 / -0.3%	0.79 / 0.78 / +1.2%
tpch_q18/datafusion:vortex-compact	200398561 / 204276933 / -1.9%	263994939 / 266333831 / -0.9%	0.76 / 0.77 / -1.0%
tpch_q19/datafusion:vortex-compact	41074387 / 40197173 / +2.2%	90219402 / 100178892 / -9.9%	0.46 / 0.40 / +13.5%
tpch_q20/datafusion:vortex-compact	66174909 / 65941655 / +0.4%	120106901 / 117153842 / +2.5%	0.55 / 0.56 / -2.1%
tpch_q21/datafusion:vortex-compact	192453500 / 194550918 / -1.1%	241449929 / 245676818 / -1.7%	0.80 / 0.79 / +0.7%
tpch_q22/datafusion:vortex-compact	26132351 / 26759771 / -2.3%	54091011 / 59631437 / -9.3%	0.48 / 0.45 / +7.7%

datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	86748317 / 87061677 / -0.4%	134582406 / 132951604 / +1.2%	0.64 / 0.65 / -1.6%
tpch_q02/datafusion:parquet	157931200 / 158040553 / -0.1%	185257728 / 191055311 / -3.0%	0.85 / 0.83 / +3.1%
tpch_q03/datafusion:parquet	142474777 / 143424191 / -0.7%	191306397 / 200040283 / -4.4%	0.74 / 0.72 / +3.9%
tpch_q04/datafusion:parquet	59648084 / 59796447 / -0.2%	97719906 / 100898860 / -3.2%	0.61 / 0.59 / +3.0%
tpch_q05/datafusion:parquet	181724575 / 181267533 / +0.3%	235855837 / 245538733 / -3.9%	0.77 / 0.74 / +4.4%
tpch_q06/datafusion:parquet	35365836 / 35115476 / +0.7%	81348237 / 82921429 / -1.9%	0.43 / 0.42 / +2.7%
tpch_q07/datafusion:parquet	234833216 / 233402564 / +0.6%	285010917 / 307815360 / -7.4%	0.82 / 0.76 / +8.7%
tpch_q08/datafusion:parquet	233419338 / 234321016 / -0.4%	309187231 / 310889004 / -0.5%	0.75 / 0.75 / +0.2%
tpch_q09/datafusion:parquet	316257770 / 317531087 / -0.4%	381021448 / 385877074 / -1.3%	0.83 / 0.82 / +0.9%
tpch_q10/datafusion:parquet	408431834 / 406029629 / +0.6%	454018048 / 469636829 / -3.3%	0.90 / 0.86 / +4.1%
tpch_q11/datafusion:parquet	104487260 / 105418814 / -0.9%	126122757 / 133283360 / -5.4%	0.83 / 0.79 / +4.7%
tpch_q12/datafusion:parquet	84881873 / 85203990 / -0.4%	123721252 / 134182112 / -7.8%	0.69 / 0.63 / +8.0%
tpch_q13/datafusion:parquet	227901995 / 229843629 / -0.8%	253622104 / 259914575 / -2.4%	0.90 / 0.88 / +1.6%
tpch_q14/datafusion:parquet	88038068 / 89686936 / -1.8%	198744045 / 205664487 / -3.4%	0.44 / 0.44 / +1.6%
tpch_q15/datafusion:parquet	91229912 / 90343517 / +1.0%	137914911 / 146467666 / -5.8%	0.66 / 0.62 / +7.2%
tpch_q16/datafusion:parquet	95336844 / 94968156 / +0.4%	121358237 / 126413825 / -4.0%	0.79 / 0.75 / +4.6%
tpch_q17/datafusion:parquet	218763010 / 217996563 / +0.4%	267288874 / 279121978 / -4.2%	0.82 / 0.78 / +4.8%
tpch_q18/datafusion:parquet	291713581 / 290658710 / +0.4%	332269758 / 332226102 / +0.0%	0.88 / 0.87 / +0.3%
tpch_q19/datafusion:parquet	109393063 / 108883253 / +0.5%	172950376 / 178641733 / -3.2%	0.63 / 0.61 / +3.8%
tpch_q20/datafusion:parquet	182863160 / 183688967 / -0.4%	246070685 / 249034356 / -1.2%	0.74 / 0.74 / +0.7%
tpch_q21/datafusion:parquet	243418627 / 245361599 / -0.8%	324313480 / 317022639 / +2.3%	0.75 / 0.77 / -3.0%
tpch_q22/datafusion:parquet	199412884 / 199872645 / -0.2%	219751810 / 223403314 / -1.6%	0.91 / 0.89 / +1.4%

duckdb / vortex-file-compressed / ns (0.984x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	53880070 / 54194502 / -0.6%	95881510 / 104563790 / -8.3%	0.56 / 0.52 / +8.4%
tpch_q02/duckdb:vortex-file-compressed	31998578 / 32523438 / -1.6%	44952371 / 52903392 / -15.0% 🟢	0.71 / 0.61 / +15.8%
tpch_q03/duckdb:vortex-file-compressed	56535123 / 58449776 / -3.3%	103962241 / 112069728 / -7.2%	0.54 / 0.52 / +4.3%
tpch_q04/duckdb:vortex-file-compressed	79865929 / 80177567 / -0.4%	115256830 / 124599654 / -7.5%	0.69 / 0.64 / +7.7%
tpch_q05/duckdb:vortex-file-compressed	65406043 / 65898202 / -0.7%	123909185 / 133010717 / -6.8%	0.53 / 0.50 / +6.5%
tpch_q06/duckdb:vortex-file-compressed	21449091 / 19758442 / +8.6%	56375308 / 64228225 / -12.2% 🟢	0.38 / 0.31 / +23.7%
tpch_q07/duckdb:vortex-file-compressed	59343415 / 60803106 / -2.4%	127476974 / 134940936 / -5.5%	0.47 / 0.45 / +3.3%
tpch_q08/duckdb:vortex-file-compressed	84703056 / 86393269 / -2.0%	151876321 / 165908271 / -8.5%	0.56 / 0.52 / +7.1%
tpch_q09/duckdb:vortex-file-compressed	164412279 / 167019036 / -1.6%	227097834 / 249217144 / -8.9%	0.72 / 0.67 / +8.0%
tpch_q10/duckdb:vortex-file-compressed	107229411 / 113144704 / -5.2%	160540526 / 174342249 / -7.9%	0.67 / 0.65 / +2.9%
tpch_q11/duckdb:vortex-file-compressed	17847435 / 17071734 / +4.5%	30068126 / 31561628 / -4.7%	0.59 / 0.54 / +9.7%
tpch_q12/duckdb:vortex-file-compressed	57266806 / 56884674 / +0.7%	103851961 / 107942520 / -3.8%	0.55 / 0.53 / +4.6%
tpch_q13/duckdb:vortex-file-compressed	92277985 / 90957478 / +1.5%	132094738 / 150089335 / -12.0% 🟢	0.70 / 0.61 / +15.3%
tpch_q14/duckdb:vortex-file-compressed	30384372 / 30552306 / -0.5%	74573588 / 77051142 / -3.2%	0.41 / 0.40 / +2.8%
tpch_q15/duckdb:vortex-file-compressed	38338883 / 40302829 / -4.9%	88236862 / 111339154 / -20.7% 🟢	0.43 / 0.36 / +20.0%
tpch_q16/duckdb:vortex-file-compressed	41619121 / 43169277 / -3.6%	53983491 / 54953708 / -1.8%	0.77 / 0.79 / -1.9%
tpch_q17/duckdb:vortex-file-compressed	56115885 / 60091976 / -6.6%	112270448 / 137209721 / -18.2% 🟢	0.50 / 0.44 / +14.1%
tpch_q18/duckdb:vortex-file-compressed	128512607 / 133725311 / -3.9%	153770195 / 166560338 / -7.7%	0.84 / 0.80 / +4.1%
tpch_q19/duckdb:vortex-file-compressed	38290700 / 43592005 / -12.2% 🟢	80329778 / 107599858 / -25.3% 🟢	0.48 / 0.41 / +17.7%
tpch_q20/duckdb:vortex-file-compressed	60775688 / 59207815 / +2.6%	119671518 / 126533300 / -5.4%	0.51 / 0.47 / +8.5%
tpch_q21/duckdb:vortex-file-compressed	241544939 / 238871655 / +1.1%	276976974 / 292828928 / -5.4%	0.87 / 0.82 / +6.9%
tpch_q22/duckdb:vortex-file-compressed	41572744 / 42381410 / -1.9%	63246385 / 60188312 / +5.1%	0.66 / 0.70 / -6.7%

duckdb / vortex-compact / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	68830193 / 67970559 / +1.3%	103299507 / 111492046 / -7.3%	0.67 / 0.61 / +9.3%
tpch_q02/duckdb:vortex-compact	35349776 / 35425846 / -0.2%	48209890 / 53159727 / -9.3%	0.73 / 0.67 / +10.0%
tpch_q03/duckdb:vortex-compact	61072049 / 64268230 / -5.0%	99215171 / 111653754 / -11.1% 🟢	0.62 / 0.58 / +6.9%
tpch_q04/duckdb:vortex-compact	86859692 / 88176102 / -1.5%	117197815 / 124690403 / -6.0%	0.74 / 0.71 / +4.8%
tpch_q05/duckdb:vortex-compact	68226056 / 72166279 / -5.5%	109966735 / 126041296 / -12.8% 🟢	0.62 / 0.57 / +8.4%
tpch_q06/duckdb:vortex-compact	25893408 / 24807386 / +4.4%	64698217 / 65801407 / -1.7%	0.40 / 0.38 / +6.2%
tpch_q07/duckdb:vortex-compact	71191373 / 71383115 / -0.3%	131860685 / 138277572 / -4.6%	0.54 / 0.52 / +4.6%
tpch_q08/duckdb:vortex-compact	90189077 / 90612109 / -0.5%	141394112 / 153662262 / -8.0%	0.64 / 0.59 / +8.2%
tpch_q09/duckdb:vortex-compact	174834393 / 175055116 / -0.1%	232188788 / 245949252 / -5.6%	0.75 / 0.71 / +5.8%
tpch_q10/duckdb:vortex-compact	115949579 / 115436547 / +0.4%	154753422 / 164781172 / -6.1%	0.75 / 0.70 / +7.0%
tpch_q11/duckdb:vortex-compact	19784469 / 19060580 / +3.8%	33541768 / 36773958 / -8.8%	0.59 / 0.52 / +13.8%
tpch_q12/duckdb:vortex-compact	68501218 / 70793587 / -3.2%	108034804 / 117695088 / -8.2%	0.63 / 0.60 / +5.4%
tpch_q13/duckdb:vortex-compact	95794203 / 94894033 / +0.9%	137787678 / 144465751 / -4.6%	0.70 / 0.66 / +5.8%
tpch_q14/duckdb:vortex-compact	34924614 / 32913323 / +6.1%	73397214 / 76699738 / -4.3%	0.48 / 0.43 / +10.9%
tpch_q15/duckdb:vortex-compact	45246099 / 44590813 / +1.5%	98472183 / 105569652 / -6.7%	0.46 / 0.42 / +8.8%
tpch_q16/duckdb:vortex-compact	44013645 / 44536959 / -1.2%	56938125 / 57263488 / -0.6%	0.77 / 0.78 / -0.6%
tpch_q17/duckdb:vortex-compact	55691543 / 57868258 / -3.8%	89544161 / 113696765 / -21.2% 🟢	0.62 / 0.51 / +22.2%
tpch_q18/duckdb:vortex-compact	144854229 / 141801552 / +2.2%	147911757 / 165001239 / -10.4% 🟢	0.98 / 0.86 / +14.0%
tpch_q19/duckdb:vortex-compact	42789302 / 44681853 / -4.2%	85581114 / 87704994 / -2.4%	0.50 / 0.51 / -1.9%
tpch_q20/duckdb:vortex-compact	66998341 / 67057423 / -0.1%	118251253 / 140012925 / -15.5% 🟢	0.57 / 0.48 / +18.3%
tpch_q21/duckdb:vortex-compact	259598475 / 259848949 / -0.1%	282176413 / 296639719 / -4.9%	0.92 / 0.88 / +5.0%
tpch_q22/duckdb:vortex-compact	43700441 / 44118771 / -0.9%	65023338 / 68106374 / -4.5%	0.67 / 0.65 / +3.7%

duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	72494789 / 72617967 / -0.2%	86615505 / 89632429 / -3.4%	0.84 / 0.81 / +3.3%
tpch_q02/duckdb:parquet	80639647 / 83843676 / -3.8%	91948698 / 91416760 / +0.6%	0.88 / 0.92 / -4.4%
tpch_q03/duckdb:parquet	122081231 / 122436235 / -0.3%	144505002 / 146541584 / -1.4%	0.84 / 0.84 / +1.1%
tpch_q04/duckdb:parquet	76088318 / 76493607 / -0.5%	92562166 / 92865413 / -0.3%	0.82 / 0.82 / -0.2%
tpch_q05/duckdb:parquet	129863795 / 130941845 / -0.8%	160000919 / 162848759 / -1.7%	0.81 / 0.80 / +0.9%
tpch_q06/duckdb:parquet	34791995 / 34787374 / +0.0%	47132512 / 48276454 / -2.4%	0.74 / 0.72 / +2.4%
tpch_q07/duckdb:parquet	93324654 / 93072648 / +0.3%	127136660 / 132711666 / -4.2%	0.73 / 0.70 / +4.7%
tpch_q08/duckdb:parquet	149453504 / 151548540 / -1.4%	201733768 / 193346231 / +4.3%	0.74 / 0.78 / -5.5%
tpch_q09/duckdb:parquet	228021491 / 228152547 / -0.1%	292342649 / 272536267 / +7.3%	0.78 / 0.84 / -6.8%
tpch_q10/duckdb:parquet	513054709 / 515297299 / -0.4%	541243007 / 547388162 / -1.1%	0.95 / 0.94 / +0.7%
tpch_q11/duckdb:parquet	33642046 / 33913449 / -0.8%	38974222 / 39321912 / -0.9%	0.86 / 0.86 / +0.1%
tpch_q12/duckdb:parquet	76443853 / 77174587 / -0.9%	88009133 / 89536331 / -1.7%	0.87 / 0.86 / +0.8%
tpch_q13/duckdb:parquet	322997303 / 327078937 / -1.2%	334154220 / 346684599 / -3.6%	0.97 / 0.94 / +2.5%
tpch_q14/duckdb:parquet	112548585 / 108853205 / +3.4%	151736967 / 135180114 / +12.2% 🔴	0.74 / 0.81 / -7.9%
tpch_q15/duckdb:parquet	43266813 / 43977530 / -1.6%	66297915 / 78013990 / -15.0% 🟢	0.65 / 0.56 / +15.8%
tpch_q16/duckdb:parquet	118195133 / 119778678 / -1.3%	128845853 / 130025895 / -0.9%	0.92 / 0.92 / -0.4%
tpch_q17/duckdb:parquet	80899691 / 80403888 / +0.6%	107163005 / 110951518 / -3.4%	0.75 / 0.72 / +4.2%
tpch_q18/duckdb:parquet	215386743 / 214640999 / +0.3%	181137881 / 181018955 / +0.1%	1.19 / 1.19 / +0.3%
tpch_q19/duckdb:parquet	166139722 / 167162042 / -0.6%	192838061 / 194883654 / -1.0%	0.86 / 0.86 / +0.4%
tpch_q20/duckdb:parquet	135771838 / 136408817 / -0.5%	166200727 / 179566088 / -7.4%	0.82 / 0.76 / +7.5%
tpch_q21/duckdb:parquet	283235341 / 277663261 / +2.0%	289293409 / 306635873 / -5.7%	0.98 / 0.91 / +8.1%
tpch_q22/duckdb:parquet	268103662 / 268942426 / -0.3%	277605935 / 282586854 / -1.8%	0.97 / 0.95 / +1.5%

No file size changes detected.

ghost · 2026-10-06T16:45:45Z

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 803a0e97 vs base dd1ce26a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.987x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.009x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed	1801902 / 1805788 / -0.2%	5086473 / 5859538 / -13.2% 🟢	0.35 / 0.31 / +15.0%
statpopgen_q01/datafusion:vortex-file-compressed	26180576 / 25187302 / +3.9%	34049237 / 33365687 / +2.0%	0.77 / 0.75 / +1.9%
statpopgen_q02/datafusion:vortex-file-compressed	111655439 / 111601055 / +0.0%	138967677 / 142187438 / -2.3%	0.80 / 0.78 / +2.4%
statpopgen_q03/datafusion:vortex-file-compressed	351834582 / 347683701 / +1.2%	381978372 / 389028926 / -1.8%	0.92 / 0.89 / +3.1%
statpopgen_q04/datafusion:vortex-file-compressed	342083792 / 370795206 / -7.7%	383646976 / 384535995 / -0.2%	0.89 / 0.96 / -7.5%
statpopgen_q05/datafusion:vortex-file-compressed	251024592 / 213826020 / +17.4% 🔴	314393210 / 309812935 / +1.5%	0.80 / 0.69 / +15.7%
statpopgen_q06/datafusion:vortex-file-compressed	761961830 / 755918722 / +0.8%	782425398 / 791605624 / -1.2%	0.97 / 0.95 / +2.0%
statpopgen_q07/datafusion:vortex-file-compressed	414228541 / 411311701 / +0.7%	420969512 / 426025438 / -1.2%	0.98 / 0.97 / +1.9%
statpopgen_q08/datafusion:vortex-file-compressed	408015073 / 420310717 / -2.9%	419431474 / 438378199 / -4.3%	0.97 / 0.96 / +1.5%
statpopgen_q09/datafusion:vortex-file-compressed	249816316 / 249682438 / +0.1%	286010468 / 290720876 / -1.6%	0.87 / 0.86 / +1.7%
statpopgen_q10/datafusion:vortex-file-compressed	747224497 / 761725489 / -1.9%	780573121 / 776145939 / +0.6%	0.96 / 0.98 / -2.5%

datafusion / vortex-compact / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact	1786744 / 1799949 / -0.7%	5212880 / 5883974 / -11.4% 🟢	0.34 / 0.31 / +12.0%
statpopgen_q01/datafusion:vortex-compact	27341132 / 27572480 / -0.8%	27176329 / 25325458 / +7.3%	1.01 / 1.09 / -7.6%
statpopgen_q02/datafusion:vortex-compact	211398664 / 211516338 / -0.1%	233603370 / 230891543 / +1.2%	0.90 / 0.92 / -1.2%
statpopgen_q03/datafusion:vortex-compact	466147672 / 465754316 / +0.1%	487980421 / 475148632 / +2.7%	0.96 / 0.98 / -2.5%
statpopgen_q04/datafusion:vortex-compact	463675805 / 463483832 / +0.0%	483555406 / 479625215 / +0.8%	0.96 / 0.97 / -0.8%
statpopgen_q05/datafusion:vortex-compact	314503530 / 313847547 / +0.2%	334000719 / 334521542 / -0.2%	0.94 / 0.94 / +0.4%
statpopgen_q06/datafusion:vortex-compact	878618678 / 874242094 / +0.5%	894832732 / 897189416 / -0.3%	0.98 / 0.97 / +0.8%
statpopgen_q07/datafusion:vortex-compact	972768191 / 974715598 / -0.2%	979108984 / 997005299 / -1.8%	0.99 / 0.98 / +1.6%
statpopgen_q08/datafusion:vortex-compact	969515652 / 969733320 / -0.0%	965168867 / 980560036 / -1.6%	1.00 / 0.99 / +1.6%
statpopgen_q09/datafusion:vortex-compact	362895357 / 364390804 / -0.4%	388118463 / 386640813 / +0.4%	0.94 / 0.94 / -0.8%
statpopgen_q10/datafusion:vortex-compact	964485557 / 970699898 / -0.6%	992592128 / 984757985 / +0.8%	0.97 / 0.99 / -1.4%

datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet	1983404 / 1989884 / -0.3%	89548277 / 89964056 / -0.5%	0.02 / 0.02 / +0.1%
statpopgen_q01/datafusion:parquet	160454470 / 160147765 / +0.2%	172547217 / 173668195 / -0.6%	0.93 / 0.92 / +0.8%
statpopgen_q02/datafusion:parquet	278489592 / 283084182 / -1.6%	419488356 / 421328449 / -0.4%	0.66 / 0.67 / -1.2%
statpopgen_q03/datafusion:parquet	396089929 / 400035664 / -1.0%	536181942 / 529470534 / +1.3%	0.74 / 0.76 / -2.2%
statpopgen_q04/datafusion:parquet	402246984 / 402624280 / -0.1%	536310671 / 508456106 / +5.5%	0.75 / 0.79 / -5.3%
statpopgen_q05/datafusion:parquet	325243246 / 320131891 / +1.6%	443944199 / 440922956 / +0.7%	0.73 / 0.73 / +0.9%
statpopgen_q06/datafusion:parquet	503884410 / 527412446 / -4.5%	637320295 / 621682205 / +2.5%	0.79 / 0.85 / -6.8%
statpopgen_q07/datafusion:parquet	435612076 / 432332308 / +0.8%	550510205 / 553575702 / -0.6%	0.79 / 0.78 / +1.3%
statpopgen_q08/datafusion:parquet	444355786 / 442811823 / +0.3%	551030676 / 545603817 / +1.0%	0.81 / 0.81 / -0.6%
statpopgen_q09/datafusion:parquet	365137894 / 368214164 / -0.8%	493189894 / 505246060 / -2.4%	0.74 / 0.73 / +1.6%
statpopgen_q10/datafusion:parquet	561061883 / 566142414 / -0.9%	670270564 / 678888069 / -1.3%	0.84 / 0.83 / +0.4%

duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed	9019436 / 9042234 / -0.3%	9468606 / 9488601 / -0.2%	0.95 / 0.95 / -0.0%
statpopgen_q01/duckdb:vortex-file-compressed	10319128 / 10316586 / +0.0%	13297580 / 15790153 / -15.8% 🟢	0.78 / 0.65 / +18.8%
statpopgen_q02/duckdb:vortex-file-compressed	303745334 / 303373816 / +0.1%	346859505 / 348172996 / -0.4%	0.88 / 0.87 / +0.5%
statpopgen_q03/duckdb:vortex-file-compressed	816691172 / 817657452 / -0.1%	823843688 / 818656135 / +0.6%	0.99 / 1.00 / -0.7%
statpopgen_q04/duckdb:vortex-file-compressed	812582906 / 817843510 / -0.6%	830042214 / 820580650 / +1.2%	0.98 / 1.00 / -1.8%
statpopgen_q05/duckdb:vortex-file-compressed	321536751 / 322083510 / -0.2%	357888593 / 345261131 / +3.7%	0.90 / 0.93 / -3.7%
statpopgen_q06/duckdb:vortex-file-compressed	1137934905 / 1150012006 / -1.1%	1159853107 / 1151226296 / +0.7%	0.98 / 1.00 / -1.8%
statpopgen_q07/duckdb:vortex-file-compressed	370723953 / 385957886 / -3.9%	377109072 / 425023482 / -11.3% 🟢	0.98 / 0.91 / +8.3%
statpopgen_q08/duckdb:vortex-file-compressed	384424308 / 390652081 / -1.6%	430187754 / 433275546 / -0.7%	0.89 / 0.90 / -0.9%
statpopgen_q09/duckdb:vortex-file-compressed	596367540 / 610528738 / -2.3%	622322837 / 619931428 / +0.4%	0.96 / 0.98 / -2.7%
statpopgen_q10/duckdb:vortex-file-compressed	1919313468 / 1919346084 / -0.0%	1887139895 / 1880909968 / +0.3%	1.02 / 1.02 / -0.3%

duckdb / vortex-compact / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact	9065190 / 9065002 / +0.0%	9422350 / 9537133 / -1.2%	0.96 / 0.95 / +1.2%
statpopgen_q01/duckdb:vortex-compact	10230612 / 10297344 / -0.6%	12834613 / 13634443 / -5.9%	0.80 / 0.76 / +5.5%
statpopgen_q02/duckdb:vortex-compact	384021020 / 380715327 / +0.9%	404128680 / 396791665 / +1.8%	0.95 / 0.96 / -1.0%
statpopgen_q03/duckdb:vortex-compact	894801829 / 896749350 / -0.2%	903946892 / 911221160 / -0.8%	0.99 / 0.98 / +0.6%
statpopgen_q04/duckdb:vortex-compact	904450384 / 900916988 / +0.4%	902139824 / 897572022 / +0.5%	1.00 / 1.00 / -0.1%
statpopgen_q05/duckdb:vortex-compact	427302378 / 427294791 / +0.0%	440925266 / 438053515 / +0.7%	0.97 / 0.98 / -0.6%
statpopgen_q06/duckdb:vortex-compact	1169975451 / 1167459797 / +0.2%	1174160828 / 1168601028 / +0.5%	1.00 / 1.00 / -0.3%
statpopgen_q07/duckdb:vortex-compact	933914245 / 933480918 / +0.0%	928414188 / 931426329 / -0.3%	1.01 / 1.00 / +0.4%
statpopgen_q08/duckdb:vortex-compact	936503370 / 950557000 / -1.5%	933208558 / 948239053 / -1.6%	1.00 / 1.00 / +0.1%
statpopgen_q09/duckdb:vortex-compact	712597064 / 708103050 / +0.6%	727221838 / 734511373 / -1.0%	0.98 / 0.96 / +1.6%
statpopgen_q10/duckdb:vortex-compact	2012999453 / 2033886217 / -1.0%	1986165820 / 1981838776 / +0.2%	1.01 / 1.03 / -1.2%

duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet	245310624 / 245270660 / +0.0%	246089271 / 245966058 / +0.1%	1.00 / 1.00 / -0.0%
statpopgen_q01/duckdb:parquet	301347217 / 302396880 / -0.3%	302754505 / 304567497 / -0.6%	1.00 / 0.99 / +0.2%
statpopgen_q02/duckdb:parquet	560057047 / 544210467 / +2.9%	573558931 / 548732801 / +4.5%	0.98 / 0.99 / -1.5%
statpopgen_q03/duckdb:parquet	860148852 / 864712260 / -0.5%	881239413 / 875740240 / +0.6%	0.98 / 0.99 / -1.1%
statpopgen_q04/duckdb:parquet	843144274 / 864026620 / -2.4%	806050603 / 870814612 / -7.4%	1.05 / 0.99 / +5.4%
statpopgen_q05/duckdb:parquet	604072852 / 607182858 / -0.5%	630033955 / 593060016 / +6.2%	0.96 / 1.02 / -6.4%
statpopgen_q06/duckdb:parquet	733240014 / 726024970 / +1.0%	702090836 / 735017261 / -4.5%	1.04 / 0.99 / +5.7%
statpopgen_q07/duckdb:parquet	605232211 / 604099654 / +0.2%	673698553 / 687628157 / -2.0%	0.90 / 0.88 / +2.3%
statpopgen_q08/duckdb:parquet	615751900 / 619653840 / -0.6%	678584241 / 702146302 / -3.4%	0.91 / 0.88 / +2.8%
statpopgen_q09/duckdb:parquet	776402012 / 787846008 / -1.5%	822447089 / 797564620 / +3.1%	0.94 / 0.99 / -4.4%
statpopgen_q10/duckdb:parquet	1418461312 / 1383545726 / +2.5%	1341552563 / 1268009058 / +5.8%	1.06 / 1.09 / -3.1%

No file size changes detected.

ghost · 2026-10-06T16:48:32Z

Benchmarks: Compression 📖

Commits: PR 803a0e97 vs base dc0e885d

vortex / vortex-file-compressed / ns (0.981x ➖, 0↑ 1↓)

name	ns (PR / base / %diff)
compress time/Arade	762121592 / 770565969 / -1.1%
compress time/Bimbo	3669183144 / 3747843353 / -2.1%
compress time/CMSprovider	2622780421 / 2653673956 / -1.2%
compress time/Euro2016	270482885 / 275007243 / -1.6%
compress time/Food	280719085 / 285233170 / -1.6%
compress time/HashTags	480479663 / 489479497 / -1.8%
compress time/TPC-H l_comment canonical	626015230 / 640764171 / -2.3%
compress time/TPC-H l_comment chunked	627233675 / 638122188 / -1.7%
compress time/taxi	403850724 / 406402632 / -0.6%
compress time/wide table cols=100 chunks=1 rows=1000	7112513 / 7143592 / -0.4%
compress time/wide table cols=100 chunks=50 rows=1000	7082242 / 7131595 / -0.7%
compress time/wide table cols=1000 chunks=1 rows=1000	69598826 / 69268034 / +0.5%
compress time/wide table cols=1000 chunks=50 rows=1000	69890514 / 70367622 / -0.7%
compress time/wide table cols=10000 chunks=1 rows=1000	746587616 / 777579243 / -4.0%
compress time/wide table cols=10000 chunks=50 rows=1000	768127074 / 771920368 / -0.5%
decompress time/Arade	8952450 / 9207803 / -2.8%
decompress time/Bimbo	36358766 / 38475593 / -5.5%
decompress time/CMSprovider	27401552 / 28601717 / -4.2%
decompress time/Euro2016	6696402 / 7082635 / -5.5%
decompress time/Food	2948319 / 2334361 / +26.3% 🔴
decompress time/HashTags	48261712 / 51039770 / -5.4%
decompress time/TPC-H l_comment canonical	19892503 / 21873235 / -9.1%
decompress time/TPC-H l_comment chunked	20828841 / 21899798 / -4.9%
decompress time/taxi	5796182 / 5520974 / +5.0%
decompress time/wide table cols=100 chunks=1 rows=1000	1912642 / 2009930 / -4.8%
decompress time/wide table cols=100 chunks=50 rows=1000	1935735 / 2035953 / -4.9%
decompress time/wide table cols=1000 chunks=1 rows=1000	18475722 / 19336945 / -4.5%
decompress time/wide table cols=1000 chunks=50 rows=1000	18507407 / 19501754 / -5.1%
decompress time/wide table cols=10000 chunks=1 rows=1000	213552247 / 225053990 / -5.1%
decompress time/wide table cols=10000 chunks=50 rows=1000	218399676 / 226006358 / -3.4%

vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
vortex-file-compressed size/Arade	142212028 / 142212028 / +0.0%
vortex-file-compressed size/Bimbo	458553996 / 458553996 / +0.0%
vortex-file-compressed size/CMSprovider	420778812 / 420778804 / +0.0%
vortex-file-compressed size/Euro2016	164046188 / 164045668 / +0.0%
vortex-file-compressed size/Food	38949464 / 38949464 / +0.0%
vortex-file-compressed size/HashTags	190338852 / 190338852 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical	179845112 / 179845112 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked	179845112 / 179845112 / +0.0%
vortex-file-compressed size/taxi	49994396 / 49994396 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000	932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000	932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000	9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000	9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000	93117680 / 93117680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000	93117680 / 93117680 / +0.0%

vortex / vortex-file-compressed / ratio (0.991x ➖, 0↑ 1↓)

name	ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade	0.339070711 / 0.342118217 / -0.9%
vortex:parquet-zstd ratio compress time/Bimbo	0.311308941 / 0.316838312 / -1.7%
vortex:parquet-zstd ratio compress time/CMSprovider	0.41006935 / 0.416128274 / -1.5%
vortex:parquet-zstd ratio compress time/Euro2016	0.251047673 / 0.254053329 / -1.2%
vortex:parquet-zstd ratio compress time/Food	0.379189227 / 0.38529618 / -1.6%
vortex:parquet-zstd ratio compress time/HashTags	0.262177565 / 0.266968485 / -1.8%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical	0.238088868 / 0.24345239 / -2.2%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked	0.238904628 / 0.242075198 / -1.3%
vortex:parquet-zstd ratio compress time/taxi	0.371807328 / 0.372469552 / -0.2%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000	1.80121305 / 1.81680318 / -0.9%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000	1.80017701 / 1.79079481 / +0.5%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000	1.56024267 / 1.54754559 / +0.8%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000	1.57087594 / 1.54807299 / +1.5%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000	1.63621414 / 1.70264145 / -3.9%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000	1.67587815 / 1.67518207 / +0.0%
vortex:parquet-zstd ratio decompress time/Arade	0.0160904586 / 0.0164974613 / -2.5%
vortex:parquet-zstd ratio decompress time/Bimbo	0.0226474473 / 0.0238513356 / -5.0%
vortex:parquet-zstd ratio decompress time/CMSprovider	0.0201421731 / 0.0209189403 / -3.7%
vortex:parquet-zstd ratio decompress time/Euro2016	0.020089975 / 0.0213427376 / -5.9%
vortex:parquet-zstd ratio decompress time/Food	0.0172948341 / 0.0137044139 / +26.2% 🔴
vortex:parquet-zstd ratio decompress time/HashTags	0.0936295934 / 0.0987720246 / -5.2%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical	0.0401043808 / 0.0436572246 / -8.1%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked	0.0419806487 / 0.043740536 / -4.0%
vortex:parquet-zstd ratio decompress time/taxi	0.026577762 / 0.0252671549 / +5.2%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000	0.931579188 / 0.976040053 / -4.6%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000	0.946696063 / 0.994190492 / -4.8%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000	0.782422369 / 0.816859889 / -4.2%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000	0.784357533 / 0.802632976 / -2.3%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000	0.873017661 / 0.906795483 / -3.7%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000	0.901193107 / 0.911097116 / -1.1%
vortex:parquet-zstd size/Arade	0.551178899 / 0.551178899 / -0.0%
vortex:parquet-zstd size/Bimbo	1.19254454 / 1.19254454 / +0.0%
vortex:parquet-zstd size/CMSprovider	1.11645611 / 1.11645609 / +0.0%
vortex:parquet-zstd size/Euro2016	1.33393606 / 1.33393183 / +0.0%
vortex:parquet-zstd size/Food	1.09103668 / 1.09103668 / +0.0%
vortex:parquet-zstd size/HashTags	1.42578493 / 1.42578493 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical	1.13568523 / 1.13568523 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked	1.13568523 / 1.13568523 / -0.0%
vortex:parquet-zstd size/taxi	0.904325412 / 0.904325412 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000	1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000	1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000	0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000	0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000	0.998688074 / 0.998688074 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000	0.998688074 / 0.998688074 / -0.0%

vortex / parquet / ns (0.995x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade	2247677456 / 2252338314 / -0.2%
parquet_rs-zstd compress time/Bimbo	11786308259 / 11828883096 / -0.4%
parquet_rs-zstd compress time/CMSprovider	6395943568 / 6377057555 / +0.3%
parquet_rs-zstd compress time/Euro2016	1077416420 / 1082478406 / -0.5%
parquet_rs-zstd compress time/Food	740313978 / 740295868 / +0.0%
parquet_rs-zstd compress time/HashTags	1832649802 / 1833472958 / -0.0%
parquet_rs-zstd compress time/TPC-H l_comment canonical	2629334307 / 2631989650 / -0.1%
parquet_rs-zstd compress time/TPC-H l_comment chunked	2625456364 / 2636049426 / -0.4%
parquet_rs-zstd compress time/taxi	1086182797 / 1091102963 / -0.5%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000	3948735 / 3931957 / +0.4%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000	3934192 / 3982363 / -1.2%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000	44607693 / 44759931 / -0.3%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000	44491428 / 45454977 / -2.1%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000	456289673 / 456689953 / -0.1%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000	458343032 / 460797894 / -0.5%
parquet_rs-zstd decompress time/Arade	556382525 / 558134541 / -0.3%
parquet_rs-zstd decompress time/Bimbo	1605424466 / 1613142073 / -0.5%
parquet_rs-zstd decompress time/CMSprovider	1360406939 / 1367264144 / -0.5%
parquet_rs-zstd decompress time/Euro2016	333320574 / 331852227 / +0.4%
parquet_rs-zstd decompress time/Food	170473968 / 170336435 / +0.1%
parquet_rs-zstd decompress time/HashTags	515453611 / 516743179 / -0.2%
parquet_rs-zstd decompress time/TPC-H l_comment canonical	496018205 / 501022115 / -1.0%
parquet_rs-zstd decompress time/TPC-H l_comment chunked	496153386 / 500675118 / -0.9%
parquet_rs-zstd decompress time/taxi	218083900 / 218503984 / -0.2%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000	2053118 / 2059270 / -0.3%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000	2044727 / 2047850 / -0.2%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000	23613489 / 23672291 / -0.2%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000	23595626 / 24297225 / -2.9%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000	244613891 / 248186051 / -1.4%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000	242345036 / 248059569 / -2.3%

vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
parquet size/Arade	258014282 / 258014282 / +0.0%
parquet size/Bimbo	384517292 / 384517292 / +0.0%
parquet size/CMSprovider	376887911 / 376887911 / +0.0%
parquet size/Euro2016	122979049 / 122979049 / +0.0%
parquet size/Food	35699500 / 35699500 / +0.0%
parquet size/HashTags	133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical	158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked	158358238 / 158358238 / +0.0%
parquet size/taxi	55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000	932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000	932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000	9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000	9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000	93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000	93240004 / 93240004 / +0.0%

vortex / arrow-ipc / ns (0.951x ➖, 5↑ 0↓)

name	ns (PR / base / %diff)
arrow-ipc compress time/Arade	98704265 / 99264102 / -0.6%
arrow-ipc compress time/Bimbo	620168448 / 626173094 / -1.0%
arrow-ipc compress time/CMSprovider	382190632 / 386929520 / -1.2%
arrow-ipc compress time/Euro2016	38458608 / 38612259 / -0.4%
arrow-ipc compress time/Food	33750681 / 34119441 / -1.1%
arrow-ipc compress time/HashTags	78943296 / 79147264 / -0.3%
arrow-ipc compress time/TPC-H l_comment canonical	496570700 / 523991824 / -5.2%
arrow-ipc compress time/TPC-H l_comment chunked	500846666 / 505576838 / -0.9%
arrow-ipc compress time/taxi	74819038 / 75493600 / -0.9%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000	203427 / 210060 / -3.2%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000	202537 / 206712 / -2.0%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000	2260220 / 2288052 / -1.2%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000	2221426 / 2274240 / -2.3%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000	25375170 / 25762033 / -1.5%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000	25749628 / 26120382 / -1.4%
arrow-ipc decompress time/Arade	139847669 / 181887297 / -23.1% 🟢
arrow-ipc decompress time/Bimbo	405748194 / 421150420 / -3.7%
arrow-ipc decompress time/CMSprovider	472086814 / 583450934 / -19.1% 🟢
arrow-ipc decompress time/Euro2016	63799423 / 75044672 / -15.0% 🟢
arrow-ipc decompress time/Food	48852184 / 58470503 / -16.4% 🟢
arrow-ipc decompress time/HashTags	120407058 / 143509482 / -16.1% 🟢
arrow-ipc decompress time/TPC-H l_comment canonical	540777156 / 534247504 / +1.2%
arrow-ipc decompress time/TPC-H l_comment chunked	539719890 / 531237569 / +1.6%
arrow-ipc decompress time/taxi	45027939 / 48820799 / -7.8%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000	318319 / 320879 / -0.8%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000	317540 / 320156 / -0.8%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000	3491151 / 3648262 / -4.3%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000	3455640 / 3645659 / -5.2%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000	35660298 / 36907317 / -3.4%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000	35673987 / 36909838 / -3.3%

vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
arrow-ipc size/Arade	691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo	3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider	2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016	360582666 / 360582666 / +0.0%
arrow-ipc size/Food	255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags	704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical	4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked	4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi	482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000	1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000	1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000	12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000	12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000	125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000	125752506 / 125752506 / +0.0%

ghost · 2026-10-06T16:51:18Z

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -12.5%
Engines: DataFusion No clear signal (-7.1%, environment too noisy confidence) · DuckDB No clear signal (-17.7%, environment too noisy confidence)
Vortex (geomean): hot 0.904x ➖ · cold 0.927x ➖
Parquet (geomean): hot 1.034x ➖ · cold 1.042x ➖
Shifts: Parquet (control) +3.4% · Median polish -11.5%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.964x ➖, 5↑ 6↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	246579616 / 227406706 / +8.4%	807749607 / 1044861900 / -22.7%	0.31 / 0.22 / +40.3%
tpch_q02/datafusion:vortex-file-compressed	732619528 / 362893520 / +101.9% 🔴	882718606 / 735506017 / +20.0%	0.83 / 0.49 / +68.2%
tpch_q03/datafusion:vortex-file-compressed	434458987 / 557784763 / -22.1%	1016890883 / 1353767100 / -24.9%	0.43 / 0.41 / +3.7%
tpch_q04/datafusion:vortex-file-compressed	203805452 / 259214662 / -21.4%	400660865 / 463388520 / -13.5%	0.51 / 0.56 / -9.1%
tpch_q05/datafusion:vortex-file-compressed	439549496 / 732518388 / -40.0% 🟢	1286070562 / 697793592 / +84.3% 🔴	0.34 / 1.05 / -67.4%
tpch_q06/datafusion:vortex-file-compressed	253437823 / 352026262 / -28.0%	445102933 / 529147386 / -15.9%	0.57 / 0.67 / -14.4%
tpch_q07/datafusion:vortex-file-compressed	957778416 / 494033216 / +93.9% 🔴	779070661 / 679737153 / +14.6%	1.23 / 0.73 / +69.2%
tpch_q08/datafusion:vortex-file-compressed	633439783 / 684130878 / -7.4%	1545456619 / 820834148 / +88.3% 🔴	0.41 / 0.83 / -50.8%
tpch_q09/datafusion:vortex-file-compressed	822546080 / 455396504 / +80.6% 🔴	1014153163 / 618575619 / +63.9% 🔴	0.81 / 0.74 / +10.2%
tpch_q10/datafusion:vortex-file-compressed	757120217 / 434485416 / +74.3% 🔴	1155135572 / 565607276 / +104.2% 🔴	0.66 / 0.77 / -14.7%
tpch_q11/datafusion:vortex-file-compressed	1035963844 / 356914809 / +190.3% 🔴	1516566648 / 543757031 / +178.9% 🔴	0.68 / 0.66 / +4.1%
tpch_q12/datafusion:vortex-file-compressed	473604739 / 883339642 / -46.4% 🟢	682415109 / 839764493 / -18.7%	0.69 / 1.05 / -34.0%
tpch_q13/datafusion:vortex-file-compressed	145710386 / 160433055 / -9.2%	360528792 / 321926343 / +12.0%	0.40 / 0.50 / -18.9%
tpch_q14/datafusion:vortex-file-compressed	193616430 / 344884573 / -43.9% 🟢	381906254 / 372150112 / +2.6%	0.51 / 0.93 / -45.3%
tpch_q15/datafusion:vortex-file-compressed	316037714 / 552997595 / -42.9% 🟢	1201659500 / 1163079564 / +3.3%	0.26 / 0.48 / -44.7%
tpch_q16/datafusion:vortex-file-compressed	189093984 / 247326997 / -23.5%	305810360 / 410612531 / -25.5%	0.62 / 0.60 / +2.7%
tpch_q17/datafusion:vortex-file-compressed	598071937 / 843196959 / -29.1%	751767287 / 872514096 / -13.8%	0.80 / 0.97 / -17.7%
tpch_q18/datafusion:vortex-file-compressed	293808807 / 358754811 / -18.1%	594770928 / 548805038 / +8.4%	0.49 / 0.65 / -24.4%
tpch_q19/datafusion:vortex-file-compressed	361977088 / 419652552 / -13.7%	459332517 / 704095339 / -34.8% 🟢	0.79 / 0.60 / +32.2%
tpch_q20/datafusion:vortex-file-compressed	407682571 / 309729894 / +31.6% 🔴	1630449622 / 485712096 / +235.7% 🔴	0.25 / 0.64 / -60.8%
tpch_q21/datafusion:vortex-file-compressed	527786718 / 837638286 / -37.0% 🟢	1294042844 / 1175911852 / +10.0%	0.41 / 0.71 / -42.7%
tpch_q22/datafusion:vortex-file-compressed	196627134 / 206308490 / -4.7%	459685457 / 373039775 / +23.2%	0.43 / 0.55 / -22.7%

datafusion / vortex-compact / ns (0.896x ➖, 5↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	248744338 / 234456956 / +6.1%	755003299 / 823067566 / -8.3%	0.33 / 0.28 / +15.7%
tpch_q02/datafusion:vortex-compact	759308676 / 331418231 / +129.1% 🔴	645339690 / 781186557 / -17.4%	1.18 / 0.42 / +177.3%
tpch_q03/datafusion:vortex-compact	310613441 / 446824217 / -30.5% 🟢	709138553 / 1044279508 / -32.1% 🟢	0.44 / 0.43 / +2.4%
tpch_q04/datafusion:vortex-compact	183005745 / 176824367 / +3.5%	397195241 / 500774590 / -20.7%	0.46 / 0.35 / +30.5%
tpch_q05/datafusion:vortex-compact	352641511 / 485397921 / -27.4%	537725209 / 613339319 / -12.3%	0.66 / 0.79 / -17.1%
tpch_q06/datafusion:vortex-compact	296697768 / 339425006 / -12.6%	487301158 / 511060445 / -4.6%	0.61 / 0.66 / -8.3%
tpch_q07/datafusion:vortex-compact	474172592 / 514963966 / -7.9%	564480421 / 690954509 / -18.3%	0.84 / 0.75 / +12.7%
tpch_q08/datafusion:vortex-compact	499757566 / 552141941 / -9.5%	696674394 / 745746074 / -6.6%	0.72 / 0.74 / -3.1%
tpch_q09/datafusion:vortex-compact	463437550 / 309472447 / +49.8% 🔴	938054633 / 569244534 / +64.8% 🔴	0.49 / 0.54 / -9.1%
tpch_q10/datafusion:vortex-compact	316341694 / 451535808 / -29.9%	523316617 / 646958174 / -19.1%	0.60 / 0.70 / -13.4%
tpch_q11/datafusion:vortex-compact	296741078 / 298125936 / -0.5%	540063226 / 516093337 / +4.6%	0.55 / 0.58 / -4.9%
tpch_q12/datafusion:vortex-compact	383600613 / 407836329 / -5.9%	753457983 / 589482405 / +27.8%	0.51 / 0.69 / -26.4%
tpch_q13/datafusion:vortex-compact	135265764 / 305477662 / -55.7% 🟢	357130748 / 787646663 / -54.7% 🟢	0.38 / 0.39 / -2.3%
tpch_q14/datafusion:vortex-compact	189182003 / 378819370 / -50.1% 🟢	337518650 / 658521469 / -48.7% 🟢	0.56 / 0.58 / -2.6%
tpch_q15/datafusion:vortex-compact	297465553 / 419866741 / -29.2%	568400666 / 610128266 / -6.8%	0.52 / 0.69 / -24.0%
tpch_q16/datafusion:vortex-compact	144286601 / 214928740 / -32.9% 🟢	268801270 / 584554078 / -54.0% 🟢	0.54 / 0.37 / +46.0%
tpch_q17/datafusion:vortex-compact	290996609 / 502430527 / -42.1% 🟢	458473824 / 698161580 / -34.3% 🟢	0.63 / 0.72 / -11.8%
tpch_q18/datafusion:vortex-compact	926890529 / 471641015 / +96.5% 🔴	1278250140 / 846432311 / +51.0% 🔴	0.73 / 0.56 / +30.1%
tpch_q19/datafusion:vortex-compact	428538055 / 546928451 / -21.6%	508388670 / 994142878 / -48.9% 🟢	0.84 / 0.55 / +53.2%
tpch_q20/datafusion:vortex-compact	293024499 / 297487018 / -1.5%	565113862 / 535621045 / +5.5%	0.52 / 0.56 / -6.6%
tpch_q21/datafusion:vortex-compact	473154610 / 503255207 / -6.0%	847351298 / 740976738 / +14.4%	0.56 / 0.68 / -17.8%
tpch_q22/datafusion:vortex-compact	210947843 / 186828488 / +12.9%	351652311 / 435606382 / -19.3%	0.60 / 0.43 / +39.9%

datafusion / parquet / ns (1.000x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	165542264 / 208041042 / -20.4%	463400089 / 518170364 / -10.6%	0.36 / 0.40 / -11.0%
tpch_q02/datafusion:parquet	260178070 / 315544283 / -17.5%	586652611 / 527940280 / +11.1%	0.44 / 0.60 / -25.8%
tpch_q03/datafusion:parquet	437495750 / 270064650 / +62.0% 🔴	989900356 / 796739185 / +24.2%	0.44 / 0.34 / +30.4%
tpch_q04/datafusion:parquet	191408772 / 165099780 / +15.9%	390617518 / 425023019 / -8.1%	0.49 / 0.39 / +26.1%
tpch_q05/datafusion:parquet	462666246 / 342563706 / +35.1% 🔴	1363490446 / 544837604 / +150.3% 🔴	0.34 / 0.63 / -46.0%
tpch_q06/datafusion:parquet	160487303 / 155950380 / +2.9%	283458696 / 349194218 / -18.8%	0.57 / 0.45 / +26.8%
tpch_q07/datafusion:parquet	418711541 / 397244435 / +5.4%	522438309 / 576575751 / -9.4%	0.80 / 0.69 / +16.3%
tpch_q08/datafusion:parquet	487067032 / 428883226 / +13.6%	638073805 / 566595681 / +12.6%	0.76 / 0.76 / +0.8%
tpch_q09/datafusion:parquet	386855474 / 477507606 / -19.0%	660692666 / 898713372 / -26.5%	0.59 / 0.53 / +10.2%
tpch_q10/datafusion:parquet	432446210 / 535476448 / -19.2%	561674017 / 522284252 / +7.5%	0.77 / 1.03 / -24.9%
tpch_q11/datafusion:parquet	249673165 / 270974747 / -7.9%	465915195 / 456526254 / +2.1%	0.54 / 0.59 / -9.7%
tpch_q12/datafusion:parquet	170472895 / 198376694 / -14.1%	358722732 / 400487564 / -10.4%	0.48 / 0.50 / -4.1%
tpch_q13/datafusion:parquet	384193722 / 367751260 / +4.5%	578635309 / 450416641 / +28.5%	0.66 / 0.82 / -18.7%
tpch_q14/datafusion:parquet	173655690 / 246602865 / -29.6%	382655290 / 520725884 / -26.5%	0.45 / 0.47 / -4.2%
tpch_q15/datafusion:parquet	312215855 / 363367045 / -14.1%	465646876 / 539413324 / -13.7%	0.67 / 0.67 / -0.5%
tpch_q16/datafusion:parquet	114331074 / 118565587 / -3.6%	457850717 / 290568151 / +57.6% 🔴	0.25 / 0.41 / -38.8%
tpch_q17/datafusion:parquet	290495713 / 319310170 / -9.0%	402394696 / 463049271 / -13.1%	0.72 / 0.69 / +4.7%
tpch_q18/datafusion:parquet	411779241 / 383100099 / +7.5%	605317832 / 487961646 / +24.1%	0.68 / 0.79 / -13.4%
tpch_q19/datafusion:parquet	248863776 / 229854678 / +8.3%	370105490 / 404130476 / -8.4%	0.67 / 0.57 / +18.2%
tpch_q20/datafusion:parquet	245919084 / 237436714 / +3.6%	576946981 / 431043892 / +33.8% 🔴	0.43 / 0.55 / -22.6%
tpch_q21/datafusion:parquet	369536609 / 342732983 / +7.8%	490195911 / 522796197 / -6.2%	0.75 / 0.66 / +15.0%
tpch_q22/datafusion:parquet	207803513 / 157967299 / +31.5% 🔴	410154348 / 356415877 / +15.1%	0.51 / 0.44 / +14.3%

duckdb / vortex-file-compressed / ns (0.879x ➖, 6↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	203609722 / 324195648 / -37.2% 🟢	346949943 / 764125867 / -54.6% 🟢	0.59 / 0.42 / +38.3%
tpch_q02/duckdb:vortex-file-compressed	777866360 / 402215958 / +93.4% 🔴	1041586039 / 569101240 / +83.0% 🔴	0.75 / 0.71 / +5.7%
tpch_q03/duckdb:vortex-file-compressed	499712903 / 580597511 / -13.9%	626640715 / 902577471 / -30.6% 🟢	0.80 / 0.64 / +24.0%
tpch_q04/duckdb:vortex-file-compressed	309294878 / 486531512 / -36.4% 🟢	409697913 / 458299892 / -10.6%	0.75 / 1.06 / -28.9%
tpch_q05/duckdb:vortex-file-compressed	541582235 / 594214978 / -8.9%	543162396 / 838618871 / -35.2% 🟢	1.00 / 0.71 / +40.7%
tpch_q06/duckdb:vortex-file-compressed	328685095 / 457970938 / -28.2%	282544042 / 488417200 / -42.2% 🟢	1.16 / 0.94 / +24.1%
tpch_q07/duckdb:vortex-file-compressed	714064157 / 611169938 / +16.8%	848006939 / 742001862 / +14.3%	0.84 / 0.82 / +2.2%
tpch_q08/duckdb:vortex-file-compressed	761955699 / 772265039 / -1.3%	716651695 / 873209983 / -17.9%	1.06 / 0.88 / +20.2%
tpch_q09/duckdb:vortex-file-compressed	526336043 / 631345817 / -16.6%	611372765 / 557726731 / +9.6%	0.86 / 1.13 / -23.9%
tpch_q10/duckdb:vortex-file-compressed	599214755 / 614779877 / -2.5%	763953081 / 837792429 / -8.8%	0.78 / 0.73 / +6.9%
tpch_q11/duckdb:vortex-file-compressed	784481233 / 213953786 / +266.7% 🔴	808605162 / 227194532 / +255.9% 🔴	0.97 / 0.94 / +3.0%
tpch_q12/duckdb:vortex-file-compressed	478219667 / 1223905210 / -60.9% 🟢	604733003 / 1278306757 / -52.7% 🟢	0.79 / 0.96 / -17.4%
tpch_q13/duckdb:vortex-file-compressed	340562955 / 346541279 / -1.7%	341125278 / 393764465 / -13.4%	1.00 / 0.88 / +13.4%
tpch_q14/duckdb:vortex-file-compressed	260444753 / 490038390 / -46.9% 🟢	354848127 / 666644496 / -46.8% 🟢	0.73 / 0.74 / -0.2%
tpch_q15/duckdb:vortex-file-compressed	156579782 / 389382453 / -59.8% 🟢	222848894 / 467071910 / -52.3% 🟢	0.70 / 0.83 / -15.7%
tpch_q16/duckdb:vortex-file-compressed	185861114 / 197817918 / -6.0%	253326403 / 200078399 / +26.6%	0.73 / 0.99 / -25.8%
tpch_q17/duckdb:vortex-file-compressed	535469806 / 764726607 / -30.0%	527549192 / 646721157 / -18.4%	1.02 / 1.18 / -14.2%
tpch_q18/duckdb:vortex-file-compressed	380095862 / 570304025 / -33.4% 🟢	515045240 / 573439503 / -10.2%	0.74 / 0.99 / -25.8%
tpch_q19/duckdb:vortex-file-compressed	368029672 / 406979721 / -9.6%	397691749 / 470882484 / -15.5%	0.93 / 0.86 / +7.1%
tpch_q20/duckdb:vortex-file-compressed	525306688 / 423732056 / +24.0%	535014480 / 632224067 / -15.4%	0.98 / 0.67 / +46.5%
tpch_q21/duckdb:vortex-file-compressed	908648448 / 1053860681 / -13.8%	920529907 / 1034897888 / -11.1%	0.99 / 1.02 / -3.1%
tpch_q22/duckdb:vortex-file-compressed	372273418 / 333859874 / +11.5%	356195974 / 355149622 / +0.3%	1.05 / 0.94 / +11.2%

duckdb / vortex-compact / ns (0.880x ➖, 2↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	227660204 / 224653138 / +1.3%	381172645 / 391145405 / -2.5%	0.60 / 0.57 / +4.0%
tpch_q02/duckdb:vortex-compact	392761516 / 434297443 / -9.6%	469418190 / 631642139 / -25.7%	0.84 / 0.69 / +21.7%
tpch_q03/duckdb:vortex-compact	490005404 / 541041979 / -9.4%	540565048 / 925742075 / -41.6% 🟢	0.91 / 0.58 / +55.1%
tpch_q04/duckdb:vortex-compact	289559717 / 406362538 / -28.7%	260637710 / 426075498 / -38.8% 🟢	1.11 / 0.95 / +16.5%
tpch_q05/duckdb:vortex-compact	396482816 / 459700210 / -13.8%	506154708 / 604841607 / -16.3%	0.78 / 0.76 / +3.1%
tpch_q06/duckdb:vortex-compact	304393606 / 423148872 / -28.1%	342178008 / 346644379 / -1.3%	0.89 / 1.22 / -27.1%
tpch_q07/duckdb:vortex-compact	526547468 / 513581045 / +2.5%	538993799 / 504526683 / +6.8%	0.98 / 1.02 / -4.0%
tpch_q08/duckdb:vortex-compact	607573689 / 652202864 / -6.8%	721299861 / 684225671 / +5.4%	0.84 / 0.95 / -11.6%
tpch_q09/duckdb:vortex-compact	482556784 / 554883574 / -13.0%	480280070 / 765479651 / -37.3% 🟢	1.00 / 0.72 / +38.6%
tpch_q10/duckdb:vortex-compact	398159043 / 506578525 / -21.4%	408708838 / 515721774 / -20.8%	0.97 / 0.98 / -0.8%
tpch_q11/duckdb:vortex-compact	213604398 / 220370621 / -3.1%	214427302 / 225956213 / -5.1%	1.00 / 0.98 / +2.1%
tpch_q12/duckdb:vortex-compact	491455055 / 550548921 / -10.7%	517874469 / 647793827 / -20.1%	0.95 / 0.85 / +11.7%
tpch_q13/duckdb:vortex-compact	249967803 / 268092222 / -6.8%	231617817 / 413482258 / -44.0% 🟢	1.08 / 0.65 / +66.5%
tpch_q14/duckdb:vortex-compact	275823435 / 265370848 / +3.9%	344958539 / 331728981 / +4.0%	0.80 / 0.80 / -0.0%
tpch_q15/duckdb:vortex-compact	161404869 / 262876563 / -38.6% 🟢	204565944 / 297448643 / -31.2% 🟢	0.79 / 0.88 / -10.7%
tpch_q16/duckdb:vortex-compact	180501741 / 194951143 / -7.4%	192957823 / 209204428 / -7.8%	0.94 / 0.93 / +0.4%
tpch_q17/duckdb:vortex-compact	421517037 / 485432230 / -13.2%	501588075 / 556299057 / -9.8%	0.84 / 0.87 / -3.7%
tpch_q18/duckdb:vortex-compact	285459785 / 498802448 / -42.8% 🟢	333539960 / 610749344 / -45.4% 🟢	0.86 / 0.82 / +4.8%
tpch_q19/duckdb:vortex-compact	416434224 / 499635184 / -16.7%	576270620 / 589555294 / -2.3%	0.72 / 0.85 / -14.7%
tpch_q20/duckdb:vortex-compact	396882393 / 423139023 / -6.2%	526907091 / 518943292 / +1.5%	0.75 / 0.82 / -7.6%
tpch_q21/duckdb:vortex-compact	632353305 / 833592924 / -24.1%	719746746 / 788282889 / -8.7%	0.88 / 1.06 / -16.9%
tpch_q22/duckdb:vortex-compact	278275432 / 156579516 / +77.7% 🔴	443114751 / 170816308 / +159.4% 🔴	0.63 / 0.92 / -31.5%

duckdb / parquet / ns (1.068x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	304613651 / 347901676 / -12.4%	611361683 / 364012436 / +68.0% 🔴	0.50 / 0.96 / -47.9%
tpch_q02/duckdb:parquet	645067268 / 653595818 / -1.3%	722696003 / 711762974 / +1.5%	0.89 / 0.92 / -2.8%
tpch_q03/duckdb:parquet	905262252 / 807232290 / +12.1%	1044866070 / 1003487066 / +4.1%	0.87 / 0.80 / +7.7%
tpch_q04/duckdb:parquet	514842119 / 483632920 / +6.5%	518287803 / 573763508 / -9.7%	0.99 / 0.84 / +17.8%
tpch_q05/duckdb:parquet	1109500927 / 956870051 / +16.0%	1210313167 / 845480330 / +43.2% 🔴	0.92 / 1.13 / -19.0%
tpch_q06/duckdb:parquet	325010530 / 346922396 / -6.3%	309404573 / 416719435 / -25.8%	1.05 / 0.83 / +26.2%
tpch_q07/duckdb:parquet	872130698 / 1021547803 / -14.6%	875293363 / 982915113 / -10.9%	1.00 / 1.04 / -4.1%
tpch_q08/duckdb:parquet	1173874561 / 1137450769 / +3.2%	1206874655 / 1202150500 / +0.4%	0.97 / 0.95 / +2.8%
tpch_q09/duckdb:parquet	974517915 / 1058342887 / -7.9%	1006870064 / 1020662735 / -1.4%	0.97 / 1.04 / -6.7%
tpch_q10/duckdb:parquet	1386953844 / 914312790 / +51.7% 🔴	1327204511 / 981436164 / +35.2% 🔴	1.05 / 0.93 / +12.2%
tpch_q11/duckdb:parquet	410575170 / 420812594 / -2.4%	451327691 / 398739344 / +13.2%	0.91 / 1.06 / -13.8%
tpch_q12/duckdb:parquet	619283138 / 669890425 / -7.6%	644365061 / 693652978 / -7.1%	0.96 / 0.97 / -0.5%
tpch_q13/duckdb:parquet	745937170 / 698948919 / +6.7%	1006994676 / 962226929 / +4.7%	0.74 / 0.73 / +2.0%
tpch_q14/duckdb:parquet	608348650 / 522496287 / +16.4%	517332835 / 719415302 / -28.1%	1.18 / 0.73 / +61.9%
tpch_q15/duckdb:parquet	581557141 / 430828811 / +35.0% 🔴	543688465 / 923702345 / -41.1% 🟢	1.07 / 0.47 / +129.3%
tpch_q16/duckdb:parquet	559780109 / 497241027 / +12.6%	519413820 / 452951120 / +14.7%	1.08 / 1.10 / -1.8%
tpch_q17/duckdb:parquet	466578195 / 498212343 / -6.3%	550522453 / 451070129 / +22.0%	0.85 / 1.10 / -23.3%
tpch_q18/duckdb:parquet	737885152 / 610581741 / +20.8%	808560610 / 655002079 / +23.4%	0.91 / 0.93 / -2.1%
tpch_q19/duckdb:parquet	621446922 / 661068094 / -6.0%	503238987 / 669151886 / -24.8%	1.23 / 0.99 / +25.0%
tpch_q20/duckdb:parquet	842231579 / 852408121 / -1.2%	803415613 / 839793480 / -4.3%	1.05 / 1.02 / +3.3%
tpch_q21/duckdb:parquet	704831782 / 769484076 / -8.4%	730772297 / 712869787 / +2.5%	0.96 / 1.08 / -10.6%
tpch_q22/duckdb:parquet	835539184 / 443832814 / +88.3% 🔴	691119249 / 419718305 / +64.7% 🔴	1.21 / 1.06 / +14.3%

ghost · 2026-10-06T16:57:15Z

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +14.8%
Engines: DataFusion No clear signal (+11.9%, environment too noisy confidence) · DuckDB No clear signal (+17.9%, environment too noisy confidence)
Vortex (geomean): hot 0.820x ➖ · cold 0.776x ➖
Parquet (geomean): hot 0.714x ➖ · cold 0.760x ➖
Shifts: Parquet (control) -28.6% · Median polish -25.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.742x ➖, 8↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	356537053 / 878207514 / -59.4% 🟢	1078070376 / 1598473029 / -32.6% 🟢	0.33 / 0.55 / -39.8%
tpch_q02/datafusion:vortex-compact	660938961 / 593781579 / +11.3%	1195092228 / 1228919718 / -2.8%	0.55 / 0.48 / +14.5%
tpch_q03/datafusion:vortex-compact	754782623 / 1425992975 / -47.1% 🟢	1758222257 / 2684198458 / -34.5% 🟢	0.43 / 0.53 / -19.2%
tpch_q04/datafusion:vortex-compact	457049204 / 554783185 / -17.6%	823497341 / 984086456 / -16.3%	0.56 / 0.56 / -1.6%
tpch_q05/datafusion:vortex-compact	821293175 / 1221744002 / -32.8% 🟢	996819067 / 1350544969 / -26.2%	0.82 / 0.90 / -8.9%
tpch_q06/datafusion:vortex-compact	494822713 / 1476309073 / -66.5% 🟢	652103563 / 1197620207 / -45.6% 🟢	0.76 / 1.23 / -38.4%
tpch_q07/datafusion:vortex-compact	949502807 / 1184360572 / -19.8%	1103167538 / 1307396067 / -15.6%	0.86 / 0.91 / -5.0%
tpch_q08/datafusion:vortex-compact	1129528189 / 1450612988 / -22.1%	1282205586 / 1857864048 / -31.0% 🟢	0.88 / 0.78 / +12.8%
tpch_q09/datafusion:vortex-compact	951363898 / 1147059900 / -17.1%	1225839765 / 1273737845 / -3.8%	0.78 / 0.90 / -13.8%
tpch_q10/datafusion:vortex-compact	837305767 / 1407480457 / -40.5% 🟢	1367127190 / 1595487492 / -14.3%	0.61 / 0.88 / -30.6%
tpch_q11/datafusion:vortex-compact	411352983 / 357422220 / +15.1%	800142415 / 735673477 / +8.8%	0.51 / 0.49 / +5.8%
tpch_q12/datafusion:vortex-compact	868258549 / 1060058374 / -18.1%	1045735923 / 1678864108 / -37.7% 🟢	0.83 / 0.63 / +31.5%
tpch_q13/datafusion:vortex-compact	269030049 / 238345834 / +12.9%	616498876 / 809804932 / -23.9%	0.44 / 0.29 / +48.3%
tpch_q14/datafusion:vortex-compact	472111444 / 807989270 / -41.6% 🟢	800469035 / 1483586180 / -46.0% 🟢	0.59 / 0.54 / +8.3%
tpch_q15/datafusion:vortex-compact	1003570404 / 1686589695 / -40.5% 🟢	1569665097 / 2239796855 / -29.9%	0.64 / 0.75 / -15.1%
tpch_q16/datafusion:vortex-compact	377160399 / 270627000 / +39.4% 🔴	512459340 / 482621507 / +6.2%	0.74 / 0.56 / +31.3%
tpch_q17/datafusion:vortex-compact	970139886 / 1328558379 / -27.0%	987812904 / 1588947648 / -37.8% 🟢	0.98 / 0.84 / +17.5%
tpch_q18/datafusion:vortex-compact	735222637 / 1024600183 / -28.2%	770506672 / 1604613294 / -52.0% 🟢	0.95 / 0.64 / +49.4%
tpch_q19/datafusion:vortex-compact	647359642 / 1106151772 / -41.5% 🟢	1060502830 / 1469961718 / -27.9%	0.61 / 0.75 / -18.9%
tpch_q20/datafusion:vortex-compact	906617055 / 1206901388 / -24.9%	1086135128 / 2260080017 / -51.9% 🟢	0.83 / 0.53 / +56.3%
tpch_q21/datafusion:vortex-compact	1761658252 / 2417986031 / -27.1%	1641415727 / 3070183993 / -46.5% 🟢	1.07 / 0.79 / +36.3%
tpch_q22/datafusion:vortex-compact	498450527 / 423488572 / +17.7%	877973885 / 788551353 / +11.3%	0.57 / 0.54 / +5.7%

datafusion / parquet / ns (0.663x ✅, 15↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	445646033 / 666283420 / -33.1% 🟢	1249088248 / 1477719191 / -15.5%	0.36 / 0.45 / -20.9%
tpch_q02/datafusion:parquet	494429313 / 1119083832 / -55.8% 🟢	1085820710 / 1874012853 / -42.1% 🟢	0.46 / 0.60 / -23.7%
tpch_q03/datafusion:parquet	802682812 / 956996464 / -16.1%	1291267935 / 1606599189 / -19.6%	0.62 / 0.60 / +4.4%
tpch_q04/datafusion:parquet	374572604 / 547671590 / -31.6% 🟢	592439204 / 752667038 / -21.3%	0.63 / 0.73 / -13.1%
tpch_q05/datafusion:parquet	699406918 / 1100374912 / -36.4% 🟢	1959429584 / 1432939491 / +36.7% 🔴	0.36 / 0.77 / -53.5%
tpch_q06/datafusion:parquet	437014551 / 667814273 / -34.6% 🟢	838955003 / 764104672 / +9.8%	0.52 / 0.87 / -40.4%
tpch_q07/datafusion:parquet	885935412 / 926693679 / -4.4%	1011793781 / 1358864656 / -25.5%	0.88 / 0.68 / +28.4%
tpch_q08/datafusion:parquet	1015557915 / 1113598974 / -8.8%	1572645993 / 1600516153 / -1.7%	0.65 / 0.70 / -7.2%
tpch_q09/datafusion:parquet	1012480113 / 1861609733 / -45.6% 🟢	1779434806 / 2035707093 / -12.6%	0.57 / 0.91 / -37.8%
tpch_q10/datafusion:parquet	1811372245 / 1586977460 / +14.1%	2359078368 / 2313862393 / +2.0%	0.77 / 0.69 / +12.0%
tpch_q11/datafusion:parquet	455982041 / 975088742 / -53.2% 🟢	753094511 / 1747782355 / -56.9% 🟢	0.61 / 0.56 / +8.5%
tpch_q12/datafusion:parquet	402177677 / 751983235 / -46.5% 🟢	688531147 / 1005900792 / -31.6% 🟢	0.58 / 0.75 / -21.9%
tpch_q13/datafusion:parquet	573107715 / 584831193 / -2.0%	1485973037 / 1000457050 / +48.5% 🔴	0.39 / 0.58 / -34.0%
tpch_q14/datafusion:parquet	495564827 / 935748172 / -47.0% 🟢	728841184 / 1207131915 / -39.6% 🟢	0.68 / 0.78 / -12.3%
tpch_q15/datafusion:parquet	720420068 / 1433617418 / -49.7% 🟢	1033047341 / 1663146316 / -37.9% 🟢	0.70 / 0.86 / -19.1%
tpch_q16/datafusion:parquet	251076662 / 827256151 / -69.6% 🟢	489828983 / 1174478269 / -58.3% 🟢	0.51 / 0.70 / -27.2%
tpch_q17/datafusion:parquet	860868948 / 1345555783 / -36.0% 🟢	919776862 / 1560693895 / -41.1% 🟢	0.94 / 0.86 / +8.6%
tpch_q18/datafusion:parquet	1141367734 / 889386672 / +28.3%	2081532640 / 1205504836 / +72.7% 🔴	0.55 / 0.74 / -25.7%
tpch_q19/datafusion:parquet	486105460 / 1009200188 / -51.8% 🟢	805067056 / 1054630892 / -23.7%	0.60 / 0.96 / -36.9%
tpch_q20/datafusion:parquet	799134531 / 1318821420 / -39.4% 🟢	1161453921 / 1559886299 / -25.5%	0.69 / 0.85 / -18.6%
tpch_q21/datafusion:parquet	1005895179 / 1641110139 / -38.7% 🟢	1152836066 / 1678902319 / -31.3% 🟢	0.87 / 0.98 / -10.7%
tpch_q22/datafusion:parquet	541124901 / 507997049 / +6.5%	796465734 / 926743299 / -14.1%	0.68 / 0.55 / +23.9%

duckdb / vortex-compact / ns (0.907x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	1271817238 / 1287859713 / -1.2%	1953718137 / 2605269572 / -25.0%	0.65 / 0.49 / +31.7%
tpch_q02/duckdb:vortex-compact	634578944 / 480771432 / +32.0% 🔴	727474770 / 803595978 / -9.5%	0.87 / 0.60 / +45.8%
tpch_q03/duckdb:vortex-compact	1462682050 / 1507285463 / -3.0%	1649722985 / 2364123561 / -30.2% 🟢	0.89 / 0.64 / +39.1%
tpch_q04/duckdb:vortex-compact	918037701 / 1069954551 / -14.2%	922421104 / 1477978542 / -37.6% 🟢	1.00 / 0.72 / +37.5%
tpch_q05/duckdb:vortex-compact	1605814098 / 1967206295 / -18.4%	1920826832 / 2638078113 / -27.2%	0.84 / 0.75 / +12.1%
tpch_q06/duckdb:vortex-compact	1401769165 / 1778555657 / -21.2%	1411178529 / 1676154354 / -15.8%	0.99 / 1.06 / -6.4%
tpch_q07/duckdb:vortex-compact	1858181050 / 2267577058 / -18.1%	1855011245 / 1906258918 / -2.7%	1.00 / 1.19 / -15.8%
tpch_q08/duckdb:vortex-compact	1792291768 / 2380755381 / -24.7%	2045962736 / 2802879396 / -27.0%	0.88 / 0.85 / +3.1%
tpch_q09/duckdb:vortex-compact	2309294932 / 2344661061 / -1.5%	2225425395 / 2902019847 / -23.3%	1.04 / 0.81 / +28.4%
tpch_q10/duckdb:vortex-compact	1776349458 / 2118678855 / -16.2%	2633594677 / 2448653150 / +7.6%	0.67 / 0.87 / -22.0%
tpch_q11/duckdb:vortex-compact	683670016 / 535622923 / +27.6%	804632251 / 731970685 / +9.9%	0.85 / 0.73 / +16.1%
tpch_q12/duckdb:vortex-compact	2189985319 / 2606283390 / -16.0%	2351772776 / 3496759304 / -32.7% 🟢	0.93 / 0.75 / +24.9%
tpch_q13/duckdb:vortex-compact	1142113171 / 1188484542 / -3.9%	1656263289 / 2110836624 / -21.5%	0.69 / 0.56 / +22.5%
tpch_q14/duckdb:vortex-compact	1115762802 / 1171415922 / -4.8%	1077230755 / 1551290611 / -30.6% 🟢	1.04 / 0.76 / +37.2%
tpch_q15/duckdb:vortex-compact	1142363873 / 1330593559 / -14.1%	1269284606 / 1647786288 / -23.0%	0.90 / 0.81 / +11.5%
tpch_q16/duckdb:vortex-compact	249836143 / 263670509 / -5.2%	328113769 / 301639953 / +8.8%	0.76 / 0.87 / -12.9%
tpch_q17/duckdb:vortex-compact	1453615654 / 1838011028 / -20.9%	1593078770 / 2097697361 / -24.1%	0.91 / 0.88 / +4.1%
tpch_q18/duckdb:vortex-compact	1057665888 / 1544645518 / -31.5% 🟢	1247229933 / 1709983441 / -27.1%	0.85 / 0.90 / -6.1%
tpch_q19/duckdb:vortex-compact	1550785400 / 1701935165 / -8.9%	1372589772 / 1709828704 / -19.7%	1.13 / 1.00 / +13.5%
tpch_q20/duckdb:vortex-compact	1928480960 / 2009078453 / -4.0%	2940127771 / 2013714024 / +46.0% 🔴	0.66 / 1.00 / -34.3%
tpch_q21/duckdb:vortex-compact	2702571529 / 3150043882 / -14.2%	2659587998 / 3576110445 / -25.6%	1.02 / 0.88 / +15.4%
tpch_q22/duckdb:vortex-compact	479880218 / 470142909 / +2.1%	690809266 / 756521407 / -8.7%	0.69 / 0.62 / +11.8%

duckdb / parquet / ns (0.770x ➖, 4↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	519477092 / 1141248000 / -54.5% 🟢	484880522 / 1658089686 / -70.8% 🟢	1.07 / 0.69 / +55.7%
tpch_q02/duckdb:parquet	927769992 / 1936964133 / -52.1% 🟢	1181307534 / 3004739038 / -60.7% 🟢	0.79 / 0.64 / +21.8%
tpch_q03/duckdb:parquet	1155534818 / 1515732625 / -23.8%	1298769125 / 2923651367 / -55.6% 🟢	0.89 / 0.52 / +71.6%
tpch_q04/duckdb:parquet	638081572 / 896535941 / -28.8%	861517848 / 1113310002 / -22.6%	0.74 / 0.81 / -8.0%
tpch_q05/duckdb:parquet	1510761749 / 1353990040 / +11.6%	1472544008 / 1693111991 / -13.0%	1.03 / 0.80 / +28.3%
tpch_q06/duckdb:parquet	763010085 / 930970769 / -18.0%	789800687 / 1082400590 / -27.0%	0.97 / 0.86 / +12.3%
tpch_q07/duckdb:parquet	1251582816 / 1455898785 / -14.0%	1169207044 / 1747685777 / -33.1% 🟢	1.07 / 0.83 / +28.5%
tpch_q08/duckdb:parquet	2058081933 / 1519950950 / +35.4% 🔴	2014998613 / 1478932924 / +36.2% 🔴	1.02 / 1.03 / -0.6%
tpch_q09/duckdb:parquet	1855374450 / 2639152974 / -29.7%	2636786610 / 3381417985 / -22.0%	0.70 / 0.78 / -9.8%
tpch_q10/duckdb:parquet	2198297790 / 2799263307 / -21.5%	2790395517 / 2933535992 / -4.9%	0.79 / 0.95 / -17.4%
tpch_q11/duckdb:parquet	495441658 / 1344849379 / -63.2% 🟢	514842344 / 1673484655 / -69.2% 🟢	0.96 / 0.80 / +19.7%
tpch_q12/duckdb:parquet	872962258 / 1079116105 / -19.1%	1016012735 / 1141971236 / -11.0%	0.86 / 0.94 / -9.1%
tpch_q13/duckdb:parquet	1031931823 / 943275321 / +9.4%	1554904602 / 1301063641 / +19.5%	0.66 / 0.73 / -8.5%
tpch_q14/duckdb:parquet	1162184443 / 1619276171 / -28.2%	1435155885 / 1541303384 / -6.9%	0.81 / 1.05 / -22.9%
tpch_q15/duckdb:parquet	749370815 / 1016613357 / -26.3%	902036017 / 951100317 / -5.2%	0.83 / 1.07 / -22.3%
tpch_q16/duckdb:parquet	626440004 / 1225827046 / -48.9% 🟢	700542911 / 1826871014 / -61.7% 🟢	0.89 / 0.67 / +33.3%
tpch_q17/duckdb:parquet	1266726801 / 1108460212 / +14.3%	1198734501 / 957610861 / +25.2%	1.06 / 1.16 / -8.7%
tpch_q18/duckdb:parquet	1024538437 / 956437899 / +7.1%	1106975434 / 1104321014 / +0.2%	0.93 / 0.87 / +6.9%
tpch_q19/duckdb:parquet	1046771185 / 1302592764 / -19.6%	1156635797 / 1312840532 / -11.9%	0.91 / 0.99 / -8.8%
tpch_q20/duckdb:parquet	1617169013 / 2127454483 / -24.0%	1532502496 / 2346224180 / -34.7% 🟢	1.06 / 0.91 / +16.4%
tpch_q21/duckdb:parquet	1005450162 / 1410711051 / -28.7%	974818030 / 1776849486 / -45.1% 🟢	1.03 / 0.79 / +29.9%
tpch_q22/duckdb:parquet	788876073 / 812821436 / -2.9%	929353006 / 870868507 / +6.7%	0.85 / 0.93 / -9.1%

ghost · 2026-10-06T17:09:28Z

Benchmarks: Random Access 📖

Commits: PR 803a0e97 vs base dc0e885d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: random-access No clear signal (-1.0%, low confidence)
Vortex (geomean): hot 0.982x ➖
Parquet (geomean): hot 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish -1.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (0.940x ➖, 1↑ 0↓)

name	ns (PR / base / %diff)
random-access/arrow-tokio-local-disk	70171 / 73637 / -4.7%
random-access/arrow-tokio-local-disk-footer	162993 / 164098 / -0.7%
random-access/feature-vectors/correlated/arrow-tokio-local-disk	1328649 / 2539469 / -47.7% 🟢
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer	1968341 / 2087152 / -5.7%
random-access/feature-vectors/uniform/arrow-tokio-local-disk	56047704 / 55304737 / +1.3%
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer	32796163 / 32881849 / -0.3%
random-access/nested-lists/correlated/arrow-tokio-local-disk	59037 / 60840 / -3.0%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer	102380 / 105039 / -2.5%
random-access/nested-lists/uniform/arrow-tokio-local-disk	1110193 / 1123100 / -1.1%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer	1177991 / 1187796 / -0.8%
random-access/nested-structs/correlated/arrow-tokio-local-disk	52890 / 56525 / -6.4%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer	95675 / 94447 / +1.3%
random-access/nested-structs/uniform/arrow-tokio-local-disk	874082 / 925714 / -5.6%
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer	929191 / 948783 / -2.1%
random-access/taxi/correlated/arrow-tokio-local-disk	119368 / 123721 / -3.5%
random-access/taxi/correlated/arrow-tokio-local-disk-footer	212373 / 219094 / -3.1%
random-access/taxi/uniform/arrow-tokio-local-disk	2849834 / 2971649 / -4.1%
random-access/taxi/uniform/arrow-tokio-local-disk-footer	2971802 / 3100120 / -4.1%

random-access / vortex-file-compressed / ns (0.982x ➖, 1↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk	243500 / 244531 / -0.4%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer	1195732 / 1239609 / -3.5%
random-access/feature-vectors/uniform/vortex-tokio-local-disk	1407076 / 1436776 / -2.1%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer	2661054 / 2676387 / -0.6%
random-access/nested-lists/correlated/vortex-tokio-local-disk	204590 / 234367 / -12.7% 🟢
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer	363032 / 393516 / -7.7%
random-access/nested-lists/uniform/vortex-tokio-local-disk	712596 / 746651 / -4.6%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer	929233 / 938389 / -1.0%
random-access/nested-structs/correlated/vortex-tokio-local-disk	287196 / 272164 / +5.5%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer	512222 / 520344 / -1.6%
random-access/nested-structs/uniform/vortex-tokio-local-disk	616880 / 592153 / +4.2%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer	955282 / 967652 / -1.3%
random-access/taxi/correlated/vortex-tokio-local-disk	652644 / 670029 / -2.6%
random-access/taxi/correlated/vortex-tokio-local-disk-footer	1465376 / 1443807 / +1.5%
random-access/taxi/uniform/vortex-tokio-local-disk	2678113 / 2601313 / +3.0%
random-access/taxi/uniform/vortex-tokio-local-disk-footer	3779704 / 3805649 / -0.7%
random-access/vortex-tokio-local-disk	431911 / 447229 / -3.4%
random-access/vortex-tokio-local-disk-footer	1055743 / 1082462 / -2.5%

random-access / parquet / ns (0.993x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk	107313884010 / 107456737883 / -0.1%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer	108263928845 / 108047914281 / +0.2%
random-access/feature-vectors/uniform/parquet-tokio-local-disk	107941911222 / 113640909249 / -5.0%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer	108422643654 / 114000552433 / -4.9%
random-access/nested-lists/correlated/parquet-tokio-local-disk	144412368 / 144439331 / -0.0%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer	147945027 / 148188217 / -0.2%
random-access/nested-lists/uniform/parquet-tokio-local-disk	144201347 / 148027428 / -2.6%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer	148054983 / 148984132 / -0.6%
random-access/nested-structs/correlated/parquet-tokio-local-disk	44155617 / 44261005 / -0.2%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer	44140939 / 44228726 / -0.2%
random-access/nested-structs/uniform/parquet-tokio-local-disk	44075334 / 44155940 / -0.2%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer	44147243 / 44191264 / -0.1%
random-access/parquet-tokio-local-disk	118700487 / 120220527 / -1.3%
random-access/parquet-tokio-local-disk-footer	120501052 / 120527456 / -0.0%
random-access/taxi/correlated/parquet-tokio-local-disk	178135182 / 180481695 / -1.3%
random-access/taxi/correlated/parquet-tokio-local-disk-footer	180728081 / 179875289 / +0.5%
random-access/taxi/uniform/parquet-tokio-local-disk	192883339 / 187831646 / +2.7%
random-access/taxi/uniform/parquet-tokio-local-disk-footer	193156471 / 192565774 / +0.3%

random-access / lance / ns (0.988x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk	292550 / 302977 / -3.4%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer	1228408 / 1254075 / -2.0%
random-access/feature-vectors/uniform/lance-tokio-local-disk	1026889 / 1061124 / -3.2%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer	1966736 / 2016999 / -2.5%
random-access/lance-tokio-local-disk	525762 / 527337 / -0.3%
random-access/lance-tokio-local-disk-footer	1477255 / 1492897 / -1.0%
random-access/nested-lists/correlated/lance-tokio-local-disk	159199 / 157726 / +0.9%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer	726160 / 731264 / -0.7%
random-access/nested-lists/uniform/lance-tokio-local-disk	835870 / 855746 / -2.3%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer	1450928 / 1445035 / +0.4%
random-access/nested-structs/correlated/lance-tokio-local-disk	267513 / 276222 / -3.2%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer	639792 / 646702 / -1.1%
random-access/nested-structs/uniform/lance-tokio-local-disk	2279131 / 2278620 / +0.0%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer	2676877 / 2689430 / -0.5%
random-access/taxi/correlated/lance-tokio-local-disk	758494 / 762070 / -0.5%
random-access/taxi/correlated/lance-tokio-local-disk-footer	2048456 / 2047818 / +0.0%
random-access/taxi/uniform/lance-tokio-local-disk	8046826 / 8089020 / -0.5%
random-access/taxi/uniform/lance-tokio-local-disk-footer	8962544 / 9086096 / -1.4%

ghost · 2026-10-06T17:14:02Z

Benchmarks: Random Access (S3) 📖

Commits: PR 803a0e97 vs base d8fa2b66
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -11.0%
Engines: random-access No clear signal (-11.0%, environment too noisy confidence)
Vortex (geomean): hot 0.934x ➖
Parquet (geomean): hot 1.049x ➖
Shifts: Parquet (control) +4.9% · Median polish +3.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (0.934x ➖, 4↑ 4↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-s3	49953879 / 650447126 / -92.3% 🟢
random-access/feature-vectors/correlated/vortex-tokio-s3-footer	124603763 / 115132908 / +8.2%
random-access/feature-vectors/uniform/vortex-tokio-s3	273433960 / 705724537 / -61.3% 🟢
random-access/feature-vectors/uniform/vortex-tokio-s3-footer	231403433 / 749463203 / -69.1% 🟢
random-access/nested-lists/correlated/vortex-tokio-s3	51334818 / 74843052 / -31.4% 🟢
random-access/nested-lists/correlated/vortex-tokio-s3-footer	92777135 / 115902578 / -20.0%
random-access/nested-lists/uniform/vortex-tokio-s3	160199119 / 164773478 / -2.8%
random-access/nested-lists/uniform/vortex-tokio-s3-footer	201895925 / 199992260 / +1.0%
random-access/nested-structs/correlated/vortex-tokio-s3	299523561 / 142905150 / +109.6% 🔴
random-access/nested-structs/correlated/vortex-tokio-s3-footer	338686256 / 112327737 / +201.5% 🔴
random-access/nested-structs/uniform/vortex-tokio-s3	387894064 / 169650480 / +128.6% 🔴
random-access/nested-structs/uniform/vortex-tokio-s3-footer	505290533 / 213836908 / +136.3% 🔴
random-access/taxi/correlated/vortex-tokio-s3	98201390 / 97255005 / +1.0%
random-access/taxi/correlated/vortex-tokio-s3-footer	151227699 / 132999978 / +13.7%
random-access/taxi/uniform/vortex-tokio-s3	174690239 / 174046970 / +0.4%
random-access/taxi/uniform/vortex-tokio-s3-footer	221937404 / 216418564 / +2.6%
random-access/vortex-tokio-s3	56377296 / 45687179 / +23.4%
random-access/vortex-tokio-s3-footer	94659522 / 86669221 / +9.2%

random-access / parquet / ns (1.049x ➖, 0↑ 1↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-s3	177924170146 / 169526633030 / +5.0%
random-access/feature-vectors/correlated/parquet-tokio-s3-footer	182815598635 / 166385085082 / +9.9%
random-access/feature-vectors/uniform/parquet-tokio-s3	179438236258 / 179674981371 / -0.1%
random-access/feature-vectors/uniform/parquet-tokio-s3-footer	180302433590 / 193914818564 / -7.0%
random-access/nested-lists/correlated/parquet-tokio-s3	1130229090 / 1029776281 / +9.8%
random-access/nested-lists/correlated/parquet-tokio-s3-footer	1127885625 / 1105056331 / +2.1%
random-access/nested-lists/uniform/parquet-tokio-s3	1139042496 / 1031603874 / +10.4%
random-access/nested-lists/uniform/parquet-tokio-s3-footer	1196685843 / 1130565121 / +5.8%
random-access/nested-structs/correlated/parquet-tokio-s3	452905448 / 457398217 / -1.0%
random-access/nested-structs/correlated/parquet-tokio-s3-footer	532927558 / 530433013 / +0.5%
random-access/nested-structs/uniform/parquet-tokio-s3	702272144 / 452114049 / +55.3% 🔴
random-access/nested-structs/uniform/parquet-tokio-s3-footer	532246656 / 541040371 / -1.6%
random-access/parquet-tokio-s3	486047893 / 475918048 / +2.1%
random-access/parquet-tokio-s3-footer	526865217 / 541761194 / -2.7%
random-access/taxi/correlated/parquet-tokio-s3	736623708 / 714938466 / +3.0%
random-access/taxi/correlated/parquet-tokio-s3-footer	849990441 / 783825771 / +8.4%
random-access/taxi/uniform/parquet-tokio-s3	802696343 / 776569559 / +3.4%
random-access/taxi/uniform/parquet-tokio-s3-footer	831509139 / 854798938 / -2.7%

random-access / lance / ns (0.855x ➖, 3↑ 2↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-s3	42560037 / 159502545 / -73.3% 🟢
random-access/feature-vectors/correlated/lance-tokio-s3-footer	208269412 / 260131327 / -19.9%
random-access/feature-vectors/uniform/lance-tokio-s3	225113768 / 241620304 / -6.8%
random-access/feature-vectors/uniform/lance-tokio-s3-footer	361473785 / 419158811 / -13.8%
random-access/lance-tokio-s3	58660828 / 100452149 / -41.6% 🟢
random-access/lance-tokio-s3-footer	245000421 / 272358642 / -10.0%
random-access/nested-lists/correlated/lance-tokio-s3	55110333 / 32799994 / +68.0% 🔴
random-access/nested-lists/correlated/lance-tokio-s3-footer	291601830 / 223738508 / +30.3% 🔴
random-access/nested-lists/uniform/lance-tokio-s3	180768758 / 185357201 / -2.5%
random-access/nested-lists/uniform/lance-tokio-s3-footer	323205254 / 275751460 / +17.2%
random-access/nested-structs/correlated/lance-tokio-s3	47338649 / 54678585 / -13.4%
random-access/nested-structs/correlated/lance-tokio-s3-footer	244982954 / 251710465 / -2.7%
random-access/nested-structs/uniform/lance-tokio-s3	121493441 / 151007257 / -19.5%
random-access/nested-structs/uniform/lance-tokio-s3-footer	306130784 / 321565595 / -4.8%
random-access/taxi/correlated/lance-tokio-s3	59211147 / 80034544 / -26.0%
random-access/taxi/correlated/lance-tokio-s3-footer	259222787 / 290402522 / -10.7%
random-access/taxi/uniform/lance-tokio-s3	226975956 / 327793523 / -30.8% 🟢
random-access/taxi/uniform/lance-tokio-s3-footer	498247426 / 562317285 / -11.4%

VortexError had an enum variant per failure mode and per foreign error type (Arrow, flatbuffers, prost, io, object_store, jiff, ...). Callers rarely branched on the variant, and keeping one per dependency made the type large and the set of variants grow with every new dependency. A VortexError is now a message, an optional source and a backtrace. A foreign error is kept as the source and recovered by downcasting, and context is added in place with with_context. The payload sits behind a single Arc, so VortexError and VortexResult<()> are one pointer wide, which keeps most results in registers on the success path. The error macros take a plain format string, plus the Context: and External: forms. Call sites that used the variant-specific forms now pass a message, and errors that were formatted into new errors now add context instead, so their source and backtrace survive. Tests that matched on a variant now assert on the guard's message. Python raises RuntimeError for every Vortex error, as before. The C API reports VX_ERROR_CODE_OTHER for Vortex errors and VX_ERROR_CODE_PANIC for panics, at their existing values; the other codes are retired, and the C++ ErrorCode mirrors the C enum. Signed-off-by: Robert Kruszewski <github@robertk.io> Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01S7EtMqoZ91rrCCh9vS2yTm

robert3005 added the changelog/break A breaking API change label Sep 26, 2026

robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch from e45d46e to 824bbb4 Compare September 26, 2026 21:33

robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch from 824bbb4 to a36c01c Compare September 26, 2026 22:13

jackylee-ch mentioned this pull request Sep 30, 2026

fix(runend): clip min/max and is_constant to the array's logical window #9960

Closed

robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch 2 times, most recently from 2ee2c82 to 7f17feb Compare October 6, 2026 14:44

joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 6, 2026

github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 6, 2026

robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch 4 times, most recently from 243389b to 957acbb Compare October 12, 2026 12:56

robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch 5 times, most recently from 6478d51 to 59e77bd Compare October 16, 2026 00:06

robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch 7 times, most recently from 0312f9f to 8c8b6c8 Compare October 23, 2026 14:58

robert3005 requested a review from joseph-isaacs October 23, 2026 15:51

robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch 2 times, most recently from f89c6b5 to 3115e2c Compare October 23, 2026 18:46

robert3005 changed the title ~~Reclassify and simplify error types~~ Simplify error types, remove kind from struct Oct 26, 2026

robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch from 3115e2c to be70183 Compare October 26, 2026 13:27

joseph-isaacs approved these changes Oct 26, 2026

View reviewed changes

robert3005 merged commit f3cbb32 into develop Oct 26, 2026

robert3005 deleted the claude/affectionate-keller-4j7w5g branch October 26, 2026 14:00

connortsui20 mentioned this pull request Oct 26, 2026

Tracking Issue: Fix Canonical Decimal #10701

Open

5 of 29 tasks

Conversation

robert3005 commented Sep 26, 2026

Uh oh!

ghost commented Sep 26, 2026 • edited by codspeed Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will regress 19 benchmarks

Performance Changes

Footnotes

Uh oh!

ghost commented Oct 6, 2026 • edited by github-actions Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: PolarSignals Profiling 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: String Encoding 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: FineWeb NVMe 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: FineWeb S3 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: Appian on NVME 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: Clickbench on NVME 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: TPC-DS SF=1 on NVME 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: TPC-H SF=10 on NVME 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: Statistical and Population Genetics 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: Compression 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: TPC-H SF=1 on S3 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: TPC-H SF=10 on S3 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: Random Access 📖

Uh oh!

ghost commented Oct 6, 2026

Benchmarks: Random Access (S3) 📖

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

ghost commented Sep 26, 2026 •

edited by codspeed Bot

Loading

ghost commented Oct 6, 2026 •

edited by github-actions Bot

Loading