Move panic case in vortex_expect/bail/ensure to a cold handler by myrrc · Pull Request #9903 · vortex-data/vortex

myrrc · 2026-09-16T10:09:04Z

vortex_ensure/bail/expect macros are inlined. This means caller function
gets a branch with creating the backtrace and throwing a panic. This in turn
makes LLVM inliner see the function as not inline-eligible.

Moving panic handler to a separate cold and inline-never function makes sure
we inline the happy part only. As a result, we generate less unwind tables.

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>

codspeed · 2026-09-16T10:16:53Z

Merging this PR will regress 1 benchmark

⚠️

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️

Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 49 improved benchmarks
❌ 1 regressed benchmark
✅ 2152 untouched benchmarks
⏩ 218 skipped benchmarks¹

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
❌	WallTime	`dict_canonicalize_gt_u8_neon[1000000]`	488.1 µs	573.3 µs	-14.87%
⚡	Simulation	`slice_vortex_buffer`	6.6 µs	3.4 µs	+95.9%
⚡	WallTime	`filtered_sink_i64_avx2[OneNullInEight]`	31.3 µs	21.9 µs	+42.99%
⚡	WallTime	`filtered_sink_i64_avx512[OneNullInEight]`	31.9 µs	22.8 µs	+40.23%
⚡	Simulation	`runend_decompress_u32`	241.8 µs	177 µs	+36.58%
⚡	Simulation	`decode_bool[10000_2_all_false]`	223.8 µs	175.7 µs	+27.35%
⚡	Simulation	`decode_bool[10000_2_all_true]`	223.2 µs	175.7 µs	+27.05%
⚡	Simulation	`decode_bool[10000_2_mostly_true]`	230.8 µs	182.7 µs	+26.35%
⚡	Simulation	`decode_bool[10000_2_mostly_false]`	231.3 µs	183.3 µs	+26.16%
⚡	Simulation	`decompress[u16, (10000, 4)]`	199 µs	158.9 µs	+25.22%
⚡	Simulation	`allocate_drop_bytes[0]`	575.7 ns	466 ns	+23.54%
⚡	Simulation	`decode_bool[10000_2_alternating]`	260.8 µs	213.5 µs	+22.15%
⚡	Simulation	`decode_bool[10000_10_all_true]`	59.1 µs	48.4 µs	+22.07%
⚡	Simulation	`decode_bool[10000_10_all_false]`	59.8 µs	49.2 µs	+21.49%
⚡	WallTime	`filtered_sink_i64_avx2[NineNullsInTen]`	18.2 µs	14.9 µs	+21.48%
⚡	Simulation	`slice_empty_tight_loop_vortex`	41.2 µs	34 µs	+21.15%
⚡	Simulation	`new_raw_prim_test_between[i32, 2048]`	77.7 µs	64.1 µs	+21.11%
⚡	Simulation	`null_count_run_end[(32000, 4, 0.01)]`	433.7 µs	359.8 µs	+20.54%
⚡	WallTime	`arrow_checked_add_u32_avx2[16384]`	21.3 µs	17.7 µs	+20.53%
⚡	Simulation	`decode_bool[10000_10_mostly_true]`	61.7 µs	51.3 µs	+20.4%
...	...	...	...	...	...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

_{Comparing myrrc/vortex-panics-cold (b02ec9e) with develop (4af09a9)}

218 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

joseph-isaacs · 2026-09-16T10:25:33Z

Thats a lot of codspeed regressions?

Also a load of wins. Want to comment

github-actions · 2026-09-16T10:39:50Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`071bb91`	tpch-nvme-10	2	Explore Profiling Data
🟢 Done	`071bb91`	statpopgen	1	Explore Profiling Data
🟢 Done	`071bb91`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`071bb91`	tpch-s3-10	1	Explore Profiling Data
🟢 Done	`071bb91`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`071bb91`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`071bb91`	fineweb	1	Explore Profiling Data
🟢 Done	`071bb91`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`071bb91`	random-access-bench	1	Explore Profiling Data
🟢 Done	`071bb91`	polarsignals	1	Explore Profiling Data
🟢 Done	`071bb91`	appian-nvme	1	Explore Profiling Data
🟢 Done	`071bb91`	tpch-s3	1	Explore Profiling Data
🟢 Done	`071bb91`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`071bb91`	string-bench	1	Explore Profiling Data
🟢 Done	`071bb91`	compress-bench	2	Explore Profiling Data

Previous Runs (2)

Status	Commit	Job	Attempt	Link
🟢 Done	`071bb91`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`071bb91`	compress-bench	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-09-16T10:42:42Z

Benchmarks: String Encoding 📖

Commits: PR 071bb91b vs base 4af09a94

vortex / vortex-file-compressed / ms (0.988x ➖, 0↑ 0↓)

name	ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst	32.202424 / 32.311857 / -0.3%
read/clickbench/URL/shard-0/onpair-12	19.882853 / 20.201298 / -1.6%
read/tpch/l_comment/fsst	53.423542 / 53.622365 / -0.4%
read/tpch/l_comment/onpair-12	49.208185 / 49.411338 / -0.4%
write/clickbench/URL/shard-0/fsst	592.075509 / 595.930239 / -0.6%
write/clickbench/URL/shard-0/onpair-12	991.157479 / 1051.47231 / -5.7%
write/tpch/l_comment/fsst	1995.95668 / 2003.34102 / -0.4%
write/tpch/l_comment/onpair-12	2205.52098 / 2203.87489 / +0.1%

vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)

name	% (PR / base / %diff)
size/clickbench/URL/shard-0/fsst	47.3999586 / 47.3999586 / +0.0%
size/clickbench/URL/shard-0/onpair-12	30.225605 / 30.225605 / +0.0%
size/tpch/l_comment/fsst	30.5819725 / 30.5819725 / +0.0%
size/tpch/l_comment/onpair-12	25.8644092 / 25.8644092 / +0.0%

github-actions · 2026-09-16T10:43:39Z

Benchmarks: PolarSignals Profiling 📖

Commits: PR 071bb91b vs base 4af09a94
Vortex (geomean): hot 1.002x ➖ · cold 0.994x ➖

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed	45602270 / 45381017 / +0.5%	93305831 / 91100623 / +2.4%	0.49 / 0.50 / -1.9%
polarsignals_q01/datafusion:vortex-file-compressed	50943660 / 50610046 / +0.7%	118175163 / 121765129 / -2.9%	0.43 / 0.42 / +3.7%
polarsignals_q02/datafusion:vortex-file-compressed	35199127 / 35173668 / +0.1%	81242946 / 80762576 / +0.6%	0.43 / 0.44 / -0.5%
polarsignals_q03/datafusion:vortex-file-compressed	53626158 / 53832968 / -0.4%	120454743 / 118301114 / +1.8%	0.45 / 0.46 / -2.2%
polarsignals_q04/datafusion:vortex-file-compressed	9589198 / 9551218 / +0.4%	51853713 / 51687702 / +0.3%	0.18 / 0.18 / +0.1%
polarsignals_q05/datafusion:vortex-file-compressed	11699494 / 11744132 / -0.4%	54016201 / 55955051 / -3.5%	0.22 / 0.21 / +3.2%
polarsignals_q06/datafusion:vortex-file-compressed	20939760 / 21392610 / -2.1%	62854797 / 64149490 / -2.0%	0.33 / 0.33 / -0.1%
polarsignals_q07/datafusion:vortex-file-compressed	11437545 / 11040903 / +3.6%	56680867 / 56321698 / +0.6%	0.20 / 0.20 / +2.9%
polarsignals_q08/datafusion:vortex-file-compressed	99124580 / 98177506 / +1.0%	163683346 / 166865899 / -1.9%	0.61 / 0.59 / +2.9%
polarsignals_q09/datafusion:vortex-file-compressed	10036656 / 10137440 / -1.0%	52230112 / 52882122 / -1.2%	0.19 / 0.19 / +0.2%

No file size changes detected.

github-actions · 2026-09-16T10:43:39Z

Benchmarks: Compression 📖

Commits: PR 071bb91b vs base 4af09a94

vortex / vortex-file-compressed / ns (0.978x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
compress time/Arade	859355723 / 889645234 / -3.4%
compress time/Bimbo	3829757597 / 3985650885 / -3.9%
compress time/CMSprovider	2961511400 / 3024899463 / -2.1%
compress time/Euro2016	312998071 / 316158873 / -1.0%
compress time/Food	310019264 / 313337768 / -1.1%
compress time/HashTags	550647563 / 566837331 / -2.9%
compress time/TPC-H l_comment canonical	774328964 / 780701391 / -0.8%
compress time/TPC-H l_comment chunked	777329476 / 782002459 / -0.6%
compress time/taxi	421264237 / 432906631 / -2.7%
compress time/wide table cols=100 chunks=1 rows=1000	7285141 / 7178694 / +1.5%
compress time/wide table cols=100 chunks=50 rows=1000	7179884 / 7155805 / +0.3%
compress time/wide table cols=1000 chunks=1 rows=1000	70593227 / 72005542 / -2.0%
compress time/wide table cols=1000 chunks=50 rows=1000	71044754 / 70689000 / +0.5%
compress time/wide table cols=10000 chunks=1 rows=1000	765812449 / 810434427 / -5.5%
compress time/wide table cols=10000 chunks=50 rows=1000	776630297 / 794651752 / -2.3%
decompress time/Arade	8972252 / 9582739 / -6.4%
decompress time/Bimbo	59406047 / 61981948 / -4.2%
decompress time/CMSprovider	26585269 / 26236635 / +1.3%
decompress time/Euro2016	7196969 / 7343035 / -2.0%
decompress time/Food	2635643 / 2861426 / -7.9%
decompress time/HashTags	58065663 / 60146130 / -3.5%
decompress time/TPC-H l_comment canonical	20390275 / 22506474 / -9.4%
decompress time/TPC-H l_comment chunked	21145076 / 22335588 / -5.3%
decompress time/taxi	8449595 / 8604316 / -1.8%
decompress time/wide table cols=100 chunks=1 rows=1000	2038173 / 2026739 / +0.6%
decompress time/wide table cols=100 chunks=50 rows=1000	2055306 / 2050527 / +0.2%
decompress time/wide table cols=1000 chunks=1 rows=1000	19568223 / 19776279 / -1.1%
decompress time/wide table cols=1000 chunks=50 rows=1000	19683328 / 19835418 / -0.8%
decompress time/wide table cols=10000 chunks=1 rows=1000	227292883 / 233057127 / -2.5%
decompress time/wide table cols=10000 chunks=50 rows=1000	235264114 / 229244822 / +2.6%

vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
vortex-file-compressed size/Arade	142210524 / 142210524 / +0.0%
vortex-file-compressed size/Bimbo	458475220 / 458475220 / +0.0%
vortex-file-compressed size/CMSprovider	420650636 / 420650636 / +0.0%
vortex-file-compressed size/Euro2016	164038340 / 164038340 / +0.0%
vortex-file-compressed size/Food	38946488 / 38946488 / +0.0%
vortex-file-compressed size/HashTags	190336420 / 190336420 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical	179845160 / 179845160 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked	179845160 / 179845160 / +0.0%
vortex-file-compressed size/taxi	50116916 / 50116916 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000	932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000	932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000	9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000	9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000	93117680 / 93117680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000	93117680 / 93117680 / +0.0%

vortex / vortex-file-compressed / ratio (0.988x ➖, 0↑ 0↓)

name	ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade	0.382515777 / 0.395855224 / -3.4%
vortex:parquet-zstd ratio compress time/Bimbo	0.323784689 / 0.338141309 / -4.2%
vortex:parquet-zstd ratio compress time/CMSprovider	0.463210282 / 0.473549123 / -2.2%
vortex:parquet-zstd ratio compress time/Euro2016	0.290312956 / 0.292924431 / -0.9%
vortex:parquet-zstd ratio compress time/Food	0.418299475 / 0.423144378 / -1.1%
vortex:parquet-zstd ratio compress time/HashTags	0.301222897 / 0.310108955 / -2.9%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical	0.294410655 / 0.297148317 / -0.9%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked	0.295112616 / 0.297478211 / -0.8%
vortex:parquet-zstd ratio compress time/taxi	0.387712212 / 0.396429031 / -2.2%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000	1.84985158 / 1.81307851 / +2.0%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000	1.84091376 / 1.8224613 / +1.0%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000	1.59590937 / 1.61560133 / -1.2%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000	1.60059547 / 1.57106109 / +1.9%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000	1.69120996 / 1.73541619 / -2.5%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000	1.69877516 / 1.72257437 / -1.4%
vortex:parquet-zstd ratio decompress time/Arade	0.0160211007 / 0.0171891556 / -6.8%
vortex:parquet-zstd ratio decompress time/Bimbo	0.0367256038 / 0.0385079099 / -4.6%
vortex:parquet-zstd ratio decompress time/CMSprovider	0.0194473142 / 0.01924349 / +1.1%
vortex:parquet-zstd ratio decompress time/Euro2016	0.0215154536 / 0.022003514 / -2.2%
vortex:parquet-zstd ratio decompress time/Food	0.0154208607 / 0.016835784 / -8.4%
vortex:parquet-zstd ratio decompress time/HashTags	0.112342666 / 0.116566624 / -3.6%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical	0.0411256598 / 0.0452173352 / -9.0%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked	0.0426247915 / 0.0447118315 / -4.7%
vortex:parquet-zstd ratio decompress time/taxi	0.0387237698 / 0.0395569166 / -2.1%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000	1.00050708 / 0.972484314 / +2.9%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000	1.00159744 / 1.0028503 / -0.1%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000	0.839778608 / 0.83219638 / +0.9%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000	0.842292792 / 0.843770227 / -0.2%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000	0.930577613 / 0.949525076 / -2.0%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000	0.971051956 / 0.941392588 / +3.2%
vortex:parquet-zstd size/Arade	0.55117307 / 0.55117307 / -0.0%
vortex:parquet-zstd size/Bimbo	1.19233967 / 1.19233967 / -0.0%
vortex:parquet-zstd size/CMSprovider	1.11611602 / 1.11611602 / -0.0%
vortex:parquet-zstd size/Euro2016	1.33387224 / 1.33387224 / -0.0%
vortex:parquet-zstd size/Food	1.09095332 / 1.09095332 / +0.0%
vortex:parquet-zstd size/HashTags	1.42576671 / 1.42576671 / +0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical	1.13568553 / 1.13568553 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked	1.13568553 / 1.13568553 / -0.0%
vortex:parquet-zstd size/taxi	0.906541619 / 0.906541619 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000	1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000	1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000	0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000	0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000	0.998688074 / 0.998688074 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000	0.998688074 / 0.998688074 / -0.0%

vortex / parquet / ns (0.996x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade	2246588964 / 2247400516 / -0.0%
parquet_rs-zstd compress time/Bimbo	11828099759 / 11786938707 / +0.3%
parquet_rs-zstd compress time/CMSprovider	6393449192 / 6387720550 / +0.1%
parquet_rs-zstd compress time/Euro2016	1078140210 / 1079318895 / -0.1%
parquet_rs-zstd compress time/Food	741141892 / 740498478 / +0.1%
parquet_rs-zstd compress time/HashTags	1828040196 / 1827865083 / +0.0%
parquet_rs-zstd compress time/TPC-H l_comment canonical	2630098305 / 2627312172 / +0.1%
parquet_rs-zstd compress time/TPC-H l_comment chunked	2634009641 / 2628772229 / +0.2%
parquet_rs-zstd compress time/taxi	1086538480 / 1092015460 / -0.5%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000	3938230 / 3959395 / -0.5%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000	3900174 / 3926451 / -0.7%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000	44233857 / 44568880 / -0.8%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000	44386452 / 44994431 / -1.4%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000	452819264 / 466997157 / -3.0%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000	457170740 / 461316369 / -0.9%
parquet_rs-zstd decompress time/Arade	560027188 / 557487479 / +0.5%
parquet_rs-zstd decompress time/Bimbo	1617564881 / 1609590035 / +0.5%
parquet_rs-zstd decompress time/CMSprovider	1367040646 / 1363403154 / +0.3%
parquet_rs-zstd decompress time/Euro2016	334502314 / 333721014 / +0.2%
parquet_rs-zstd decompress time/Food	170914131 / 169960959 / +0.6%
parquet_rs-zstd decompress time/HashTags	516862072 / 515980713 / +0.2%
parquet_rs-zstd decompress time/TPC-H l_comment canonical	495804203 / 497739946 / -0.4%
parquet_rs-zstd decompress time/TPC-H l_comment chunked	496074591 / 499545361 / -0.7%
parquet_rs-zstd decompress time/taxi	218201767 / 217517358 / +0.3%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000	2037140 / 2084084 / -2.3%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000	2052028 / 2044699 / +0.4%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000	23301645 / 23763957 / -1.9%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000	23368748 / 23508080 / -0.6%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000	244249249 / 245445995 / -0.5%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000	242277576 / 243516706 / -0.5%

vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
parquet size/Arade	258014282 / 258014282 / +0.0%
parquet size/Bimbo	384517292 / 384517292 / +0.0%
parquet size/CMSprovider	376887911 / 376887911 / +0.0%
parquet size/Euro2016	122979049 / 122979049 / +0.0%
parquet size/Food	35699500 / 35699500 / +0.0%
parquet size/HashTags	133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical	158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked	158358238 / 158358238 / +0.0%
parquet size/taxi	55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000	932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000	932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000	9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000	9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000	93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000	93240004 / 93240004 / +0.0%

vortex / arrow-ipc / ns (0.968x ➖, 3↑ 0↓)

name	ns (PR / base / %diff)
arrow-ipc compress time/Arade	99670223 / 101113767 / -1.4%
arrow-ipc compress time/Bimbo	618086627 / 631607474 / -2.1%
arrow-ipc compress time/CMSprovider	383193246 / 386311204 / -0.8%
arrow-ipc compress time/Euro2016	38464186 / 38712347 / -0.6%
arrow-ipc compress time/Food	33906536 / 34334523 / -1.2%
arrow-ipc compress time/HashTags	78503120 / 79340729 / -1.1%
arrow-ipc compress time/TPC-H l_comment canonical	495957670 / 521431883 / -4.9%
arrow-ipc compress time/TPC-H l_comment chunked	501350343 / 506553289 / -1.0%
arrow-ipc compress time/taxi	74819565 / 75281827 / -0.6%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000	204106 / 212528 / -4.0%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000	201933 / 205762 / -1.9%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000	2240911 / 2265021 / -1.1%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000	2220627 / 2263067 / -1.9%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000	25554269 / 25863321 / -1.2%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000	25500228 / 25867432 / -1.4%
arrow-ipc decompress time/Arade	139908745 / 140882408 / -0.7%
arrow-ipc decompress time/Bimbo	407265656 / 410356220 / -0.8%
arrow-ipc decompress time/CMSprovider	471750131 / 583531090 / -19.2% 🟢
arrow-ipc decompress time/Euro2016	63753697 / 74640880 / -14.6% 🟢
arrow-ipc decompress time/Food	51120316 / 48929518 / +4.5%
arrow-ipc decompress time/HashTags	119476524 / 142947437 / -16.4% 🟢
arrow-ipc decompress time/TPC-H l_comment canonical	540057026 / 534158525 / +1.1%
arrow-ipc decompress time/TPC-H l_comment chunked	540476793 / 534294043 / +1.2%
arrow-ipc decompress time/taxi	45213769 / 45280892 / -0.1%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000	319739 / 321793 / -0.6%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000	320009 / 318330 / +0.5%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000	3440850 / 3578889 / -3.9%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000	3443527 / 3659926 / -5.9%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000	35187374 / 37853651 / -7.0%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000	34826261 / 36698270 / -5.1%

vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
arrow-ipc size/Arade	691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo	3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider	2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016	360582666 / 360582666 / +0.0%
arrow-ipc size/Food	255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags	704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical	4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked	4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi	482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000	1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000	1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000	12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000	12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000	125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000	125752506 / 125752506 / +0.0%

github-actions · 2026-09-16T10:44:28Z

Benchmarks: FineWeb NVMe 📖

Commits: PR 071bb91b vs base 4af09a94
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+2.6%, low confidence) · DuckDB No clear signal (-2.3%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 0.963x ➖
Parquet (geomean): hot 1.006x ➖ · cold 1.001x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	6788896 / 6759654 / +0.4%	20425658 / 19617796 / +4.1%	0.33 / 0.34 / -3.5%
fineweb_q01/datafusion:vortex-file-compressed	11331568 / 11293262 / +0.3%	51766589 / 49898971 / +3.7%	0.22 / 0.23 / -3.3%
fineweb_q02/datafusion:vortex-file-compressed	12305798 / 12860760 / -4.3%	57603032 / 56854792 / +1.3%	0.21 / 0.23 / -5.6%
fineweb_q03/datafusion:vortex-file-compressed	18851959 / 19100668 / -1.3%	104390535 / 106197174 / -1.7%	0.18 / 0.18 / +0.4%
fineweb_q04/datafusion:vortex-file-compressed	72829658 / 74006248 / -1.6%	155996114 / 158750737 / -1.7%	0.47 / 0.47 / +0.1%
fineweb_q05/datafusion:vortex-file-compressed	56355020 / 57812006 / -2.5%	136565830 / 135863808 / +0.5%	0.41 / 0.43 / -3.0%
fineweb_q06/datafusion:vortex-file-compressed	19678074 / 18912940 / +4.0%	108004543 / 111328997 / -3.0%	0.18 / 0.17 / +7.2%
fineweb_q07/datafusion:vortex-file-compressed	17910988 / 16788046 / +6.7%	100742730 / 101571562 / -0.8%	0.18 / 0.17 / +7.6%
fineweb_q08/datafusion:vortex-file-compressed	10582418 / 11161018 / -5.2%	46391386 / 44908314 / +3.3%	0.23 / 0.25 / -8.2%

datafusion / vortex-compact / ns (1.062x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	6924985 / 6858190 / +1.0%	19002972 / 20328085 / -6.5%	0.36 / 0.34 / +8.0%
fineweb_q01/datafusion:vortex-compact	75549246 / 44417328 / +70.1% 🔴	81776109 / 80321283 / +1.8%	0.92 / 0.55 / +67.1%
fineweb_q02/datafusion:vortex-compact	44530634 / 44091854 / +1.0%	81292472 / 83305408 / -2.4%	0.55 / 0.53 / +3.5%
fineweb_q03/datafusion:vortex-compact	157360534 / 156125994 / +0.8%	229045689 / 228475014 / +0.2%	0.69 / 0.68 / +0.5%
fineweb_q04/datafusion:vortex-compact	176167274 / 162920041 / +8.1%	253251417 / 251691739 / +0.6%	0.70 / 0.65 / +7.5%
fineweb_q05/datafusion:vortex-compact	155864529 / 155659814 / +0.1%	237364119 / 237412261 / -0.0%	0.66 / 0.66 / +0.2%
fineweb_q06/datafusion:vortex-compact	88767221 / 87528428 / +1.4%	165593097 / 165578732 / +0.0%	0.54 / 0.53 / +1.4%
fineweb_q07/datafusion:vortex-compact	87401168 / 89829150 / -2.7%	154179297 / 158243483 / -2.6%	0.57 / 0.57 / -0.1%
fineweb_q08/datafusion:vortex-compact	8978938 / 9750077 / -7.9%	44167554 / 44065033 / +0.2%	0.20 / 0.22 / -8.1%

datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	9456301 / 9492922 / -0.4%	34272402 / 33641090 / +1.9%	0.28 / 0.28 / -2.2%
fineweb_q01/datafusion:parquet	70664527 / 69803484 / +1.2%	154658259 / 152836623 / +1.2%	0.46 / 0.46 / +0.0%
fineweb_q02/datafusion:parquet	70980481 / 69228928 / +2.5%	156065068 / 158234183 / -1.4%	0.45 / 0.44 / +4.0%
fineweb_q03/datafusion:parquet	70756542 / 69805786 / +1.4%	148780459 / 151465263 / -1.8%	0.48 / 0.46 / +3.2%
fineweb_q04/datafusion:parquet	76823350 / 76679130 / +0.2%	156356105 / 157453099 / -0.7%	0.49 / 0.49 / +0.9%
fineweb_q05/datafusion:parquet	74981315 / 75765328 / -1.0%	152086510 / 156998954 / -3.1%	0.49 / 0.48 / +2.2%
fineweb_q06/datafusion:parquet	70791370 / 70603286 / +0.3%	157207743 / 156561016 / +0.4%	0.45 / 0.45 / -0.1%
fineweb_q07/datafusion:parquet	69178149 / 68648484 / +0.8%	150927682 / 152784580 / -1.2%	0.46 / 0.45 / +2.0%
fineweb_q08/datafusion:parquet	68653797 / 70411274 / -2.5%	150080002 / 154528443 / -2.9%	0.46 / 0.46 / +0.4%

duckdb / vortex-file-compressed / ns (1.066x ➖, 2↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	1994873 / 1871824 / +6.6%	4891324 / 7667463 / -36.2% 🟢	0.41 / 0.24 / +67.1%
fineweb_q01/duckdb:vortex-file-compressed	19896410 / 15682571 / +26.9% 🔴	56357088 / 63549020 / -11.3% 🟢	0.35 / 0.25 / +43.1%
fineweb_q02/duckdb:vortex-file-compressed	20759048 / 13327836 / +55.8% 🔴	53439022 / 37153498 / +43.8% 🔴	0.39 / 0.36 / +8.3%
fineweb_q03/duckdb:vortex-file-compressed	26327134 / 31565279 / -16.6% 🟢	119825633 / 131179001 / -8.7%	0.22 / 0.24 / -8.7%
fineweb_q04/duckdb:vortex-file-compressed	74088260 / 84565560 / -12.4% 🟢	118508217 / 174361108 / -32.0% 🟢	0.63 / 0.49 / +28.9%
fineweb_q05/duckdb:vortex-file-compressed	61864612 / 65102033 / -5.0%	109555347 / 140924331 / -22.3% 🟢	0.56 / 0.46 / +22.2%
fineweb_q06/duckdb:vortex-file-compressed	49761451 / 41984528 / +18.5% 🔴	156799949 / 134032710 / +17.0% 🔴	0.32 / 0.31 / +1.3%
fineweb_q07/duckdb:vortex-file-compressed	27147260 / 27430071 / -1.0%	103763557 / 97467228 / +6.5%	0.26 / 0.28 / -7.0%
fineweb_q08/duckdb:vortex-file-compressed	6643202 / 6428539 / +3.3%	13337470 / 13547161 / -1.5%	0.50 / 0.47 / +5.0%

duckdb / vortex-compact / ns (0.911x ➖, 4↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	2094896 / 3113506 / -32.7% 🟢	5511177 / 5134495 / +7.3%	0.38 / 0.61 / -37.3%
fineweb_q01/duckdb:vortex-compact	45029498 / 52020203 / -13.4% 🟢	69395221 / 94314063 / -26.4% 🟢	0.65 / 0.55 / +17.6%
fineweb_q02/duckdb:vortex-compact	50650676 / 58490000 / -13.4% 🟢	90254547 / 90632003 / -0.4%	0.56 / 0.65 / -13.0%
fineweb_q03/duckdb:vortex-compact	185817838 / 186095217 / -0.1%	236404928 / 291269815 / -18.8% 🟢	0.79 / 0.64 / +23.0%
fineweb_q04/duckdb:vortex-compact	186876777 / 186991938 / -0.1%	251078425 / 242378559 / +3.6%	0.74 / 0.77 / -3.5%
fineweb_q05/duckdb:vortex-compact	179803649 / 182865062 / -1.7%	216473850 / 206738228 / +4.7%	0.83 / 0.88 / -6.1%
fineweb_q06/duckdb:vortex-compact	91839136 / 92687772 / -0.9%	155836504 / 154021065 / +1.2%	0.59 / 0.60 / -2.1%
fineweb_q07/duckdb:vortex-compact	99822362 / 98807109 / +1.0%	160895869 / 193490803 / -16.8% 🟢	0.62 / 0.51 / +21.5%
fineweb_q08/duckdb:vortex-compact	6242566 / 7161810 / -12.8% 🟢	12330513 / 12829642 / -3.9%	0.51 / 0.56 / -9.3%

duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	23492804 / 21968367 / +6.9%	25804264 / 23021262 / +12.1% 🔴	0.91 / 0.95 / -4.6%
fineweb_q01/duckdb:parquet	45024312 / 44682576 / +0.8%	55246437 / 53296232 / +3.7%	0.81 / 0.84 / -2.8%
fineweb_q02/duckdb:parquet	43693940 / 43710293 / -0.0%	52981888 / 59084523 / -10.3% 🟢	0.82 / 0.74 / +11.5%
fineweb_q03/duckdb:parquet	95781372 / 95489717 / +0.3%	197069716 / 187412342 / +5.2%	0.49 / 0.51 / -4.6%
fineweb_q04/duckdb:parquet	151589964 / 152667892 / -0.7%	214855256 / 200294499 / +7.3%	0.71 / 0.76 / -7.4%
fineweb_q05/duckdb:parquet	144107996 / 143056942 / +0.7%	194343450 / 193987367 / +0.2%	0.74 / 0.74 / +0.6%
fineweb_q06/duckdb:parquet	71288388 / 71631344 / -0.5%	128570782 / 128611629 / -0.0%	0.55 / 0.56 / -0.4%
fineweb_q07/duckdb:parquet	72290842 / 71945878 / +0.5%	158310864 / 147799176 / +7.1%	0.46 / 0.49 / -6.2%
fineweb_q08/duckdb:parquet	24234462 / 24262412 / -0.1%	24645838 / 28280698 / -12.9% 🟢	0.98 / 0.86 / +14.6%

No file size changes detected.

github-actions · 2026-09-16T10:45:08Z

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 071bb91b vs base 4af09a94
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.011x ➖
Parquet (geomean): hot 1.009x ➖ · cold 1.022x ➖
Shifts: Parquet (control) +0.9% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	16706211 / 16804508 / -0.6%	47939128 / 44446714 / +7.9%	0.35 / 0.38 / -7.8%
tpch_q02/datafusion:vortex-file-compressed	17269650 / 17606707 / -1.9%	36414475 / 36087509 / +0.9%	0.47 / 0.49 / -2.8%
tpch_q03/datafusion:vortex-file-compressed	19560542 / 19350620 / +1.1%	48635269 / 46629322 / +4.3%	0.40 / 0.41 / -3.1%
tpch_q04/datafusion:vortex-file-compressed	10009971 / 10285385 / -2.7%	32784452 / 31456926 / +4.2%	0.31 / 0.33 / -6.6%
tpch_q05/datafusion:vortex-file-compressed	36999675 / 37065955 / -0.2%	66501157 / 64064838 / +3.8%	0.56 / 0.58 / -3.8%
tpch_q06/datafusion:vortex-file-compressed	6388394 / 6208312 / +2.9%	31857947 / 28006363 / +13.8% 🔴	0.20 / 0.22 / -9.5%
tpch_q07/datafusion:vortex-file-compressed	51916234 / 51678381 / +0.5%	81447881 / 81494122 / -0.1%	0.64 / 0.63 / +0.5%
tpch_q08/datafusion:vortex-file-compressed	52081720 / 52521106 / -0.8%	82931914 / 81533777 / +1.7%	0.63 / 0.64 / -2.5%
tpch_q09/datafusion:vortex-file-compressed	49696255 / 49989656 / -0.6%	77722721 / 80159567 / -3.0%	0.64 / 0.62 / +2.5%
tpch_q10/datafusion:vortex-file-compressed	17216811 / 17108879 / +0.6%	52479676 / 48266558 / +8.7%	0.33 / 0.35 / -7.4%
tpch_q11/datafusion:vortex-file-compressed	15139064 / 15156821 / -0.1%	34086257 / 32943560 / +3.5%	0.44 / 0.46 / -3.5%
tpch_q12/datafusion:vortex-file-compressed	22724365 / 22614685 / +0.5%	47586597 / 44361495 / +7.3%	0.48 / 0.51 / -6.3%
tpch_q13/datafusion:vortex-file-compressed	19702238 / 20122145 / -2.1%	41072158 / 38953237 / +5.4%	0.48 / 0.52 / -7.1%
tpch_q14/datafusion:vortex-file-compressed	15516776 / 15382660 / +0.9%	41093507 / 38824855 / +5.8%	0.38 / 0.40 / -4.7%
tpch_q15/datafusion:vortex-file-compressed	18757144 / 18698538 / +0.3%	47689755 / 45179364 / +5.6%	0.39 / 0.41 / -5.0%
tpch_q16/datafusion:vortex-file-compressed	18536949 / 18886732 / -1.9%	37645377 / 36652984 / +2.7%	0.49 / 0.52 / -4.4%
tpch_q17/datafusion:vortex-file-compressed	28013848 / 28639988 / -2.2%	59308858 / 56591431 / +4.8%	0.47 / 0.51 / -6.7%
tpch_q18/datafusion:vortex-file-compressed	36625452 / 37151842 / -1.4%	57912325 / 57140035 / +1.4%	0.63 / 0.65 / -2.7%
tpch_q19/datafusion:vortex-file-compressed	13662140 / 13438535 / +1.7%	38081243 / 35917301 / +6.0%	0.36 / 0.37 / -4.1%
tpch_q20/datafusion:vortex-file-compressed	21144734 / 20747367 / +1.9%	43696211 / 44111584 / -0.9%	0.48 / 0.47 / +2.9%
tpch_q21/datafusion:vortex-file-compressed	39136094 / 39569494 / -1.1%	67930792 / 67069351 / +1.3%	0.58 / 0.59 / -2.3%
tpch_q22/datafusion:vortex-file-compressed	11327735 / 11312798 / +0.1%	32324591 / 30295601 / +6.7%	0.35 / 0.37 / -6.2%

datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	17713193 / 16992021 / +4.2%	44968673 / 41563349 / +8.2%	0.39 / 0.41 / -3.6%
tpch_q02/datafusion:vortex-compact	19976813 / 19499896 / +2.4%	37649431 / 36665080 / +2.7%	0.53 / 0.53 / -0.2%
tpch_q03/datafusion:vortex-compact	20434455 / 20011269 / +2.1%	48007942 / 46926478 / +2.3%	0.43 / 0.43 / -0.2%
tpch_q04/datafusion:vortex-compact	11798544 / 11951401 / -1.3%	31362209 / 30880875 / +1.6%	0.38 / 0.39 / -2.8%
tpch_q05/datafusion:vortex-compact	38065158 / 37371086 / +1.9%	67341107 / 63888839 / +5.4%	0.57 / 0.58 / -3.4%
tpch_q06/datafusion:vortex-compact	6730891 / 6864146 / -1.9%	28565422 / 27640223 / +3.3%	0.24 / 0.25 / -5.1%
tpch_q07/datafusion:vortex-compact	52437535 / 53000347 / -1.1%	80693682 / 72073935 / +12.0% 🔴	0.65 / 0.74 / -11.6%
tpch_q08/datafusion:vortex-compact	53190584 / 53391653 / -0.4%	85488222 / 82203182 / +4.0%	0.62 / 0.65 / -4.2%
tpch_q09/datafusion:vortex-compact	51231395 / 50626565 / +1.2%	75134112 / 75397631 / -0.3%	0.68 / 0.67 / +1.5%
tpch_q10/datafusion:vortex-compact	19492668 / 19282171 / +1.1%	49348173 / 45672137 / +8.0%	0.40 / 0.42 / -6.4%
tpch_q11/datafusion:vortex-compact	16046769 / 16100358 / -0.3%	34631371 / 34296217 / +1.0%	0.46 / 0.47 / -1.3%
tpch_q12/datafusion:vortex-compact	24302380 / 24895985 / -2.4%	46202752 / 47757632 / -3.3%	0.53 / 0.52 / +0.9%
tpch_q13/datafusion:vortex-compact	20928032 / 20866062 / +0.3%	42586430 / 37757514 / +12.8% 🔴	0.49 / 0.55 / -11.1%
tpch_q14/datafusion:vortex-compact	16425336 / 16401022 / +0.1%	41760008 / 40879868 / +2.2%	0.39 / 0.40 / -2.0%
tpch_q15/datafusion:vortex-compact	20266502 / 20134244 / +0.7%	46648248 / 45469023 / +2.6%	0.43 / 0.44 / -1.9%
tpch_q16/datafusion:vortex-compact	19268418 / 19348997 / -0.4%	39523678 / 36792414 / +7.4%	0.49 / 0.53 / -7.3%
tpch_q17/datafusion:vortex-compact	29158369 / 28619075 / +1.9%	58097907 / 55827126 / +4.1%	0.50 / 0.51 / -2.1%
tpch_q18/datafusion:vortex-compact	37818820 / 37860212 / -0.1%	60142439 / 55910825 / +7.6%	0.63 / 0.68 / -7.1%
tpch_q19/datafusion:vortex-compact	16714735 / 16625507 / +0.5%	41201262 / 40292301 / +2.3%	0.41 / 0.41 / -1.7%
tpch_q20/datafusion:vortex-compact	21952870 / 22394482 / -2.0%	45377514 / 43823892 / +3.5%	0.48 / 0.51 / -5.3%
tpch_q21/datafusion:vortex-compact	41654683 / 41837318 / -0.4%	70506906 / 67121545 / +5.0%	0.59 / 0.62 / -5.2%
tpch_q22/datafusion:vortex-compact	11699911 / 12222179 / -4.3%	32155617 / 30634512 / +5.0%	0.36 / 0.40 / -8.8%

datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	67120882 / 67078352 / +0.1%	86847659 / 81294213 / +6.8%	0.77 / 0.83 / -6.3%
tpch_q02/datafusion:parquet	54146460 / 53893084 / +0.5%	70273852 / 69906082 / +0.5%	0.77 / 0.77 / -0.1%
tpch_q03/datafusion:parquet	73240635 / 72060503 / +1.6%	100508938 / 96596880 / +4.0%	0.73 / 0.75 / -2.3%
tpch_q04/datafusion:parquet	39725330 / 39919373 / -0.5%	60799913 / 59449141 / +2.3%	0.65 / 0.67 / -2.7%
tpch_q05/datafusion:parquet	89432233 / 88767777 / +0.7%	118103052 / 112859268 / +4.6%	0.76 / 0.79 / -3.7%
tpch_q06/datafusion:parquet	28313990 / 28477798 / -0.6%	48650408 / 45899585 / +6.0%	0.58 / 0.62 / -6.2%
tpch_q07/datafusion:parquet	93543926 / 94634879 / -1.2%	129325744 / 119241297 / +8.5%	0.72 / 0.79 / -8.9%
tpch_q08/datafusion:parquet	98871754 / 98406470 / +0.5%	127585100 / 121300006 / +5.2%	0.77 / 0.81 / -4.5%
tpch_q09/datafusion:parquet	114561957 / 114860006 / -0.3%	150230544 / 143274956 / +4.9%	0.76 / 0.80 / -4.9%
tpch_q10/datafusion:parquet	80307517 / 80513712 / -0.3%	112607987 / 109759074 / +2.6%	0.71 / 0.73 / -2.8%
tpch_q11/datafusion:parquet	38836621 / 39544266 / -1.8%	62308860 / 61076500 / +2.0%	0.62 / 0.65 / -3.7%
tpch_q12/datafusion:parquet	62306523 / 61987419 / +0.5%	87561968 / 85316644 / +2.6%	0.71 / 0.73 / -2.1%
tpch_q13/datafusion:parquet	159746527 / 159815542 / -0.0%	181881543 / 179458421 / +1.4%	0.88 / 0.89 / -1.4%
tpch_q14/datafusion:parquet	39720231 / 40145068 / -1.1%	65817753 / 64450776 / +2.1%	0.60 / 0.62 / -3.1%
tpch_q15/datafusion:parquet	46029095 / 46454382 / -0.9%	70007930 / 66910452 / +4.6%	0.66 / 0.69 / -5.3%
tpch_q16/datafusion:parquet	38979223 / 38939066 / +0.1%	57508069 / 55538330 / +3.5%	0.68 / 0.70 / -3.3%
tpch_q17/datafusion:parquet	117072633 / 116289681 / +0.7%	141240753 / 141175262 / +0.0%	0.83 / 0.82 / +0.6%
tpch_q18/datafusion:parquet	116766919 / 115891180 / +0.8%	139351391 / 137686396 / +1.2%	0.84 / 0.84 / -0.4%
tpch_q19/datafusion:parquet	50585138 / 51062004 / -0.9%	76922255 / 73317307 / +4.9%	0.66 / 0.70 / -5.6%
tpch_q20/datafusion:parquet	58028485 / 58211630 / -0.3%	83505665 / 85384075 / -2.2%	0.69 / 0.68 / +1.9%
tpch_q21/datafusion:parquet	99270083 / 99122179 / +0.1%	125209517 / 123258410 / +1.6%	0.79 / 0.80 / -1.4%
tpch_q22/datafusion:parquet	41892243 / 41968499 / -0.2%	61240780 / 57625790 / +6.3%	0.68 / 0.73 / -6.1%

duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	11414755 / 11834856 / -3.5%	22978495 / 20999859 / +9.4%	0.50 / 0.56 / -11.9%
tpch_q02/duckdb:vortex-file-compressed	17399111 / 17424874 / -0.1%	24817805 / 25496807 / -2.7%	0.70 / 0.68 / +2.6%
tpch_q03/duckdb:vortex-file-compressed	18565297 / 17510858 / +6.0%	33044468 / 43041762 / -23.2% 🟢	0.56 / 0.41 / +38.1%
tpch_q04/duckdb:vortex-file-compressed	16945628 / 16880264 / +0.4%	31826237 / 30775346 / +3.4%	0.53 / 0.55 / -2.9%
tpch_q05/duckdb:vortex-file-compressed	22505308 / 21962477 / +2.5%	34424855 / 40350606 / -14.7% 🟢	0.65 / 0.54 / +20.1%
tpch_q06/duckdb:vortex-file-compressed	5647187 / 5484985 / +3.0%	13953720 / 16936892 / -17.6% 🟢	0.40 / 0.32 / +25.0%
tpch_q07/duckdb:vortex-file-compressed	20822849 / 20960915 / -0.7%	40527019 / 36633585 / +10.6% 🔴	0.51 / 0.57 / -10.2%
tpch_q08/duckdb:vortex-file-compressed	23678416 / 23809876 / -0.6%	42038869 / 41968323 / +0.2%	0.56 / 0.57 / -0.7%
tpch_q09/duckdb:vortex-file-compressed	29568976 / 29666200 / -0.3%	59029135 / 51045027 / +15.6% 🔴	0.50 / 0.58 / -13.8%
tpch_q10/duckdb:vortex-file-compressed	28914382 / 29166554 / -0.9%	46028115 / 50382598 / -8.6%	0.63 / 0.58 / +8.5%
tpch_q11/duckdb:vortex-file-compressed	8747988 / 8966375 / -2.4%	14048488 / 15530975 / -9.5%	0.62 / 0.58 / +7.9%
tpch_q12/duckdb:vortex-file-compressed	15870769 / 17590422 / -9.8%	29916190 / 31910695 / -6.3%	0.53 / 0.55 / -3.8%
tpch_q13/duckdb:vortex-file-compressed	22623843 / 22155936 / +2.1%	38040154 / 38532238 / -1.3%	0.59 / 0.57 / +3.4%
tpch_q14/duckdb:vortex-file-compressed	12992964 / 13192217 / -1.5%	28310264 / 24772038 / +14.3% 🔴	0.46 / 0.53 / -13.8%
tpch_q15/duckdb:vortex-file-compressed	9462391 / 10125915 / -6.6%	20583602 / 19239109 / +7.0%	0.46 / 0.53 / -12.7%
tpch_q16/duckdb:vortex-file-compressed	18241759 / 18545559 / -1.6%	23773542 / 23751350 / +0.1%	0.77 / 0.78 / -1.7%
tpch_q17/duckdb:vortex-file-compressed	15617791 / 16487599 / -5.3%	30649164 / 38740526 / -20.9% 🟢	0.51 / 0.43 / +19.7%
tpch_q18/duckdb:vortex-file-compressed	25850767 / 25091816 / +3.0%	36120424 / 39345970 / -8.2%	0.72 / 0.64 / +12.2%
tpch_q19/duckdb:vortex-file-compressed	24799154 / 24026332 / +3.2%	40210406 / 40497574 / -0.7%	0.62 / 0.59 / +4.0%
tpch_q20/duckdb:vortex-file-compressed	16921361 / 17732876 / -4.6%	39514079 / 34348761 / +15.0% 🔴	0.43 / 0.52 / -17.1%
tpch_q21/duckdb:vortex-file-compressed	66614243 / 66490350 / +0.2%	84025462 / 82439516 / +1.9%	0.79 / 0.81 / -1.7%
tpch_q22/duckdb:vortex-file-compressed	14717526 / 12271476 / +19.9% 🔴	20059870 / 20279712 / -1.1%	0.73 / 0.61 / +21.2%

duckdb / vortex-compact / ns (1.009x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	13490114 / 14051228 / -4.0%	25416127 / 22589502 / +12.5% 🔴	0.53 / 0.62 / -14.7%
tpch_q02/duckdb:vortex-compact	20072634 / 19980012 / +0.5%	27623528 / 31140632 / -11.3% 🟢	0.73 / 0.64 / +13.3%
tpch_q03/duckdb:vortex-compact	18569473 / 19264683 / -3.6%	33571655 / 34904847 / -3.8%	0.55 / 0.55 / +0.2%
tpch_q04/duckdb:vortex-compact	18161433 / 18084690 / +0.4%	31028837 / 29771768 / +4.2%	0.59 / 0.61 / -3.6%
tpch_q05/duckdb:vortex-compact	23007581 / 22842792 / +0.7%	35940528 / 36491228 / -1.5%	0.64 / 0.63 / +2.3%
tpch_q06/duckdb:vortex-compact	8160548 / 6046569 / +35.0% 🔴	15436669 / 16499395 / -6.4%	0.53 / 0.37 / +44.3%
tpch_q07/duckdb:vortex-compact	22032093 / 21597802 / +2.0%	41470089 / 36654145 / +13.1% 🔴	0.53 / 0.59 / -9.8%
tpch_q08/duckdb:vortex-compact	26520306 / 25871390 / +2.5%	38374024 / 39090652 / -1.8%	0.69 / 0.66 / +4.4%
tpch_q09/duckdb:vortex-compact	29564675 / 30625223 / -3.5%	49712353 / 46016649 / +8.0%	0.59 / 0.67 / -10.6%
tpch_q10/duckdb:vortex-compact	31081421 / 31606447 / -1.7%	47064721 / 49567887 / -5.0%	0.66 / 0.64 / +3.6%
tpch_q11/duckdb:vortex-compact	9983805 / 9894394 / +0.9%	18262780 / 16061430 / +13.7% 🔴	0.55 / 0.62 / -11.3%
tpch_q12/duckdb:vortex-compact	18200721 / 19007375 / -4.2%	29380260 / 33046433 / -11.1% 🟢	0.62 / 0.58 / +7.7%
tpch_q13/duckdb:vortex-compact	22418336 / 22842279 / -1.9%	39835418 / 40782520 / -2.3%	0.56 / 0.56 / +0.5%
tpch_q14/duckdb:vortex-compact	14359334 / 14667590 / -2.1%	27382795 / 27995105 / -2.2%	0.52 / 0.52 / +0.1%
tpch_q15/duckdb:vortex-compact	10708088 / 10076709 / +6.3%	20023048 / 21895391 / -8.6%	0.53 / 0.46 / +16.2%
tpch_q16/duckdb:vortex-compact	19990383 / 19849967 / +0.7%	24540090 / 26683731 / -8.0%	0.81 / 0.74 / +9.5%
tpch_q17/duckdb:vortex-compact	16625973 / 16703585 / -0.5%	31721053 / 31727314 / -0.0%	0.52 / 0.53 / -0.4%
tpch_q18/duckdb:vortex-compact	25974451 / 26212108 / -0.9%	38221694 / 36048284 / +6.0%	0.68 / 0.73 / -6.5%
tpch_q19/duckdb:vortex-compact	25109747 / 24793801 / +1.3%	34981907 / 37168490 / -5.9%	0.72 / 0.67 / +7.6%
tpch_q20/duckdb:vortex-compact	19363935 / 19282209 / +0.4%	33846291 / 33635360 / +0.6%	0.57 / 0.57 / -0.2%
tpch_q21/duckdb:vortex-compact	69772117 / 69573302 / +0.3%	83691652 / 84311707 / -0.7%	0.83 / 0.83 / +1.0%
tpch_q22/duckdb:vortex-compact	12890793 / 13296511 / -3.1%	20717014 / 24006490 / -13.7% 🟢	0.62 / 0.55 / +12.3%

duckdb / parquet / ns (1.018x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	60430611 / 59854568 / +1.0%	66398183 / 66639006 / -0.4%	0.91 / 0.90 / +1.3%
tpch_q02/duckdb:parquet	37928485 / 34752715 / +9.1%	47145357 / 43312737 / +8.8%	0.80 / 0.80 / +0.3%
tpch_q03/duckdb:parquet	62934260 / 61766873 / +1.9%	74808301 / 74045574 / +1.0%	0.84 / 0.83 / +0.9%
tpch_q04/duckdb:parquet	43648535 / 43246303 / +0.9%	53255800 / 53249188 / +0.0%	0.82 / 0.81 / +0.9%
tpch_q05/duckdb:parquet	61396533 / 60460243 / +1.5%	72601146 / 71942205 / +0.9%	0.85 / 0.84 / +0.6%
tpch_q06/duckdb:parquet	20255523 / 19944254 / +1.6%	24624875 / 24477154 / +0.6%	0.82 / 0.81 / +1.0%
tpch_q07/duckdb:parquet	60918544 / 60968352 / -0.1%	71909211 / 71367120 / +0.8%	0.85 / 0.85 / -0.8%
tpch_q08/duckdb:parquet	73925165 / 73154626 / +1.1%	86422259 / 85845876 / +0.7%	0.86 / 0.85 / +0.4%
tpch_q09/duckdb:parquet	114527121 / 113631038 / +0.8%	128412089 / 126787361 / +1.3%	0.89 / 0.90 / -0.5%
tpch_q10/duckdb:parquet	109326226 / 110095984 / -0.7%	122489419 / 121428947 / +0.9%	0.89 / 0.91 / -1.6%
tpch_q11/duckdb:parquet	20530644 / 20085602 / +2.2%	24320698 / 23984855 / +1.4%	0.84 / 0.84 / +0.8%
tpch_q12/duckdb:parquet	44484491 / 40923671 / +8.7%	49700187 / 48819352 / +1.8%	0.90 / 0.84 / +6.8%
tpch_q13/duckdb:parquet	240172379 / 238590972 / +0.7%	248022427 / 246410725 / +0.7%	0.97 / 0.97 / +0.0%
tpch_q14/duckdb:parquet	44014885 / 43474052 / +1.2%	51859459 / 51813485 / +0.1%	0.85 / 0.84 / +1.2%
tpch_q15/duckdb:parquet	28100507 / 27429289 / +2.4%	31345352 / 30997209 / +1.1%	0.90 / 0.88 / +1.3%
tpch_q16/duckdb:parquet	51199332 / 49841352 / +2.7%	57223190 / 57849628 / -1.1%	0.89 / 0.86 / +3.8%
tpch_q17/duckdb:parquet	44747425 / 44425899 / +0.7%	54488350 / 53841436 / +1.2%	0.82 / 0.83 / -0.5%
tpch_q18/duckdb:parquet	90684527 / 89785210 / +1.0%	101015977 / 100143792 / +0.9%	0.90 / 0.90 / +0.1%
tpch_q19/duckdb:parquet	61397257 / 61088013 / +0.5%	71609835 / 70086385 / +2.2%	0.86 / 0.87 / -1.6%
tpch_q20/duckdb:parquet	59289270 / 58469701 / +1.4%	70479458 / 70877691 / -0.6%	0.84 / 0.82 / +2.0%
tpch_q21/duckdb:parquet	138632875 / 136437911 / +1.6%	149073153 / 147786955 / +0.9%	0.93 / 0.92 / +0.7%
tpch_q22/duckdb:parquet	50867206 / 50498719 / +0.7%	58533303 / 58257096 / +0.5%	0.87 / 0.87 / +0.3%

No file size changes detected.

github-actions · 2026-09-16T10:46:51Z

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 071bb91b vs base 4af09a94
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 0.986x ➖ · cold 1.029x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.043x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed	171803310 / 182905331 / -6.1%	586643827 / 524041897 / +11.9% 🔴	0.29 / 0.35 / -16.1%
clickbench-sorted_q24/datafusion:vortex-file-compressed	11287895 / 11183282 / +0.9%	50396854 / 45768187 / +10.1% 🔴	0.22 / 0.24 / -8.3%
clickbench-sorted_q26/datafusion:vortex-file-compressed	12046714 / 11424868 / +5.4%	48513539 / 48767393 / -0.5%	0.25 / 0.23 / +6.0%
clickbench-sorted_q36/datafusion:vortex-file-compressed	22689844 / 22853292 / -0.7%	68572199 / 64629696 / +6.1%	0.33 / 0.35 / -6.4%
clickbench-sorted_q37/datafusion:vortex-file-compressed	18115596 / 18050118 / +0.4%	60416504 / 57344694 / +5.4%	0.30 / 0.31 / -4.7%
clickbench-sorted_q38/datafusion:vortex-file-compressed	17591764 / 17140440 / +2.6%	62731158 / 57207113 / +9.7%	0.28 / 0.30 / -6.4%
clickbench-sorted_q39/datafusion:vortex-file-compressed	40650155 / 40923612 / -0.7%	90908411 / 90373049 / +0.6%	0.45 / 0.45 / -1.3%
clickbench-sorted_q40/datafusion:vortex-file-compressed	11943966 / 11757447 / +1.6%	45278456 / 41226282 / +9.8%	0.26 / 0.29 / -7.5%
clickbench-sorted_q41/datafusion:vortex-file-compressed	12163478 / 12323842 / -1.3%	43862138 / 41058401 / +6.8%	0.28 / 0.30 / -7.6%
clickbench-sorted_q42/datafusion:vortex-file-compressed	10193891 / 10199690 / -0.1%	35934885 / 34137986 / +5.3%	0.28 / 0.30 / -5.1%

datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact	210458997 / 207045612 / +1.6%	454052652 / 437961192 / +3.7%	0.46 / 0.47 / -2.0%
clickbench-sorted_q24/datafusion:vortex-compact	21732160 / 22682543 / -4.2%	50445773 / 54927619 / -8.2%	0.43 / 0.41 / +4.3%
clickbench-sorted_q26/datafusion:vortex-compact	23172428 / 24488456 / -5.4%	51727546 / 51170161 / +1.1%	0.45 / 0.48 / -6.4%
clickbench-sorted_q36/datafusion:vortex-compact	25242034 / 25822013 / -2.2%	63747983 / 64919291 / -1.8%	0.40 / 0.40 / -0.4%
clickbench-sorted_q37/datafusion:vortex-compact	22490276 / 22315213 / +0.8%	65535220 / 63925571 / +2.5%	0.34 / 0.35 / -1.7%
clickbench-sorted_q38/datafusion:vortex-compact	21425542 / 20898478 / +2.5%	65150538 / 63954893 / +1.9%	0.33 / 0.33 / +0.6%
clickbench-sorted_q39/datafusion:vortex-compact	45231384 / 44333781 / +2.0%	85521196 / 81164450 / +5.4%	0.53 / 0.55 / -3.2%
clickbench-sorted_q40/datafusion:vortex-compact	14235184 / 14653947 / -2.9%	45203695 / 40780795 / +10.8% 🔴	0.31 / 0.36 / -12.4%
clickbench-sorted_q41/datafusion:vortex-compact	14093608 / 13867450 / +1.6%	44513509 / 41735468 / +6.7%	0.32 / 0.33 / -4.7%
clickbench-sorted_q42/datafusion:vortex-compact	11090966 / 10715636 / +3.5%	35282366 / 33568437 / +5.1%	0.31 / 0.32 / -1.5%

datafusion / parquet / ns (1.008x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet	764444923 / 751701450 / +1.7%	945105474 / 938702651 / +0.7%	0.81 / 0.80 / +1.0%
clickbench-sorted_q24/datafusion:parquet	9439034 / 9072336 / +4.0%	72094641 / 72130961 / -0.1%	0.13 / 0.13 / +4.1%
clickbench-sorted_q26/datafusion:parquet	9723092 / 9892260 / -1.7%	71151048 / 71008507 / +0.2%	0.14 / 0.14 / -1.9%
clickbench-sorted_q36/datafusion:parquet	94230201 / 93884654 / +0.4%	171252213 / 167777553 / +2.1%	0.55 / 0.56 / -1.7%
clickbench-sorted_q37/datafusion:parquet	64692807 / 64403694 / +0.4%	130561909 / 130840038 / -0.2%	0.50 / 0.49 / +0.7%
clickbench-sorted_q38/datafusion:parquet	87615108 / 87336363 / +0.3%	161511760 / 155394236 / +3.9%	0.54 / 0.56 / -3.5%
clickbench-sorted_q39/datafusion:parquet	159950771 / 158571560 / +0.9%	236066525 / 228433362 / +3.3%	0.68 / 0.69 / -2.4%
clickbench-sorted_q40/datafusion:parquet	45067054 / 44529742 / +1.2%	116315677 / 111989216 / +3.9%	0.39 / 0.40 / -2.6%
clickbench-sorted_q41/datafusion:parquet	42220700 / 42232243 / -0.0%	111188083 / 110181834 / +0.9%	0.38 / 0.38 / -0.9%
clickbench-sorted_q42/datafusion:parquet	26470844 / 26350380 / +0.5%	85978000 / 87288601 / -1.5%	0.31 / 0.30 / +2.0%

duckdb / vortex-file-compressed / ns (0.984x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed	57121238 / 56741991 / +0.7%	108815034 / 77501207 / +40.4% 🔴	0.52 / 0.73 / -28.3%
clickbench-sorted_q24/duckdb:vortex-file-compressed	17819886 / 22774677 / -21.8% 🟢	29132366 / 30360421 / -4.0%	0.61 / 0.75 / -18.5%
clickbench-sorted_q26/duckdb:vortex-file-compressed	15339426 / 14859034 / +3.2%	26076869 / 31409463 / -17.0% 🟢	0.59 / 0.47 / +24.3%
clickbench-sorted_q36/duckdb:vortex-file-compressed	29679041 / 30230454 / -1.8%	66590070 / 61956691 / +7.5%	0.45 / 0.49 / -8.7%
clickbench-sorted_q37/duckdb:vortex-file-compressed	24735523 / 25301206 / -2.2%	54319566 / 54861910 / -1.0%	0.46 / 0.46 / -1.3%
clickbench-sorted_q38/duckdb:vortex-file-compressed	27566986 / 25377338 / +8.6%	59032946 / 57418454 / +2.8%	0.47 / 0.44 / +5.7%
clickbench-sorted_q39/duckdb:vortex-file-compressed	47507953 / 48175513 / -1.4%	97866404 / 94813358 / +3.2%	0.49 / 0.51 / -4.5%
clickbench-sorted_q40/duckdb:vortex-file-compressed	15655444 / 15405117 / +1.6%	38950117 / 38626078 / +0.8%	0.40 / 0.40 / +0.8%
clickbench-sorted_q41/duckdb:vortex-file-compressed	16048372 / 15856336 / +1.2%	39800876 / 37275798 / +6.8%	0.40 / 0.43 / -5.2%
clickbench-sorted_q42/duckdb:vortex-file-compressed	12682466 / 12800794 / -0.9%	30134991 / 32047727 / -6.0%	0.42 / 0.40 / +5.4%

duckdb / vortex-compact / ns (0.960x ➖, 2↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact	66166434 / 62539096 / +5.8%	98660043 / 96785433 / +1.9%	0.67 / 0.65 / +3.8%
clickbench-sorted_q24/duckdb:vortex-compact	24488670 / 26893898 / -8.9%	31902537 / 30744983 / +3.8%	0.77 / 0.87 / -12.2%
clickbench-sorted_q26/duckdb:vortex-compact	16138741 / 18971989 / -14.9% 🟢	29657740 / 30571711 / -3.0%	0.54 / 0.62 / -12.3%
clickbench-sorted_q36/duckdb:vortex-compact	36930430 / 38554670 / -4.2%	73224035 / 71043286 / +3.1%	0.50 / 0.54 / -7.1%
clickbench-sorted_q37/duckdb:vortex-compact	31070559 / 33064736 / -6.0%	68555271 / 66247845 / +3.5%	0.45 / 0.50 / -9.2%
clickbench-sorted_q38/duckdb:vortex-compact	32265300 / 32833869 / -1.7%	66319026 / 70052632 / -5.3%	0.49 / 0.47 / +3.8%
clickbench-sorted_q39/duckdb:vortex-compact	64375770 / 61062118 / +5.4%	110358555 / 106589328 / +3.5%	0.58 / 0.57 / +1.8%
clickbench-sorted_q40/duckdb:vortex-compact	17799694 / 22163938 / -19.7% 🟢	40643314 / 40570828 / +0.2%	0.44 / 0.55 / -19.8%
clickbench-sorted_q41/duckdb:vortex-compact	19384846 / 19661596 / -1.4%	40554896 / 42460942 / -4.5%	0.48 / 0.46 / +3.2%
clickbench-sorted_q42/duckdb:vortex-compact	17161410 / 15573645 / +10.2% 🔴	33235247 / 34075179 / -2.5%	0.52 / 0.46 / +13.0%

duckdb / parquet / ns (0.985x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet	126645486 / 123315510 / +2.7%	141089371 / 147826582 / -4.6%	0.90 / 0.83 / +7.6%
clickbench-sorted_q24/duckdb:parquet	18134918 / 17318290 / +4.7%	32733469 / 28945549 / +13.1% 🔴	0.55 / 0.60 / -7.4%
clickbench-sorted_q26/duckdb:parquet	13007612 / 12989595 / +0.1%	21455075 / 21057866 / +1.9%	0.61 / 0.62 / -1.7%
clickbench-sorted_q36/duckdb:parquet	45992437 / 47353551 / -2.9%	66771590 / 59245329 / +12.7% 🔴	0.69 / 0.80 / -13.8%
clickbench-sorted_q37/duckdb:parquet	30602488 / 31924209 / -4.1%	50276312 / 52248909 / -3.8%	0.61 / 0.61 / -0.4%
clickbench-sorted_q38/duckdb:parquet	40888689 / 39332400 / +4.0%	58385000 / 56666738 / +3.0%	0.70 / 0.69 / +0.9%
clickbench-sorted_q39/duckdb:parquet	72129246 / 73301550 / -1.6%	86933620 / 87767270 / -0.9%	0.83 / 0.84 / -0.7%
clickbench-sorted_q40/duckdb:parquet	17042750 / 18811752 / -9.4%	44512678 / 35584775 / +25.1% 🔴	0.38 / 0.53 / -27.6%
clickbench-sorted_q41/duckdb:parquet	16304196 / 17307904 / -5.8%	43526501 / 35009202 / +24.3% 🔴	0.37 / 0.49 / -24.2%
clickbench-sorted_q42/duckdb:parquet	11014800 / 11170862 / -1.4%	27392038 / 25345249 / +8.1%	0.40 / 0.44 / -8.8%

File Size Changes (200 files changed, -0.0% overall, 104↑ 96↓)

File	Scale	Format	Base	HEAD	Change	%
hits_001.vortex	1.0	vortex-file-compressed	188.77 MB	192.99 MB	+4.22 MB	+2.2%
hits_000.vortex	1.0	vortex-compact	97.57 MB	99.43 MB	+1.86 MB	+1.9%
hits_043.vortex	1.0	vortex-compact	94.41 MB	95.61 MB	+1.21 MB	+1.3%
hits_013.vortex	1.0	vortex-compact	123.93 MB	125.48 MB	+1.55 MB	+1.2%
hits_001.vortex	1.0	vortex-compact	138.75 MB	140.24 MB	+1.49 MB	+1.1%
hits_027.vortex	1.0	vortex-file-compressed	189.78 MB	191.70 MB	+1.92 MB	+1.0%
hits_087.vortex	1.0	vortex-file-compressed	160.12 MB	161.69 MB	+1.58 MB	+1.0%
hits_059.vortex	1.0	vortex-file-compressed	198.77 MB	200.41 MB	+1.64 MB	+0.8%
hits_097.vortex	1.0	vortex-compact	140.12 MB	141.17 MB	+1.05 MB	+0.7%
hits_037.vortex	1.0	vortex-compact	132.20 MB	133.14 MB	+954.38 KB	+0.7%
hits_067.vortex	1.0	vortex-compact	98.45 MB	99.14 MB	+703.95 KB	+0.7%
hits_096.vortex	1.0	vortex-file-compressed	199.15 MB	200.52 MB	+1.38 MB	+0.7%
hits_029.vortex	1.0	vortex-file-compressed	199.47 MB	200.81 MB	+1.35 MB	+0.7%
hits_026.vortex	1.0	vortex-compact	98.40 MB	99.02 MB	+630.46 KB	+0.6%
hits_024.vortex	1.0	vortex-compact	122.74 MB	123.39 MB	+665.73 KB	+0.5%
hits_055.vortex	1.0	vortex-compact	152.50 MB	153.29 MB	+810.01 KB	+0.5%
hits_052.vortex	1.0	vortex-compact	97.72 MB	98.12 MB	+403.38 KB	+0.4%
hits_062.vortex	1.0	vortex-file-compressed	171.32 MB	171.91 MB	+608.44 KB	+0.3%
hits_088.vortex	1.0	vortex-compact	133.97 MB	134.43 MB	+469.62 KB	+0.3%
hits_032.vortex	1.0	vortex-compact	110.60 MB	110.96 MB	+371.49 KB	+0.3%
hits_082.vortex	1.0	vortex-file-compressed	139.31 MB	139.69 MB	+392.70 KB	+0.3%
hits_010.vortex	1.0	vortex-file-compressed	168.99 MB	169.45 MB	+466.34 KB	+0.3%
hits_051.vortex	1.0	vortex-file-compressed	172.95 MB	173.40 MB	+466.59 KB	+0.3%
hits_014.vortex	1.0	vortex-file-compressed	172.86 MB	173.30 MB	+453.02 KB	+0.3%
hits_066.vortex	1.0	vortex-file-compressed	162.94 MB	163.35 MB	+415.18 KB	+0.2%
hits_005.vortex	1.0	vortex-file-compressed	167.05 MB	167.44 MB	+400.57 KB	+0.2%
hits_071.vortex	1.0	vortex-file-compressed	139.34 MB	139.66 MB	+331.03 KB	+0.2%
hits_050.vortex	1.0	vortex-file-compressed	161.54 MB	161.91 MB	+378.14 KB	+0.2%
hits_052.vortex	1.0	vortex-file-compressed	130.11 MB	130.40 MB	+302.73 KB	+0.2%
hits_014.vortex	1.0	vortex-compact	133.88 MB	134.15 MB	+278.18 KB	+0.2%
hits_095.vortex	1.0	vortex-file-compressed	153.61 MB	153.91 MB	+304.46 KB	+0.2%
hits_057.vortex	1.0	vortex-compact	111.43 MB	111.65 MB	+220.82 KB	+0.2%
hits_046.vortex	1.0	vortex-compact	74.90 MB	75.03 MB	+138.97 KB	+0.2%
hits_053.vortex	1.0	vortex-file-compressed	189.41 MB	189.75 MB	+344.56 KB	+0.2%
hits_011.vortex	1.0	vortex-compact	152.70 MB	152.97 MB	+275.05 KB	+0.2%
hits_039.vortex	1.0	vortex-file-compressed	161.65 MB	161.91 MB	+274.73 KB	+0.2%
hits_079.vortex	1.0	vortex-compact	127.85 MB	128.06 MB	+213.88 KB	+0.2%
hits_079.vortex	1.0	vortex-file-compressed	180.52 MB	180.80 MB	+283.88 KB	+0.2%
hits_055.vortex	1.0	vortex-file-compressed	200.64 MB	200.92 MB	+287.30 KB	+0.1%
hits_048.vortex	1.0	vortex-compact	153.15 MB	153.35 MB	+208.26 KB	+0.1%
hits_076.vortex	1.0	vortex-compact	125.00 MB	125.16 MB	+168.22 KB	+0.1%
hits_049.vortex	1.0	vortex-file-compressed	191.13 MB	191.37 MB	+240.47 KB	+0.1%
hits_060.vortex	1.0	vortex-file-compressed	192.78 MB	193.01 MB	+237.80 KB	+0.1%
hits_008.vortex	1.0	vortex-file-compressed	139.29 MB	139.45 MB	+157.37 KB	+0.1%
hits_002.vortex	1.0	vortex-file-compressed	161.39 MB	161.57 MB	+181.05 KB	+0.1%
hits_073.vortex	1.0	vortex-compact	134.21 MB	134.34 MB	+139.69 KB	+0.1%
hits_085.vortex	1.0	vortex-compact	153.32 MB	153.47 MB	+154.59 KB	+0.1%
hits_096.vortex	1.0	vortex-compact	153.10 MB	153.24 MB	+150.78 KB	+0.1%
hits_059.vortex	1.0	vortex-compact	152.90 MB	153.04 MB	+141.51 KB	+0.1%
hits_046.vortex	1.0	vortex-file-compressed	100.74 MB	100.83 MB	+85.18 KB	+0.1%
hits_003.vortex	1.0	vortex-compact	104.51 MB	104.59 MB	+85.27 KB	+0.1%
hits_088.vortex	1.0	vortex-file-compressed	172.63 MB	172.77 MB	+137.66 KB	+0.1%
hits_051.vortex	1.0	vortex-compact	133.91 MB	134.01 MB	+102.74 KB	+0.1%
hits_083.vortex	1.0	vortex-compact	110.06 MB	110.15 MB	+83.60 KB	+0.1%
hits_022.vortex	1.0	vortex-compact	153.06 MB	153.17 MB	+107.91 KB	+0.1%
hits_084.vortex	1.0	vortex-compact	110.57 MB	110.65 MB	+77.18 KB	+0.1%
hits_072.vortex	1.0	vortex-compact	75.59 MB	75.64 MB	+51.79 KB	+0.1%
hits_013.vortex	1.0	vortex-file-compressed	161.79 MB	161.90 MB	+107.71 KB	+0.1%
hits_098.vortex	1.0	vortex-file-compressed	137.69 MB	137.78 MB	+86.33 KB	+0.1%
hits_080.vortex	1.0	vortex-file-compressed	127.03 MB	127.11 MB	+78.62 KB	+0.1%
hits_028.vortex	1.0	vortex-file-compressed	152.11 MB	152.20 MB	+88.61 KB	+0.1%
hits_019.vortex	1.0	vortex-file-compressed	139.95 MB	140.02 MB	+80.22 KB	+0.1%
hits_036.vortex	1.0	vortex-file-compressed	171.86 MB	171.96 MB	+98.35 KB	+0.1%
hits_011.vortex	1.0	vortex-file-compressed	200.21 MB	200.32 MB	+111.41 KB	+0.1%
hits_043.vortex	1.0	vortex-file-compressed	126.63 MB	126.70 MB	+70.24 KB	+0.1%
hits_065.vortex	1.0	vortex-file-compressed	161.80 MB	161.89 MB	+88.63 KB	+0.1%
hits_081.vortex	1.0	vortex-compact	153.72 MB	153.80 MB	+81.98 KB	+0.1%
hits_028.vortex	1.0	vortex-compact	115.19 MB	115.25 MB	+58.72 KB	+0.0%
hits_004.vortex	1.0	vortex-file-compressed	130.58 MB	130.64 MB	+65.41 KB	+0.0%
hits_070.vortex	1.0	vortex-compact	153.67 MB	153.74 MB	+72.23 KB	+0.0%
hits_040.vortex	1.0	vortex-compact	109.93 MB	109.98 MB	+51.38 KB	+0.0%
hits_031.vortex	1.0	vortex-compact	111.13 MB	111.18 MB	+51.65 KB	+0.0%
hits_081.vortex	1.0	vortex-file-compressed	200.93 MB	201.02 MB	+93.02 KB	+0.0%
hits_015.vortex	1.0	vortex-file-compressed	130.29 MB	130.34 MB	+58.43 KB	+0.0%
hits_033.vortex	1.0	vortex-compact	153.41 MB	153.48 MB	+68.41 KB	+0.0%
hits_089.vortex	1.0	vortex-file-compressed	130.63 MB	130.69 MB	+54.07 KB	+0.0%
hits_073.vortex	1.0	vortex-file-compressed	172.95 MB	173.02 MB	+71.10 KB	+0.0%
hits_068.vortex	1.0	vortex-file-compressed	160.36 MB	160.42 MB	+60.74 KB	+0.0%
hits_094.vortex	1.0	vortex-compact	110.77 MB	110.81 MB	+37.21 KB	+0.0%
hits_070.vortex	1.0	vortex-file-compressed	200.95 MB	201.02 MB	+66.37 KB	+0.0%
hits_000.vortex	1.0	vortex-file-compressed	130.75 MB	130.79 MB	+36.12 KB	+0.0%
hits_016.vortex	1.0	vortex-compact	127.33 MB	127.37 MB	+32.70 KB	+0.0%
hits_056.vortex	1.0	vortex-compact	100.75 MB	100.77 MB	+25.41 KB	+0.0%
hits_061.vortex	1.0	vortex-file-compressed	161.31 MB	161.35 MB	+40.16 KB	+0.0%
hits_020.vortex	1.0	vortex-file-compressed	159.88 MB	159.92 MB	+39.62 KB	+0.0%
hits_025.vortex	1.0	vortex-compact	133.65 MB	133.69 MB	+33.04 KB	+0.0%
hits_007.vortex	1.0	vortex-file-compressed	201.15 MB	201.20 MB	+49.32 KB	+0.0%
hits_017.vortex	1.0	vortex-file-compressed	147.19 MB	147.23 MB	+35.17 KB	+0.0%
hits_082.vortex	1.0	vortex-compact	105.62 MB	105.65 MB	+24.23 KB	+0.0%
hits_074.vortex	1.0	vortex-file-compressed	200.09 MB	200.13 MB	+40.03 KB	+0.0%
hits_039.vortex	1.0	vortex-compact	123.78 MB	123.80 MB	+21.86 KB	+0.0%
hits_069.vortex	1.0	vortex-file-compressed	142.77 MB	142.79 MB	+23.65 KB	+0.0%
hits_026.vortex	1.0	vortex-file-compressed	130.53 MB	130.55 MB	+20.52 KB	+0.0%
hits_075.vortex	1.0	vortex-compact	137.71 MB	137.73 MB	+19.43 KB	+0.0%
hits_095.vortex	1.0	vortex-compact	110.61 MB	110.62 MB	+13.84 KB	+0.0%
hits_036.vortex	1.0	vortex-compact	133.27 MB	133.29 MB	+16.06 KB	+0.0%
hits_042.vortex	1.0	vortex-file-compressed	202.14 MB	202.16 MB	+20.66 KB	+0.0%
hits_024.vortex	1.0	vortex-file-compressed	161.14 MB	161.16 MB	+15.77 KB	+0.0%
hits_053.vortex	1.0	vortex-compact	138.26 MB	138.27 MB	+13.40 KB	+0.0%
hits_042.vortex	1.0	vortex-compact	136.21 MB	136.22 MB	+12.71 KB	+0.0%
hits_009.vortex	1.0	vortex-compact	75.21 MB	75.21 MB	+5.70 KB	+0.0%
hits_060.vortex	1.0	vortex-compact	140.05 MB	140.06 MB	+9.51 KB	+0.0%
hits_078.vortex	1.0	vortex-file-compressed	130.27 MB	130.27 MB	+5.90 KB	+0.0%
hits_091.vortex	1.0	vortex-file-compressed	147.38 MB	147.38 MB	+152 B	+0.0%
hits_086.vortex	1.0	vortex-compact	139.56 MB	139.56 MB	496 B	-0.0%
hits_089.vortex	1.0	vortex-compact	98.74 MB	98.74 MB	1.34 KB	-0.0%
hits_021.vortex	1.0	vortex-compact	110.62 MB	110.61 MB	1.64 KB	-0.0%
hits_018.vortex	1.0	vortex-compact	152.90 MB	152.89 MB	4.80 KB	-0.0%
hits_034.vortex	1.0	vortex-compact	133.16 MB	133.15 MB	4.87 KB	-0.0%
hits_035.vortex	1.0	vortex-compact	75.91 MB	75.91 MB	3.12 KB	-0.0%
hits_091.vortex	1.0	vortex-compact	111.82 MB	111.81 MB	5.91 KB	-0.0%
hits_062.vortex	1.0	vortex-compact	132.61 MB	132.60 MB	7.55 KB	-0.0%
hits_071.vortex	1.0	vortex-compact	105.58 MB	105.57 MB	13.32 KB	-0.0%
hits_075.vortex	1.0	vortex-file-compressed	189.14 MB	189.12 MB	29.03 KB	-0.0%
hits_049.vortex	1.0	vortex-compact	139.40 MB	139.38 MB	21.81 KB	-0.0%
hits_090.vortex	1.0	vortex-compact	141.04 MB	141.02 MB	24.27 KB	-0.0%
hits_083.vortex	1.0	vortex-file-compressed	156.25 MB	156.23 MB	27.45 KB	-0.0%
hits_048.vortex	1.0	vortex-file-compressed	200.52 MB	200.48 MB	37.05 KB	-0.0%
hits_063.vortex	1.0	vortex-file-compressed	131.00 MB	130.98 MB	24.93 KB	-0.0%
hits_012.vortex	1.0	vortex-file-compressed	190.47 MB	190.43 MB	37.03 KB	-0.0%
hits_045.vortex	1.0	vortex-compact	105.69 MB	105.67 MB	21.91 KB	-0.0%
hits_068.vortex	1.0	vortex-compact	112.12 MB	112.10 MB	24.02 KB	-0.0%
hits_019.vortex	1.0	vortex-compact	105.98 MB	105.95 MB	29.27 KB	-0.0%
hits_047.vortex	1.0	vortex-file-compressed	153.90 MB	153.86 MB	43.08 KB	-0.0%
hits_023.vortex	1.0	vortex-file-compressed	194.89 MB	194.83 MB	54.63 KB	-0.0%
hits_092.vortex	1.0	vortex-compact	153.37 MB	153.32 MB	44.43 KB	-0.0%
hits_054.vortex	1.0	vortex-compact	111.61 MB	111.57 MB	34.35 KB	-0.0%
hits_056.vortex	1.0	vortex-file-compressed	135.09 MB	135.04 MB	48.56 KB	-0.0%
hits_005.vortex	1.0	vortex-compact	115.85 MB	115.81 MB	42.48 KB	-0.0%
hits_058.vortex	1.0	vortex-file-compressed	154.53 MB	154.47 MB	58.58 KB	-0.0%
hits_025.vortex	1.0	vortex-file-compressed	172.25 MB	172.18 MB	72.48 KB	-0.0%
hits_077.vortex	1.0	vortex-file-compressed	173.08 MB	173.00 MB	75.80 KB	-0.0%
hits_038.vortex	1.0	vortex-file-compressed	189.68 MB	189.59 MB	88.72 KB	-0.0%
hits_092.vortex	1.0	vortex-file-compressed	200.94 MB	200.85 MB	95.74 KB	-0.0%
hits_097.vortex	1.0	vortex-file-compressed	192.61 MB	192.52 MB	92.90 KB	-0.0%
hits_012.vortex	1.0	vortex-compact	138.82 MB	138.76 MB	68.13 KB	-0.0%
hits_037.vortex	1.0	vortex-file-compressed	178.12 MB	178.03 MB	89.03 KB	-0.0%
hits_030.vortex	1.0	vortex-file-compressed	131.15 MB	131.09 MB	66.06 KB	-0.0%
hits_085.vortex	1.0	vortex-file-compressed	200.80 MB	200.70 MB	104.34 KB	-0.1%
hits_016.vortex	1.0	vortex-file-compressed	179.86 MB	179.76 MB	98.38 KB	-0.1%
hits_006.vortex	1.0	vortex-file-compressed	126.64 MB	126.57 MB	72.98 KB	-0.1%
hits_032.vortex	1.0	vortex-file-compressed	154.03 MB	153.94 MB	88.84 KB	-0.1%
hits_094.vortex	1.0	vortex-file-compressed	158.34 MB	158.24 MB	93.05 KB	-0.1%
hits_044.vortex	1.0	vortex-compact	153.57 MB	153.47 MB	95.52 KB	-0.1%
hits_020.vortex	1.0	vortex-compact	111.68 MB	111.61 MB	70.63 KB	-0.1%
hits_099.vortex	1.0	vortex-compact	133.17 MB	133.08 MB	92.77 KB	-0.1%
hits_021.vortex	1.0	vortex-file-compressed	153.75 MB	153.64 MB	110.70 KB	-0.1%
hits_072.vortex	1.0	vortex-file-compressed	101.89 MB	101.82 MB	74.09 KB	-0.1%
hits_008.vortex	1.0	vortex-compact	105.72 MB	105.64 MB	80.89 KB	-0.1%
hits_058.vortex	1.0	vortex-compact	111.05 MB	110.96 MB	85.15 KB	-0.1%
hits_093.vortex	1.0	vortex-file-compressed	130.85 MB	130.75 MB	104.26 KB	-0.1%
hits_040.vortex	1.0	vortex-file-compressed	144.61 MB	144.49 MB	122.43 KB	-0.1%
hits_076.vortex	1.0	vortex-file-compressed	161.60 MB	161.45 MB	153.30 KB	-0.1%
hits_003.vortex	1.0	vortex-file-compressed	136.67 MB	136.54 MB	133.94 KB	-0.1%
hits_041.vortex	1.0	vortex-compact	97.92 MB	97.83 MB	96.66 KB	-0.1%
hits_029.vortex	1.0	vortex-compact	153.44 MB	153.27 MB	169.82 KB	-0.1%
hits_050.vortex	1.0	vortex-compact	125.14 MB	125.00 MB	143.31 KB	-0.1%
hits_018.vortex	1.0	vortex-file-compressed	200.91 MB	200.68 MB	236.49 KB	-0.1%
hits_009.vortex	1.0	vortex-file-compressed	101.15 MB	101.03 MB	122.35 KB	-0.1%
hits_061.vortex	1.0	vortex-compact	125.01 MB	124.85 MB	158.42 KB	-0.1%
hits_035.vortex	1.0	vortex-file-compressed	102.23 MB	102.10 MB	137.83 KB	-0.1%
hits_017.vortex	1.0	vortex-compact	111.89 MB	111.74 MB	157.26 KB	-0.1%
hits_074.vortex	1.0	vortex-compact	153.13 MB	152.87 MB	275.12 KB	-0.2%
hits_057.vortex	1.0	vortex-file-compressed	160.07 MB	159.78 MB	301.77 KB	-0.2%
hits_099.vortex	1.0	vortex-file-compressed	172.14 MB	171.80 MB	346.84 KB	-0.2%
hits_002.vortex	1.0	vortex-compact	123.97 MB	123.71 MB	270.81 KB	-0.2%
hits_067.vortex	1.0	vortex-file-compressed	131.12 MB	130.83 MB	299.32 KB	-0.2%
hits_065.vortex	1.0	vortex-compact	125.44 MB	125.14 MB	301.02 KB	-0.2%
hits_031.vortex	1.0	vortex-file-compressed	159.58 MB	159.11 MB	475.37 KB	-0.3%
hits_041.vortex	1.0	vortex-file-compressed	130.64 MB	130.26 MB	394.70 KB	-0.3%
hits_077.vortex	1.0	vortex-compact	134.42 MB	134.01 MB	416.20 KB	-0.3%
hits_010.vortex	1.0	vortex-compact	123.44 MB	123.06 MB	385.13 KB	-0.3%
hits_007.vortex	1.0	vortex-compact	153.65 MB	153.16 MB	500.77 KB	-0.3%
hits_047.vortex	1.0	vortex-compact	110.82 MB	110.46 MB	365.70 KB	-0.3%
hits_078.vortex	1.0	vortex-compact	98.21 MB	97.87 MB	345.02 KB	-0.3%
hits_084.vortex	1.0	vortex-file-compressed	154.68 MB	154.01 MB	682.42 KB	-0.4%
hits_045.vortex	1.0	vortex-file-compressed	139.77 MB	139.17 MB	618.76 KB	-0.4%
hits_004.vortex	1.0	vortex-compact	98.25 MB	97.81 MB	454.34 KB	-0.5%
hits_022.vortex	1.0	vortex-file-compressed	200.09 MB	199.05 MB	1.04 MB	-0.5%
hits_034.vortex	1.0	vortex-file-compressed	182.72 MB	181.76 MB	984.03 KB	-0.5%
hits_023.vortex	1.0	vortex-compact	142.43 MB	141.67 MB	771.27 KB	-0.5%
hits_066.vortex	1.0	vortex-compact	117.41 MB	116.76 MB	663.71 KB	-0.6%
hits_098.vortex	1.0	vortex-compact	103.47 MB	102.89 MB	598.38 KB	-0.6%
hits_054.vortex	1.0	vortex-file-compressed	148.13 MB	147.28 MB	869.02 KB	-0.6%
hits_033.vortex	1.0	vortex-file-compressed	201.07 MB	199.91 MB	1.16 MB	-0.6%
hits_069.vortex	1.0	vortex-compact	99.90 MB	99.26 MB	656.80 KB	-0.6%
hits_063.vortex	1.0	vortex-compact	98.78 MB	98.14 MB	657.52 KB	-0.7%
hits_027.vortex	1.0	vortex-compact	138.99 MB	137.99 MB	1023.20 KB	-0.7%
hits_030.vortex	1.0	vortex-compact	98.83 MB	98.05 MB	801.02 KB	-0.8%
hits_044.vortex	1.0	vortex-file-compressed	201.10 MB	199.50 MB	1.60 MB	-0.8%
hits_064.vortex	1.0	vortex-file-compressed	192.02 MB	190.48 MB	1.53 MB	-0.8%
hits_038.vortex	1.0	vortex-compact	139.26 MB	138.12 MB	1.14 MB	-0.8%
hits_006.vortex	1.0	vortex-compact	96.06 MB	95.23 MB	847.12 KB	-0.9%
hits_064.vortex	1.0	vortex-compact	140.13 MB	138.79 MB	1.34 MB	-1.0%
hits_015.vortex	1.0	vortex-compact	98.34 MB	97.36 MB	1005.91 KB	-1.0%
hits_086.vortex	1.0	vortex-file-compressed	193.90 MB	191.78 MB	2.11 MB	-1.1%
hits_087.vortex	1.0	vortex-compact	125.28 MB	123.80 MB	1.47 MB	-1.2%
hits_090.vortex	1.0	vortex-file-compressed	194.57 MB	192.28 MB	2.29 MB	-1.2%
hits_093.vortex	1.0	vortex-compact	98.93 MB	97.66 MB	1.27 MB	-1.3%
hits_080.vortex	1.0	vortex-compact	96.58 MB	94.14 MB	2.44 MB	-2.5%

Totals:

vortex-compact: 11.92 GB → 11.91 GB (-0.0%)
vortex-file-compressed: 15.96 GB → 15.97 GB (+0.0%)

github-actions · 2026-09-16T10:48:22Z

Benchmarks: FineWeb S3 📖

Commits: PR 071bb91b vs base 4af09a94
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.1%
Engines: DataFusion No clear signal (+1.6%, environment too noisy confidence) · DuckDB No clear signal (+6.7%, environment too noisy confidence)
Vortex (geomean): hot 0.895x ➖ · cold 0.858x ➖
Parquet (geomean): hot 0.860x ➖ · cold 0.858x ➖
Shifts: Parquet (control) -14.0% · Median polish -7.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.868x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	37251972 / 37317636 / -0.2%	144953852 / 153035401 / -5.3%	0.26 / 0.24 / +5.4%
fineweb_q01/datafusion:vortex-file-compressed	393845224 / 560341930 / -29.7%	602045922 / 699586307 / -13.9%	0.65 / 0.80 / -18.3%
fineweb_q02/datafusion:vortex-file-compressed	371921112 / 425899165 / -12.7%	445775833 / 1146902832 / -61.1% 🟢	0.83 / 0.37 / +124.7%
fineweb_q03/datafusion:vortex-file-compressed	466899142 / 568197888 / -17.8%	721607540 / 759306145 / -5.0%	0.65 / 0.75 / -13.5%
fineweb_q04/datafusion:vortex-file-compressed	426422163 / 435316200 / -2.0%	482633990 / 473146551 / +2.0%	0.88 / 0.92 / -4.0%
fineweb_q05/datafusion:vortex-file-compressed	431536392 / 579336503 / -25.5%	502877147 / 504078920 / -0.2%	0.86 / 1.15 / -25.3%
fineweb_q06/datafusion:vortex-file-compressed	727297398 / 774978848 / -6.2%	782578525 / 814592959 / -3.9%	0.93 / 0.95 / -2.3%
fineweb_q07/datafusion:vortex-file-compressed	503265606 / 519523498 / -3.1%	474164071 / 517890457 / -8.4%	1.06 / 1.00 / +5.8%
fineweb_q08/datafusion:vortex-file-compressed	174823675 / 209433373 / -16.5%	190202550 / 170426520 / +11.6%	0.92 / 1.23 / -25.2%

datafusion / vortex-compact / ns (0.818x ➖, 4↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	49407322 / 57328882 / -13.8%	180042699 / 165220102 / +9.0%	0.27 / 0.35 / -20.9%
fineweb_q01/datafusion:vortex-compact	353863210 / 591875748 / -40.2% 🟢	601081166 / 813841012 / -26.1%	0.59 / 0.73 / -19.1%
fineweb_q02/datafusion:vortex-compact	385806470 / 581412544 / -33.6% 🟢	512089338 / 760272007 / -32.6% 🟢	0.75 / 0.76 / -1.5%
fineweb_q03/datafusion:vortex-compact	860611289 / 645343550 / +33.4% 🔴	802293630 / 872587679 / -8.1%	1.07 / 0.74 / +45.0%
fineweb_q04/datafusion:vortex-compact	465752081 / 462254083 / +0.8%	506074997 / 497682570 / +1.7%	0.92 / 0.93 / -0.9%
fineweb_q05/datafusion:vortex-compact	458814515 / 462301928 / -0.8%	568523789 / 702911456 / -19.1%	0.81 / 0.66 / +22.7%
fineweb_q06/datafusion:vortex-compact	683782418 / 990256112 / -30.9% 🟢	626429754 / 839664969 / -25.4%	1.09 / 1.18 / -7.4%
fineweb_q07/datafusion:vortex-compact	658610686 / 586267479 / +12.3%	518632090 / 1191749863 / -56.5% 🟢	1.27 / 0.49 / +158.1%
fineweb_q08/datafusion:vortex-compact	176086408 / 377734064 / -53.4% 🟢	167380220 / 491638190 / -66.0% 🟢	1.05 / 0.77 / +36.9%

datafusion / parquet / ns (0.830x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	377033294 / 564001410 / -33.2% 🟢	720393861 / 931597666 / -22.7%	0.52 / 0.61 / -13.6%
fineweb_q01/datafusion:parquet	789471933 / 770165548 / +2.5%	655208334 / 932581926 / -29.7%	1.20 / 0.83 / +45.9%
fineweb_q02/datafusion:parquet	696918367 / 881282318 / -20.9%	744450490 / 899732810 / -17.3%	0.94 / 0.98 / -4.4%
fineweb_q03/datafusion:parquet	679520660 / 961148664 / -29.3%	856557677 / 847840796 / +1.0%	0.79 / 1.13 / -30.0%
fineweb_q04/datafusion:parquet	848712226 / 930358542 / -8.8%	728732490 / 887714479 / -17.9%	1.16 / 1.05 / +11.1%
fineweb_q05/datafusion:parquet	928315880 / 993471700 / -6.6%	722042952 / 926111863 / -22.0%	1.29 / 1.07 / +19.9%
fineweb_q06/datafusion:parquet	824012534 / 898291671 / -8.3%	1003650192 / 952437573 / +5.4%	0.82 / 0.94 / -12.9%
fineweb_q07/datafusion:parquet	700968590 / 798865040 / -12.3%	665138630 / 850287368 / -21.8%	1.05 / 0.94 / +12.2%
fineweb_q08/datafusion:parquet	722321874 / 1018075647 / -29.1%	614798866 / 899085742 / -31.6% 🟢	1.17 / 1.13 / +3.8%

duckdb / vortex-file-compressed / ns (0.986x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	70315203 / 51789408 / +35.8% 🔴	67821706 / 65864495 / +3.0%	1.04 / 0.79 / +31.9%
fineweb_q01/duckdb:vortex-file-compressed	388971081 / 490480393 / -20.7%	439590538 / 534959011 / -17.8%	0.88 / 0.92 / -3.5%
fineweb_q02/duckdb:vortex-file-compressed	560549437 / 574682048 / -2.5%	613513291 / 577674185 / +6.2%	0.91 / 0.99 / -8.2%
fineweb_q03/duckdb:vortex-file-compressed	994321409 / 1061963756 / -6.4%	1033526595 / 1414485289 / -26.9%	0.96 / 0.75 / +28.1%
fineweb_q04/duckdb:vortex-file-compressed	981911692 / 1122641590 / -12.5%	1004834375 / 1082073067 / -7.1%	0.98 / 1.04 / -5.8%
fineweb_q05/duckdb:vortex-file-compressed	873214298 / 896355390 / -2.6%	975261458 / 1028209872 / -5.1%	0.90 / 0.87 / +2.7%
fineweb_q06/duckdb:vortex-file-compressed	1184809591 / 1217207139 / -2.7%	1215238152 / 1230419558 / -1.2%	0.97 / 0.99 / -1.4%
fineweb_q07/duckdb:vortex-file-compressed	1070213744 / 952079432 / +12.4%	1173959842 / 1045157722 / +12.3%	0.91 / 0.91 / +0.1%
fineweb_q08/duckdb:vortex-file-compressed	388514280 / 403496192 / -3.7%	480253277 / 441562990 / +8.8%	0.81 / 0.91 / -11.5%

duckdb / vortex-compact / ns (0.916x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	65191169 / 71637130 / -9.0%	65064392 / 71964745 / -9.6%	1.00 / 1.00 / +0.7%
fineweb_q01/duckdb:vortex-compact	383193104 / 514633218 / -25.5%	454294946 / 546329803 / -16.8%	0.84 / 0.94 / -10.5%
fineweb_q02/duckdb:vortex-compact	560242682 / 793517690 / -29.4%	703312934 / 709075980 / -0.8%	0.80 / 1.12 / -28.8%
fineweb_q03/duckdb:vortex-compact	1026792338 / 1108930062 / -7.4%	1107530461 / 1489296991 / -25.6%	0.93 / 0.74 / +24.5%
fineweb_q04/duckdb:vortex-compact	1085690543 / 1120196272 / -3.1%	1137383152 / 1073899448 / +5.9%	0.95 / 1.04 / -8.5%
fineweb_q05/duckdb:vortex-compact	957957276 / 947209170 / +1.1%	1056765262 / 1017628494 / +3.8%	0.91 / 0.93 / -2.6%
fineweb_q06/duckdb:vortex-compact	1161673125 / 1124311539 / +3.3%	1203800912 / 1306242834 / -7.8%	0.97 / 0.86 / +12.1%
fineweb_q07/duckdb:vortex-compact	956713490 / 997940499 / -4.1%	1009195088 / 1143986563 / -11.8%	0.95 / 0.87 / +8.7%
fineweb_q08/duckdb:vortex-compact	388306508 / 369268602 / +5.2%	431043127 / 508462499 / -15.2%	0.90 / 0.73 / +24.0%

duckdb / parquet / ns (0.891x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	555752782 / 543627808 / +2.2%	529002513 / 773934759 / -31.6% 🟢	1.05 / 0.70 / +49.6%
fineweb_q01/duckdb:parquet	571125428 / 719540858 / -20.6%	614408725 / 593159627 / +3.6%	0.93 / 1.21 / -23.4%
fineweb_q02/duckdb:parquet	599890324 / 673056618 / -10.9%	625267701 / 755097879 / -17.2%	0.96 / 0.89 / +7.6%
fineweb_q03/duckdb:parquet	1379817437 / 1372760120 / +0.5%	1374876293 / 1397369418 / -1.6%	1.00 / 0.98 / +2.2%
fineweb_q04/duckdb:parquet	726977330 / 787788262 / -7.7%	807840450 / 787063147 / +2.6%	0.90 / 1.00 / -10.1%
fineweb_q05/duckdb:parquet	841008639 / 993622964 / -15.4%	829027569 / 1001362303 / -17.2%	1.01 / 0.99 / +2.2%
fineweb_q06/duckdb:parquet	1578611530 / 1993768470 / -20.8%	1630021381 / 1759592365 / -7.4%	0.97 / 1.13 / -14.5%
fineweb_q07/duckdb:parquet	1036159300 / 1172796582 / -11.7%	1073782351 / 1204354550 / -10.8%	0.96 / 0.97 / -0.9%
fineweb_q08/duckdb:parquet	487177782 / 546917896 / -10.9%	479461401 / 503631742 / -4.8%	1.02 / 1.09 / -6.4%

github-actions · 2026-09-16T10:48:41Z

Benchmarks: Appian on NVME 📖

Commits: PR 071bb91b vs base 4af09a94
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (+1.4%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 1.003x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.983x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.006x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact	53036244 / 52548532 / +0.9%	77071488 / 72859012 / +5.8%	0.69 / 0.72 / -4.6%
appian_q02/datafusion:vortex-compact	236083469 / 232604418 / +1.5%	271209480 / 270709679 / +0.2%	0.87 / 0.86 / +1.3%
appian_q03/datafusion:vortex-compact	147542621 / 148148076 / -0.4%	192840638 / 181304845 / +6.4%	0.77 / 0.82 / -6.4%
appian_q04/datafusion:vortex-compact	9932794571 / 9846969950 / +0.9%	9764116355 / 9773250654 / -0.1%	1.02 / 1.01 / +1.0%
appian_q05/datafusion:vortex-compact	138359854 / 136213378 / +1.6%	166140251 / 167431865 / -0.8%	0.83 / 0.81 / +2.4%
appian_q06/datafusion:vortex-compact	142795201 / 143013126 / -0.2%	166148547 / 168501661 / -1.4%	0.86 / 0.85 / +1.3%
appian_q07/datafusion:vortex-compact	163814370 / 165000037 / -0.7%	202642953 / 197144922 / +2.8%	0.81 / 0.84 / -3.4%
appian_q08/datafusion:vortex-compact	551115737 / 546519127 / +0.8%	593744975 / 603044004 / -1.5%	0.93 / 0.91 / +2.4%

datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet	72803619 / 72527747 / +0.4%	98858198 / 93262280 / +6.0%	0.74 / 0.78 / -5.3%
appian_q02/datafusion:parquet	300602908 / 300832975 / -0.1%	338365257 / 329372662 / +2.7%	0.89 / 0.91 / -2.7%
appian_q03/datafusion:parquet	186047352 / 186881660 / -0.4%	234427278 / 230892087 / +1.5%	0.79 / 0.81 / -1.9%
appian_q04/datafusion:parquet	9917311554 / 9891286533 / +0.3%	9797238537 / 9881988987 / -0.9%	1.01 / 1.00 / +1.1%
appian_q05/datafusion:parquet	194487408 / 194633696 / -0.1%	219825830 / 220254099 / -0.2%	0.88 / 0.88 / +0.1%
appian_q06/datafusion:parquet	168809294 / 169077997 / -0.2%	194420740 / 187376075 / +3.8%	0.87 / 0.90 / -3.8%
appian_q07/datafusion:parquet	208367067 / 209454477 / -0.5%	241675446 / 240992883 / +0.3%	0.86 / 0.87 / -0.8%
appian_q08/datafusion:parquet	667787150 / 679491565 / -1.7%	682537741 / 685925498 / -0.5%	0.98 / 0.99 / -1.2%

duckdb / vortex-compact / ns (1.009x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact	91047764 / 89774217 / +1.4%	113759826 / 103348818 / +10.1% 🔴	0.80 / 0.87 / -7.9%
appian_q02/duckdb:vortex-compact	211238613 / 215104294 / -1.8%	227559210 / 236164625 / -3.6%	0.93 / 0.91 / +1.9%
appian_q03/duckdb:vortex-compact	121419243 / 121490533 / -0.1%	136686455 / 134882643 / +1.3%	0.89 / 0.90 / -1.4%
appian_q04/duckdb:vortex-compact	585439475 / 552968730 / +5.9%	589621321 / 618699515 / -4.7%	0.99 / 0.89 / +11.1%
appian_q05/duckdb:vortex-compact	134169737 / 131502680 / +2.0%	154830563 / 151485659 / +2.2%	0.87 / 0.87 / -0.2%
appian_q06/duckdb:vortex-compact	405227866 / 404929306 / +0.1%	406724531 / 413300853 / -1.6%	1.00 / 0.98 / +1.7%
appian_q07/duckdb:vortex-compact	136239956 / 136836050 / -0.4%	155237117 / 155371998 / -0.1%	0.88 / 0.88 / -0.3%
appian_q08/duckdb:vortex-compact	438457330 / 436931520 / +0.3%	438283124 / 476928199 / -8.1%	1.00 / 0.92 / +9.2%

duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet	98187063 / 100436890 / -2.2%	120193944 / 118850548 / +1.1%	0.82 / 0.85 / -3.3%
appian_q02/duckdb:parquet	196200979 / 196814192 / -0.3%	207353980 / 210648475 / -1.6%	0.95 / 0.93 / +1.3%
appian_q03/duckdb:parquet	125004407 / 125261856 / -0.2%	139452568 / 142557713 / -2.2%	0.90 / 0.88 / +2.0%
appian_q04/duckdb:parquet	448776319 / 457591589 / -1.9%	447312641 / 490479894 / -8.8%	1.00 / 0.93 / +7.5%
appian_q05/duckdb:parquet	143150450 / 143638678 / -0.3%	168073719 / 164183303 / +2.4%	0.85 / 0.87 / -2.6%
appian_q06/duckdb:parquet	271614843 / 263494002 / +3.1%	270767328 / 292965533 / -7.6%	1.00 / 0.90 / +11.5%
appian_q07/duckdb:parquet	153769918 / 154044536 / -0.2%	167580800 / 172977515 / -3.1%	0.92 / 0.89 / +3.0%
appian_q08/duckdb:parquet	378987988 / 385739746 / -1.8%	376600869 / 459881021 / -18.1% 🟢	1.01 / 0.84 / +20.0%

No file size changes detected.

github-actions · 2026-09-16T10:49:06Z

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 071bb91b vs base 4af09a94
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.7%
Engines: DuckDB No clear signal (-1.7%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.985x ➖
Parquet (geomean): hot 1.013x ➖ · cold 1.008x ➖
Shifts: Parquet (control) +1.3% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed	9033747 / 9047516 / -0.2%	9455666 / 9374030 / +0.9%	0.96 / 0.97 / -1.0%
statpopgen_q01/duckdb:vortex-file-compressed	10438654 / 10261228 / +1.7%	13635509 / 14766751 / -7.7%	0.77 / 0.69 / +10.2%
statpopgen_q02/duckdb:vortex-file-compressed	303369184 / 302509509 / +0.3%	339451923 / 341370570 / -0.6%	0.89 / 0.89 / +0.9%
statpopgen_q03/duckdb:vortex-file-compressed	814457000 / 817582914 / -0.4%	824072690 / 823165124 / +0.1%	0.99 / 0.99 / -0.5%
statpopgen_q04/duckdb:vortex-file-compressed	822113354 / 821736952 / +0.0%	827901100 / 814164801 / +1.7%	0.99 / 1.01 / -1.6%
statpopgen_q05/duckdb:vortex-file-compressed	318982309 / 312936138 / +1.9%	344908754 / 355559199 / -3.0%	0.92 / 0.88 / +5.1%
statpopgen_q06/duckdb:vortex-file-compressed	1142275255 / 1133401248 / +0.8%	1147963198 / 1155976022 / -0.7%	1.00 / 0.98 / +1.5%
statpopgen_q07/duckdb:vortex-file-compressed	127400486 / 130214392 / -2.2%	138637373 / 149558152 / -7.3%	0.92 / 0.87 / +5.5%
statpopgen_q08/duckdb:vortex-file-compressed	150164910 / 144778228 / +3.7%	206048830 / 209668090 / -1.7%	0.73 / 0.69 / +5.5%
statpopgen_q09/duckdb:vortex-file-compressed	607079566 / 611768996 / -0.8%	629650392 / 620867394 / +1.4%	0.96 / 0.99 / -2.2%
statpopgen_q10/duckdb:vortex-file-compressed	1933325434 / 1941483219 / -0.4%	1914253926 / 1913119552 / +0.1%	1.01 / 1.01 / -0.5%

duckdb / vortex-compact / ns (0.987x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact	9068635 / 9082456 / -0.2%	9607140 / 9435876 / +1.8%	0.94 / 0.96 / -1.9%
statpopgen_q01/duckdb:vortex-compact	10139028 / 10260392 / -1.2%	13656786 / 14659535 / -6.8%	0.74 / 0.70 / +6.1%
statpopgen_q02/duckdb:vortex-compact	380392428 / 388997964 / -2.2%	400910780 / 402926292 / -0.5%	0.95 / 0.97 / -1.7%
statpopgen_q03/duckdb:vortex-compact	888169173 / 907894603 / -2.2%	896237802 / 925059994 / -3.1%	0.99 / 0.98 / +1.0%
statpopgen_q04/duckdb:vortex-compact	897759589 / 910084796 / -1.4%	911459307 / 912818283 / -0.1%	0.98 / 1.00 / -1.2%
statpopgen_q05/duckdb:vortex-compact	424167496 / 434860084 / -2.5%	440721302 / 448988299 / -1.8%	0.96 / 0.97 / -0.6%
statpopgen_q06/duckdb:vortex-compact	1164184376 / 1174113888 / -0.8%	1190137823 / 1179080196 / +0.9%	0.98 / 1.00 / -1.8%
statpopgen_q07/duckdb:vortex-compact	325027056 / 334642118 / -2.9%	339346930 / 352715069 / -3.8%	0.96 / 0.95 / +1.0%
statpopgen_q08/duckdb:vortex-compact	349199963 / 350465738 / -0.4%	365978381 / 361234979 / +1.3%	0.95 / 0.97 / -1.7%
statpopgen_q09/duckdb:vortex-compact	709675756 / 718667334 / -1.3%	704972560 / 718131896 / -1.8%	1.01 / 1.00 / +0.6%
statpopgen_q10/duckdb:vortex-compact	2033976896 / 2012177066 / +1.1%	1981407549 / 1994604320 / -0.7%	1.03 / 1.01 / +1.8%

duckdb / parquet / ns (1.013x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet	248215199 / 248674926 / -0.2%	249364191 / 247413938 / +0.8%	1.00 / 1.01 / -1.0%
statpopgen_q01/duckdb:parquet	306138400 / 305160970 / +0.3%	306408140 / 306442927 / -0.0%	1.00 / 1.00 / +0.3%
statpopgen_q02/duckdb:parquet	569284804 / 543345106 / +4.8%	590881248 / 570798156 / +3.5%	0.96 / 0.95 / +1.2%
statpopgen_q03/duckdb:parquet	876676543 / 858910600 / +2.1%	871940336 / 865886612 / +0.7%	1.01 / 0.99 / +1.4%
statpopgen_q04/duckdb:parquet	840357300 / 819157822 / +2.6%	845900798 / 850096750 / -0.5%	0.99 / 0.96 / +3.1%
statpopgen_q05/duckdb:parquet	593652946 / 569644492 / +4.2%	611675952 / 573910777 / +6.6%	0.97 / 0.99 / -2.2%
statpopgen_q06/duckdb:parquet	690284074 / 714685905 / -3.4%	706426555 / 709164519 / -0.4%	0.98 / 1.01 / -3.0%
statpopgen_q07/duckdb:parquet	615476569 / 614355088 / +0.2%	701394840 / 723139858 / -3.0%	0.88 / 0.85 / +3.3%
statpopgen_q08/duckdb:parquet	622656863 / 619993660 / +0.4%	701432464 / 719881855 / -2.6%	0.89 / 0.86 / +3.1%
statpopgen_q09/duckdb:parquet	795973282 / 768815148 / +3.5%	792626741 / 792728820 / -0.0%	1.00 / 0.97 / +3.5%
statpopgen_q10/duckdb:parquet	1412437302 / 1412877250 / -0.0%	1251546976 / 1206827238 / +3.7%	1.13 / 1.17 / -3.6%

No file size changes detected.

github-actions · 2026-09-16T10:49:35Z

Benchmarks: Clickbench on NVME 📖

Commits: PR 071bb91b vs base 4af09a94
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-1.9%, low confidence) · DuckDB No clear signal (-1.4%, environment too noisy confidence)
Vortex (geomean): hot 0.998x ➖ · cold 1.006x ➖
Parquet (geomean): hot 1.015x ➖ · cold 1.006x ➖
Shifts: Parquet (control) +1.5% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1227287 / 1258169 / -2.5%	21083770 / 20621039 / +2.2%	0.06 / 0.06 / -4.6%
clickbench_q01/datafusion:vortex-file-compressed	5902569 / 5878742 / +0.4%	31232316 / 32591659 / -4.2%	0.19 / 0.18 / +4.8%
clickbench_q02/datafusion:vortex-file-compressed	10162846 / 10616652 / -4.3%	38475664 / 40649048 / -5.3%	0.26 / 0.26 / +1.1%
clickbench_q03/datafusion:vortex-file-compressed	11792808 / 11504344 / +2.5%	54694672 / 55309330 / -1.1%	0.22 / 0.21 / +3.7%
clickbench_q04/datafusion:vortex-file-compressed	56493681 / 56669466 / -0.3%	94155784 / 91206878 / +3.2%	0.60 / 0.62 / -3.4%
clickbench_q05/datafusion:vortex-file-compressed	74569712 / 74469024 / +0.1%	117608071 / 111607772 / +5.4%	0.63 / 0.67 / -5.0%
clickbench_q06/datafusion:vortex-file-compressed	1251374 / 1272208 / -1.6%	21833671 / 20308849 / +7.5%	0.06 / 0.06 / -8.5%
clickbench_q07/datafusion:vortex-file-compressed	9640480 / 10177842 / -5.3%	34635250 / 36152521 / -4.2%	0.28 / 0.28 / -1.1%
clickbench_q08/datafusion:vortex-file-compressed	77732230 / 75495614 / +3.0%	121388859 / 113114114 / +7.3%	0.64 / 0.67 / -4.1%
clickbench_q09/datafusion:vortex-file-compressed	167279454 / 170236169 / -1.7%	204107054 / 203917642 / +0.1%	0.82 / 0.83 / -1.8%
clickbench_q10/datafusion:vortex-file-compressed	23754802 / 23537679 / +0.9%	70020540 / 67434505 / +3.8%	0.34 / 0.35 / -2.8%
clickbench_q11/datafusion:vortex-file-compressed	27281948 / 26413208 / +3.3%	68932969 / 67720763 / +1.8%	0.40 / 0.39 / +1.5%
clickbench_q12/datafusion:vortex-file-compressed	72420371 / 72182485 / +0.3%	118880943 / 113571148 / +4.7%	0.61 / 0.64 / -4.2%
clickbench_q13/datafusion:vortex-file-compressed	117389646 / 118198900 / -0.7%	178710636 / 179584322 / -0.5%	0.66 / 0.66 / -0.2%
clickbench_q14/datafusion:vortex-file-compressed	76186765 / 77017957 / -1.1%	123726216 / 116261821 / +6.4%	0.62 / 0.66 / -7.0%
clickbench_q15/datafusion:vortex-file-compressed	62362902 / 61524708 / +1.4%	103892509 / 99742273 / +4.2%	0.60 / 0.62 / -2.7%
clickbench_q16/datafusion:vortex-file-compressed	150222788 / 150073678 / +0.1%	214461885 / 198068559 / +8.3%	0.70 / 0.76 / -7.6%
clickbench_q17/datafusion:vortex-file-compressed	150362215 / 145166040 / +3.6%	214614627 / 206252036 / +4.1%	0.70 / 0.70 / -0.5%
clickbench_q18/datafusion:vortex-file-compressed	302846430 / 293152942 / +3.3%	375383898 / 345452825 / +8.7%	0.81 / 0.85 / -4.9%
clickbench_q19/datafusion:vortex-file-compressed	7892844 / 7643085 / +3.3%	49623137 / 47218340 / +5.1%	0.16 / 0.16 / -1.7%
clickbench_q20/datafusion:vortex-file-compressed	62785978 / 62821422 / -0.1%	230753389 / 228854897 / +0.8%	0.27 / 0.27 / -0.9%
clickbench_q21/datafusion:vortex-file-compressed	88061640 / 91628654 / -3.9%	269537621 / 277120335 / -2.7%	0.33 / 0.33 / -1.2%
clickbench_q22/datafusion:vortex-file-compressed	103540249 / 102984790 / +0.5%	346366359 / 350069422 / -1.1%	0.30 / 0.29 / +1.6%
clickbench_q23/datafusion:vortex-file-compressed	205151883 / 206149940 / -0.5%	513524827 / 560526266 / -8.4%	0.40 / 0.37 / +8.6%
clickbench_q24/datafusion:vortex-file-compressed	16543008 / 15764518 / +4.9%	65118534 / 62819629 / +3.7%	0.25 / 0.25 / +1.2%
clickbench_q25/datafusion:vortex-file-compressed	17986366 / 17833630 / +0.9%	59452441 / 58934803 / +0.9%	0.30 / 0.30 / -0.0%
clickbench_q26/datafusion:vortex-file-compressed	17321186 / 16873678 / +2.7%	66467481 / 65136712 / +2.0%	0.26 / 0.26 / +0.6%
clickbench_q27/datafusion:vortex-file-compressed	98499059 / 98368632 / +0.1%	246615769 / 244205509 / +1.0%	0.40 / 0.40 / -0.8%
clickbench_q28/datafusion:vortex-file-compressed	565908284 / 563113786 / +0.5%	623865213 / 615419535 / +1.4%	0.91 / 0.92 / -0.9%
clickbench_q29/datafusion:vortex-file-compressed	22914824 / 23227599 / -1.3%	50672941 / 50345720 / +0.6%	0.45 / 0.46 / -2.0%
clickbench_q30/datafusion:vortex-file-compressed	60641963 / 60194941 / +0.7%	106029091 / 109784652 / -3.4%	0.57 / 0.55 / +4.3%
clickbench_q31/datafusion:vortex-file-compressed	70391814 / 72228692 / -2.5%	156651536 / 151713727 / +3.3%	0.45 / 0.48 / -5.6%
clickbench_q32/datafusion:vortex-file-compressed	297227234 / 298209322 / -0.3%	386877524 / 367084974 / +5.4%	0.77 / 0.81 / -5.4%
clickbench_q33/datafusion:vortex-file-compressed	330056380 / 326591124 / +1.1%	460453525 / 411971133 / +11.8% 🔴	0.72 / 0.79 / -9.6%
clickbench_q34/datafusion:vortex-file-compressed	326813987 / 327973360 / -0.4%	434764448 / 417832541 / +4.1%	0.75 / 0.78 / -4.2%
clickbench_q35/datafusion:vortex-file-compressed	55499468 / 55906881 / -0.7%	88379430 / 86104804 / +2.6%	0.63 / 0.65 / -3.3%
clickbench_q36/datafusion:vortex-file-compressed	37348763 / 37318438 / +0.1%	67323906 / 63648233 / +5.8%	0.55 / 0.59 / -5.4%
clickbench_q37/datafusion:vortex-file-compressed	22091719 / 21584254 / +2.4%	48441082 / 46912370 / +3.3%	0.46 / 0.46 / -0.9%
clickbench_q38/datafusion:vortex-file-compressed	11874828 / 11466209 / +3.6%	41008219 / 39561191 / +3.7%	0.29 / 0.29 / -0.1%
clickbench_q39/datafusion:vortex-file-compressed	79120444 / 77618410 / +1.9%	112343269 / 109358569 / +2.7%	0.70 / 0.71 / -0.8%
clickbench_q40/datafusion:vortex-file-compressed	11325170 / 11388881 / -0.6%	38249200 / 35966109 / +6.3%	0.30 / 0.32 / -6.5%
clickbench_q41/datafusion:vortex-file-compressed	10668568 / 10379699 / +2.8%	37393717 / 35680324 / +4.8%	0.29 / 0.29 / -1.9%
clickbench_q42/datafusion:vortex-file-compressed	11092586 / 11097692 / -0.0%	37651707 / 35480838 / +6.1%	0.29 / 0.31 / -5.8%

datafusion / vortex-compact / ns (1.003x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact	1272133 / 1229142 / +3.5%	21239896 / 20899283 / +1.6%	0.06 / 0.06 / +1.8%
clickbench_q01/datafusion:vortex-compact	7193798 / 7041901 / +2.2%	34783514 / 36618302 / -5.0%	0.21 / 0.19 / +7.5%
clickbench_q02/datafusion:vortex-compact	19935283 / 19939496 / -0.0%	44629110 / 42145327 / +5.9%	0.45 / 0.47 / -5.6%
clickbench_q03/datafusion:vortex-compact	14353628 / 14263994 / +0.6%	43580693 / 39990970 / +9.0%	0.33 / 0.36 / -7.7%
clickbench_q04/datafusion:vortex-compact	57466242 / 56995680 / +0.8%	86256655 / 87764668 / -1.7%	0.67 / 0.65 / +2.6%
clickbench_q05/datafusion:vortex-compact	82598085 / 82520729 / +0.1%	117104867 / 125848432 / -6.9%	0.71 / 0.66 / +7.6%
clickbench_q06/datafusion:vortex-compact	1222875 / 1236695 / -1.1%	21348283 / 20221750 / +5.6%	0.06 / 0.06 / -6.3%
clickbench_q07/datafusion:vortex-compact	12258728 / 12244152 / +0.1%	37585568 / 35596737 / +5.6%	0.33 / 0.34 / -5.2%
clickbench_q08/datafusion:vortex-compact	84066216 / 86475390 / -2.8%	118545955 / 116143082 / +2.1%	0.71 / 0.74 / -4.8%
clickbench_q09/datafusion:vortex-compact	188330250 / 189092468 / -0.4%	224259049 / 219562079 / +2.1%	0.84 / 0.86 / -2.5%
clickbench_q10/datafusion:vortex-compact	43069274 / 43864742 / -1.8%	71668106 / 70629317 / +1.5%	0.60 / 0.62 / -3.2%
clickbench_q11/datafusion:vortex-compact	55566454 / 55712300 / -0.3%	83960154 / 83424570 / +0.6%	0.66 / 0.67 / -0.9%
clickbench_q12/datafusion:vortex-compact	83023330 / 80277938 / +3.4%	128322565 / 120125148 / +6.8%	0.65 / 0.67 / -3.2%
clickbench_q13/datafusion:vortex-compact	135738504 / 135352396 / +0.3%	186247276 / 189236769 / -1.6%	0.73 / 0.72 / +1.9%
clickbench_q14/datafusion:vortex-compact	91688570 / 93024476 / -1.4%	132130560 / 129638863 / +1.9%	0.69 / 0.72 / -3.3%
clickbench_q15/datafusion:vortex-compact	62714401 / 62850383 / -0.2%	94371869 / 93549609 / +0.9%	0.66 / 0.67 / -1.1%
clickbench_q16/datafusion:vortex-compact	160922334 / 167267762 / -3.8%	216910267 / 216415672 / +0.2%	0.74 / 0.77 / -4.0%
clickbench_q17/datafusion:vortex-compact	165129270 / 162137223 / +1.8%	230324829 / 211668020 / +8.8%	0.72 / 0.77 / -6.4%
clickbench_q18/datafusion:vortex-compact	304952322 / 298004146 / +2.3%	370000779 / 375697461 / -1.5%	0.82 / 0.79 / +3.9%
clickbench_q19/datafusion:vortex-compact	10298566 / 10105572 / +1.9%	39436045 / 38291168 / +3.0%	0.26 / 0.26 / -1.0%
clickbench_q20/datafusion:vortex-compact	70629166 / 72627329 / -2.8%	191349244 / 191047390 / +0.2%	0.37 / 0.38 / -2.9%
clickbench_q21/datafusion:vortex-compact	116742716 / 117463642 / -0.6%	225737828 / 227649378 / -0.8%	0.52 / 0.52 / +0.2%
clickbench_q22/datafusion:vortex-compact	185198220 / 185392934 / -0.1%	274549011 / 275551206 / -0.4%	0.67 / 0.67 / +0.3%
clickbench_q23/datafusion:vortex-compact	628682160 / 549691508 / +14.4% 🔴	636975092 / 629680275 / +1.2%	0.99 / 0.87 / +13.1%
clickbench_q24/datafusion:vortex-compact	29087723 / 28789956 / +1.0%	60097408 / 57043765 / +5.4%	0.48 / 0.50 / -4.1%
clickbench_q25/datafusion:vortex-compact	36710189 / 38329842 / -4.2%	65671278 / 69343453 / -5.3%	0.56 / 0.55 / +1.1%
clickbench_q26/datafusion:vortex-compact	29165223 / 30397553 / -4.1%	61399177 / 59446766 / +3.3%	0.48 / 0.51 / -7.1%
clickbench_q27/datafusion:vortex-compact	103810081 / 104856423 / -1.0%	215476098 / 210644543 / +2.3%	0.48 / 0.50 / -3.2%
clickbench_q28/datafusion:vortex-compact	577500364 / 583115310 / -1.0%	637576272 / 614405168 / +3.8%	0.91 / 0.95 / -4.6%
clickbench_q29/datafusion:vortex-compact	30878442 / 31540489 / -2.1%	55373623 / 54190276 / +2.2%	0.56 / 0.58 / -4.2%
clickbench_q30/datafusion:vortex-compact	94901236 / 92187094 / +2.9%	128128092 / 128097694 / +0.0%	0.74 / 0.72 / +2.9%
clickbench_q31/datafusion:vortex-compact	100460365 / 100517930 / -0.1%	152233719 / 152776754 / -0.4%	0.66 / 0.66 / +0.3%
clickbench_q32/datafusion:vortex-compact	305086852 / 298745615 / +2.1%	384116777 / 367472654 / +4.5%	0.79 / 0.81 / -2.3%
clickbench_q33/datafusion:vortex-compact	333759262 / 347551078 / -4.0%	424213919 / 412009598 / +3.0%	0.79 / 0.84 / -6.7%
clickbench_q34/datafusion:vortex-compact	347740082 / 340523571 / +2.1%	440241304 / 416089998 / +5.8%	0.79 / 0.82 / -3.5%
clickbench_q35/datafusion:vortex-compact	61254116 / 61686800 / -0.7%	94992812 / 92831189 / +2.3%	0.64 / 0.66 / -3.0%
clickbench_q36/datafusion:vortex-compact	38630132 / 37894798 / +1.9%	67793380 / 68077560 / -0.4%	0.57 / 0.56 / +2.4%
clickbench_q37/datafusion:vortex-compact	22588487 / 22417525 / +0.8%	47626402 / 45749509 / +4.1%	0.47 / 0.49 / -3.2%
clickbench_q38/datafusion:vortex-compact	13039052 / 12736005 / +2.4%	42244426 / 40676152 / +3.9%	0.31 / 0.31 / -1.4%
clickbench_q39/datafusion:vortex-compact	80049530 / 79049958 / +1.3%	112333462 / 110841692 / +1.3%	0.71 / 0.71 / -0.1%
clickbench_q40/datafusion:vortex-compact	12549786 / 12513722 / +0.3%	39057431 / 37399884 / +4.4%	0.32 / 0.33 / -4.0%
clickbench_q41/datafusion:vortex-compact	13138291 / 12812346 / +2.5%	36851743 / 36209328 / +1.8%	0.36 / 0.35 / +0.8%
clickbench_q42/datafusion:vortex-compact	11078719 / 11322962 / -2.2%	36498874 / 34685151 / +5.2%	0.30 / 0.33 / -7.0%

datafusion / parquet / ns (1.022x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1259350 / 1261609 / -0.2%	49967702 / 50059324 / -0.2%	0.03 / 0.03 / +0.0%
clickbench_q01/datafusion:parquet	16096314 / 16370284 / -1.7%	69287104 / 74666946 / -7.2%	0.23 / 0.22 / +6.0%
clickbench_q02/datafusion:parquet	18540798 / 18412162 / +0.7%	83637953 / 84274823 / -0.8%	0.22 / 0.22 / +1.5%
clickbench_q03/datafusion:parquet	17059110 / 16758413 / +1.8%	84243339 / 84179365 / +0.1%	0.20 / 0.20 / +1.7%
clickbench_q04/datafusion:parquet	64791770 / 62989112 / +2.9%	128438604 / 126899278 / +1.2%	0.50 / 0.50 / +1.6%
clickbench_q05/datafusion:parquet	90155766 / 87599294 / +2.9%	160680126 / 160769247 / -0.1%	0.56 / 0.54 / +3.0%
clickbench_q06/datafusion:parquet	1297242 / 1276146 / +1.7%	50046176 / 49619441 / +0.9%	0.03 / 0.03 / +0.8%
clickbench_q07/datafusion:parquet	16785558 / 16728259 / +0.3%	69031458 / 69793734 / -1.1%	0.24 / 0.24 / +1.5%
clickbench_q08/datafusion:parquet	84962630 / 83532077 / +1.7%	171388935 / 169900194 / +0.9%	0.50 / 0.49 / +0.8%
clickbench_q09/datafusion:parquet	192465938 / 187565522 / +2.6%	279130849 / 266289706 / +4.8%	0.69 / 0.70 / -2.1%
clickbench_q10/datafusion:parquet	36067684 / 36137208 / -0.2%	102345756 / 102885052 / -0.5%	0.35 / 0.35 / +0.3%
clickbench_q11/datafusion:parquet	43675335 / 42185747 / +3.5%	111513762 / 112230740 / -0.6%	0.39 / 0.38 / +4.2%
clickbench_q12/datafusion:parquet	95552474 / 94573846 / +1.0%	163942591 / 159932670 / +2.5%	0.58 / 0.59 / -1.4%
clickbench_q13/datafusion:parquet	148261886 / 144685306 / +2.5%	229169728 / 221877325 / +3.3%	0.65 / 0.65 / -0.8%
clickbench_q14/datafusion:parquet	102463058 / 99560450 / +2.9%	176424116 / 171316938 / +3.0%	0.58 / 0.58 / -0.1%
clickbench_q15/datafusion:parquet	71091854 / 71133890 / -0.1%	134827563 / 132792850 / +1.5%	0.53 / 0.54 / -1.6%
clickbench_q16/datafusion:parquet	156292004 / 154401356 / +1.2%	240180775 / 234610139 / +2.4%	0.65 / 0.66 / -1.1%
clickbench_q17/datafusion:parquet	157856940 / 153030374 / +3.2%	241322259 / 235278339 / +2.6%	0.65 / 0.65 / +0.6%
clickbench_q18/datafusion:parquet	316451488 / 312124055 / +1.4%	415746415 / 411151455 / +1.1%	0.76 / 0.76 / +0.3%
clickbench_q19/datafusion:parquet	19411209 / 19251706 / +0.8%	77602643 / 78525761 / -1.2%	0.25 / 0.25 / +2.0%
clickbench_q20/datafusion:parquet	178494830 / 170959461 / +4.4%	284037894 / 299459540 / -5.1%	0.63 / 0.57 / +10.1%
clickbench_q21/datafusion:parquet	175018540 / 163859418 / +6.8%	300601394 / 311116636 / -3.4%	0.58 / 0.53 / +10.5%
clickbench_q22/datafusion:parquet	263259572 / 247950316 / +6.2%	432825498 / 452790231 / -4.4%	0.61 / 0.55 / +11.1%
clickbench_q23/datafusion:parquet	1158222244 / 957601351 / +21.0% 🔴	1242820710 / 1192382367 / +4.2%	0.93 / 0.80 / +16.0%
clickbench_q24/datafusion:parquet	29787059 / 29550888 / +0.8%	90820551 / 91501881 / -0.7%	0.33 / 0.32 / +1.6%
clickbench_q25/datafusion:parquet	36046556 / 35847914 / +0.6%	103669983 / 102582647 / +1.1%	0.35 / 0.35 / -0.5%
clickbench_q26/datafusion:parquet	30514798 / 31013416 / -1.6%	90025462 / 91946356 / -2.1%	0.34 / 0.34 / +0.5%
clickbench_q27/datafusion:parquet	192964269 / 182662210 / +5.6%	296315247 / 304428558 / -2.7%	0.65 / 0.60 / +8.5%
clickbench_q28/datafusion:parquet	625097535 / 616525531 / +1.4%	710235156 / 699851214 / +1.5%	0.88 / 0.88 / -0.1%
clickbench_q29/datafusion:parquet	29970198 / 29967982 / +0.0%	93961558 / 92877901 / +1.2%	0.32 / 0.32 / -1.1%
clickbench_q30/datafusion:parquet	90968695 / 89038737 / +2.2%	177098105 / 174595629 / +1.4%	0.51 / 0.51 / +0.7%
clickbench_q31/datafusion:parquet	103582807 / 99774732 / +3.8%	199828120 / 196087340 / +1.9%	0.52 / 0.51 / +1.9%
clickbench_q32/datafusion:parquet	325223278 / 314925525 / +3.3%	429931578 / 419495953 / +2.5%	0.76 / 0.75 / +0.8%
clickbench_q33/datafusion:parquet	385550784 / 372715219 / +3.4%	483353453 / 457376529 / +5.7%	0.80 / 0.81 / -2.1%
clickbench_q34/datafusion:parquet	384014028 / 369248148 / +4.0%	479643174 / 471882883 / +1.6%	0.80 / 0.78 / +2.3%
clickbench_q35/datafusion:parquet	63851824 / 63618888 / +0.4%	124625356 / 124295870 / +0.3%	0.51 / 0.51 / +0.1%
clickbench_q36/datafusion:parquet	73562602 / 72622756 / +1.3%	136810783 / 136497153 / +0.2%	0.54 / 0.53 / +1.1%
clickbench_q37/datafusion:parquet	35416368 / 35429864 / -0.0%	92509620 / 91995328 / +0.6%	0.38 / 0.39 / -0.6%
clickbench_q38/datafusion:parquet	47673652 / 47091656 / +1.2%	108572303 / 106729541 / +1.7%	0.44 / 0.44 / -0.5%
clickbench_q39/datafusion:parquet	143538669 / 143098960 / +0.3%	215806697 / 210412131 / +2.6%	0.67 / 0.68 / -2.2%
clickbench_q40/datafusion:parquet	20143271 / 20054720 / +0.4%	79377341 / 77670827 / +2.2%	0.25 / 0.26 / -1.7%
clickbench_q41/datafusion:parquet	19087732 / 18679842 / +2.2%	76571518 / 75838161 / +1.0%	0.25 / 0.25 / +1.2%
clickbench_q42/datafusion:parquet	19283492 / 18974810 / +1.6%	75006556 / 74534756 / +0.6%	0.26 / 0.25 / +1.0%

duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	1589234 / 1595752 / -0.4%	25875878 / 22846090 / +13.3% 🔴	0.06 / 0.07 / -12.1%
clickbench_q01/duckdb:vortex-file-compressed	12788106 / 12528157 / +2.1%	26980384 / 29872347 / -9.7%	0.47 / 0.42 / +13.0%
clickbench_q02/duckdb:vortex-file-compressed	14629474 / 13548224 / +8.0%	36830885 / 33077658 / +11.3% 🔴	0.40 / 0.41 / -3.0%
clickbench_q03/duckdb:vortex-file-compressed	18094942 / 18995842 / -4.7%	53530878 / 49352213 / +8.5%	0.34 / 0.38 / -12.2%
clickbench_q04/duckdb:vortex-file-compressed	68018306 / 68274590 / -0.4%	106471082 / 100031665 / +6.4%	0.64 / 0.68 / -6.4%
clickbench_q05/duckdb:vortex-file-compressed	66132754 / 68025386 / -2.8%	92924752 / 92691401 / +0.3%	0.71 / 0.73 / -3.0%
clickbench_q06/duckdb:vortex-file-compressed	1837038 / 1889120 / -2.8%	28776883 / 33297119 / -13.6% 🟢	0.06 / 0.06 / +12.5%
clickbench_q07/duckdb:vortex-file-compressed	13759744 / 13947424 / -1.3%	31296541 / 34883282 / -10.3% 🟢	0.44 / 0.40 / +10.0%
clickbench_q08/duckdb:vortex-file-compressed	82240478 / 84226410 / -2.4%	129164437 / 125921184 / +2.6%	0.64 / 0.67 / -4.8%
clickbench_q09/duckdb:vortex-file-compressed	105559072 / 108621558 / -2.8%	158586603 / 147561793 / +7.5%	0.67 / 0.74 / -9.6%
clickbench_q10/duckdb:vortex-file-compressed	34670692 / 34459059 / +0.6%	70879847 / 69284589 / +2.3%	0.49 / 0.50 / -1.7%
clickbench_q11/duckdb:vortex-file-compressed	35126212 / 34914528 / +0.6%	74898183 / 78700943 / -4.8%	0.47 / 0.44 / +5.7%
clickbench_q12/duckdb:vortex-file-compressed	74004320 / 72774228 / +1.7%	104127429 / 106702403 / -2.4%	0.71 / 0.68 / +4.2%
clickbench_q13/duckdb:vortex-file-compressed	145047772 / 133110366 / +9.0%	179107380 / 182051702 / -1.6%	0.81 / 0.73 / +10.8%
clickbench_q14/duckdb:vortex-file-compressed	78028924 / 77422978 / +0.8%	108661179 / 108147612 / +0.5%	0.72 / 0.72 / +0.3%
clickbench_q15/duckdb:vortex-file-compressed	90246914 / 91245746 / -1.1%	128716577 / 129789398 / -0.8%	0.70 / 0.70 / -0.3%
clickbench_q16/duckdb:vortex-file-compressed	158359225 / 162204400 / -2.4%	223852308 / 235659263 / -5.0%	0.71 / 0.69 / +2.8%
clickbench_q17/duckdb:vortex-file-compressed	161048340 / 163955284 / -1.8%	226845428 / 210310916 / +7.9%	0.71 / 0.78 / -8.9%
clickbench_q18/duckdb:vortex-file-compressed	313993570 / 310113665 / +1.3%	375175432 / 375031278 / +0.0%	0.84 / 0.83 / +1.2%
clickbench_q19/duckdb:vortex-file-compressed	16894015 / 17116962 / -1.3%	43482258 / 39867939 / +9.1%	0.39 / 0.43 / -9.5%
clickbench_q20/duckdb:vortex-file-compressed	110416666 / 112428022 / -1.8%	189243095 / 193822281 / -2.4%	0.58 / 0.58 / +0.6%
clickbench_q21/duckdb:vortex-file-compressed	158510050 / 159186987 / -0.4%	305313515 / 305801130 / -0.2%	0.52 / 0.52 / -0.3%
clickbench_q22/duckdb:vortex-file-compressed	232477139 / 244962620 / -5.1%	466359033 / 484924943 / -3.8%	0.50 / 0.51 / -1.3%
clickbench_q23/duckdb:vortex-file-compressed	59387290 / 58205253 / +2.0%	96991097 / 101364172 / -4.3%	0.61 / 0.57 / +6.6%
clickbench_q24/duckdb:vortex-file-compressed	25451659 / 28153695 / -9.6%	47566793 / 44440199 / +7.0%	0.54 / 0.63 / -15.5%
clickbench_q25/duckdb:vortex-file-compressed	32215795 / 31427772 / +2.5%	54903048 / 50456932 / +8.8%	0.59 / 0.62 / -5.8%
clickbench_q26/duckdb:vortex-file-compressed	19600251 / 20174652 / -2.8%	36157796 / 35085489 / +3.1%	0.54 / 0.58 / -5.7%
clickbench_q27/duckdb:vortex-file-compressed	146929124 / 147669204 / -0.5%	267929395 / 259243314 / +3.4%	0.55 / 0.57 / -3.7%
clickbench_q28/duckdb:vortex-file-compressed	813025212 / 820732071 / -0.9%	688850442 / 682056927 / +1.0%	1.18 / 1.20 / -1.9%
clickbench_q29/duckdb:vortex-file-compressed	17474952 / 17699606 / -1.3%	37463484 / 41265357 / -9.2%	0.47 / 0.43 / +8.8%
clickbench_q30/duckdb:vortex-file-compressed	65135266 / 65227942 / -0.1%	113788990 / 115223468 / -1.2%	0.57 / 0.57 / +1.1%
clickbench_q31/duckdb:vortex-file-compressed	124440120 / 124590372 / -0.1%	206884345 / 208513035 / -0.8%	0.60 / 0.60 / +0.7%
clickbench_q32/duckdb:vortex-file-compressed	453633694 / 447770127 / +1.3%	520453698 / 542249779 / -4.0%	0.87 / 0.83 / +5.6%
clickbench_q33/duckdb:vortex-file-compressed	388537478 / 389705968 / -0.3%	498562609 / 510134409 / -2.3%	0.78 / 0.76 / +2.0%
clickbench_q34/duckdb:vortex-file-compressed	408054793 / 412938170 / -1.2%	528533981 / 549305523 / -3.8%	0.77 / 0.75 / +2.7%
clickbench_q35/duckdb:vortex-file-compressed	102436320 / 101687528 / +0.7%	136907699 / 136148785 / +0.6%	0.75 / 0.75 / +0.2%
clickbench_q36/duckdb:vortex-file-compressed	16192529 / 15888624 / +1.9%	33145549 / 34043953 / -2.6%	0.49 / 0.47 / +4.7%
clickbench_q37/duckdb:vortex-file-compressed	11495878 / 11892074 / -3.3%	27951317 / 32398406 / -13.7% 🟢	0.41 / 0.37 / +12.0%
clickbench_q38/duckdb:vortex-file-compressed	12654932 / 13667630 / -7.4%	29188171 / 29529822 / -1.2%	0.43 / 0.46 / -6.3%
clickbench_q39/duckdb:vortex-file-compressed	23926161 / 23506602 / +1.8%	41095001 / 42892248 / -4.2%	0.58 / 0.55 / +6.2%
clickbench_q40/duckdb:vortex-file-compressed	11688961 / 10422526 / +12.2% 🔴	28983166 / 26153327 / +10.8% 🔴	0.40 / 0.40 / +1.2%
clickbench_q41/duckdb:vortex-file-compressed	12088089 / 11555590 / +4.6%	33281890 / 27379134 / +21.6% 🔴	0.36 / 0.42 / -13.9%
clickbench_q42/duckdb:vortex-file-compressed	13191505 / 11847380 / +11.3% 🔴	27291784 / 27948889 / -2.4%	0.48 / 0.42 / +14.0%

duckdb / vortex-compact / ns (0.986x ➖, 2↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact	1574646 / 1563988 / +0.7%	23593144 / 26588590 / -11.3% 🟢	0.07 / 0.06 / +13.5%
clickbench_q01/duckdb:vortex-compact	12265678 / 14932588 / -17.9% 🟢	27902385 / 28785120 / -3.1%	0.44 / 0.52 / -15.3%
clickbench_q02/duckdb:vortex-compact	19069764 / 19766154 / -3.5%	39537397 / 41490336 / -4.7%	0.48 / 0.48 / +1.2%
clickbench_q03/duckdb:vortex-compact	19832330 / 20277776 / -2.2%	50049385 / 49140319 / +1.8%	0.40 / 0.41 / -4.0%
clickbench_q04/duckdb:vortex-compact	72028472 / 73112137 / -1.5%	106942363 / 104783219 / +2.1%	0.67 / 0.70 / -3.5%
clickbench_q05/duckdb:vortex-compact	75694172 / 74709920 / +1.3%	104009152 / 105631732 / -1.5%	0.73 / 0.71 / +2.9%
clickbench_q06/duckdb:vortex-compact	1886405 / 1853393 / +1.8%	29811677 / 28257153 / +5.5%	0.06 / 0.07 / -3.5%
clickbench_q07/duckdb:vortex-compact	14719228 / 14443062 / +1.9%	31492927 / 35525264 / -11.4% 🟢	0.47 / 0.41 / +15.0%
clickbench_q08/duckdb:vortex-compact	100035436 / 94656682 / +5.7%	137175017 / 133299265 / +2.9%	0.73 / 0.71 / +2.7%
clickbench_q09/duckdb:vortex-compact	142030966 / 150863831 / -5.9%	183192546 / 183277320 / -0.0%	0.78 / 0.82 / -5.8%
clickbench_q10/duckdb:vortex-compact	52445326 / 53166743 / -1.4%	90030983 / 91896973 / -2.0%	0.58 / 0.58 / +0.7%
clickbench_q11/duckdb:vortex-compact	65358474 / 66336257 / -1.5%	102263522 / 102831530 / -0.6%	0.64 / 0.65 / -0.9%
clickbench_q12/duckdb:vortex-compact	86104642 / 87045412 / -1.1%	123902367 / 127465551 / -2.8%	0.69 / 0.68 / +1.8%
clickbench_q13/duckdb:vortex-compact	170096178 / 166696301 / +2.0%	212312223 / 218101787 / -2.7%	0.80 / 0.76 / +4.8%
clickbench_q14/duckdb:vortex-compact	97325051 / 95965188 / +1.4%	132708416 / 129378633 / +2.6%	0.73 / 0.74 / -1.1%
clickbench_q15/duckdb:vortex-compact	96408814 / 95489500 / +1.0%	134365573 / 132840061 / +1.1%	0.72 / 0.72 / -0.2%
clickbench_q16/duckdb:vortex-compact	176070043 / 185653444 / -5.2%	223723408 / 223705684 / +0.0%	0.79 / 0.83 / -5.2%
clickbench_q17/duckdb:vortex-compact	178249210 / 181317084 / -1.7%	232563000 / 224525068 / +3.6%	0.77 / 0.81 / -5.1%
clickbench_q18/duckdb:vortex-compact	327910759 / 333148712 / -1.6%	384464997 / 417834358 / -8.0%	0.85 / 0.80 / +7.0%
clickbench_q19/duckdb:vortex-compact	16297070 / 16815236 / -3.1%	40050208 / 42968929 / -6.8%	0.41 / 0.39 / +4.0%
clickbench_q20/duckdb:vortex-compact	107572629 / 116185399 / -7.4%	175181804 / 179628864 / -2.5%	0.61 / 0.65 / -5.1%
clickbench_q21/duckdb:vortex-compact	177544726 / 175298326 / +1.3%	327106069 / 319728165 / +2.3%	0.54 / 0.55 / -1.0%
clickbench_q22/duckdb:vortex-compact	352116130 / 356130794 / -1.1%	562379655 / 558321264 / +0.7%	0.63 / 0.64 / -1.8%
clickbench_q23/duckdb:vortex-compact	94210461 / 93015046 / +1.3%	124843866 / 136715002 / -8.7%	0.75 / 0.68 / +10.9%
clickbench_q24/duckdb:vortex-compact	30588444 / 30876206 / -0.9%	46985604 / 44498219 / +5.6%	0.65 / 0.69 / -6.2%
clickbench_q25/duckdb:vortex-compact	47746830 / 47719522 / +0.1%	70209912 / 72782871 / -3.5%	0.68 / 0.66 / +3.7%
clickbench_q26/duckdb:vortex-compact	23502874 / 25395279 / -7.5%	38290228 / 40332209 / -5.1%	0.61 / 0.63 / -2.5%
clickbench_q27/duckdb:vortex-compact	198027293 / 208567818 / -5.1%	324108516 / 325311455 / -0.4%	0.61 / 0.64 / -4.7%
clickbench_q28/duckdb:vortex-compact	661233080 / 596422470 / +10.9% 🔴	687047904 / 700831288 / -2.0%	0.96 / 0.85 / +13.1%
clickbench_q29/duckdb:vortex-compact	22312358 / 21560964 / +3.5%	43075086 / 42236226 / +2.0%	0.52 / 0.51 / +1.5%
clickbench_q30/duckdb:vortex-compact	111269218 / 111032387 / +0.2%	153699878 / 152556488 / +0.7%	0.72 / 0.73 / -0.5%
clickbench_q31/duckdb:vortex-compact	173452638 / 162273980 / +6.9%	244847281 / 251139419 / -2.5%	0.71 / 0.65 / +9.6%
clickbench_q32/duckdb:vortex-compact	445435500 / 454422827 / -2.0%	497141687 / 533189394 / -6.8%	0.90 / 0.85 / +5.1%
clickbench_q33/duckdb:vortex-compact	384041072 / 394787206 / -2.7%	492471341 / 502198191 / -1.9%	0.78 / 0.79 / -0.8%
clickbench_q34/duckdb:vortex-compact	413454738 / 416057890 / -0.6%	520169673 / 518037256 / +0.4%	0.79 / 0.80 / -1.0%
clickbench_q35/duckdb:vortex-compact	108229494 / 106381066 / +1.7%	140047518 / 161598210 / -13.3% 🟢	0.77 / 0.66 / +17.4%
clickbench_q36/duckdb:vortex-compact	16954770 / 16955880 / -0.0%	34252811 / 33358063 / +2.7%	0.49 / 0.51 / -2.6%
clickbench_q37/duckdb:vortex-compact	13467346 / 13978167 / -3.7%	29913852 / 30416265 / -1.7%	0.45 / 0.46 / -2.0%
clickbench_q38/duckdb:vortex-compact	14541522 / 14647822 / -0.7%	29106338 / 31218762 / -6.8%	0.50 / 0.47 / +6.5%
clickbench_q39/duckdb:vortex-compact	25847230 / 27793946 / -7.0%	41018220 / 44250028 / -7.3%	0.63 / 0.63 / +0.3%
clickbench_q40/duckdb:vortex-compact	13074458 / 12595740 / +3.8%	29064306 / 29311120 / -0.8%	0.45 / 0.43 / +4.7%
clickbench_q41/duckdb:vortex-compact	13313578 / 15477200 / -14.0% 🟢	28581686 / 32083588 / -10.9% 🟢	0.47 / 0.48 / -3.4%
clickbench_q42/duckdb:vortex-compact	13313853 / 13255303 / +0.4%	31434384 / 28885259 / +8.8%	0.42 / 0.46 / -7.7%

duckdb / parquet / ns (1.008x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	10516688 / 7606932 / +38.3% 🔴	22833154 / 20811532 / +9.7%	0.46 / 0.37 / +26.0%
clickbench_q01/duckdb:parquet	12574423 / 10257054 / +22.6% 🔴	22095808 / 22429594 / -1.5%	0.57 / 0.46 / +24.4%
clickbench_q02/duckdb:parquet	16158686 / 15394753 / +5.0%	35733911 / 34570967 / +3.4%	0.45 / 0.45 / +1.5%
clickbench_q03/duckdb:parquet	16081636 / 15491338 / +3.8%	53644978 / 52062567 / +3.0%	0.30 / 0.30 / +0.7%
clickbench_q04/duckdb:parquet	69801234 / 71338051 / -2.2%	91749667 / 90258775 / +1.7%	0.76 / 0.79 / -3.7%
clickbench_q05/duckdb:parquet	78512865 / 85561457 / -8.2%	119366367 / 114932733 / +3.9%	0.66 / 0.74 / -11.6%
clickbench_q06/duckdb:parquet	14624642 / 15563422 / -6.0%	27294964 / 25317996 / +7.8%	0.54 / 0.61 / -12.8%
clickbench_q07/duckdb:parquet	11254190 / 11248144 / +0.1%	23871682 / 22862692 / +4.4%	0.47 / 0.49 / -4.2%
clickbench_q08/duckdb:parquet	85675903 / 82055512 / +4.4%	128579637 / 125229930 / +2.7%	0.67 / 0.66 / +1.7%
clickbench_q09/duckdb:parquet	114355262 / 114115622 / +0.2%	182017439 / 159185897 / +14.3% 🔴	0.63 / 0.72 / -12.4%
clickbench_q10/duckdb:parquet	31688064 / 34706510 / -8.7%	67895210 / 67140388 / +1.1%	0.47 / 0.52 / -9.7%
clickbench_q11/duckdb:parquet	36953484 / 37833830 / -2.3%	76622300 / 75395249 / +1.6%	0.48 / 0.50 / -3.9%
clickbench_q12/duckdb:parquet	92630938 / 90468996 / +2.4%	135045715 / 135258782 / -0.2%	0.69 / 0.67 / +2.6%
clickbench_q13/duckdb:parquet	144424120 / 142931309 / +1.0%	207007729 / 206475004 / +0.3%	0.70 / 0.69 / +0.8%
clickbench_q14/duckdb:parquet	97450494 / 98974314 / -1.5%	136318058 / 143757392 / -5.2%	0.71 / 0.69 / +3.8%
clickbench_q15/duckdb:parquet	91094018 / 97079846 / -6.2%	124855909 / 123595076 / +1.0%	0.73 / 0.79 / -7.1%
clickbench_q16/duckdb:parquet	166884732 / 170558755 / -2.2%	224351226 / 228706775 / -1.9%	0.74 / 0.75 / -0.3%
clickbench_q17/duckdb:parquet	174481466 / 174327436 / +0.1%	247892670 / 237738979 / +4.3%	0.70 / 0.73 / -4.0%
clickbench_q18/duckdb:parquet	316434151 / 322555728 / -1.9%	399659862 / 410908487 / -2.7%	0.79 / 0.78 / +0.9%
clickbench_q19/duckdb:parquet	13303354 / 13474256 / -1.3%	41302787 / 44036177 / -6.2%	0.32 / 0.31 / +5.3%
clickbench_q20/duckdb:parquet	132629334 / 139726209 / -5.1%	248064383 / 247379434 / +0.3%	0.53 / 0.56 / -5.3%
clickbench_q21/duckdb:parquet	183713216 / 173404378 / +5.9%	324123996 / 325534905 / -0.4%	0.57 / 0.53 / +6.4%
clickbench_q22/duckdb:parquet	240712864 / 239802788 / +0.4%	434490035 / 410047694 / +6.0%	0.55 / 0.58 / -5.3%
clickbench_q23/duckdb:parquet	147163812 / 144874161 / +1.6%	162266406 / 171873225 / -5.6%	0.91 / 0.84 / +7.6%
clickbench_q24/duckdb:parquet	42621560 / 44889405 / -5.1%	63218852 / 67604589 / -6.5%	0.67 / 0.66 / +1.5%
clickbench_q25/duckdb:parquet	40957036 / 39660438 / +3.3%	91991158 / 91764446 / +0.2%	0.45 / 0.43 / +3.0%
clickbench_q26/duckdb:parquet	29006564 / 28742938 / +0.9%	51215550 / 48331826 / +6.0%	0.57 / 0.59 / -4.8%
clickbench_q27/duckdb:parquet	147532666 / 143132020 / +3.1%	264097335 / 260102748 / +1.5%	0.56 / 0.55 / +1.5%
clickbench_q28/duckdb:parquet	898474596 / 897556512 / +0.1%	991735311 / 989015718 / +0.3%	0.91 / 0.91 / -0.2%
clickbench_q29/duckdb:parquet	17564326 / 17957735 / -2.2%	33454200 / 30834688 / +8.5%	0.53 / 0.58 / -9.8%
clickbench_q30/duckdb:parquet	89969730 / 90948436 / -1.1%	171317983 / 173121099 / -1.0%	0.53 / 0.53 / -0.0%
clickbench_q31/duckdb:parquet	143665316 / 143426020 / +0.2%	289887490 / 291886174 / -0.7%	0.50 / 0.49 / +0.9%
clickbench_q32/duckdb:parquet	454353653 / 441625068 / +2.9%	496357483 / 485424960 / +2.3%	0.92 / 0.91 / +0.6%
clickbench_q33/duckdb:parquet	442352310 / 434066961 / +1.9%	478385397 / 470800634 / +1.6%	0.92 / 0.92 / +0.3%
clickbench_q34/duckdb:parquet	446567085 / 462464914 / -3.4%	490701116 / 495221427 / -0.9%	0.91 / 0.93 / -2.5%
clickbench_q35/duckdb:parquet	101256645 / 100235740 / +1.0%	126358634 / 118597434 / +6.5%	0.80 / 0.85 / -5.2%
clickbench_q36/duckdb:parquet	30952788 / 31042907 / -0.3%	40560956 / 43946241 / -7.7%	0.76 / 0.71 / +8.0%
clickbench_q37/duckdb:parquet	22631296 / 22772688 / -0.6%	31043089 / 32770567 / -5.3%	0.73 / 0.69 / +4.9%
clickbench_q38/duckdb:parquet	23829496 / 23815862 / +0.1%	33154782 / 37468667 / -11.5% 🟢	0.72 / 0.64 / +13.1%
clickbench_q39/duckdb:parquet	57115673 / 56791526 / +0.6%	66247401 / 65179368 / +1.6%	0.86 / 0.87 / -1.1%
clickbench_q40/duckdb:parquet	12539338 / 12617718 / -0.6%	22423451 / 23105208 / -3.0%	0.56 / 0.55 / +2.4%
clickbench_q41/duckdb:parquet	12864357 / 12423334 / +3.5%	22109220 / 22807077 / -3.1%	0.58 / 0.54 / +6.8%
clickbench_q42/duckdb:parquet	14327931 / 14571940 / -1.7%	24487152 / 24386586 / +0.4%	0.59 / 0.60 / -2.1%

No file size changes detected.

github-actions · 2026-09-16T10:49:40Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 071bb91b vs base 4af09a94
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.976x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.991x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed	23965665 / 24613508 / -2.6%	43866730 / 44983909 / -2.5%	0.55 / 0.55 / -0.2%
tpcds_q02/datafusion:vortex-file-compressed	45714874 / 45253895 / +1.0%	61470664 / 63452793 / -3.1%	0.74 / 0.71 / +4.3%
tpcds_q03/datafusion:vortex-file-compressed	12287612 / 11775511 / +4.3%	27421846 / 28834950 / -4.9%	0.45 / 0.41 / +9.7%
tpcds_q04/datafusion:vortex-file-compressed	112522936 / 115957410 / -3.0%	143155311 / 143579896 / -0.3%	0.79 / 0.81 / -2.7%
tpcds_q05/datafusion:vortex-file-compressed	60138740 / 60200846 / -0.1%	83507275 / 82716658 / +1.0%	0.72 / 0.73 / -1.0%
tpcds_q06/datafusion:vortex-file-compressed	23851010 / 23963480 / -0.5%	44772961 / 46326415 / -3.4%	0.53 / 0.52 / +3.0%
tpcds_q07/datafusion:vortex-file-compressed	33012906 / 32376860 / +2.0%	56064015 / 56997051 / -1.6%	0.59 / 0.57 / +3.7%
tpcds_q08/datafusion:vortex-file-compressed	25877279 / 25455011 / +1.7%	44760175 / 44911844 / -0.3%	0.58 / 0.57 / +2.0%
tpcds_q09/datafusion:vortex-file-compressed	16865510 / 17456064 / -3.4%	35353597 / 35464075 / -0.3%	0.48 / 0.49 / -3.1%
tpcds_q10/datafusion:vortex-file-compressed	28437528 / 29205323 / -2.6%	49778097 / 51605725 / -3.5%	0.57 / 0.57 / +0.9%
tpcds_q11/datafusion:vortex-file-compressed	62612326 / 63711062 / -1.7%	93519925 / 90614877 / +3.2%	0.67 / 0.70 / -4.8%
tpcds_q12/datafusion:vortex-file-compressed	16540786 / 16583672 / -0.3%	32522625 / 34020156 / -4.4%	0.51 / 0.49 / +4.3%
tpcds_q13/datafusion:vortex-file-compressed	33987639 / 34400388 / -1.2%	52465681 / 53870757 / -2.6%	0.65 / 0.64 / +1.4%
tpcds_q14/datafusion:vortex-file-compressed	91839816 / 90466897 / +1.5%	124510261 / 118046590 / +5.5%	0.74 / 0.77 / -3.8%
tpcds_q15/datafusion:vortex-file-compressed	23929620 / 24012361 / -0.3%	43318630 / 44919164 / -3.6%	0.55 / 0.53 / +3.3%
tpcds_q16/datafusion:vortex-file-compressed	20378022 / 20688040 / -1.5%	40775994 / 42928793 / -5.0%	0.50 / 0.48 / +3.7%
tpcds_q17/datafusion:vortex-file-compressed	61550680 / 58606500 / +5.0%	83691424 / 84017402 / -0.4%	0.74 / 0.70 / +5.4%
tpcds_q18/datafusion:vortex-file-compressed	68304522 / 68586240 / -0.4%	92392983 / 95734197 / -3.5%	0.74 / 0.72 / +3.2%
tpcds_q19/datafusion:vortex-file-compressed	18437940 / 18394836 / +0.2%	41059318 / 40714947 / +0.8%	0.45 / 0.45 / -0.6%
tpcds_q20/datafusion:vortex-file-compressed	17818062 / 17792512 / +0.1%	35038952 / 36107988 / -3.0%	0.51 / 0.49 / +3.2%
tpcds_q21/datafusion:vortex-file-compressed	17154396 / 17104270 / +0.3%	39403869 / 41893416 / -5.9%	0.44 / 0.41 / +6.6%
tpcds_q22/datafusion:vortex-file-compressed	49827487 / 50129417 / -0.6%	70820934 / 73295742 / -3.4%	0.70 / 0.68 / +2.9%
tpcds_q23/datafusion:vortex-file-compressed	74005711 / 72511889 / +2.1%	101943615 / 99666571 / +2.3%	0.73 / 0.73 / -0.2%
tpcds_q24/datafusion:vortex-file-compressed	70047961 / 70607318 / -0.8%	95865195 / 95486313 / +0.4%	0.73 / 0.74 / -1.2%
tpcds_q25/datafusion:vortex-file-compressed	56499554 / 52119700 / +8.4%	78976555 / 76108476 / +3.8%	0.72 / 0.68 / +4.5%
tpcds_q26/datafusion:vortex-file-compressed	30053148 / 29537584 / +1.7%	50861024 / 52167633 / -2.5%	0.59 / 0.57 / +4.4%
tpcds_q27/datafusion:vortex-file-compressed	63902634 / 62098810 / +2.9%	87636303 / 90837586 / -3.5%	0.73 / 0.68 / +6.7%
tpcds_q28/datafusion:vortex-file-compressed	18519696 / 17936784 / +3.2%	37370974 / 37006920 / +1.0%	0.50 / 0.48 / +2.2%
tpcds_q29/datafusion:vortex-file-compressed	60635051 / 61429544 / -1.3%	78969769 / 78830300 / +0.2%	0.77 / 0.78 / -1.5%
tpcds_q30/datafusion:vortex-file-compressed	27336618 / 27120744 / +0.8%	45079291 / 45712483 / -1.4%	0.61 / 0.59 / +2.2%
tpcds_q31/datafusion:vortex-file-compressed	65415973 / 64127012 / +2.0%	91223077 / 94445834 / -3.4%	0.72 / 0.68 / +5.6%
tpcds_q32/datafusion:vortex-file-compressed	13548204 / 13682280 / -1.0%	31037983 / 31347748 / -1.0%	0.44 / 0.44 / +0.0%
tpcds_q33/datafusion:vortex-file-compressed	27496726 / 27158386 / +1.2%	48366780 / 47883888 / +1.0%	0.57 / 0.57 / +0.2%
tpcds_q34/datafusion:vortex-file-compressed	18640264 / 18708184 / -0.4%	38471244 / 39468773 / -2.5%	0.48 / 0.47 / +2.2%
tpcds_q35/datafusion:vortex-file-compressed	35148681 / 35376942 / -0.6%	56469569 / 58569633 / -3.6%	0.62 / 0.60 / +3.0%
tpcds_q36/datafusion:vortex-file-compressed	49611890 / 47307464 / +4.9%	73321618 / 74856937 / -2.1%	0.68 / 0.63 / +7.1%
tpcds_q37/datafusion:vortex-file-compressed	13215162 / 13748130 / -3.9%	34094071 / 36090492 / -5.5%	0.39 / 0.38 / +1.8%
tpcds_q38/datafusion:vortex-file-compressed	29951782 / 30233598 / -0.9%	52372744 / 53071376 / -1.3%	0.57 / 0.57 / +0.4%
tpcds_q39/datafusion:vortex-file-compressed	65594731 / 66343951 / -1.1%	89347374 / 94734961 / -5.7%	0.73 / 0.70 / +4.8%
tpcds_q40/datafusion:vortex-file-compressed	25493572 / 24622711 / +3.5%	44216496 / 47213594 / -6.3%	0.58 / 0.52 / +10.6%
tpcds_q41/datafusion:vortex-file-compressed	16610995 / 16662026 / -0.3%	30651383 / 31085769 / -1.4%	0.54 / 0.54 / +1.1%
tpcds_q42/datafusion:vortex-file-compressed	11534418 / 11310660 / +2.0%	27869793 / 28271913 / -1.4%	0.41 / 0.40 / +3.4%
tpcds_q43/datafusion:vortex-file-compressed	13690460 / 13742020 / -0.4%	32000517 / 32670116 / -2.0%	0.43 / 0.42 / +1.7%
tpcds_q44/datafusion:vortex-file-compressed	26645892 / 26524878 / +0.5%	48539257 / 52916456 / -8.3%	0.55 / 0.50 / +9.5%
tpcds_q45/datafusion:vortex-file-compressed	28122358 / 28145676 / -0.1%	48319422 / 47784290 / +1.1%	0.58 / 0.59 / -1.2%
tpcds_q46/datafusion:vortex-file-compressed	24801795 / 24534090 / +1.1%	47149325 / 48706334 / -3.2%	0.53 / 0.50 / +4.4%
tpcds_q47/datafusion:vortex-file-compressed	78606450 / 78093712 / +0.7%	106113712 / 107412094 / -1.2%	0.74 / 0.73 / +1.9%
tpcds_q48/datafusion:vortex-file-compressed	31188346 / 31211372 / -0.1%	50874947 / 51876004 / -1.9%	0.61 / 0.60 / +1.9%
tpcds_q49/datafusion:vortex-file-compressed	62533171 / 59959234 / +4.3%	90929431 / 95083197 / -4.4%	0.69 / 0.63 / +9.1%
tpcds_q50/datafusion:vortex-file-compressed	34925554 / 34574179 / +1.0%	55094851 / 56124462 / -1.8%	0.63 / 0.62 / +2.9%
tpcds_q51/datafusion:vortex-file-compressed	61699303 / 60809854 / +1.5%	84571519 / 86223108 / -1.9%	0.73 / 0.71 / +3.4%
tpcds_q52/datafusion:vortex-file-compressed	11747074 / 11865020 / -1.0%	29066460 / 30282641 / -4.0%	0.40 / 0.39 / +3.1%
tpcds_q53/datafusion:vortex-file-compressed	18375108 / 18472358 / -0.5%	38395269 / 40306992 / -4.7%	0.48 / 0.46 / +4.4%
tpcds_q54/datafusion:vortex-file-compressed	34223894 / 35440382 / -3.4%	57538584 / 61216841 / -6.0%	0.59 / 0.58 / +2.7%
tpcds_q55/datafusion:vortex-file-compressed	11406843 / 11313370 / +0.8%	27474941 / 28450180 / -3.4%	0.42 / 0.40 / +4.4%
tpcds_q56/datafusion:vortex-file-compressed	27007468 / 27516892 / -1.9%	48118612 / 50507634 / -4.7%	0.56 / 0.54 / +3.0%
tpcds_q57/datafusion:vortex-file-compressed	73605138 / 73675518 / -0.1%	95507987 / 98043454 / -2.6%	0.77 / 0.75 / +2.6%
tpcds_q58/datafusion:vortex-file-compressed	41207260 / 41050378 / +0.4%	65995753 / 66618188 / -0.9%	0.62 / 0.62 / +1.3%
tpcds_q59/datafusion:vortex-file-compressed	32051058 / 32434296 / -1.2%	51506536 / 52736960 / -2.3%	0.62 / 0.62 / +1.2%
tpcds_q60/datafusion:vortex-file-compressed	26795508 / 26761780 / +0.1%	48262223 / 48490386 / -0.5%	0.56 / 0.55 / +0.6%
tpcds_q61/datafusion:vortex-file-compressed	24082587 / 25184298 / -4.4%	48941708 / 46658897 / +4.9%	0.49 / 0.54 / -8.8%
tpcds_q62/datafusion:vortex-file-compressed	17401349 / 17427893 / -0.2%	35493796 / 36951645 / -3.9%	0.49 / 0.47 / +3.9%
tpcds_q63/datafusion:vortex-file-compressed	18686075 / 18790958 / -0.6%	37191698 / 40045335 / -7.1%	0.50 / 0.47 / +7.1%
tpcds_q64/datafusion:vortex-file-compressed	322409344 / 320970643 / +0.4%	355341413 / 354289215 / +0.3%	0.91 / 0.91 / +0.2%
tpcds_q65/datafusion:vortex-file-compressed	76802592 / 76123736 / +0.9%	95341977 / 96461892 / -1.2%	0.81 / 0.79 / +2.1%
tpcds_q66/datafusion:vortex-file-compressed	53008132 / 52908076 / +0.2%	74460959 / 76067265 / -2.1%	0.71 / 0.70 / +2.4%
tpcds_q67/datafusion:vortex-file-compressed	55825602 / 56470176 / -1.1%	84481242 / 84414539 / +0.1%	0.66 / 0.67 / -1.2%
tpcds_q68/datafusion:vortex-file-compressed	24237381 / 24342632 / -0.4%	46795020 / 50012864 / -6.4%	0.52 / 0.49 / +6.4%
tpcds_q69/datafusion:vortex-file-compressed	28814918 / 28513338 / +1.1%	48435146 / 49480299 / -2.1%	0.59 / 0.58 / +3.2%
tpcds_q70/datafusion:vortex-file-compressed	71821568 / 71675272 / +0.2%	93198591 / 93896520 / -0.7%	0.77 / 0.76 / +1.0%
tpcds_q71/datafusion:vortex-file-compressed	20160558 / 19629870 / +2.7%	39774902 / 40118849 / -0.9%	0.51 / 0.49 / +3.6%
tpcds_q72/datafusion:vortex-file-compressed	463421907 / 477092648 / -2.9%	493420216 / 478988216 / +3.0%	0.94 / 1.00 / -5.7%
tpcds_q73/datafusion:vortex-file-compressed	17413698 / 17318791 / +0.5%	38476880 / 38367247 / +0.3%	0.45 / 0.45 / +0.3%
tpcds_q74/datafusion:vortex-file-compressed	45709558 / 45423777 / +0.6%	68383459 / 72069770 / -5.1%	0.67 / 0.63 / +6.1%
tpcds_q75/datafusion:vortex-file-compressed	128329975 / 132017515 / -2.8%	160517749 / 156477913 / +2.6%	0.80 / 0.84 / -5.2%
tpcds_q76/datafusion:vortex-file-compressed	43646924 / 42155398 / +3.5%	63524066 / 64303372 / -1.2%	0.69 / 0.66 / +4.8%
tpcds_q77/datafusion:vortex-file-compressed	35767662 / 35515819 / +0.7%	59940107 / 60749636 / -1.3%	0.60 / 0.58 / +2.1%
tpcds_q78/datafusion:vortex-file-compressed	80779606 / 79419746 / +1.7%	109150104 / 110780087 / -1.5%	0.74 / 0.72 / +3.2%
tpcds_q79/datafusion:vortex-file-compressed	21308910 / 21192760 / +0.5%	42065801 / 43619986 / -3.6%	0.51 / 0.49 / +4.3%
tpcds_q80/datafusion:vortex-file-compressed	77398946 / 76513965 / +1.2%	112562447 / 112472466 / +0.1%	0.69 / 0.68 / +1.1%
tpcds_q81/datafusion:vortex-file-compressed	28124553 / 28465433 / -1.2%	44450375 / 46031639 / -3.4%	0.63 / 0.62 / +2.3%
tpcds_q82/datafusion:vortex-file-compressed	13434126 / 13360998 / +0.5%	33571550 / 35719142 / -6.0%	0.40 / 0.37 / +7.0%
tpcds_q83/datafusion:vortex-file-compressed	36643005 / 36057704 / +1.6%	57918425 / 57441863 / +0.8%	0.63 / 0.63 / +0.8%
tpcds_q84/datafusion:vortex-file-compressed	12381912 / 12313998 / +0.6%	27661754 / 28456180 / -2.8%	0.45 / 0.43 / +3.4%
tpcds_q85/datafusion:vortex-file-compressed	59495311 / 60092349 / -1.0%	83446517 / 85599738 / -2.5%	0.71 / 0.70 / +1.6%
tpcds_q86/datafusion:vortex-file-compressed	16266158 / 16510778 / -1.5%	32366965 / 33139858 / -2.3%	0.50 / 0.50 / +0.9%
tpcds_q87/datafusion:vortex-file-compressed	29917936 / 29476486 / +1.5%	52419902 / 52193149 / +0.4%	0.57 / 0.56 / +1.1%
tpcds_q88/datafusion:vortex-file-compressed	34363330 / 35087570 / -2.1%	60569862 / 59412718 / +1.9%	0.57 / 0.59 / -3.9%
tpcds_q89/datafusion:vortex-file-compressed	21262990 / 21357998 / -0.4%	39691092 / 41674014 / -4.8%	0.54 / 0.51 / +4.5%
tpcds_q90/datafusion:vortex-file-compressed	10467437 / 10747053 / -2.6%	26342513 / 27896768 / -5.6%	0.40 / 0.39 / +3.1%
tpcds_q91/datafusion:vortex-file-compressed	16557880 / 17045331 / -2.9%	34928974 / 35759787 / -2.3%	0.47 / 0.48 / -0.5%
tpcds_q92/datafusion:vortex-file-compressed	14214250 / 13657294 / +4.1%	30587234 / 32221195 / -5.1%	0.46 / 0.42 / +9.6%
tpcds_q93/datafusion:vortex-file-compressed	24111315 / 23948942 / +0.7%	45648078 / 45578007 / +0.2%	0.53 / 0.53 / +0.5%
tpcds_q94/datafusion:vortex-file-compressed	19856446 / 19726358 / +0.7%	39066741 / 40630338 / -3.8%	0.51 / 0.49 / +4.7%
tpcds_q95/datafusion:vortex-file-compressed	46597080 / 45747236 / +1.9%	66386282 / 69139950 / -4.0%	0.70 / 0.66 / +6.1%
tpcds_q96/datafusion:vortex-file-compressed	9481717 / 9610876 / -1.3%	25420253 / 25839329 / -1.6%	0.37 / 0.37 / +0.3%
tpcds_q97/datafusion:vortex-file-compressed	21114113 / 21261544 / -0.7%	42345822 / 44359948 / -4.5%	0.50 / 0.48 / +4.0%
tpcds_q98/datafusion:vortex-file-compressed	17035468 / 16465264 / +3.5%	36215546 / 37316314 / -2.9%	0.47 / 0.44 / +6.6%
tpcds_q99/datafusion:vortex-file-compressed	19494650 / 19437630 / +0.3%	37271132 / 39520862 / -5.7%	0.52 / 0.49 / +6.3%

datafusion / vortex-compact / ns (0.994x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact	26290125 / 26448188 / -0.6%	44784021 / 45975343 / -2.6%	0.59 / 0.58 / +2.0%
tpcds_q02/datafusion:vortex-compact	48197420 / 48795997 / -1.2%	65415375 / 65652950 / -0.4%	0.74 / 0.74 / -0.9%
tpcds_q03/datafusion:vortex-compact	12826860 / 12680131 / +1.2%	32536296 / 33751042 / -3.6%	0.39 / 0.38 / +4.9%
tpcds_q04/datafusion:vortex-compact	121945764 / 124081618 / -1.7%	147043438 / 153060339 / -3.9%	0.83 / 0.81 / +2.3%
tpcds_q05/datafusion:vortex-compact	61776174 / 62250928 / -0.8%	83958313 / 84886680 / -1.1%	0.74 / 0.73 / +0.3%
tpcds_q06/datafusion:vortex-compact	25726050 / 25757778 / -0.1%	46366964 / 50622120 / -8.4%	0.55 / 0.51 / +9.0%
tpcds_q07/datafusion:vortex-compact	35718210 / 34668894 / +3.0%	55277278 / 57616761 / -4.1%	0.65 / 0.60 / +7.4%
tpcds_q08/datafusion:vortex-compact	29789128 / 31157589 / -4.4%	47978651 / 50392309 / -4.8%	0.62 / 0.62 / +0.4%
tpcds_q09/datafusion:vortex-compact	21772654 / 21964410 / -0.9%	41067568 / 41490923 / -1.0%	0.53 / 0.53 / +0.1%
tpcds_q10/datafusion:vortex-compact	36763590 / 37219403 / -1.2%	56844721 / 60578911 / -6.2%	0.65 / 0.61 / +5.3%
tpcds_q11/datafusion:vortex-compact	69850644 / 69321218 / +0.8%	89809198 / 95487642 / -5.9%	0.78 / 0.73 / +7.1%
tpcds_q12/datafusion:vortex-compact	20497061 / 20968922 / -2.3%	38332145 / 39906672 / -3.9%	0.53 / 0.53 / +1.8%
tpcds_q13/datafusion:vortex-compact	55147999 / 59345684 / -7.1%	71926345 / 75358924 / -4.6%	0.77 / 0.79 / -2.6%
tpcds_q14/datafusion:vortex-compact	96046177 / 98751183 / -2.7%	122496051 / 127316990 / -3.8%	0.78 / 0.78 / +1.1%
tpcds_q15/datafusion:vortex-compact	27888446 / 27871792 / +0.1%	45698107 / 45980869 / -0.6%	0.61 / 0.61 / +0.7%
tpcds_q16/datafusion:vortex-compact	23486122 / 23701298 / -0.9%	41960212 / 42963060 / -2.3%	0.56 / 0.55 / +1.5%
tpcds_q17/datafusion:vortex-compact	65430686 / 69052191 / -5.2%	93498670 / 105484275 / -11.4% 🟢	0.70 / 0.65 / +6.9%
tpcds_q18/datafusion:vortex-compact	68487114 / 68073363 / +0.6%	91439530 / 89974434 / +1.6%	0.75 / 0.76 / -1.0%
tpcds_q19/datafusion:vortex-compact	24149938 / 24471686 / -1.3%	42128757 / 43432084 / -3.0%	0.57 / 0.56 / +1.7%
tpcds_q20/datafusion:vortex-compact	22525284 / 22208072 / +1.4%	40420770 / 42604706 / -5.1%	0.56 / 0.52 / +6.9%
tpcds_q21/datafusion:vortex-compact	18276979 / 18880784 / -3.2%	41304550 / 43133435 / -4.2%	0.44 / 0.44 / +1.1%
tpcds_q22/datafusion:vortex-compact	49867683 / 50385841 / -1.0%	71814282 / 74347586 / -3.4%	0.69 / 0.68 / +2.5%
tpcds_q23/datafusion:vortex-compact	79131554 / 76456893 / +3.5%	101988898 / 104137380 / -2.1%	0.78 / 0.73 / +5.7%
tpcds_q24/datafusion:vortex-compact	78390222 / 78288956 / +0.1%	100296284 / 103568389 / -3.2%	0.78 / 0.76 / +3.4%
tpcds_q25/datafusion:vortex-compact	58239437 / 62047028 / -6.1%	88983936 / 78952987 / +12.7% 🔴	0.65 / 0.79 / -16.7%
tpcds_q26/datafusion:vortex-compact	32916306 / 32227530 / +2.1%	52399831 / 57420876 / -8.7%	0.63 / 0.56 / +11.9%
tpcds_q27/datafusion:vortex-compact	62536640 / 61931638 / +1.0%	87667201 / 90985298 / -3.6%	0.71 / 0.68 / +4.8%
tpcds_q28/datafusion:vortex-compact	27706468 / 27615039 / +0.3%	48393706 / 50099006 / -3.4%	0.57 / 0.55 / +3.9%
tpcds_q29/datafusion:vortex-compact	66356786 / 65818753 / +0.8%	88976776 / 90786381 / -2.0%	0.75 / 0.72 / +2.9%
tpcds_q30/datafusion:vortex-compact	30790299 / 30911220 / -0.4%	47578049 / 49507260 / -3.9%	0.65 / 0.62 / +3.6%
tpcds_q31/datafusion:vortex-compact	77045484 / 76083276 / +1.3%	105727402 / 103609705 / +2.0%	0.73 / 0.73 / -0.8%
tpcds_q32/datafusion:vortex-compact	16367148 / 16447177 / -0.5%	33639701 / 35461809 / -5.1%	0.49 / 0.46 / +4.9%
tpcds_q33/datafusion:vortex-compact	29537820 / 27495328 / +7.4%	51740242 / 51961346 / -0.4%	0.57 / 0.53 / +7.9%
tpcds_q34/datafusion:vortex-compact	21556716 / 21198648 / +1.7%	42117037 / 42138382 / -0.1%	0.51 / 0.50 / +1.7%
tpcds_q35/datafusion:vortex-compact	42513744 / 41709532 / +1.9%	67556100 / 66934174 / +0.9%	0.63 / 0.62 / +1.0%
tpcds_q36/datafusion:vortex-compact	51719307 / 52432212 / -1.4%	74851044 / 78013739 / -4.1%	0.69 / 0.67 / +2.8%
tpcds_q37/datafusion:vortex-compact	15907242 / 15579328 / +2.1%	36314775 / 38239280 / -5.0%	0.44 / 0.41 / +7.5%
tpcds_q38/datafusion:vortex-compact	32538720 / 33463843 / -2.8%	55330986 / 57310311 / -3.5%	0.59 / 0.58 / +0.7%
tpcds_q39/datafusion:vortex-compact	65398871 / 66744070 / -2.0%	90062522 / 90189996 / -0.1%	0.73 / 0.74 / -1.9%
tpcds_q40/datafusion:vortex-compact	27835251 / 28216066 / -1.3%	50261622 / 50597876 / -0.7%	0.55 / 0.56 / -0.7%
tpcds_q41/datafusion:vortex-compact	19012458 / 18817302 / +1.0%	32829611 / 32826479 / +0.0%	0.58 / 0.57 / +1.0%
tpcds_q42/datafusion:vortex-compact	13029535 / 12847552 / +1.4%	32130954 / 34526590 / -6.9%	0.41 / 0.37 / +9.0%
tpcds_q43/datafusion:vortex-compact	16328890 / 15766374 / +3.6%	33429511 / 34518939 / -3.2%	0.49 / 0.46 / +6.9%
tpcds_q44/datafusion:vortex-compact	31263221 / 29758875 / +5.1%	54115088 / 55083819 / -1.8%	0.58 / 0.54 / +6.9%
tpcds_q45/datafusion:vortex-compact	31174367 / 31567917 / -1.2%	50390246 / 51510380 / -2.2%	0.62 / 0.61 / +0.9%
tpcds_q46/datafusion:vortex-compact	27987804 / 28285554 / -1.1%	50271634 / 50223744 / +0.1%	0.56 / 0.56 / -1.1%
tpcds_q47/datafusion:vortex-compact	87840963 / 86834258 / +1.2%	116143403 / 119328271 / -2.7%	0.76 / 0.73 / +3.9%
tpcds_q48/datafusion:vortex-compact	51157443 / 50259789 / +1.8%	66778534 / 70236470 / -4.9%	0.77 / 0.72 / +7.1%
tpcds_q49/datafusion:vortex-compact	65945350 / 65385222 / +0.9%	89307695 / 96864180 / -7.8%	0.74 / 0.68 / +9.4%
tpcds_q50/datafusion:vortex-compact	37046966 / 37069134 / -0.1%	55754747 / 58981698 / -5.5%	0.66 / 0.63 / +5.7%
tpcds_q51/datafusion:vortex-compact	62841693 / 62819228 / +0.0%	85021635 / 85914461 / -1.0%	0.74 / 0.73 / +1.1%
tpcds_q52/datafusion:vortex-compact	12906958 / 13700988 / -5.8%	32432920 / 32560235 / -0.4%	0.40 / 0.42 / -5.4%
tpcds_q53/datafusion:vortex-compact	22958407 / 22850405 / +0.5%	41513507 / 43216509 / -3.9%	0.55 / 0.53 / +4.6%
tpcds_q54/datafusion:vortex-compact	39029156 / 38861102 / +0.4%	63020800 / 62877370 / +0.2%	0.62 / 0.62 / +0.2%
tpcds_q55/datafusion:vortex-compact	12409154 / 12992856 / -4.5%	32247699 / 32614854 / -1.1%	0.38 / 0.40 / -3.4%
tpcds_q56/datafusion:vortex-compact	28477710 / 27747306 / +2.6%	51770985 / 49890257 / +3.8%	0.55 / 0.56 / -1.1%
tpcds_q57/datafusion:vortex-compact	80412140 / 78592856 / +2.3%	107633398 / 107777047 / -0.1%	0.75 / 0.73 / +2.5%
tpcds_q58/datafusion:vortex-compact	46562378 / 46952066 / -0.8%	73112523 / 73333281 / -0.3%	0.64 / 0.64 / -0.5%
tpcds_q59/datafusion:vortex-compact	38533008 / 40093984 / -3.9%	58040559 / 58741329 / -1.2%	0.66 / 0.68 / -2.7%
tpcds_q60/datafusion:vortex-compact	28931005 / 29223188 / -1.0%	49928988 / 49752376 / +0.4%	0.58 / 0.59 / -1.4%
tpcds_q61/datafusion:vortex-compact	26333082 / 27691887 / -4.9%	46951412 / 48439285 / -3.1%	0.56 / 0.57 / -1.9%
tpcds_q62/datafusion:vortex-compact	17582602 / 17731234 / -0.8%	35410254 / 36594105 / -3.2%	0.50 / 0.48 / +2.5%
tpcds_q63/datafusion:vortex-compact	22865817 / 23220196 / -1.5%	42472011 / 42075717 / +0.9%	0.54 / 0.55 / -2.4%
tpcds_q64/datafusion:vortex-compact	448375768 / 448762162 / -0.1%	458606141 / 464066247 / -1.2%	0.98 / 0.97 / +1.1%
tpcds_q65/datafusion:vortex-compact	81331288 / 81516016 / -0.2%	99136818 / 105896952 / -6.4%	0.82 / 0.77 / +6.6%
tpcds_q66/datafusion:vortex-compact	54633384 / 54710772 / -0.1%	76909019 / 77196610 / -0.4%	0.71 / 0.71 / +0.2%
tpcds_q67/datafusion:vortex-compact	59454722 / 59488084 / -0.1%	88216435 / 90332326 / -2.3%	0.67 / 0.66 / +2.3%
tpcds_q68/datafusion:vortex-compact	27527746 / 32660740 / -15.7% 🟢	49962612 / 54903608 / -9.0%	0.55 / 0.59 / -7.4%
tpcds_q69/datafusion:vortex-compact	36476729 / 35874724 / +1.7%	57183229 / 59784387 / -4.4%	0.64 / 0.60 / +6.3%
tpcds_q70/datafusion:vortex-compact	75409048 / 76124158 / -0.9%	96206822 / 97258698 / -1.1%	0.78 / 0.78 / +0.1%
tpcds_q71/datafusion:vortex-compact	19577122 / 19804188 / -1.1%	40193853 / 40655642 / -1.1%	0.49 / 0.49 / -0.0%
tpcds_q72/datafusion:vortex-compact	474823002 / 473194102 / +0.3%	504336019 / 507755269 / -0.7%	0.94 / 0.93 / +1.0%
tpcds_q73/datafusion:vortex-compact	19612581 / 20641442 / -5.0%	40483548 / 40422402 / +0.2%	0.48 / 0.51 / -5.1%
tpcds_q74/datafusion:vortex-compact	51717250 / 49983945 / +3.5%	74252602 / 73826606 / +0.6%	0.70 / 0.68 / +2.9%
tpcds_q75/datafusion:vortex-compact	136189239 / 137436584 / -0.9%	160117215 / 162619334 / -1.5%	0.85 / 0.85 / +0.6%
tpcds_q76/datafusion:vortex-compact	44218620 / 40177070 / +10.1% 🔴	64724107 / 57160033 / +13.2% 🔴	0.68 / 0.70 / -2.8%
tpcds_q77/datafusion:vortex-compact	37599634 / 39164331 / -4.0%	62477764 / 65301623 / -4.3%	0.60 / 0.60 / +0.3%
tpcds_q78/datafusion:vortex-compact	85900927 / 87358720 / -1.7%	112131413 / 114372967 / -2.0%	0.77 / 0.76 / +0.3%
tpcds_q79/datafusion:vortex-compact	24456332 / 24749421 / -1.2%	44400340 / 44840604 / -1.0%	0.55 / 0.55 / -0.2%
tpcds_q80/datafusion:vortex-compact	79154703 / 78637697 / +0.7%	106363816 / 109306894 / -2.7%	0.74 / 0.72 / +3.4%
tpcds_q81/datafusion:vortex-compact	30292170 / 29986055 / +1.0%	48127128 / 47360436 / +1.6%	0.63 / 0.63 / -0.6%
tpcds_q82/datafusion:vortex-compact	15732660 / 16086183 / -2.2%	39206511 / 37932062 / +3.4%	0.40 / 0.42 / -5.4%
tpcds_q83/datafusion:vortex-compact	37139269 / 36775888 / +1.0%	59259058 / 61076442 / -3.0%	0.63 / 0.60 / +4.1%
tpcds_q84/datafusion:vortex-compact	12926878 / 12836750 / +0.7%	28593701 / 29097524 / -1.7%	0.45 / 0.44 / +2.5%
tpcds_q85/datafusion:vortex-compact	103922142 / 103844288 / +0.1%	127774962 / 127940130 / -0.1%	0.81 / 0.81 / +0.2%
tpcds_q86/datafusion:vortex-compact	16319652 / 16194754 / +0.8%	35226076 / 37380524 / -5.8%	0.46 / 0.43 / +6.9%
tpcds_q87/datafusion:vortex-compact	34094486 / 33424751 / +2.0%	55999093 / 55252088 / +1.4%	0.61 / 0.60 / +0.6%
tpcds_q88/datafusion:vortex-compact	42345527 / 41176666 / +2.8%	73619014 / 69222733 / +6.4%	0.58 / 0.59 / -3.3%
tpcds_q89/datafusion:vortex-compact	23782566 / 25460284 / -6.6%	44145638 / 46198643 / -4.4%	0.54 / 0.55 / -2.2%
tpcds_q90/datafusion:vortex-compact	11302908 / 11740922 / -3.7%	27119939 / 29077239 / -6.7%	0.42 / 0.40 / +3.2%
tpcds_q91/datafusion:vortex-compact	27315890 / 27247169 / +0.3%	46494815 / 47310135 / -1.7%	0.59 / 0.58 / +2.0%
tpcds_q92/datafusion:vortex-compact	15250081 / 16281539 / -6.3%	33249828 / 33623424 / -1.1%	0.46 / 0.48 / -5.3%
tpcds_q93/datafusion:vortex-compact	26123570 / 25102170 / +4.1%	46615138 / 46609593 / +0.0%	0.56 / 0.54 / +4.1%
tpcds_q94/datafusion:vortex-compact	21393472 / 22273190 / -3.9%	39899554 / 40741973 / -2.1%	0.54 / 0.55 / -1.9%
tpcds_q95/datafusion:vortex-compact	49849388 / 49530243 / +0.6%	71004814 / 72080975 / -1.5%	0.70 / 0.69 / +2.2%
tpcds_q96/datafusion:vortex-compact	10544048 / 10476758 / +0.6%	26487023 / 28109456 / -5.8%	0.40 / 0.37 / +6.8%
tpcds_q97/datafusion:vortex-compact	24681178 / 25110139 / -1.7%	43652879 / 45247101 / -3.5%	0.57 / 0.55 / +1.9%
tpcds_q98/datafusion:vortex-compact	22014592 / 22404426 / -1.7%	42667528 / 43619520 / -2.2%	0.52 / 0.51 / +0.5%
tpcds_q99/datafusion:vortex-compact	21055927 / 20820827 / +1.1%	39385499 / 41548516 / -5.2%	0.53 / 0.50 / +6.7%

datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet	29605906 / 29709236 / -0.3%	44504439 / 53544693 / -16.9% 🟢	0.67 / 0.55 / +19.9%
tpcds_q02/datafusion:parquet	45869056 / 44780082 / +2.4%	61733963 / 61660379 / +0.1%	0.74 / 0.73 / +2.3%
tpcds_q03/datafusion:parquet	18761056 / 18896474 / -0.7%	32533557 / 31967815 / +1.8%	0.58 / 0.59 / -2.4%
tpcds_q04/datafusion:parquet	194576698 / 196628170 / -1.0%	222787615 / 229728217 / -3.0%	0.87 / 0.86 / +2.0%
tpcds_q05/datafusion:parquet	72072441 / 73050123 / -1.3%	95199287 / 95514274 / -0.3%	0.76 / 0.76 / -1.0%
tpcds_q06/datafusion:parquet	35435131 / 35066351 / +1.1%	51712161 / 53510699 / -3.4%	0.69 / 0.66 / +4.6%
tpcds_q07/datafusion:parquet	46135450 / 47163908 / -2.2%	65332062 / 69652512 / -6.2%	0.71 / 0.68 / +4.3%
tpcds_q08/datafusion:parquet	39974362 / 39036181 / +2.4%	53783261 / 56332728 / -4.5%	0.74 / 0.69 / +7.3%
tpcds_q09/datafusion:parquet	29599458 / 32533271 / -9.0%	46829146 / 45074500 / +3.9%	0.63 / 0.72 / -12.4%
tpcds_q10/datafusion:parquet	50433802 / 50620646 / -0.4%	65586172 / 60330174 / +8.7%	0.77 / 0.84 / -8.4%
tpcds_q11/datafusion:parquet	93141549 / 93754906 / -0.7%	122364733 / 119321849 / +2.6%	0.76 / 0.79 / -3.1%
tpcds_q12/datafusion:parquet	24496866 / 24507892 / -0.0%	37648760 / 37044480 / +1.6%	0.65 / 0.66 / -1.6%
tpcds_q13/datafusion:parquet	45464466 / 45484218 / -0.0%	65840437 / 69394581 / -5.1%	0.69 / 0.66 / +5.4%
tpcds_q14/datafusion:parquet	140935686 / 136791819 / +3.0%	154884186 / 153208350 / +1.1%	0.91 / 0.89 / +1.9%
tpcds_q15/datafusion:parquet	30554214 / 31095338 / -1.7%	49121583 / 49255663 / -0.3%	0.62 / 0.63 / -1.5%
tpcds_q16/datafusion:parquet	37905464 / 36868764 / +2.8%	55420199 / 57181360 / -3.1%	0.68 / 0.64 / +6.1%
tpcds_q17/datafusion:parquet	75264629 / 73972280 / +1.7%	100622264 / 101408581 / -0.8%	0.75 / 0.73 / +2.5%
tpcds_q18/datafusion:parquet	56889466 / 58110472 / -2.1%	79309754 / 77887762 / +1.8%	0.72 / 0.75 / -3.9%
tpcds_q19/datafusion:parquet	32211376 / 33100758 / -2.7%	49340454 / 49330055 / +0.0%	0.65 / 0.67 / -2.7%
tpcds_q20/datafusion:parquet	25808404 / 25951678 / -0.6%	38212920 / 37017419 / +3.2%	0.68 / 0.70 / -3.7%
tpcds_q21/datafusion:parquet	20386436 / 20558997 / -0.8%	32757716 / 33833102 / -3.2%	0.62 / 0.61 / +2.4%
tpcds_q22/datafusion:parquet	77069827 / 77491988 / -0.5%	92432255 / 92948832 / -0.6%	0.83 / 0.83 / +0.0%
tpcds_q23/datafusion:parquet	117770374 / 115574724 / +1.9%	145060690 / 138819031 / +4.5%	0.81 / 0.83 / -2.5%
tpcds_q24/datafusion:parquet	90082662 / 90233130 / -0.2%	118852767 / 121552014 / -2.2%	0.76 / 0.74 / +2.1%
tpcds_q25/datafusion:parquet	74160615 / 75152466 / -1.3%	100228432 / 101463040 / -1.2%	0.74 / 0.74 / -0.1%
tpcds_q26/datafusion:parquet	42822413 / 43157603 / -0.8%	60312446 / 60365955 / -0.1%	0.71 / 0.71 / -0.7%
tpcds_q27/datafusion:parquet	79189656 / 78142540 / +1.3%	107227288 / 110350906 / -2.8%	0.74 / 0.71 / +4.3%
tpcds_q28/datafusion:parquet	26737027 / 27057670 / -1.2%	43632946 / 44683903 / -2.4%	0.61 / 0.61 / +1.2%
tpcds_q29/datafusion:parquet	76457960 / 76235245 / +0.3%	100834830 / 105067021 / -4.0%	0.76 / 0.73 / +4.5%
tpcds_q30/datafusion:parquet	45696062 / 46342493 / -1.4%	63155349 / 67538803 / -6.5%	0.72 / 0.69 / +5.4%
tpcds_q31/datafusion:parquet	90638917 / 88885120 / +2.0%	108841635 / 109114669 / -0.3%	0.83 / 0.81 / +2.2%
tpcds_q32/datafusion:parquet	25781526 / 25555002 / +0.9%	41915538 / 42461157 / -1.3%	0.62 / 0.60 / +2.2%
tpcds_q33/datafusion:parquet	40907828 / 41107155 / -0.5%	54027130 / 58925529 / -8.3%	0.76 / 0.70 / +8.5%
tpcds_q34/datafusion:parquet	23930630 / 23767493 / +0.7%	38438313 / 39419715 / -2.5%	0.62 / 0.60 / +3.3%
tpcds_q35/datafusion:parquet	55012303 / 54284986 / +1.3%	70428876 / 72113496 / -2.3%	0.78 / 0.75 / +3.8%
tpcds_q36/datafusion:parquet	53127982 / 53095688 / +0.1%	80702164 / 75639220 / +6.7%	0.66 / 0.70 / -6.2%
tpcds_q37/datafusion:parquet	25574062 / 25432003 / +0.6%	38813579 / 39651857 / -2.1%	0.66 / 0.64 / +2.7%
tpcds_q38/datafusion:parquet	44572230 / 44986992 / -0.9%	64542292 / 67035309 / -3.7%	0.69 / 0.67 / +2.9%
tpcds_q39/datafusion:parquet	71981222 / 71908239 / +0.1%	90780724 / 90760806 / +0.0%	0.79 / 0.79 / +0.1%
tpcds_q40/datafusion:parquet	29061278 / 28944626 / +0.4%	49805500 / 49998911 / -0.4%	0.58 / 0.58 / +0.8%
tpcds_q41/datafusion:parquet	20071660 / 19886256 / +0.9%	33594475 / 33992473 / -1.2%	0.60 / 0.59 / +2.1%
tpcds_q42/datafusion:parquet	18409600 / 18135642 / +1.5%	30651524 / 30572558 / +0.3%	0.60 / 0.59 / +1.2%
tpcds_q43/datafusion:parquet	19558022 / 19527358 / +0.2%	32674232 / 33378274 / -2.1%	0.60 / 0.59 / +2.3%
tpcds_q44/datafusion:parquet	33628648 / 34590310 / -2.8%	50947252 / 52503034 / -3.0%	0.66 / 0.66 / +0.2%
tpcds_q45/datafusion:parquet	38043486 / 38264958 / -0.6%	54112411 / 55461924 / -2.4%	0.70 / 0.69 / +1.9%
tpcds_q46/datafusion:parquet	28970760 / 30182788 / -4.0%	49773191 / 51685023 / -3.7%	0.58 / 0.58 / -0.3%
tpcds_q47/datafusion:parquet	98376183 / 99174302 / -0.8%	124830734 / 123926487 / +0.7%	0.79 / 0.80 / -1.5%
tpcds_q48/datafusion:parquet	41365884 / 41750318 / -0.9%	61396683 / 62412877 / -1.6%	0.67 / 0.67 / +0.7%
tpcds_q49/datafusion:parquet	73992930 / 72299348 / +2.3%	98907340 / 100163027 / -1.3%	0.75 / 0.72 / +3.6%
tpcds_q50/datafusion:parquet	47729370 / 47699994 / +0.1%	71246153 / 69683848 / +2.2%	0.67 / 0.68 / -2.1%
tpcds_q51/datafusion:parquet	70450108 / 71648448 / -1.7%	95971595 / 95569012 / +0.4%	0.73 / 0.75 / -2.1%
tpcds_q52/datafusion:parquet	18382602 / 18210652 / +0.9%	30284227 / 35050121 / -13.6% 🟢	0.61 / 0.52 / +16.8%
tpcds_q53/datafusion:parquet	22752079 / 22393035 / +1.6%	40923283 / 41419071 / -1.2%	0.56 / 0.54 / +2.8%
tpcds_q54/datafusion:parquet	54908571 / 53720766 / +2.2%	71145153 / 72468217 / -1.8%	0.77 / 0.74 / +4.1%
tpcds_q55/datafusion:parquet	18378920 / 18139525 / +1.3%	30308690 / 32632186 / -7.1%	0.61 / 0.56 / +9.1%
tpcds_q56/datafusion:parquet	44339851 / 45961158 / -3.5%	62031576 / 62403167 / -0.6%	0.71 / 0.74 / -2.9%
tpcds_q57/datafusion:parquet	100851492 / 100867668 / -0.0%	120095691 / 126196799 / -4.8%	0.84 / 0.80 / +5.1%
tpcds_q58/datafusion:parquet	63473021 / 64976790 / -2.3%	83348854 / 86223719 / -3.3%	0.76 / 0.75 / +1.1%
tpcds_q59/datafusion:parquet	45586300 / 47488196 / -4.0%	66419120 / 64680969 / +2.7%	0.69 / 0.73 / -6.5%
tpcds_q60/datafusion:parquet	45397785 / 45970100 / -1.2%	60636921 / 63096497 / -3.9%	0.75 / 0.73 / +2.8%
tpcds_q61/datafusion:parquet	38228746 / 37518900 / +1.9%	57538134 / 59812555 / -3.8%	0.66 / 0.63 / +5.9%
tpcds_q62/datafusion:parquet	24851086 / 24982757 / -0.5%	39627148 / 41253879 / -3.9%	0.63 / 0.61 / +3.6%
tpcds_q63/datafusion:parquet	22381764 / 22204708 / +0.8%	41011526 / 40885088 / +0.3%	0.55 / 0.54 / +0.5%
tpcds_q64/datafusion:parquet	201476848 / 205473347 / -1.9%	239231544 / 241866391 / -1.1%	0.84 / 0.85 / -0.9%
tpcds_q65/datafusion:parquet	39224238 / 38792864 / +1.1%	58130957 / 60481019 / -3.9%	0.67 / 0.64 / +5.2%
tpcds_q66/datafusion:parquet	61773886 / 62690804 / -1.5%	79661624 / 83039014 / -4.1%	0.78 / 0.75 / +2.7%
tpcds_q67/datafusion:parquet	70201375 / 69811798 / +0.6%	96209251 / 98342129 / -2.2%	0.73 / 0.71 / +2.8%
tpcds_q68/datafusion:parquet	29346180 / 29424935 / -0.3%	49828313 / 51964113 / -4.1%	0.59 / 0.57 / +4.0%
tpcds_q69/datafusion:parquet	49481278 / 51208185 / -3.4%	65833337 / 65948966 / -0.2%	0.75 / 0.78 / -3.2%
tpcds_q70/datafusion:parquet	36703090 / 36883950 / -0.5%	57540682 / 58124875 / -1.0%	0.64 / 0.63 / +0.5%
tpcds_q71/datafusion:parquet	28756068 / 27676876 / +3.9%	45912831 / 43353084 / +5.9%	0.63 / 0.64 / -1.9%
tpcds_q72/datafusion:parquet	549238794 / 555029968 / -1.0%	576597037 / 575982853 / +0.1%	0.95 / 0.96 / -1.1%
tpcds_q73/datafusion:parquet	23335070 / 23416282 / -0.3%	38528870 / 38744787 / -0.6%	0.61 / 0.60 / +0.2%
tpcds_q74/datafusion:parquet	69080886 / 68660252 / +0.6%	88716657 / 89065598 / -0.4%	0.78 / 0.77 / +1.0%
tpcds_q75/datafusion:parquet	151126411 / 146373814 / +3.2%	179468412 / 183444951 / -2.2%	0.84 / 0.80 / +5.5%
tpcds_q76/datafusion:parquet	53853712 / 53871008 / -0.0%	75047522 / 75818862 / -1.0%	0.72 / 0.71 / +1.0%
tpcds_q77/datafusion:parquet	56402272 / 55900362 / +0.9%	79535743 / 79631695 / -0.1%	0.71 / 0.70 / +1.0%
tpcds_q78/datafusion:parquet	91787878 / 90812370 / +1.1%	122285946 / 128702023 / -5.0%	0.75 / 0.71 / +6.4%
tpcds_q79/datafusion:parquet	26566057 / 26268642 / +1.1%	46204286 / 47870919 / -3.5%	0.57 / 0.55 / +4.8%
tpcds_q80/datafusion:parquet	82212892 / 82797992 / -0.7%	115589068 / 116448117 / -0.7%	0.71 / 0.71 / +0.0%
tpcds_q81/datafusion:parquet	43930282 / 41548203 / +5.7%	61718740 / 62869022 / -1.8%	0.71 / 0.66 / +7.7%
tpcds_q82/datafusion:parquet	26996010 / 26901477 / +0.4%	43041857 / 40743677 / +5.6%	0.63 / 0.66 / -5.0%
tpcds_q83/datafusion:parquet	58017735 / 57549702 / +0.8%	76282718 / 76359608 / -0.1%	0.76 / 0.75 / +0.9%
tpcds_q84/datafusion:parquet	30658116 / 30674142 / -0.1%	45464381 / 46428646 / -2.1%	0.67 / 0.66 / +2.1%
tpcds_q85/datafusion:parquet	82659374 / 83785804 / -1.3%	106850138 / 109644145 / -2.5%	0.77 / 0.76 / +1.2%
tpcds_q86/datafusion:parquet	20510352 / 20583722 / -0.4%	35505624 / 36031361 / -1.5%	0.58 / 0.57 / +1.1%
tpcds_q87/datafusion:parquet	46218653 / 46332028 / -0.2%	62237849 / 65300350 / -4.7%	0.74 / 0.71 / +4.7%
tpcds_q88/datafusion:parquet	49066614 / 49752114 / -1.4%	63562728 / 66020923 / -3.7%	0.77 / 0.75 / +2.4%
tpcds_q89/datafusion:parquet	25794362 / 25957932 / -0.6%	45645427 / 44107697 / +3.5%	0.57 / 0.59 / -4.0%
tpcds_q90/datafusion:parquet	19299788 / 19297406 / +0.0%	33386845 / 34295786 / -2.7%	0.58 / 0.56 / +2.7%
tpcds_q91/datafusion:parquet	36731124 / 37685458 / -2.5%	53104792 / 54675259 / -2.9%	0.69 / 0.69 / +0.4%
tpcds_q92/datafusion:parquet	26425309 / 26035536 / +1.5%	42659571 / 42141490 / +1.2%	0.62 / 0.62 / +0.3%
tpcds_q93/datafusion:parquet	26633604 / 26777010 / -0.5%	47767016 / 46230516 / +3.3%	0.56 / 0.58 / -3.7%
tpcds_q94/datafusion:parquet	34828473 / 34722458 / +0.3%	50512988 / 49912176 / +1.2%	0.69 / 0.70 / -0.9%
tpcds_q95/datafusion:parquet	62768478 / 64235885 / -2.3%	79015642 / 85211236 / -7.3%	0.79 / 0.75 / +5.4%
tpcds_q96/datafusion:parquet	17049726 / 16766300 / +1.7%	29270437 / 30357664 / -3.6%	0.58 / 0.55 / +5.5%
tpcds_q97/datafusion:parquet	35660912 / 34966762 / +2.0%	54960429 / 55477477 / -0.9%	0.65 / 0.63 / +2.9%
tpcds_q98/datafusion:parquet	25373062 / 25233594 / +0.6%	40857634 / 40098873 / +1.9%	0.62 / 0.63 / -1.3%
tpcds_q99/datafusion:parquet	29806730 / 30049782 / -0.8%	45144146 / 44333517 / +1.8%	0.66 / 0.68 / -2.6%

duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed	15268250 / 15067645 / +1.3%	22436208 / 23493475 / -4.5%	0.68 / 0.64 / +6.1%
tpcds_q02/duckdb:vortex-file-compressed	15022846 / 15261439 / -1.6%	20708720 / 22071230 / -6.2%	0.73 / 0.69 / +4.9%
tpcds_q03/duckdb:vortex-file-compressed	11595505 / 11792552 / -1.7%	18638640 / 21075875 / -11.6% 🟢	0.62 / 0.56 / +11.2%
tpcds_q04/duckdb:vortex-file-compressed	49829526 / 50434244 / -1.2%	61019431 / 63695314 / -4.2%	0.82 / 0.79 / +3.1%
tpcds_q05/duckdb:vortex-file-compressed	18667436 / 18818436 / -0.8%	25549887 / 27756179 / -7.9%	0.73 / 0.68 / +7.8%
tpcds_q06/duckdb:vortex-file-compressed	26857228 / 27188045 / -1.2%	38957521 / 44126981 / -11.7% 🟢	0.69 / 0.62 / +11.9%
tpcds_q07/duckdb:vortex-file-compressed	15368488 / 15598605 / -1.5%	26555185 / 29886599 / -11.1% 🟢	0.58 / 0.52 / +10.9%
tpcds_q08/duckdb:vortex-file-compressed	18969690 / 19044735 / -0.4%	27794158 / 28674713 / -3.1%	0.68 / 0.66 / +2.8%
tpcds_q09/duckdb:vortex-file-compressed	14188327 / 13607556 / +4.3%	21352151 / 21846357 / -2.3%	0.66 / 0.62 / +6.7%
tpcds_q10/duckdb:vortex-file-compressed	27452082 / 27659006 / -0.7%	41472037 / 41115177 / +0.9%	0.66 / 0.67 / -1.6%
tpcds_q11/duckdb:vortex-file-compressed	40075875 / 40615257 / -1.3%	50361991 / 52043755 / -3.2%	0.80 / 0.78 / +2.0%
tpcds_q12/duckdb:vortex-file-compressed	11477404 / 10081102 / +13.9% 🔴	16579138 / 17900194 / -7.4%	0.69 / 0.56 / +22.9%
tpcds_q13/duckdb:vortex-file-compressed	22170800 / 22253572 / -0.4%	34617380 / 36721389 / -5.7%	0.64 / 0.61 / +5.7%
tpcds_q14/duckdb:vortex-file-compressed	58539850 / 58025710 / +0.9%	70432718 / 71762204 / -1.9%	0.83 / 0.81 / +2.8%
tpcds_q15/duckdb:vortex-file-compressed	20581874 / 20834640 / -1.2%	26015896 / 28580006 / -9.0%	0.79 / 0.73 / +8.5%
tpcds_q16/duckdb:vortex-file-compressed	17743512 / 17455768 / +1.6%	29152891 / 26103726 / +11.7% 🔴	0.61 / 0.67 / -9.0%
tpcds_q17/duckdb:vortex-file-compressed	30015592 / 30103672 / -0.3%	45259722 / 44760603 / +1.1%	0.66 / 0.67 / -1.4%
tpcds_q18/duckdb:vortex-file-compressed	28034966 / 28586945 / -1.9%	38230603 / 38727484 / -1.3%	0.73 / 0.74 / -0.7%
tpcds_q19/duckdb:vortex-file-compressed	23672609 / 23808676 / -0.6%	33488615 / 37043056 / -9.6%	0.71 / 0.64 / +10.0%
tpcds_q20/duckdb:vortex-file-compressed	10731518 / 10507257 / +2.1%	15231190 / 18549836 / -17.9% 🟢	0.70 / 0.57 / +24.4%
tpcds_q21/duckdb:vortex-file-compressed	9720262 / 9819291 / -1.0%	22072849 / 23648039 / -6.7%	0.44 / 0.42 / +6.1%
tpcds_q22/duckdb:vortex-file-compressed	29005208 / 28717386 / +1.0%	38295304 / 38725246 / -1.1%	0.76 / 0.74 / +2.1%
tpcds_q23/duckdb:vortex-file-compressed	37396766 / 36934316 / +1.3%	50038004 / 50840528 / -1.6%	0.75 / 0.73 / +2.9%
tpcds_q24/duckdb:vortex-file-compressed	28186228 / 27786862 / +1.4%	39634936 / 42345432 / -6.4%	0.71 / 0.66 / +8.4%
tpcds_q25/duckdb:vortex-file-compressed	25406018 / 25521517 / -0.5%	40001674 / 40352376 / -0.9%	0.64 / 0.63 / +0.4%
tpcds_q26/duckdb:vortex-file-compressed	13598648 / 13466026 / +1.0%	21376781 / 19970415 / +7.0%	0.64 / 0.67 / -5.7%
tpcds_q27/duckdb:vortex-file-compressed	18594596 / 17781564 / +4.6%	30116982 / 34928817 / -13.8% 🟢	0.62 / 0.51 / +21.3%
tpcds_q28/duckdb:vortex-file-compressed	12509320 / 13773540 / -9.2%	18889492 / 22702644 / -16.8% 🟢	0.66 / 0.61 / +9.2%
tpcds_q29/duckdb:vortex-file-compressed	28381092 / 28899243 / -1.8%	43388367 / 46360691 / -6.4%	0.65 / 0.62 / +4.9%
tpcds_q30/duckdb:vortex-file-compressed	19374584 / 19510164 / -0.7%	27432133 / 29743208 / -7.8%	0.71 / 0.66 / +7.7%
tpcds_q31/duckdb:vortex-file-compressed	19388139 / 19069199 / +1.7%	27045077 / 29918105 / -9.6%	0.72 / 0.64 / +12.5%
tpcds_q32/duckdb:vortex-file-compressed	10028264 / `9873632` / +1.6%	16601175 / 16530953 / +0.4%	0.60 / 0.60 / +1.1%
tpcds_q33/duckdb:vortex-file-compressed	16885626 / 16752888 / +0.8%	26457797 / 28980571 / -8.7%	0.64 / 0.58 / +10.4%
tpcds_q34/duckdb:vortex-file-compressed	15533597 / 15159834 / +2.5%	24112603 / 21459064 / +12.4% 🔴	0.64 / 0.71 / -8.8%
tpcds_q35/duckdb:vortex-file-compressed	45997754 / 46349893 / -0.8%	60239841 / 60914297 / -1.1%	0.76 / 0.76 / +0.4%
tpcds_q36/duckdb:vortex-file-compressed	15340352 / 15746566 / -2.6%	25896603 / 31550656 / -17.9% 🟢	0.59 / 0.50 / +18.7%
tpcds_q37/duckdb:vortex-file-compressed	13880539 / 13912793 / -0.2%	26195416 / 25670942 / +2.0%	0.53 / 0.54 / -2.2%
tpcds_q38/duckdb:vortex-file-compressed	22242634 / 22209193 / +0.2%	28539334 / 27811633 / +2.6%	0.78 / 0.80 / -2.4%
tpcds_q39/duckdb:vortex-file-compressed	18757938 / 19635328 / -4.5%	33031314 / 27721869 / +19.2% 🔴	0.57 / 0.71 / -19.8%
tpcds_q40/duckdb:vortex-file-compressed	13125898 / 13135200 / -0.1%	23318887 / 21744651 / +7.2%	0.56 / 0.60 / -6.8%
tpcds_q41/duckdb:vortex-file-compressed	6670697 / 6631662 / +0.6%	9604242 / 9474220 / +1.4%	0.69 / 0.70 / -0.8%
tpcds_q42/duckdb:vortex-file-compressed	8335600 / 8909592 / -6.4%	20506604 / 17900003 / +14.6% 🔴	0.41 / 0.50 / -18.3%
tpcds_q43/duckdb:vortex-file-compressed	10055399 / 10143798 / -0.9%	20775790 / 18650513 / +11.4% 🔴	0.48 / 0.54 / -11.0%
tpcds_q44/duckdb:vortex-file-compressed	15409728 / 14957422 / +3.0%	26059541 / 29760182 / -12.4% 🟢	0.59 / 0.50 / +17.7%
tpcds_q45/duckdb:vortex-file-compressed	22158476 / 22566195 / -1.8%	29012261 / 29099202 / -0.3%	0.76 / 0.78 / -1.5%
tpcds_q46/duckdb:vortex-file-compressed	18726135 / 18512293 / +1.2%	32170199 / 29326553 / +9.7%	0.58 / 0.63 / -7.8%
tpcds_q47/duckdb:vortex-file-compressed	30650090 / 32481419 / -5.6%	43270116 / 45919604 / -5.8%	0.71 / 0.71 / +0.1%
tpcds_q48/duckdb:vortex-file-compressed	19581509 / 19422230 / +0.8%	32364265 / 31741146 / +2.0%	0.61 / 0.61 / -1.1%
tpcds_q49/duckdb:vortex-file-compressed	16686534 / 16751826 / -0.4%	31337495 / 30712900 / +2.0%	0.53 / 0.55 / -2.4%
tpcds_q50/duckdb:vortex-file-compressed	16843063 / 16789206 / +0.3%	26660083 / 28952534 / -7.9%	0.63 / 0.58 / +8.9%
tpcds_q51/duckdb:vortex-file-compressed	77565717 / 64477734 / +20.3% 🔴	62634031 / 64250440 / -2.5%	1.24 / 1.00 / +23.4%
tpcds_q52/duckdb:vortex-file-compressed	10556534 / 10415501 / +1.4%	16429851 / 18079553 / -9.1%	0.64 / 0.58 / +11.5%
tpcds_q53/duckdb:vortex-file-compressed	14425050 / 14442118 / -0.1%	24407583 / 25447217 / -4.1%	0.59 / 0.57 / +4.1%
tpcds_q54/duckdb:vortex-file-compressed	20261306 / 20604668 / -1.7%	29373129 / 32304390 / -9.1%	0.69 / 0.64 / +8.1%
tpcds_q55/duckdb:vortex-file-compressed	10105082 / 8531786 / +18.4% 🔴	19475088 / 17996306 / +8.2%	0.52 / 0.47 / +9.4%
tpcds_q56/duckdb:vortex-file-compressed	17313543 / 17698844 / -2.2%	29227667 / 31166926 / -6.2%	0.59 / 0.57 / +4.3%
tpcds_q57/duckdb:vortex-file-compressed	24375366 / 24504978 / -0.5%	30714468 / 40321474 / -23.8% 🟢	0.79 / 0.61 / +30.6%
tpcds_q58/duckdb:vortex-file-compressed	17646836 / 18176084 / -2.9%	27172426 / 28766475 / -5.5%	0.65 / 0.63 / +2.8%
tpcds_q59/duckdb:vortex-file-compressed	18662374 / 18879488 / -1.1%	24871443 / 28940062 / -14.1% 🟢	0.75 / 0.65 / +15.0%
tpcds_q60/duckdb:vortex-file-compressed	17747750 / 17619287 / +0.7%	28406017 / 30036097 / -5.4%	0.62 / 0.59 / +6.5%
tpcds_q61/duckdb:vortex-file-compressed	19842117 / 19912574 / -0.4%	29962792 / 32388018 / -7.5%	0.66 / 0.61 / +7.7%
tpcds_q62/duckdb:vortex-file-compressed	10299219 / 10225746 / +0.7%	15733582 / 17206139 / -8.6%	0.65 / 0.59 / +10.1%
tpcds_q63/duckdb:vortex-file-compressed	13557728 / 13340725 / +1.6%	25178199 / 23971695 / +5.0%	0.54 / 0.56 / -3.2%
tpcds_q64/duckdb:vortex-file-compressed	63223898 / 62184166 / +1.7%	77985491 / 79892778 / -2.4%	0.81 / 0.78 / +4.2%
tpcds_q65/duckdb:vortex-file-compressed	15526873 / 15348528 / +1.2%	25545280 / 27632841 / -7.6%	0.61 / 0.56 / +9.4%
tpcds_q66/duckdb:vortex-file-compressed	21161478 / 21006441 / +0.7%	36047858 / 26447073 / +36.3% 🔴	0.59 / 0.79 / -26.1%
tpcds_q67/duckdb:vortex-file-compressed	66675074 / 65055134 / +2.5%	82908419 / 80935326 / +2.4%	0.80 / 0.80 / +0.1%
tpcds_q68/duckdb:vortex-file-compressed	18178796 / 18307366 / -0.7%	28833569 / 38440158 / -25.0% 🟢	0.63 / 0.48 / +32.4%
tpcds_q69/duckdb:vortex-file-compressed	28640160 / 29898526 / -4.2%	45253009 / 45549034 / -0.6%	0.63 / 0.66 / -3.6%
tpcds_q70/duckdb:vortex-file-compressed	18852356 / 18613545 / +1.3%	26832963 / 29756547 / -9.8%	0.70 / 0.63 / +12.3%
tpcds_q71/duckdb:vortex-file-compressed	12763449 / 13322392 / -4.2%	21526875 / 26264860 / -18.0% 🟢	0.59 / 0.51 / +16.9%
tpcds_q72/duckdb:vortex-file-compressed	62109018 / 61837393 / +0.4%	77964379 / 75494456 / +3.3%	0.80 / 0.82 / -2.7%
tpcds_q73/duckdb:vortex-file-compressed	14745489 / 14705185 / +0.3%	24966983 / 20913694 / +19.4% 🔴	0.59 / 0.70 / -16.0%
tpcds_q74/duckdb:vortex-file-compressed	27606174 / 27472564 / +0.5%	36025323 / 36829749 / -2.2%	0.77 / 0.75 / +2.7%
tpcds_q75/duckdb:vortex-file-compressed	28486386 / 28171944 / +1.1%	38091205 / 41666239 / -8.6%	0.75 / 0.68 / +10.6%
tpcds_q76/duckdb:vortex-file-compressed	12326642 / 12172197 / +1.3%	26204545 / 24816609 / +5.6%	0.47 / 0.49 / -4.1%
tpcds_q77/duckdb:vortex-file-compressed	15867368 / 15944194 / -0.5%	23829044 / 24772183 / -3.8%	0.67 / 0.64 / +3.5%
tpcds_q78/duckdb:vortex-file-compressed	37302554 / 37109806 / +0.5%	48360028 / 46155342 / +4.8%	0.77 / 0.80 / -4.1%
tpcds_q79/duckdb:vortex-file-compressed	14802902 / 14557899 / +1.7%	28792593 / 25200883 / +14.3% 🔴	0.51 / 0.58 / -11.0%
tpcds_q80/duckdb:vortex-file-compressed	28740476 / 27489661 / +4.6%	40039628 / 43699601 / -8.4%	0.72 / 0.63 / +14.1%
tpcds_q81/duckdb:vortex-file-compressed	22208617 / 22056036 / +0.7%	29845329 / 29756499 / +0.3%	0.74 / 0.74 / +0.4%
tpcds_q82/duckdb:vortex-file-compressed	31724510 / 32682154 / -2.9%	41238742 / 43368652 / -4.9%	0.77 / 0.75 / +2.1%
tpcds_q83/duckdb:vortex-file-compressed	20085982 / 20114978 / -0.1%	25507148 / 25328285 / +0.7%	0.79 / 0.79 / -0.8%
tpcds_q84/duckdb:vortex-file-compressed	12732052 / 12972970 / -1.9%	18564514 / 23404084 / -20.7% 🟢	0.69 / 0.55 / +23.7%
tpcds_q85/duckdb:vortex-file-compressed	30756008 / 31292636 / -1.7%	39024894 / 41183432 / -5.2%	0.79 / 0.76 / +3.7%
tpcds_q86/duckdb:vortex-file-compressed	10939421 / 10719642 / +2.1%	17321884 / 20316251 / -14.7% 🟢	0.63 / 0.53 / +19.7%
tpcds_q87/duckdb:vortex-file-compressed	23726574 / 24266908 / -2.2%	30654715 / 30500164 / +0.5%	0.77 / 0.80 / -2.7%
tpcds_q88/duckdb:vortex-file-compressed	32354584 / 32546415 / -0.6%	43962492 / 46355218 / -5.2%	0.74 / 0.70 / +4.8%
tpcds_q89/duckdb:vortex-file-compressed	13921282 / 13848969 / +0.5%	22737391 / 27231542 / -16.5% 🟢	0.61 / 0.51 / +20.4%
tpcds_q90/duckdb:vortex-file-compressed	8153672 / 8473296 / -3.8%	13321910 / 14729513 / -9.6%	0.61 / 0.58 / +6.4%
tpcds_q91/duckdb:vortex-file-compressed	15285834 / 15277173 / +0.1%	21346086 / 21669208 / -1.5%	0.72 / 0.71 / +1.6%
tpcds_q92/duckdb:vortex-file-compressed	13119987 / 13176712 / -0.4%	21978837 / 22610094 / -2.8%	0.60 / 0.58 / +2.4%
tpcds_q93/duckdb:vortex-file-compressed	17475376 / 17081087 / +2.3%	22710865 / 22813574 / -0.5%	0.77 / 0.75 / +2.8%
tpcds_q94/duckdb:vortex-file-compressed	16308402 / 16125231 / +1.1%	25640716 / 26111634 / -1.8%	0.64 / 0.62 / +3.0%
tpcds_q95/duckdb:vortex-file-compressed	71068577 / 71013550 / +0.1%	77508675 / 79955444 / -3.1%	0.92 / 0.89 / +3.2%
tpcds_q96/duckdb:vortex-file-compressed	7686170 / 7256595 / +5.9%	17689240 / 18240532 / -3.0%	0.43 / 0.40 / +9.2%
tpcds_q97/duckdb:vortex-file-compressed	22192350 / 22365290 / -0.8%	30323376 / 28705433 / +5.6%	0.73 / 0.78 / -6.1%
tpcds_q98/duckdb:vortex-file-compressed	13426776 / 13107836 / +2.4%	21892056 / 24176637 / -9.4%	0.61 / 0.54 / +13.1%
tpcds_q99/duckdb:vortex-file-compressed	13513079 / 13436035 / +0.6%	19367754 / 19213943 / +0.8%	0.70 / 0.70 / -0.2%

duckdb / vortex-compact / ns (1.004x ➖, 1↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact	16457216 / 16449608 / +0.0%	24279693 / 24406605 / -0.5%	0.68 / 0.67 / +0.6%
tpcds_q02/duckdb:vortex-compact	16286536 / 16570849 / -1.7%	22578196 / 21923903 / +3.0%	0.72 / 0.76 / -4.6%
tpcds_q03/duckdb:vortex-compact	21905992 / 21448750 / +2.1%	37355233 / 30734459 / +21.5% 🔴	0.59 / 0.70 / -16.0%
tpcds_q04/duckdb:vortex-compact	53134658 / 54125976 / -1.8%	64111091 / 66150142 / -3.1%	0.83 / 0.82 / +1.3%
tpcds_q05/duckdb:vortex-compact	22857809 / 22179551 / +3.1%	31773713 / 32281592 / -1.6%	0.72 / 0.69 / +4.7%
tpcds_q06/duckdb:vortex-compact	32257434 / 33590004 / -4.0%	45417405 / 44734875 / +1.5%	0.71 / 0.75 / -5.4%
tpcds_q07/duckdb:vortex-compact	28234108 / 27809114 / +1.5%	38747769 / 38409447 / +0.9%	0.73 / 0.72 / +0.6%
tpcds_q08/duckdb:vortex-compact	49106562 / 49439168 / -0.7%	59151904 / 58011548 / +2.0%	0.83 / 0.85 / -2.6%
tpcds_q09/duckdb:vortex-compact	18723332 / 19115662 / -2.1%	26859337 / 28802478 / -6.7%	0.70 / 0.66 / +5.0%
tpcds_q10/duckdb:vortex-compact	45226100 / 45215674 / +0.0%	58760695 / 55883471 / +5.1%	0.77 / 0.81 / -4.9%
tpcds_q11/duckdb:vortex-compact	45434820 / 45114230 / +0.7%	55404617 / 59700966 / -7.2%	0.82 / 0.76 / +8.5%
tpcds_q12/duckdb:vortex-compact	13606741 / 13488658 / +0.9%	19882397 / 19702532 / +0.9%	0.68 / 0.68 / -0.0%
tpcds_q13/duckdb:vortex-compact	37735325 / 37315028 / +1.1%	47572516 / 49149662 / -3.2%	0.79 / 0.76 / +4.5%
tpcds_q14/duckdb:vortex-compact	67367964 / 66563209 / +1.2%	76522817 / 76248171 / +0.4%	0.88 / 0.87 / +0.8%
tpcds_q15/duckdb:vortex-compact	25861311 / 26096248 / -0.9%	31517879 / 30891948 / +2.0%	0.82 / 0.84 / -2.9%
tpcds_q16/duckdb:vortex-compact	24856615 / 24802932 / +0.2%	32739646 / 34115010 / -4.0%	0.76 / 0.73 / +4.4%
tpcds_q17/duckdb:vortex-compact	44633179 / 45363296 / -1.6%	56121255 / 58392391 / -3.9%	0.80 / 0.78 / +2.4%
tpcds_q18/duckdb:vortex-compact	35350804 / 36047063 / -1.9%	44656050 / 45721684 / -2.3%	0.79 / 0.79 / +0.4%
tpcds_q19/duckdb:vortex-compact	35941608 / 35858135 / +0.2%	44882809 / 43754113 / +2.6%	0.80 / 0.82 / -2.3%
tpcds_q20/duckdb:vortex-compact	13999098 / 14200591 / -1.4%	19738190 / 19620618 / +0.6%	0.71 / 0.72 / -2.0%
tpcds_q21/duckdb:vortex-compact	10395520 / 11769758 / -11.7% 🟢	20460312 / 19531456 / +4.8%	0.51 / 0.60 / -15.7%
tpcds_q22/duckdb:vortex-compact	30417662 / 31805693 / -4.4%	40003102 / 40566959 / -1.4%	0.76 / 0.78 / -3.0%
tpcds_q23/duckdb:vortex-compact	44169232 / 42655115 / +3.5%	55015431 / 53517845 / +2.8%	0.80 / 0.80 / +0.7%
tpcds_q24/duckdb:vortex-compact	38975274 / 39801542 / -2.1%	46979638 / 51587479 / -8.9%	0.83 / 0.77 / +7.5%
tpcds_q25/duckdb:vortex-compact	43402680 / 42684460 / +1.7%	52100180 / 54712013 / -4.8%	0.83 / 0.78 / +6.8%
tpcds_q26/duckdb:vortex-compact	24939374 / 24895419 / +0.2%	33651059 / 31539525 / +6.7%	0.74 / 0.79 / -6.1%
tpcds_q27/duckdb:vortex-compact	33171185 / 34364119 / -3.5%	43483552 / 41733992 / +4.2%	0.76 / 0.82 / -7.4%
tpcds_q28/duckdb:vortex-compact	23015310 / 23222850 / -0.9%	32874466 / 31741067 / +3.6%	0.70 / 0.73 / -4.3%
tpcds_q29/duckdb:vortex-compact	44489327 / 44388055 / +0.2%	57035220 / 56481271 / +1.0%	0.78 / 0.79 / -0.7%
tpcds_q30/duckdb:vortex-compact	22417465 / 22541239 / -0.5%	30109675 / 31835956 / -5.4%	0.74 / 0.71 / +5.2%
tpcds_q31/duckdb:vortex-compact	23556398 / 24103214 / -2.3%	30207509 / 31292628 / -3.5%	0.78 / 0.77 / +1.2%
tpcds_q32/duckdb:vortex-compact	14144124 / 14203106 / -0.4%	22070705 / 21551438 / +2.4%	0.64 / 0.66 / -2.8%
tpcds_q33/duckdb:vortex-compact	23431328 / 22785351 / +2.8%	31293171 / 39014240 / -19.8% 🟢	0.75 / 0.58 / +28.2%
tpcds_q34/duckdb:vortex-compact	22113437 / 22150818 / -0.2%	31788282 / 29335295 / +8.4%	0.70 / 0.76 / -7.9%
tpcds_q35/duckdb:vortex-compact	62359928 / 62423522 / -0.1%	74509057 / 74129955 / +0.5%	0.84 / 0.84 / -0.6%
tpcds_q36/duckdb:vortex-compact	22161706 / 22088937 / +0.3%	30749761 / 32715068 / -6.0%	0.72 / 0.68 / +6.7%
tpcds_q37/duckdb:vortex-compact	15296504 / 15303440 / -0.0%	27126607 / 24474650 / +10.8% 🔴	0.56 / 0.63 / -9.8%
tpcds_q38/duckdb:vortex-compact	26414972 / 25934372 / +1.9%	33465900 / 32630987 / +2.6%	0.79 / 0.79 / -0.7%
tpcds_q39/duckdb:vortex-compact	18746900 / 18673774 / +0.4%	29115662 / 33158713 / -12.2% 🟢	0.64 / 0.56 / +14.3%
tpcds_q40/duckdb:vortex-compact	15925374 / 16059156 / -0.8%	21440948 / 21218463 / +1.0%	0.74 / 0.76 / -1.9%
tpcds_q41/duckdb:vortex-compact	7595668 / 7697953 / -1.3%	12479341 / 11397600 / +9.5%	0.61 / 0.68 / -9.9%
tpcds_q42/duckdb:vortex-compact	12714065 / 11521918 / +10.3% 🔴	19390064 / 20944565 / -7.4%	0.66 / 0.55 / +19.2%
tpcds_q43/duckdb:vortex-compact	19344096 / 16258349 / +19.0% 🔴	24867403 / 27902657 / -10.9% 🟢	0.78 / 0.58 / +33.5%
tpcds_q44/duckdb:vortex-compact	24069720 / 23738840 / +1.4%	35173504 / 40126093 / -12.3% 🟢	0.68 / 0.59 / +15.7%
tpcds_q45/duckdb:vortex-compact	27694536 / 27238020 / +1.7%	32965772 / 33553726 / -1.8%	0.84 / 0.81 / +3.5%
tpcds_q46/duckdb:vortex-compact	29572714 / 29164648 / +1.4%	38020228 / 39433275 / -3.6%	0.78 / 0.74 / +5.2%
tpcds_q47/duckdb:vortex-compact	36449520 / 36839238 / -1.1%	49545487 / 48847624 / +1.4%	0.74 / 0.75 / -2.5%
tpcds_q48/duckdb:vortex-compact	33594472 / 33574516 / +0.1%	43626700 / 44651998 / -2.3%	0.77 / 0.75 / +2.4%
tpcds_q49/duckdb:vortex-compact	22852347 / 23723743 / -3.7%	33809274 / 36437651 / -7.2%	0.68 / 0.65 / +3.8%
tpcds_q50/duckdb:vortex-compact	26780664 / 26797427 / -0.1%	37307871 / 36648676 / +1.8%	0.72 / 0.73 / -1.8%
tpcds_q51/duckdb:vortex-compact	52962998 / 57408722 / -7.7%	65568311 / 65373125 / +0.3%	0.81 / 0.88 / -8.0%
tpcds_q52/duckdb:vortex-compact	13611083 / 11692552 / +16.4% 🔴	20690665 / 21416321 / -3.4%	0.66 / 0.55 / +20.5%
tpcds_q53/duckdb:vortex-compact	21968880 / 21894009 / +0.3%	29736160 / 33176936 / -10.4% 🟢	0.74 / 0.66 / +12.0%
tpcds_q54/duckdb:vortex-compact	26679661 / 25824790 / +3.3%	35656217 / 36176476 / -1.4%	0.75 / 0.71 / +4.8%
tpcds_q55/duckdb:vortex-compact	11864016 / 11986845 / -1.0%	20379327 / 20989268 / -2.9%	0.58 / 0.57 / +1.9%
tpcds_q56/duckdb:vortex-compact	24048087 / 25832454 / -6.9%	34814146 / 34389310 / +1.2%	0.69 / 0.75 / -8.0%
tpcds_q57/duckdb:vortex-compact	27622826 / 28057401 / -1.5%	34656130 / 34724936 / -0.2%	0.80 / 0.81 / -1.4%
tpcds_q58/duckdb:vortex-compact	21159942 / 21260418 / -0.5%	31491655 / 30673439 / +2.7%	0.67 / 0.69 / -3.1%
tpcds_q59/duckdb:vortex-compact	23512371 / 23324790 / +0.8%	29668997 / 30477469 / -2.7%	0.79 / 0.77 / +3.6%
tpcds_q60/duckdb:vortex-compact	24462220 / 24108088 / +1.5%	35090440 / 36117667 / -2.8%	0.70 / 0.67 / +4.4%
tpcds_q61/duckdb:vortex-compact	32140423 / 32363196 / -0.7%	42687204 / 46894507 / -9.0%	0.75 / 0.69 / +9.1%
tpcds_q62/duckdb:vortex-compact	11616662 / 11455174 / +1.4%	18467331 / 18366941 / +0.5%	0.63 / 0.62 / +0.9%
tpcds_q63/duckdb:vortex-compact	20166670 / 21132320 / -4.6%	28814600 / 28333695 / +1.7%	0.70 / 0.75 / -6.2%
tpcds_q64/duckdb:vortex-compact	86666183 / 84054456 / +3.1%	93928545 / 98924898 / -5.1%	0.92 / 0.85 / +8.6%
tpcds_q65/duckdb:vortex-compact	19677610 / 20885016 / -5.8%	33644897 / 32356053 / +4.0%	0.58 / 0.65 / -9.4%
tpcds_q66/duckdb:vortex-compact	25069480 / 25469837 / -1.6%	31788326 / 40322462 / -21.2% 🟢	0.79 / 0.63 / +24.9%
tpcds_q67/duckdb:vortex-compact	71087545 / 71880424 / -1.1%	84371205 / 89697852 / -5.9%	0.84 / 0.80 / +5.1%
tpcds_q68/duckdb:vortex-compact	30983662 / 29255788 / +5.9%	41727948 / 42636717 / -2.1%	0.74 / 0.69 / +8.2%
tpcds_q69/duckdb:vortex-compact	46939332 / 46878084 / +0.1%	60808314 / 60427852 / +0.6%	0.77 / 0.78 / -0.5%
tpcds_q70/duckdb:vortex-compact	30939410 / 31100954 / -0.5%	37311438 / 43569983 / -14.4% 🟢	0.83 / 0.71 / +16.2%
tpcds_q71/duckdb:vortex-compact	19329582 / 18858908 / +2.5%	29825813 / 31980107 / -6.7%	0.65 / 0.59 / +9.9%
tpcds_q72/duckdb:vortex-compact	69501620 / 69626594 / -0.2%	89612713 / 81863156 / +9.5%	0.78 / 0.85 / -8.8%
tpcds_q73/duckdb:vortex-compact	21553202 / 21503755 / +0.2%	29363781 / 29705738 / -1.2%	0.73 / 0.72 / +1.4%
tpcds_q74/duckdb:vortex-compact	32156018 / 31661532 / +1.6%	40916624 / 45713207 / -10.5% 🟢	0.79 / 0.69 / +13.5%
tpcds_q75/duckdb:vortex-compact	32998589 / 33496126 / -1.5%	44848509 / 45378551 / -1.2%	0.74 / 0.74 / -0.3%
tpcds_q76/duckdb:vortex-compact	16219940 / 16075210 / +0.9%	25638005 / 28496094 / -10.0% 🟢	0.63 / 0.56 / +12.1%
tpcds_q77/duckdb:vortex-compact	22896471 / 22484028 / +1.8%	32724628 / 31210142 / +4.9%	0.70 / 0.72 / -2.9%
tpcds_q78/duckdb:vortex-compact	41304908 / 42093636 / -1.9%	51137170 / 52890266 / -3.3%	0.81 / 0.80 / +1.5%
tpcds_q79/duckdb:vortex-compact	37745192 / 37839761 / -0.2%	46091476 / 46994723 / -1.9%	0.82 / 0.81 / +1.7%
tpcds_q80/duckdb:vortex-compact	37362442 / 36139047 / +3.4%	46056360 / 52088308 / -11.6% 🟢	0.81 / 0.69 / +16.9%
tpcds_q81/duckdb:vortex-compact	24353714 / 24222710 / +0.5%	34438220 / 31437776 / +9.5%	0.71 / 0.77 / -8.2%
tpcds_q82/duckdb:vortex-compact	34973177 / 35326946 / -1.0%	43283574 / 43709815 / -1.0%	0.81 / 0.81 / -0.0%
tpcds_q83/duckdb:vortex-compact	28336068 / 27885570 / +1.6%	32452627 / 33140732 / -2.1%	0.87 / 0.84 / +3.8%
tpcds_q84/duckdb:vortex-compact	15004291 / 14793424 / +1.4%	20499726 / 23160279 / -11.5% 🟢	0.73 / 0.64 / +14.6%
tpcds_q85/duckdb:vortex-compact	41947252 / 41996624 / -0.1%	49667909 / 51343948 / -3.3%	0.84 / 0.82 / +3.3%
tpcds_q86/duckdb:vortex-compact	12221464 / 12015955 / +1.7%	17902561 / 18075437 / -1.0%	0.68 / 0.66 / +2.7%
tpcds_q87/duckdb:vortex-compact	27881652 / 27951958 / -0.3%	36040831 / 34759293 / +3.7%	0.77 / 0.80 / -3.8%
tpcds_q88/duckdb:vortex-compact	67558085 / 66272248 / +1.9%	86082362 / 76621807 / +12.3% 🔴	0.78 / 0.86 / -9.3%
tpcds_q89/duckdb:vortex-compact	21055824 / 20443008 / +3.0%	28519992 / 30101293 / -5.3%	0.74 / 0.68 / +8.7%
tpcds_q90/duckdb:vortex-compact	14711733 / 12236088 / +20.2% 🔴	18259012 / 18977064 / -3.8%	0.81 / 0.64 / +25.0%
tpcds_q91/duckdb:vortex-compact	30597934 / 30534638 / +0.2%	37433535 / 37690729 / -0.7%	0.82 / 0.81 / +0.9%
tpcds_q92/duckdb:vortex-compact	20474097 / 20510406 / -0.2%	30762364 / 27950478 / +10.1% 🔴	0.67 / 0.73 / -9.3%
tpcds_q93/duckdb:vortex-compact	18190393 / 18677267 / -2.6%	27350793 / 25894552 / +5.6%	0.67 / 0.72 / -7.8%
tpcds_q94/duckdb:vortex-compact	21962324 / 21847638 / +0.5%	30420954 / 30796434 / -1.2%	0.72 / 0.71 / +1.8%
tpcds_q95/duckdb:vortex-compact	76851316 / 77455186 / -0.8%	84826271 / 86091374 / -1.5%	0.91 / 0.90 / +0.7%
tpcds_q96/duckdb:vortex-compact	17061776 / 17062542 / -0.0%	23472353 / 24547182 / -4.4%	0.73 / 0.70 / +4.6%
tpcds_q97/duckdb:vortex-compact	25676290 / 25254946 / +1.7%	32328011 / 34115677 / -5.2%	0.79 / 0.74 / +7.3%
tpcds_q98/duckdb:vortex-compact	18386374 / 18247280 / +0.8%	27912786 / 29023709 / -3.8%	0.66 / 0.63 / +4.8%
tpcds_q99/duckdb:vortex-compact	17090419 / 17066214 / +0.1%	25234588 / 25129784 / +0.4%	0.68 / 0.68 / -0.3%

duckdb / parquet / ns (1.001x ➖, 2↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet	24482900 / 24785567 / -1.2%	32587910 / 34001693 / -4.2%	0.75 / 0.73 / +3.1%
tpcds_q02/duckdb:parquet	15394232 / 17547396 / -12.3% 🟢	20692748 / 22974776 / -9.9%	0.74 / 0.76 / -2.6%
tpcds_q03/duckdb:parquet	8774937 / 8796149 / -0.2%	15595802 / 15596196 / -0.0%	0.56 / 0.56 / -0.2%
tpcds_q04/duckdb:parquet	128363243 / 126984058 / +1.1%	133116178 / 132919321 / +0.1%	0.96 / 0.96 / +0.9%
tpcds_q05/duckdb:parquet	21872501 / 21081769 / +3.8%	28380395 / 25938278 / +9.4%	0.77 / 0.81 / -5.2%
tpcds_q06/duckdb:parquet	26978924 / 26943662 / +0.1%	38075464 / 38592745 / -1.3%	0.71 / 0.70 / +1.5%
tpcds_q07/duckdb:parquet	15260395 / 15292792 / -0.2%	23154782 / 25418303 / -8.9%	0.66 / 0.60 / +9.5%
tpcds_q08/duckdb:parquet	27204738 / 25205307 / +7.9%	35990583 / 33281653 / +8.1%	0.76 / 0.76 / -0.2%
tpcds_q09/duckdb:parquet	18906021 / 18811987 / +0.5%	21894218 / 24458223 / -10.5% 🟢	0.86 / 0.77 / +12.3%
tpcds_q10/duckdb:parquet	27833835 / 27400607 / +1.6%	38214519 / 37601878 / +1.6%	0.73 / 0.73 / -0.0%
tpcds_q11/duckdb:parquet	71689828 / 71365459 / +0.5%	76439454 / 75855332 / +0.8%	0.94 / 0.94 / -0.3%
tpcds_q12/duckdb:parquet	12653179 / 12651241 / +0.0%	17401054 / 17301053 / +0.6%	0.73 / 0.73 / -0.6%
tpcds_q13/duckdb:parquet	24375822 / 23849820 / +2.2%	39171357 / 31691200 / +23.6% 🔴	0.62 / 0.75 / -17.3%
tpcds_q14/duckdb:parquet	60261166 / 61030450 / -1.3%	66825518 / 67799696 / -1.4%	0.90 / 0.90 / +0.2%
tpcds_q15/duckdb:parquet	25200553 / 25057313 / +0.6%	31006521 / 30602807 / +1.3%	0.81 / 0.82 / -0.7%
tpcds_q16/duckdb:parquet	20040528 / 19882764 / +0.8%	29973962 / 28705528 / +4.4%	0.67 / 0.69 / -3.5%
tpcds_q17/duckdb:parquet	32420442 / 32499427 / -0.2%	40899052 / 40879541 / +0.0%	0.79 / 0.80 / -0.3%
tpcds_q18/duckdb:parquet	41625158 / 39086682 / +6.5%	50204192 / 49956618 / +0.5%	0.83 / 0.78 / +6.0%
tpcds_q19/duckdb:parquet	24611486 / 24411696 / +0.8%	31984266 / 31642927 / +1.1%	0.77 / 0.77 / -0.3%
tpcds_q20/duckdb:parquet	13844042 / 13518365 / +2.4%	18549454 / 17908498 / +3.6%	0.75 / 0.75 / -1.1%
tpcds_q21/duckdb:parquet	9455864 / 9419713 / +0.4%	13776935 / 14730052 / -6.5%	0.69 / 0.64 / +7.3%
tpcds_q22/duckdb:parquet	34901350 / 36723324 / -5.0%	39774181 / 42102963 / -5.5%	0.88 / 0.87 / +0.6%
tpcds_q23/duckdb:parquet	40748932 / 40778153 / -0.1%	48143862 / 50570465 / -4.8%	0.85 / 0.81 / +5.0%
tpcds_q24/duckdb:parquet	33535509 / 33096656 / +1.3%	43440373 / 44359793 / -2.1%	0.77 / 0.75 / +3.5%
tpcds_q25/duckdb:parquet	30182224 / 30073508 / +0.4%	42651998 / 39871760 / +7.0%	0.71 / 0.75 / -6.2%
tpcds_q26/duckdb:parquet	31368008 / 30813007 / +1.8%	39836234 / 37980278 / +4.9%	0.79 / 0.81 / -2.9%
tpcds_q27/duckdb:parquet	32114382 / 31723182 / +1.2%	40812524 / 41173716 / -0.9%	0.79 / 0.77 / +2.1%
tpcds_q28/duckdb:parquet	17412936 / 17147784 / +1.5%	26289143 / 20023898 / +31.3% 🔴	0.66 / 0.86 / -22.7%
tpcds_q29/duckdb:parquet	30883032 / 30756530 / +0.4%	40252227 / 40610592 / -0.9%	0.77 / 0.76 / +1.3%
tpcds_q30/duckdb:parquet	32722996 / 32586200 / +0.4%	44719076 / 41092259 / +8.8%	0.73 / 0.79 / -7.7%
tpcds_q31/duckdb:parquet	20109494 / 20176724 / -0.3%	28526363 / 26818711 / +6.4%	0.70 / 0.75 / -6.3%
tpcds_q32/duckdb:parquet	11367011 / 11105106 / +2.4%	17643990 / 17399352 / +1.4%	0.64 / 0.64 / +0.9%
tpcds_q33/duckdb:parquet	16634995 / 16096152 / +3.3%	23145628 / 23144017 / +0.0%	0.72 / 0.70 / +3.3%
tpcds_q34/duckdb:parquet	16722064 / 16043920 / +4.2%	22119627 / 22056404 / +0.3%	0.76 / 0.73 / +3.9%
tpcds_q35/duckdb:parquet	46713272 / 46390356 / +0.7%	62133037 / 58720750 / +5.8%	0.75 / 0.79 / -4.8%
tpcds_q36/duckdb:parquet	15060628 / 16673100 / -9.7%	23011108 / 22941766 / +0.3%	0.65 / 0.73 / -9.9%
tpcds_q37/duckdb:parquet	11544894 / 12352252 / -6.5%	18299955 / 18924137 / -3.3%	0.63 / 0.65 / -3.3%
tpcds_q38/duckdb:parquet	26264718 / 26179662 / +0.3%	30776182 / 31249430 / -1.5%	0.85 / 0.84 / +1.9%
tpcds_q39/duckdb:parquet	24675719 / 24679044 / -0.0%	32387249 / 31772322 / +1.9%	0.76 / 0.78 / -1.9%
tpcds_q40/duckdb:parquet	15846366 / 16013472 / -1.0%	21472796 / 21264494 / +1.0%	0.74 / 0.75 / -2.0%
tpcds_q41/duckdb:parquet	9510726 / 10092676 / -5.8%	14319452 / 14243766 / +0.5%	0.66 / 0.71 / -6.3%
tpcds_q42/duckdb:parquet	10823024 / 8226661 / +31.6% 🔴	17691947 / 14727582 / +20.1% 🔴	0.61 / 0.56 / +9.5%
tpcds_q43/duckdb:parquet	10641522 / 10563364 / +0.7%	15609724 / 15686989 / -0.5%	0.68 / 0.67 / +1.2%
tpcds_q44/duckdb:parquet	16197554 / 15938692 / +1.6%	26136680 / 28597857 / -8.6%	0.62 / 0.56 / +11.2%
tpcds_q45/duckdb:parquet	23315544 / 23129941 / +0.8%	28962144 / 29608858 / -2.2%	0.81 / 0.78 / +3.1%
tpcds_q46/duckdb:parquet	36441860 / 36268692 / +0.5%	44218532 / 45990525 / -3.9%	0.82 / 0.79 / +4.5%
tpcds_q47/duckdb:parquet	33164672 / 31321554 / +5.9%	37187568 / 37385878 / -0.5%	0.89 / 0.84 / +6.4%
tpcds_q48/duckdb:parquet	21271676 / 20863476 / +2.0%	28675419 / 28570159 / +0.4%	0.74 / 0.73 / +1.6%
tpcds_q49/duckdb:parquet	18922835 / 18806446 / +0.6%	27078375 / 29778456 / -9.1%	0.70 / 0.63 / +10.7%
tpcds_q50/duckdb:parquet	17740400 / 17624504 / +0.7%	24964802 / 24631007 / +1.4%	0.71 / 0.72 / -0.7%
tpcds_q51/duckdb:parquet	53193270 / 53787502 / -1.1%	60694096 / 88676409 / -31.6% 🟢	0.88 / 0.61 / +44.5%
tpcds_q52/duckdb:parquet	8499150 / 9274379 / -8.4%	15190263 / 15071703 / +0.8%	0.56 / 0.62 / -9.1%
tpcds_q53/duckdb:parquet	11409912 / 11532138 / -1.1%	17324314 / 17242043 / +0.5%	0.66 / 0.67 / -1.5%
tpcds_q54/duckdb:parquet	20419242 / 20778756 / -1.7%	30106560 / 29903198 / +0.7%	0.68 / 0.69 / -2.4%
tpcds_q55/duckdb:parquet	8529890 / 8572056 / -0.5%	14980071 / 15322632 / -2.2%	0.57 / 0.56 / +1.8%
tpcds_q56/duckdb:parquet	16034482 / 16732510 / -4.2%	23581144 / 23670044 / -0.4%	0.68 / 0.71 / -3.8%
tpcds_q57/duckdb:parquet	29044484 / 30131401 / -3.6%	34362205 / 34119909 / +0.7%	0.85 / 0.88 / -4.3%
tpcds_q58/duckdb:parquet	18806388 / 18294160 / +2.8%	29390662 / 25813981 / +13.9% 🔴	0.64 / 0.71 / -9.7%
tpcds_q59/duckdb:parquet	19957396 / 19930762 / +0.1%	25617515 / 25164153 / +1.8%	0.78 / 0.79 / -1.6%
tpcds_q60/duckdb:parquet	16960912 / 16746738 / +1.3%	23690849 / 24143349 / -1.9%	0.72 / 0.69 / +3.2%
tpcds_q61/duckdb:parquet	21905080 / 21575308 / +1.5%	28572964 / 29608606 / -3.5%	0.77 / 0.73 / +5.2%
tpcds_q62/duckdb:parquet	10906485 / 10814445 / +0.9%	15343610 / 14710474 / +4.3%	0.71 / 0.74 / -3.3%
tpcds_q63/duckdb:parquet	10918234 / 10937456 / -0.2%	17064114 / 17284815 / -1.3%	0.64 / 0.63 / +1.1%
tpcds_q64/duckdb:parquet	52799530 / 52733880 / +0.1%	64889576 / 75995060 / -14.6% 🟢	0.81 / 0.69 / +17.3%
tpcds_q65/duckdb:parquet	14635223 / 14566450 / +0.5%	21143353 / 21071703 / +0.3%	0.69 / 0.69 / +0.1%
tpcds_q66/duckdb:parquet	24724772 / 24770790 / -0.2%	30910750 / 32120885 / -3.8%	0.80 / 0.77 / +3.7%
tpcds_q67/duckdb:parquet	79314196 / 77281683 / +2.6%	88211316 / 83924295 / +5.1%	0.90 / 0.92 / -2.4%
tpcds_q68/duckdb:parquet	29602828 / 29141843 / +1.6%	39811398 / 40631763 / -2.0%	0.74 / 0.72 / +3.7%
tpcds_q69/duckdb:parquet	28993740 / 28651482 / +1.2%	39625664 / 38852462 / +2.0%	0.73 / 0.74 / -0.8%
tpcds_q70/duckdb:parquet	17991862 / 18954522 / -5.1%	24199166 / 26772633 / -9.6%	0.74 / 0.71 / +5.0%
tpcds_q71/duckdb:parquet	14650434 / 14769218 / -0.8%	20779267 / 21483537 / -3.3%	0.71 / 0.69 / +2.6%
tpcds_q72/duckdb:parquet	81961906 / 81716420 / +0.3%	86217380 / 87424307 / -1.4%	0.95 / 0.93 / +1.7%
tpcds_q73/duckdb:parquet	13620269 / 13352522 / +2.0%	19880825 / 19233173 / +3.4%	0.69 / 0.69 / -1.3%
tpcds_q74/duckdb:parquet	99472649 / 98825004 / +0.7%	106891654 / 105824540 / +1.0%	0.93 / 0.93 / -0.3%
tpcds_q75/duckdb:parquet	43986752 / 40170330 / +9.5%	51892755 / 51605528 / +0.6%	0.85 / 0.78 / +8.9%
tpcds_q76/duckdb:parquet	13474047 / 13647378 / -1.3%	21097397 / 23152763 / -8.9%	0.64 / 0.59 / +8.3%
tpcds_q77/duckdb:parquet	16881623 / 17119238 / -1.4%	24900522 / 25102804 / -0.8%	0.68 / 0.68 / -0.6%
tpcds_q78/duckdb:parquet	48319490 / 48587621 / -0.6%	53022437 / 53410162 / -0.7%	0.91 / 0.91 / +0.2%
tpcds_q79/duckdb:parquet	20711994 / 20348085 / +1.8%	28996554 / 29360973 / -1.2%	0.71 / 0.69 / +3.1%
tpcds_q80/duckdb:parquet	31353914 / 31393986 / -0.1%	39499307 / 39993265 / -1.2%	0.79 / 0.78 / +1.1%
tpcds_q81/duckdb:parquet	29686142 / 29835424 / -0.5%	39382970 / 39067205 / +0.8%	0.75 / 0.76 / -1.3%
tpcds_q82/duckdb:parquet	13486113 / 14311564 / -5.8%	18875812 / 20586579 / -8.3%	0.71 / 0.70 / +2.8%
tpcds_q83/duckdb:parquet	15914034 / 15924858 / -0.1%	21233818 / 19691646 / +7.8%	0.75 / 0.81 / -7.3%
tpcds_q84/duckdb:parquet	17497800 / 17293122 / +1.2%	23898346 / 23613574 / +1.2%	0.73 / 0.73 / -0.0%
tpcds_q85/duckdb:parquet	35054778 / 34659928 / +1.1%	45464350 / 48360666 / -6.0%	0.77 / 0.72 / +7.6%
tpcds_q86/duckdb:parquet	11181180 / 11982930 / -6.7%	18899807 / 15744791 / +20.0% 🔴	0.59 / 0.76 / -22.3%
tpcds_q87/duckdb:parquet	28918288 / 28206208 / +2.5%	32550316 / 31975732 / +1.8%	0.89 / 0.88 / +0.7%
tpcds_q88/duckdb:parquet	27263536 / 28356160 / -3.9%	36214771 / 31533591 / +14.8% 🔴	0.75 / 0.90 / -16.3%
tpcds_q89/duckdb:parquet	12762352 / 12604934 / +1.2%	20315378 / 22192014 / -8.5%	0.63 / 0.57 / +10.6%
tpcds_q90/duckdb:parquet	6911736 / 6949072 / -0.5%	11417127 / 10718597 / +6.5%	0.61 / 0.65 / -6.6%
tpcds_q91/duckdb:parquet	21074382 / 20479498 / +2.9%	29517673 / 28399195 / +3.9%	0.71 / 0.72 / -1.0%
tpcds_q92/duckdb:parquet	11546262 / 11504888 / +0.4%	18288048 / 18195558 / +0.5%	0.63 / 0.63 / -0.1%
tpcds_q93/duckdb:parquet	21512490 / 21245974 / +1.3%	28968875 / 29297443 / -1.1%	0.74 / 0.73 / +2.4%
tpcds_q94/duckdb:parquet	16302685 / 16072160 / +1.4%	25349040 / 26426038 / -4.1%	0.64 / 0.61 / +5.7%
tpcds_q95/duckdb:parquet	89660968 / 90331294 / -0.7%	96114074 / 97496712 / -1.4%	0.93 / 0.93 / +0.7%
tpcds_q96/duckdb:parquet	6909786 / 6823317 / +1.3%	10923410 / 14130306 / -22.7% 🟢	0.63 / 0.48 / +31.0%
tpcds_q97/duckdb:parquet	26063896 / 25960956 / +0.4%	31999171 / 31402351 / +1.9%	0.81 / 0.83 / -1.5%
tpcds_q98/duckdb:parquet	15123142 / 17618601 / -14.2% 🟢	22637286 / 24500071 / -7.6%	0.67 / 0.72 / -7.1%
tpcds_q99/duckdb:parquet	17342385 / 17596747 / -1.4%	21296553 / 20802509 / +2.4%	0.81 / 0.85 / -3.7%

No file size changes detected.

github-actions · 2026-09-16T10:49:40Z

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 071bb91b vs base 4af09a94
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-1.3%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.967x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.998x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	97653915 / 92363873 / +5.7%	172614752 / 160863425 / +7.3%	0.57 / 0.57 / -1.5%
tpch_q02/datafusion:vortex-file-compressed	64950666 / 65070777 / -0.2%	94625892 / 96568506 / -2.0%	0.69 / 0.67 / +1.9%
tpch_q03/datafusion:vortex-file-compressed	64083016 / 66102604 / -3.1%	116966783 / 118784791 / -1.5%	0.55 / 0.56 / -1.5%
tpch_q04/datafusion:vortex-file-compressed	35186028 / 35279762 / -0.3%	79873215 / 79023985 / +1.1%	0.44 / 0.45 / -1.3%
tpch_q05/datafusion:vortex-file-compressed	116809264 / 121251882 / -3.7%	176812347 / 185245916 / -4.6%	0.66 / 0.65 / +0.9%
tpch_q06/datafusion:vortex-file-compressed	14933408 / 14650614 / +1.9%	66632377 / 74140546 / -10.1% 🟢	0.22 / 0.20 / +13.4%
tpch_q07/datafusion:vortex-file-compressed	141701435 / 141852936 / -0.1%	198811898 / 192985339 / +3.0%	0.71 / 0.74 / -3.0%
tpch_q08/datafusion:vortex-file-compressed	144189049 / 150051981 / -3.9%	212110871 / 213429579 / -0.6%	0.68 / 0.70 / -3.3%
tpch_q09/datafusion:vortex-file-compressed	187181601 / 195277665 / -4.1%	260558645 / 261239521 / -0.3%	0.72 / 0.75 / -3.9%
tpch_q10/datafusion:vortex-file-compressed	73628049 / 73683764 / -0.1%	139563240 / 137763494 / +1.3%	0.53 / 0.53 / -1.4%
tpch_q11/datafusion:vortex-file-compressed	42473979 / 43400530 / -2.1%	67944666 / 66163613 / +2.7%	0.63 / 0.66 / -4.7%
tpch_q12/datafusion:vortex-file-compressed	46155377 / 45385220 / +1.7%	91085074 / 95425543 / -4.5%	0.51 / 0.48 / +6.5%
tpch_q13/datafusion:vortex-file-compressed	46369828 / 46458834 / -0.2%	81049954 / 85244787 / -4.9%	0.57 / 0.55 / +5.0%
tpch_q14/datafusion:vortex-file-compressed	25082663 / 25797187 / -2.8%	103274046 / 93746252 / +10.2% 🔴	0.24 / 0.28 / -11.7%
tpch_q15/datafusion:vortex-file-compressed	37259689 / 37273092 / -0.0%	100124383 / 103154638 / -2.9%	0.37 / 0.36 / +3.0%
tpch_q16/datafusion:vortex-file-compressed	37510633 / 37931079 / -1.1%	66971263 / 68629064 / -2.4%	0.56 / 0.55 / +1.3%
tpch_q17/datafusion:vortex-file-compressed	174950784 / 180309391 / -3.0%	223565864 / 222350292 / +0.5%	0.78 / 0.81 / -3.5%
tpch_q18/datafusion:vortex-file-compressed	203806915 / 201339877 / +1.2%	266127260 / 262749068 / +1.3%	0.77 / 0.77 / -0.1%
tpch_q19/datafusion:vortex-file-compressed	35224527 / 34740011 / +1.4%	94981898 / 91685452 / +3.6%	0.37 / 0.38 / -2.1%
tpch_q20/datafusion:vortex-file-compressed	63322063 / 63077670 / +0.4%	125528170 / 130682228 / -3.9%	0.50 / 0.48 / +4.5%
tpch_q21/datafusion:vortex-file-compressed	181579423 / 181721035 / -0.1%	244249529 / 240575200 / +1.5%	0.74 / 0.76 / -1.6%
tpch_q22/datafusion:vortex-file-compressed	25405459 / 25514300 / -0.4%	55684512 / 56078123 / -0.7%	0.46 / 0.45 / +0.3%

datafusion / vortex-compact / ns (0.993x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	99274497 / 97279549 / +2.1%	154658920 / 149346383 / +3.6%	0.64 / 0.65 / -1.5%
tpch_q02/datafusion:vortex-compact	65316899 / 64741146 / +0.9%	96404293 / 90925338 / +6.0%	0.68 / 0.71 / -4.8%
tpch_q03/datafusion:vortex-compact	66700903 / 67001385 / -0.4%	111439556 / 118891524 / -6.3%	0.60 / 0.56 / +6.2%
tpch_q04/datafusion:vortex-compact	41921298 / 41161913 / +1.8%	78927916 / 78148897 / +1.0%	0.53 / 0.53 / +0.8%
tpch_q05/datafusion:vortex-compact	119537897 / 121253764 / -1.4%	170697542 / 164047835 / +4.1%	0.70 / 0.74 / -5.3%
tpch_q06/datafusion:vortex-compact	18288804 / 18149027 / +0.8%	60525346 / 66469272 / -8.9%	0.30 / 0.27 / +10.7%
tpch_q07/datafusion:vortex-compact	143872904 / 145811054 / -1.3%	182251677 / 180876371 / +0.8%	0.79 / 0.81 / -2.1%
tpch_q08/datafusion:vortex-compact	145746856 / 146994873 / -0.8%	206907881 / 195839547 / +5.7%	0.70 / 0.75 / -6.2%
tpch_q09/datafusion:vortex-compact	186420590 / 188888786 / -1.3%	248451891 / 246350893 / +0.9%	0.75 / 0.77 / -2.1%
tpch_q10/datafusion:vortex-compact	79016581 / 79746927 / -0.9%	124154962 / 133227143 / -6.8%	0.64 / 0.60 / +6.3%
tpch_q11/datafusion:vortex-compact	43494948 / 43532229 / -0.1%	67920485 / 66738001 / +1.8%	0.64 / 0.65 / -1.8%
tpch_q12/datafusion:vortex-compact	56788326 / 58469446 / -2.9%	94211499 / 92125915 / +2.3%	0.60 / 0.63 / -5.0%
tpch_q13/datafusion:vortex-compact	53764530 / 53857076 / -0.2%	83720214 / 82447347 / +1.5%	0.64 / 0.65 / -1.7%
tpch_q14/datafusion:vortex-compact	27472043 / 27759230 / -1.0%	97278637 / 97610837 / -0.3%	0.28 / 0.28 / -0.7%
tpch_q15/datafusion:vortex-compact	45204924 / 45605808 / -0.9%	97929983 / 100410399 / -2.5%	0.46 / 0.45 / +1.6%
tpch_q16/datafusion:vortex-compact	39572478 / 41520673 / -4.7%	69575280 / 72478292 / -4.0%	0.57 / 0.57 / -0.7%
tpch_q17/datafusion:vortex-compact	176037205 / 174974619 / +0.6%	229495691 / 216403124 / +6.1%	0.77 / 0.81 / -5.1%
tpch_q18/datafusion:vortex-compact	200201506 / 203559581 / -1.6%	259632986 / 258209690 / +0.6%	0.77 / 0.79 / -2.2%
tpch_q19/datafusion:vortex-compact	42230214 / 43300583 / -2.5%	87416843 / 88587156 / -1.3%	0.48 / 0.49 / -1.2%
tpch_q20/datafusion:vortex-compact	65396492 / 66657449 / -1.9%	117152850 / 119481891 / -1.9%	0.56 / 0.56 / +0.1%
tpch_q21/datafusion:vortex-compact	192877125 / 191459969 / +0.7%	245400260 / 244031765 / +0.6%	0.79 / 0.78 / +0.2%
tpch_q22/datafusion:vortex-compact	26752433 / 26610608 / +0.5%	54093007 / 57366279 / -5.7%	0.49 / 0.46 / +6.6%

datafusion / parquet / ns (1.007x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	83440068 / 83915432 / -0.6%	133921971 / 130738255 / +2.4%	0.62 / 0.64 / -2.9%
tpch_q02/datafusion:parquet	135342383 / 134468984 / +0.6%	165923796 / 164552132 / +0.8%	0.82 / 0.82 / -0.2%
tpch_q03/datafusion:parquet	125823370 / 124749406 / +0.9%	204809352 / 203244604 / +0.8%	0.61 / 0.61 / +0.1%
tpch_q04/datafusion:parquet	53678760 / 53414467 / +0.5%	103593657 / 107669219 / -3.8%	0.52 / 0.50 / +4.4%
tpch_q05/datafusion:parquet	166351905 / 164851595 / +0.9%	247324128 / 246878289 / +0.2%	0.67 / 0.67 / +0.7%
tpch_q06/datafusion:parquet	32981729 / 32060240 / +2.9%	82631755 / 84460851 / -2.2%	0.40 / 0.38 / +5.2%
tpch_q07/datafusion:parquet	215034515 / 213480629 / +0.7%	309855164 / 281853447 / +9.9%	0.69 / 0.76 / -8.4%
tpch_q08/datafusion:parquet	211056762 / 210421926 / +0.3%	305165198 / 295307299 / +3.3%	0.69 / 0.71 / -2.9%
tpch_q09/datafusion:parquet	280743844 / 283059468 / -0.8%	355271054 / 374355550 / -5.1%	0.79 / 0.76 / +4.5%
tpch_q10/datafusion:parquet	301241953 / 302587162 / -0.4%	372712929 / 387702102 / -3.9%	0.81 / 0.78 / +3.6%
tpch_q11/datafusion:parquet	98064476 / 96353603 / +1.8%	119458183 / 122243566 / -2.3%	0.82 / 0.79 / +4.1%
tpch_q12/datafusion:parquet	78870899 / 78157618 / +0.9%	128077567 / 138178885 / -7.3%	0.62 / 0.57 / +8.9%
tpch_q13/datafusion:parquet	195573537 / 194814989 / +0.4%	227984190 / 232139290 / -1.8%	0.86 / 0.84 / +2.2%
tpch_q14/datafusion:parquet	74866142 / 75183777 / -0.4%	196026921 / 181000027 / +8.3%	0.38 / 0.42 / -8.1%
tpch_q15/datafusion:parquet	78122219 / 76754651 / +1.8%	137309208 / 143049743 / -4.0%	0.57 / 0.54 / +6.0%
tpch_q16/datafusion:parquet	84605916 / 85449849 / -1.0%	109725030 / 113002107 / -2.9%	0.77 / 0.76 / +2.0%
tpch_q17/datafusion:parquet	206408659 / 206261403 / +0.1%	269527633 / 270149858 / -0.2%	0.77 / 0.76 / +0.3%
tpch_q18/datafusion:parquet	266582277 / 262721899 / +1.5%	315693152 / 314644538 / +0.3%	0.84 / 0.83 / +1.1%
tpch_q19/datafusion:parquet	98834706 / 97819733 / +1.0%	169067407 / 166920432 / +1.3%	0.58 / 0.59 / -0.2%
tpch_q20/datafusion:parquet	153583073 / 152205046 / +0.9%	210992762 / 223915056 / -5.8%	0.73 / 0.68 / +7.1%
tpch_q21/datafusion:parquet	233597164 / 227657186 / +2.6%	319572424 / 305517765 / +4.6%	0.73 / 0.75 / -1.9%
tpch_q22/datafusion:parquet	162540226 / 160394505 / +1.3%	185005291 / 187264826 / -1.2%	0.88 / 0.86 / +2.6%

duckdb / vortex-file-compressed / ns (0.983x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	53812102 / 55255460 / -2.6%	98098055 / 100008898 / -1.9%	0.55 / 0.55 / -0.7%
tpch_q02/duckdb:vortex-file-compressed	31974853 / 32184365 / -0.7%	46029289 / 50488189 / -8.8%	0.69 / 0.64 / +9.0%
tpch_q03/duckdb:vortex-file-compressed	56558435 / 57202794 / -1.1%	108105677 / 119686314 / -9.7%	0.52 / 0.48 / +9.5%
tpch_q04/duckdb:vortex-file-compressed	79535151 / 80935907 / -1.7%	114738600 / 123756868 / -7.3%	0.69 / 0.65 / +6.0%
tpch_q05/duckdb:vortex-file-compressed	63407551 / 65346936 / -3.0%	120330533 / 127313027 / -5.5%	0.53 / 0.51 / +2.7%
tpch_q06/duckdb:vortex-file-compressed	20966189 / 21015940 / -0.2%	55628918 / 65112889 / -14.6% 🟢	0.38 / 0.32 / +16.8%
tpch_q07/duckdb:vortex-file-compressed	59801982 / 60039931 / -0.4%	127232052 / 138856267 / -8.4%	0.47 / 0.43 / +8.7%
tpch_q08/duckdb:vortex-file-compressed	81924766 / 86797902 / -5.6%	142534647 / 162001869 / -12.0% 🟢	0.57 / 0.54 / +7.3%
tpch_q09/duckdb:vortex-file-compressed	169529328 / 171418256 / -1.1%	228901516 / 248301568 / -7.8%	0.74 / 0.69 / +7.3%
tpch_q10/duckdb:vortex-file-compressed	112453925 / 112904302 / -0.4%	191710592 / 194952193 / -1.7%	0.59 / 0.58 / +1.3%
tpch_q11/duckdb:vortex-file-compressed	17362755 / 16997393 / +2.1%	29106685 / 31370137 / -7.2%	0.60 / 0.54 / +10.1%
tpch_q12/duckdb:vortex-file-compressed	55058684 / 57790372 / -4.7%	94230763 / 117946036 / -20.1% 🟢	0.58 / 0.49 / +19.3%
tpch_q13/duckdb:vortex-file-compressed	89724744 / 91076717 / -1.5%	139620969 / 151890971 / -8.1%	0.64 / 0.60 / +7.2%
tpch_q14/duckdb:vortex-file-compressed	31276075 / 32378239 / -3.4%	80124803 / 81930666 / -2.2%	0.39 / 0.40 / -1.2%
tpch_q15/duckdb:vortex-file-compressed	39796433 / 42388104 / -6.1%	91284018 / 105304261 / -13.3% 🟢	0.44 / 0.40 / +8.3%
tpch_q16/duckdb:vortex-file-compressed	42126167 / 42085249 / +0.1%	53113118 / 54952295 / -3.3%	0.79 / 0.77 / +3.6%
tpch_q17/duckdb:vortex-file-compressed	75201307 / 74795344 / +0.5%	157755185 / 166462905 / -5.2%	0.48 / 0.45 / +6.1%
tpch_q18/duckdb:vortex-file-compressed	123586692 / 130444859 / -5.3%	159044846 / 156852731 / +1.4%	0.78 / 0.83 / -6.6%
tpch_q19/duckdb:vortex-file-compressed	45010082 / 46558346 / -3.3%	101867365 / 120111806 / -15.2% 🟢	0.44 / 0.39 / +14.0%
tpch_q20/duckdb:vortex-file-compressed	59418580 / 59378344 / +0.1%	111636413 / 121441728 / -8.1%	0.53 / 0.49 / +8.9%
tpch_q21/duckdb:vortex-file-compressed	245537757 / 244217611 / +0.5%	291426890 / 295038143 / -1.2%	0.84 / 0.83 / +1.8%
tpch_q22/duckdb:vortex-file-compressed	41777017 / 41068718 / +1.7%	60870996 / 62892373 / -3.2%	0.69 / 0.65 / +5.1%

duckdb / vortex-compact / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	66438502 / 67807839 / -2.0%	99337823 / 110296417 / -9.9%	0.67 / 0.61 / +8.8%
tpch_q02/duckdb:vortex-compact	34621812 / 35411625 / -2.2%	49487991 / 50715740 / -2.4%	0.70 / 0.70 / +0.2%
tpch_q03/duckdb:vortex-compact	64084527 / 62804202 / +2.0%	104486784 / 109020980 / -4.2%	0.61 / 0.58 / +6.5%
tpch_q04/duckdb:vortex-compact	88261912 / 88580612 / -0.4%	115331736 / 120363891 / -4.2%	0.77 / 0.74 / +4.0%
tpch_q05/duckdb:vortex-compact	68768331 / 70597391 / -2.6%	109617044 / 128765288 / -14.9% 🟢	0.63 / 0.55 / +14.4%
tpch_q06/duckdb:vortex-compact	25844086 / 24561641 / +5.2%	61219892 / 65104426 / -6.0%	0.42 / 0.38 / +11.9%
tpch_q07/duckdb:vortex-compact	72460310 / 72012791 / +0.6%	135634350 / 133864905 / +1.3%	0.53 / 0.54 / -0.7%
tpch_q08/duckdb:vortex-compact	91642021 / 91426706 / +0.2%	144093395 / 152110024 / -5.3%	0.64 / 0.60 / +5.8%
tpch_q09/duckdb:vortex-compact	172595207 / 170341866 / +1.3%	238901864 / 238945253 / -0.0%	0.72 / 0.71 / +1.3%
tpch_q10/duckdb:vortex-compact	125716346 / 121535547 / +3.4%	182042341 / 193646038 / -6.0%	0.69 / 0.63 / +10.0%
tpch_q11/duckdb:vortex-compact	19580373 / 19484505 / +0.5%	32873628 / 34371166 / -4.4%	0.60 / 0.57 / +5.1%
tpch_q12/duckdb:vortex-compact	70144161 / 70886025 / -1.0%	101837079 / 119244163 / -14.6% 🟢	0.69 / 0.59 / +15.9%
tpch_q13/duckdb:vortex-compact	95056659 / 94447240 / +0.6%	131464074 / 143182005 / -8.2%	0.72 / 0.66 / +9.6%
tpch_q14/duckdb:vortex-compact	32712036 / 34666262 / -5.6%	70738869 / 75809354 / -6.7%	0.46 / 0.46 / +1.1%
tpch_q15/duckdb:vortex-compact	43192796 / 43920441 / -1.7%	99998959 / 96349809 / +3.8%	0.43 / 0.46 / -5.2%
tpch_q16/duckdb:vortex-compact	43535540 / 44076359 / -1.2%	55925850 / 53335188 / +4.9%	0.78 / 0.83 / -5.8%
tpch_q17/duckdb:vortex-compact	62028416 / 60950063 / +1.8%	117505408 / 140763536 / -16.5% 🟢	0.53 / 0.43 / +21.9%
tpch_q18/duckdb:vortex-compact	140921415 / 140545872 / +0.3%	162302098 / 163212936 / -0.6%	0.87 / 0.86 / +0.8%
tpch_q19/duckdb:vortex-compact	48363176 / 48343026 / +0.0%	97397659 / 98893716 / -1.5%	0.50 / 0.49 / +1.6%
tpch_q20/duckdb:vortex-compact	67453168 / 69071404 / -2.3%	126472635 / 134776406 / -6.2%	0.53 / 0.51 / +4.1%
tpch_q21/duckdb:vortex-compact	264643688 / 264087516 / +0.2%	293139851 / 310620489 / -5.6%	0.90 / 0.85 / +6.2%
tpch_q22/duckdb:vortex-compact	44307599 / 44571622 / -0.6%	65824950 / 65280072 / +0.8%	0.67 / 0.68 / -1.4%

duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	70518561 / 70720899 / -0.3%	86623424 / 92250522 / -6.1%	0.81 / 0.77 / +6.2%
tpch_q02/duckdb:parquet	70635671 / 70959963 / -0.5%	80723803 / 82731365 / -2.4%	0.88 / 0.86 / +2.0%
tpch_q03/duckdb:parquet	113240489 / 115732097 / -2.2%	163864336 / 148623428 / +10.3% 🔴	0.69 / 0.78 / -11.3%
tpch_q04/duckdb:parquet	74116748 / 74156375 / -0.1%	99656553 / 104046176 / -4.2%	0.74 / 0.71 / +4.3%
tpch_q05/duckdb:parquet	124724011 / 124103633 / +0.5%	171504636 / 163183639 / +5.1%	0.73 / 0.76 / -4.4%
tpch_q06/duckdb:parquet	35086408 / 34608828 / +1.4%	50473251 / 56515714 / -10.7% 🟢	0.70 / 0.61 / +13.5%
tpch_q07/duckdb:parquet	90095173 / 90227587 / -0.1%	143662724 / 132346464 / +8.6%	0.63 / 0.68 / -8.0%
tpch_q08/duckdb:parquet	143230509 / 142347637 / +0.6%	185468758 / 198291370 / -6.5%	0.77 / 0.72 / +7.6%
tpch_q09/duckdb:parquet	224566245 / 221486900 / +1.4%	313167291 / 266538664 / +17.5% 🔴	0.72 / 0.83 / -13.7%
tpch_q10/duckdb:parquet	474160531 / 469896315 / +0.9%	510288641 / 511285088 / -0.2%	0.93 / 0.92 / +1.1%
tpch_q11/duckdb:parquet	30681596 / 30615218 / +0.2%	37708883 / 38262901 / -1.4%	0.81 / 0.80 / +1.7%
tpch_q12/duckdb:parquet	74309288 / 75650793 / -1.8%	92259525 / 93230797 / -1.0%	0.81 / 0.81 / -0.7%
tpch_q13/duckdb:parquet	315144227 / 317034321 / -0.6%	328515868 / 332917633 / -1.3%	0.96 / 0.95 / +0.7%
tpch_q14/duckdb:parquet	103002687 / 105707875 / -2.6%	142407699 / 140117323 / +1.6%	0.72 / 0.75 / -4.1%
tpch_q15/duckdb:parquet	43248800 / 44336757 / -2.5%	67266383 / 77608294 / -13.3% 🟢	0.64 / 0.57 / +12.5%
tpch_q16/duckdb:parquet	113825384 / 113891704 / -0.1%	124309007 / 124963936 / -0.5%	0.92 / 0.91 / +0.5%
tpch_q17/duckdb:parquet	73120454 / 74372668 / -1.7%	106161492 / 100583112 / +5.5%	0.69 / 0.74 / -6.8%
tpch_q18/duckdb:parquet	206865901 / 206036215 / +0.4%	178147217 / 169636621 / +5.0%	1.16 / 1.21 / -4.4%
tpch_q19/duckdb:parquet	162357045 / 162137824 / +0.1%	193389156 / 191772408 / +0.8%	0.84 / 0.85 / -0.7%
tpch_q20/duckdb:parquet	128040902 / 127855771 / +0.1%	172171523 / 165173882 / +4.2%	0.74 / 0.77 / -3.9%
tpch_q21/duckdb:parquet	271018093 / 270325251 / +0.3%	299191167 / 304860805 / -1.9%	0.91 / 0.89 / +2.2%
tpch_q22/duckdb:parquet	262941466 / 260736886 / +0.8%	270861996 / 276878074 / -2.2%	0.97 / 0.94 / +3.1%

No file size changes detected.

github-actions · 2026-09-16T10:54:04Z

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 071bb91b vs base 4af09a94
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.5%
Engines: DataFusion No clear signal (-1.2%, environment too noisy confidence) · DuckDB No clear signal (-1.8%, environment too noisy confidence)
Vortex (geomean): hot 1.012x ➖ · cold 0.981x ➖
Parquet (geomean): hot 1.027x ➖ · cold 0.984x ➖
Shifts: Parquet (control) +2.7% · Median polish -1.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.934x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	214977529 / 218162898 / -1.5%	657704175 / 674533485 / -2.5%	0.33 / 0.32 / +1.1%
tpch_q02/datafusion:vortex-file-compressed	307589822 / 360879136 / -14.8%	590668251 / 589721187 / +0.2%	0.52 / 0.61 / -14.9%
tpch_q03/datafusion:vortex-file-compressed	344605021 / 350292035 / -1.6%	883740013 / 1226852224 / -28.0%	0.39 / 0.29 / +36.6%
tpch_q04/datafusion:vortex-file-compressed	188186102 / 229962270 / -18.2%	425674743 / 419369335 / +1.5%	0.44 / 0.55 / -19.4%
tpch_q05/datafusion:vortex-file-compressed	394792632 / 617240741 / -36.0% 🟢	514222674 / 731585802 / -29.7%	0.77 / 0.84 / -9.0%
tpch_q06/datafusion:vortex-file-compressed	244923508 / 241621428 / +1.4%	400623799 / 415258468 / -3.5%	0.61 / 0.58 / +5.1%
tpch_q07/datafusion:vortex-file-compressed	361963679 / 395709883 / -8.5%	504732466 / 465375548 / +8.5%	0.72 / 0.85 / -15.7%
tpch_q08/datafusion:vortex-file-compressed	391354589 / 435619549 / -10.2%	570652096 / 635186025 / -10.2%	0.69 / 0.69 / -0.0%
tpch_q09/datafusion:vortex-file-compressed	462850816 / 438866309 / +5.5%	715858039 / 492262769 / +45.4% 🔴	0.65 / 0.89 / -27.5%
tpch_q10/datafusion:vortex-file-compressed	344281259 / 336856490 / +2.2%	506720076 / 492821103 / +2.8%	0.68 / 0.68 / -0.6%
tpch_q11/datafusion:vortex-file-compressed	262551147 / 291096315 / -9.8%	477557390 / 388145895 / +23.0%	0.55 / 0.75 / -26.7%
tpch_q12/datafusion:vortex-file-compressed	458563033 / 276168326 / +66.0% 🔴	668311896 / 463441191 / +44.2% 🔴	0.69 / 0.60 / +15.1%
tpch_q13/datafusion:vortex-file-compressed	136112492 / 138371819 / -1.6%	329093047 / 317147995 / +3.8%	0.41 / 0.44 / -5.2%
tpch_q14/datafusion:vortex-file-compressed	187023770 / 166117295 / +12.6%	308866057 / 336050923 / -8.1%	0.61 / 0.49 / +22.5%
tpch_q15/datafusion:vortex-file-compressed	292829412 / 340955471 / -14.1%	729433454 / 454841136 / +60.4% 🔴	0.40 / 0.75 / -46.4%
tpch_q16/datafusion:vortex-file-compressed	141201631 / 158161122 / -10.7%	279896473 / 298849324 / -6.3%	0.50 / 0.53 / -4.7%
tpch_q17/datafusion:vortex-file-compressed	300340016 / 361227027 / -16.9%	498324892 / 611554391 / -18.5%	0.60 / 0.59 / +2.0%
tpch_q18/datafusion:vortex-file-compressed	268432429 / 355066977 / -24.4%	425423621 / 476734629 / -10.8%	0.63 / 0.74 / -15.3%
tpch_q19/datafusion:vortex-file-compressed	374932645 / 347603278 / +7.9%	424542285 / 419043179 / +1.3%	0.88 / 0.83 / +6.5%
tpch_q20/datafusion:vortex-file-compressed	309243840 / 327689023 / -5.6%	438230514 / 497551156 / -11.9%	0.71 / 0.66 / +7.1%
tpch_q21/datafusion:vortex-file-compressed	615875172 / 640711067 / -3.9%	607607625 / 760141879 / -20.1%	1.01 / 0.84 / +20.3%
tpch_q22/datafusion:vortex-file-compressed	138079602 / 189107367 / -27.0%	299123844 / 322139776 / -7.1%	0.46 / 0.59 / -21.4%

datafusion / vortex-compact / ns (1.055x ➖, 1↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	209653378 / 214782986 / -2.4%	571072517 / 532168185 / +7.3%	0.37 / 0.40 / -9.0%
tpch_q02/datafusion:vortex-compact	292483590 / 331374876 / -11.7%	554746214 / 623055933 / -11.0%	0.53 / 0.53 / -0.9%
tpch_q03/datafusion:vortex-compact	353070061 / 328356692 / +7.5%	654388535 / 639622008 / +2.3%	0.54 / 0.51 / +5.1%
tpch_q04/datafusion:vortex-compact	144782687 / 148873862 / -2.7%	297254201 / 466054324 / -36.2% 🟢	0.49 / 0.32 / +52.5%
tpch_q05/datafusion:vortex-compact	299553906 / 454303828 / -34.1% 🟢	558691668 / 498075172 / +12.2%	0.54 / 0.91 / -41.2%
tpch_q06/datafusion:vortex-compact	247607184 / 253084621 / -2.2%	368819912 / 380226912 / -3.0%	0.67 / 0.67 / +0.9%
tpch_q07/datafusion:vortex-compact	340192066 / 353703559 / -3.8%	445634866 / 533241186 / -16.4%	0.76 / 0.66 / +15.1%
tpch_q08/datafusion:vortex-compact	412920726 / 373013106 / +10.7%	549745123 / 760259757 / -27.7%	0.75 / 0.49 / +53.1%
tpch_q09/datafusion:vortex-compact	402775422 / 453569430 / -11.2%	416598595 / 448138315 / -7.0%	0.97 / 1.01 / -4.5%
tpch_q10/datafusion:vortex-compact	299137553 / 314072027 / -4.8%	505955598 / 441528808 / +14.6%	0.59 / 0.71 / -16.9%
tpch_q11/datafusion:vortex-compact	250565020 / 307859449 / -18.6%	489336699 / 592770676 / -17.4%	0.51 / 0.52 / -1.4%
tpch_q12/datafusion:vortex-compact	309258388 / 251777180 / +22.8%	411793996 / 420429934 / -2.1%	0.75 / 0.60 / +25.4%
tpch_q13/datafusion:vortex-compact	217163965 / 99025104 / +119.3% 🔴	315459095 / 402845814 / -21.7%	0.69 / 0.25 / +180.1%
tpch_q14/datafusion:vortex-compact	166913963 / 177807485 / -6.1%	280168549 / 298270802 / -6.1%	0.60 / 0.60 / -0.1%
tpch_q15/datafusion:vortex-compact	282703741 / 305556854 / -7.5%	433567863 / 479372245 / -9.6%	0.65 / 0.64 / +2.3%
tpch_q16/datafusion:vortex-compact	148442059 / 144416588 / +2.8%	270301463 / 299742941 / -9.8%	0.55 / 0.48 / +14.0%
tpch_q17/datafusion:vortex-compact	583305245 / 261655381 / +122.9% 🔴	940712145 / 446216871 / +110.8% 🔴	0.62 / 0.59 / +5.7%
tpch_q18/datafusion:vortex-compact	483817163 / 251287399 / +92.5% 🔴	397953631 / 366054770 / +8.7%	1.22 / 0.69 / +77.1%
tpch_q19/datafusion:vortex-compact	391507883 / 406004476 / -3.6%	505826814 / 484630548 / +4.4%	0.77 / 0.84 / -7.6%
tpch_q20/datafusion:vortex-compact	250904336 / 252014996 / -0.4%	376024720 / 398997633 / -5.8%	0.67 / 0.63 / +5.6%
tpch_q21/datafusion:vortex-compact	409874593 / 420261716 / -2.5%	590170441 / 585475005 / +0.8%	0.69 / 0.72 / -3.2%
tpch_q22/datafusion:vortex-compact	136846730 / 172238460 / -20.5%	284226785 / 340090768 / -16.4%	0.48 / 0.51 / -4.9%

datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	164650798 / 164315750 / +0.2%	523032602 / 426804648 / +22.5%	0.31 / 0.38 / -18.2%
tpch_q02/datafusion:parquet	254814288 / 257175202 / -0.9%	461542188 / 522368026 / -11.6%	0.55 / 0.49 / +12.1%
tpch_q03/datafusion:parquet	298087483 / 268134490 / +11.2%	689969222 / 776212086 / -11.1%	0.43 / 0.35 / +25.1%
tpch_q04/datafusion:parquet	160633450 / 169071649 / -5.0%	488792537 / 329292986 / +48.4% 🔴	0.33 / 0.51 / -36.0%
tpch_q05/datafusion:parquet	458596053 / 354883897 / +29.2%	471133085 / 499321567 / -5.6%	0.97 / 0.71 / +37.0%
tpch_q06/datafusion:parquet	144610386 / 131015708 / +10.4%	275361800 / 358486115 / -23.2%	0.53 / 0.37 / +43.7%
tpch_q07/datafusion:parquet	385404021 / 326817932 / +17.9%	464442931 / 426739046 / +8.8%	0.83 / 0.77 / +8.4%
tpch_q08/datafusion:parquet	436923859 / 415860749 / +5.1%	600082332 / 529699833 / +13.3%	0.73 / 0.79 / -7.3%
tpch_q09/datafusion:parquet	457042541 / 492253437 / -7.2%	557544807 / 689819824 / -19.2%	0.82 / 0.71 / +14.9%
tpch_q10/datafusion:parquet	455032923 / 368613866 / +23.4%	557699032 / 528107937 / +5.6%	0.82 / 0.70 / +16.9%
tpch_q11/datafusion:parquet	258947731 / 263452721 / -1.7%	429354267 / 473855297 / -9.4%	0.60 / 0.56 / +8.5%
tpch_q12/datafusion:parquet	194159322 / 191712069 / +1.3%	379949012 / 383788924 / -1.0%	0.51 / 0.50 / +2.3%
tpch_q13/datafusion:parquet	394406227 / 481426561 / -18.1%	521824199 / 621559533 / -16.0%	0.76 / 0.77 / -2.4%
tpch_q14/datafusion:parquet	161365522 / 194910864 / -17.2%	254820173 / 390441219 / -34.7% 🟢	0.63 / 0.50 / +26.9%
tpch_q15/datafusion:parquet	251983402 / 287523279 / -12.4%	412297293 / 465437832 / -11.4%	0.61 / 0.62 / -1.1%
tpch_q16/datafusion:parquet	105022536 / 102344461 / +2.6%	233768781 / 303154125 / -22.9%	0.45 / 0.34 / +33.1%
tpch_q17/datafusion:parquet	315953180 / 333184477 / -5.2%	573510345 / 446390755 / +28.5%	0.55 / 0.75 / -26.2%
tpch_q18/datafusion:parquet	428032994 / 455436929 / -6.0%	484126724 / 668468578 / -27.6%	0.88 / 0.68 / +29.8%
tpch_q19/datafusion:parquet	169150403 / 206701505 / -18.2%	267847369 / 382224971 / -29.9%	0.63 / 0.54 / +16.8%
tpch_q20/datafusion:parquet	259063907 / 241840158 / +7.1%	422678592 / 401583060 / +5.3%	0.61 / 0.60 / +1.8%
tpch_q21/datafusion:parquet	405357723 / 361992936 / +12.0%	451986272 / 457952121 / -1.3%	0.90 / 0.79 / +13.5%
tpch_q22/datafusion:parquet	157704050 / 161950507 / -2.6%	306870914 / 318246938 / -3.6%	0.51 / 0.51 / +1.0%

duckdb / vortex-file-compressed / ns (0.930x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	192295560 / 214385500 / -10.3%	243103373 / 530213334 / -54.1% 🟢	0.79 / 0.40 / +95.6%
tpch_q02/duckdb:vortex-file-compressed	357845914 / 397725032 / -10.0%	403138259 / 416942504 / -3.3%	0.89 / 0.95 / -6.9%
tpch_q03/duckdb:vortex-file-compressed	411603411 / 452109781 / -9.0%	519876987 / 505509685 / +2.8%	0.79 / 0.89 / -11.5%
tpch_q04/duckdb:vortex-file-compressed	293735947 / 300856975 / -2.4%	293812093 / 336919183 / -12.8%	1.00 / 0.89 / +12.0%
tpch_q05/duckdb:vortex-file-compressed	430700561 / 472209687 / -8.8%	515476733 / 545784253 / -5.6%	0.84 / 0.87 / -3.4%
tpch_q06/duckdb:vortex-file-compressed	256485866 / 315708637 / -18.8%	307087397 / 343677807 / -10.6%	0.84 / 0.92 / -9.1%
tpch_q07/duckdb:vortex-file-compressed	452102923 / 512840695 / -11.8%	482624022 / 504468628 / -4.3%	0.94 / 1.02 / -7.9%
tpch_q08/duckdb:vortex-file-compressed	582867367 / 551372040 / +5.7%	591208102 / 628054856 / -5.9%	0.99 / 0.88 / +12.3%
tpch_q09/duckdb:vortex-file-compressed	456049298 / 469220357 / -2.8%	460809396 / 476586774 / -3.3%	0.99 / 0.98 / +0.5%
tpch_q10/duckdb:vortex-file-compressed	425695564 / 514461742 / -17.3%	469403231 / 631216221 / -25.6%	0.91 / 0.82 / +11.3%
tpch_q11/duckdb:vortex-file-compressed	167139521 / 180295202 / -7.3%	188736850 / 398544213 / -52.6% 🟢	0.89 / 0.45 / +95.8%
tpch_q12/duckdb:vortex-file-compressed	621219210 / 574712119 / +8.1%	470312402 / 436011862 / +7.9%	1.32 / 1.32 / +0.2%
tpch_q13/duckdb:vortex-file-compressed	315873684 / 318066430 / -0.7%	314417765 / 336463903 / -6.6%	1.00 / 0.95 / +6.3%
tpch_q14/duckdb:vortex-file-compressed	228476555 / 228253517 / +0.1%	291057040 / 273479276 / +6.4%	0.78 / 0.83 / -5.9%
tpch_q15/duckdb:vortex-file-compressed	145792718 / 182907763 / -20.3%	200204921 / 180347465 / +11.0%	0.73 / 1.01 / -28.2%
tpch_q16/duckdb:vortex-file-compressed	179380584 / 170289342 / +5.3%	187400101 / 247790189 / -24.4%	0.96 / 0.69 / +39.3%
tpch_q17/duckdb:vortex-file-compressed	416085100 / 443369690 / -6.2%	529407535 / 457084275 / +15.8%	0.79 / 0.97 / -19.0%
tpch_q18/duckdb:vortex-file-compressed	317890598 / 377349237 / -15.8%	344875406 / 377116643 / -8.5%	0.92 / 1.00 / -7.9%
tpch_q19/duckdb:vortex-file-compressed	309802879 / 336383019 / -7.9%	352551893 / 326717556 / +7.9%	0.88 / 1.03 / -14.7%
tpch_q20/duckdb:vortex-file-compressed	417153816 / 380041530 / +9.8%	436812367 / 401422404 / +8.8%	0.95 / 0.95 / +0.9%
tpch_q21/duckdb:vortex-file-compressed	627222081 / 633014294 / -0.9%	827056509 / 759979213 / +8.8%	0.76 / 0.83 / -9.0%
tpch_q22/duckdb:vortex-file-compressed	168923407 / 221263302 / -23.7%	235090194 / 262741487 / -10.5%	0.72 / 0.84 / -14.7%

duckdb / vortex-compact / ns (1.146x ➖, 0↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	208985151 / 207386617 / +0.8%	290425304 / 221970760 / +30.8% 🔴	0.72 / 0.93 / -23.0%
tpch_q02/duckdb:vortex-compact	366298229 / 340391523 / +7.6%	401137560 / 325790461 / +23.1%	0.91 / 1.04 / -12.6%
tpch_q03/duckdb:vortex-compact	429858933 / 383496766 / +12.1%	454860355 / 490269215 / -7.2%	0.95 / 0.78 / +20.8%
tpch_q04/duckdb:vortex-compact	268423944 / 211777477 / +26.7%	294269031 / 227817509 / +29.2%	0.91 / 0.93 / -1.9%
tpch_q05/duckdb:vortex-compact	350948259 / 347230464 / +1.1%	398990465 / 382028727 / +4.4%	0.88 / 0.91 / -3.2%
tpch_q06/duckdb:vortex-compact	277176120 / 302353106 / -8.3%	273064207 / 284975963 / -4.2%	1.02 / 1.06 / -4.3%
tpch_q07/duckdb:vortex-compact	563994371 / 425897631 / +32.4% 🔴	564879570 / 476989266 / +18.4%	1.00 / 0.89 / +11.8%
tpch_q08/duckdb:vortex-compact	534763473 / 516140475 / +3.6%	509728217 / 567781857 / -10.2%	1.05 / 0.91 / +15.4%
tpch_q09/duckdb:vortex-compact	448252073 / 432657141 / +3.6%	462892563 / 435344671 / +6.3%	0.97 / 0.99 / -2.6%
tpch_q10/duckdb:vortex-compact	649525395 / 413250515 / +57.2% 🔴	1099255551 / 660319653 / +66.5% 🔴	0.59 / 0.63 / -5.6%
tpch_q11/duckdb:vortex-compact	193977659 / 149692330 / +29.6%	219453278 / 193586065 / +13.4%	0.88 / 0.77 / +14.3%
tpch_q12/duckdb:vortex-compact	561300550 / 452096375 / +24.2%	542276427 / 459053571 / +18.1%	1.04 / 0.98 / +5.1%
tpch_q13/duckdb:vortex-compact	235929669 / 186757038 / +26.3%	266456685 / 228719724 / +16.5%	0.89 / 0.82 / +8.4%
tpch_q14/duckdb:vortex-compact	227098323 / 254308560 / -10.7%	264881463 / 311048709 / -14.8%	0.86 / 0.82 / +4.9%
tpch_q15/duckdb:vortex-compact	152627702 / 150140262 / +1.7%	184354176 / 202618473 / -9.0%	0.83 / 0.74 / +11.7%
tpch_q16/duckdb:vortex-compact	177095205 / 163599328 / +8.2%	189877026 / 196740008 / -3.5%	0.93 / 0.83 / +12.2%
tpch_q17/duckdb:vortex-compact	352973464 / 359658339 / -1.9%	360353068 / 400626024 / -10.1%	0.98 / 0.90 / +9.1%
tpch_q18/duckdb:vortex-compact	448488117 / 293645999 / +52.7% 🔴	394907331 / 364152470 / +8.4%	1.14 / 0.81 / +40.8%
tpch_q19/duckdb:vortex-compact	713740444 / 323687618 / +120.5% 🔴	494432552 / 357378356 / +38.3% 🔴	1.44 / 0.91 / +59.4%
tpch_q20/duckdb:vortex-compact	370943835 / 338076648 / +9.7%	419516597 / 415194868 / +1.0%	0.88 / 0.81 / +8.6%
tpch_q21/duckdb:vortex-compact	551096147 / 618117012 / -10.8%	533299917 / 655856882 / -18.7%	1.03 / 0.94 / +9.6%
tpch_q22/duckdb:vortex-compact	160370893 / 164941147 / -2.8%	205462177 / 201426404 / +2.0%	0.78 / 0.82 / -4.7%

duckdb / parquet / ns (1.051x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	300157311 / 290724660 / +3.2%	300030654 / 272552003 / +10.1%	1.00 / 1.07 / -6.2%
tpch_q02/duckdb:parquet	601246110 / 632180806 / -4.9%	600096794 / 629499727 / -4.7%	1.00 / 1.00 / -0.2%
tpch_q03/duckdb:parquet	690573181 / 774270390 / -10.8%	754334625 / 870447315 / -13.3%	0.92 / 0.89 / +2.9%
tpch_q04/duckdb:parquet	422640514 / 453689261 / -6.8%	489555761 / 501114045 / -2.3%	0.86 / 0.91 / -4.6%
tpch_q05/duckdb:parquet	954999926 / 878844471 / +8.7%	911374487 / 911855374 / -0.1%	1.05 / 0.96 / +8.7%
tpch_q06/duckdb:parquet	358870590 / 308000754 / +16.5%	274455852 / 289060914 / -5.1%	1.31 / 1.07 / +22.7%
tpch_q07/duckdb:parquet	872065314 / 873134508 / -0.1%	798867099 / 773158979 / +3.3%	1.09 / 1.13 / -3.3%
tpch_q08/duckdb:parquet	1108247016 / 1064221569 / +4.1%	1140539280 / 982473115 / +16.1%	0.97 / 1.08 / -10.3%
tpch_q09/duckdb:parquet	1084290923 / 1025434313 / +5.7%	1121826448 / 997239150 / +12.5%	0.97 / 1.03 / -6.0%
tpch_q10/duckdb:parquet	1019791726 / 965774682 / +5.6%	1045404382 / 1002943569 / +4.2%	0.98 / 0.96 / +1.3%
tpch_q11/duckdb:parquet	424157717 / 396188523 / +7.1%	393204061 / 486611448 / -19.2%	1.08 / 0.81 / +32.5%
tpch_q12/duckdb:parquet	563451562 / 519525611 / +8.5%	604449031 / 614625282 / -1.7%	0.93 / 0.85 / +10.3%
tpch_q13/duckdb:parquet	759364728 / 762696919 / -0.4%	744695237 / 949528335 / -21.6%	1.02 / 0.80 / +26.9%
tpch_q14/duckdb:parquet	527909298 / 471399622 / +12.0%	592513526 / 473006367 / +25.3%	0.89 / 1.00 / -10.6%
tpch_q15/duckdb:parquet	477135026 / 356730693 / +33.8% 🔴	499776490 / 394621058 / +26.6%	0.95 / 0.90 / +5.6%
tpch_q16/duckdb:parquet	476631346 / 463321265 / +2.9%	482769801 / 410656868 / +17.6%	0.99 / 1.13 / -12.5%
tpch_q17/duckdb:parquet	578139458 / 457295386 / +26.4%	471535120 / 468684397 / +0.6%	1.23 / 0.98 / +25.7%
tpch_q18/duckdb:parquet	671389619 / 643329672 / +4.4%	733055780 / 598768723 / +22.4%	0.92 / 1.07 / -14.8%
tpch_q19/duckdb:parquet	554874798 / 598224499 / -7.2%	618717087 / 647731645 / -4.5%	0.90 / 0.92 / -2.9%
tpch_q20/duckdb:parquet	917691004 / 793720670 / +15.6%	862551092 / 767192377 / +12.4%	1.06 / 1.03 / +2.8%
tpch_q21/duckdb:parquet	691343532 / 713457926 / -3.1%	711166345 / 670319279 / +6.1%	0.97 / 1.06 / -8.7%
tpch_q22/duckdb:parquet	412352922 / 406510062 / +1.4%	426283219 / 392683170 / +8.6%	0.97 / 1.04 / -6.6%

github-actions · 2026-09-16T10:58:37Z

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 071bb91b vs base 4af09a94
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +12.2%
Engines: DataFusion No clear signal (+11.4%, environment too noisy confidence) · DuckDB No clear signal (+12.9%, environment too noisy confidence)
Vortex (geomean): hot 1.090x ➖ · cold 1.111x ➖
Parquet (geomean): hot 0.972x ➖ · cold 0.885x ➖
Shifts: Parquet (control) -2.8% · Median polish -1.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.038x ➖, 0↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	354788830 / 308890620 / +14.9%	1158642740 / 1000678327 / +15.8%	0.31 / 0.31 / -0.8%
tpch_q02/datafusion:vortex-compact	455418054 / 625059017 / -27.1%	898783067 / 1139860537 / -21.1%	0.51 / 0.55 / -7.6%
tpch_q03/datafusion:vortex-compact	679773855 / 418195205 / +62.5% 🔴	1247225061 / 1363371591 / -8.5%	0.55 / 0.31 / +77.7%
tpch_q04/datafusion:vortex-compact	340967065 / 364853711 / -6.5%	696282326 / 607715381 / +14.6%	0.49 / 0.60 / -18.4%
tpch_q05/datafusion:vortex-compact	620425223 / 704173760 / -11.9%	823326268 / 1063006388 / -22.5%	0.75 / 0.66 / +13.8%
tpch_q06/datafusion:vortex-compact	287058065 / 288355358 / -0.4%	446893818 / 573945492 / -22.1%	0.64 / 0.50 / +27.9%
tpch_q07/datafusion:vortex-compact	536579047 / 622631147 / -13.8%	685658131 / 772705681 / -11.3%	0.78 / 0.81 / -2.9%
tpch_q08/datafusion:vortex-compact	852641265 / 881372433 / -3.3%	1313766713 / 999330755 / +31.5% 🔴	0.65 / 0.88 / -26.4%
tpch_q09/datafusion:vortex-compact	982367035 / 751811627 / +30.7% 🔴	1723653794 / 957181374 / +80.1% 🔴	0.57 / 0.79 / -27.4%
tpch_q10/datafusion:vortex-compact	669757917 / 671703375 / -0.3%	1057889294 / 991359208 / +6.7%	0.63 / 0.68 / -6.6%
tpch_q11/datafusion:vortex-compact	309272515 / 364527500 / -15.2%	568434967 / 668579981 / -15.0%	0.54 / 0.55 / -0.2%
tpch_q12/datafusion:vortex-compact	575907164 / 510706731 / +12.8%	809838078 / 809944058 / -0.0%	0.71 / 0.63 / +12.8%
tpch_q13/datafusion:vortex-compact	423081819 / 280486920 / +50.8% 🔴	1120742431 / 524159171 / +113.8% 🔴	0.38 / 0.54 / -29.5%
tpch_q14/datafusion:vortex-compact	475954045 / 408929326 / +16.4%	687151044 / 399063031 / +72.2% 🔴	0.69 / 1.02 / -32.4%
tpch_q15/datafusion:vortex-compact	694818692 / 579424003 / +19.9%	802253890 / 946501297 / -15.2%	0.87 / 0.61 / +41.5%
tpch_q16/datafusion:vortex-compact	269562113 / 254077855 / +6.1%	470141587 / 467283434 / +0.6%	0.57 / 0.54 / +5.4%
tpch_q17/datafusion:vortex-compact	761110848 / 786870862 / -3.3%	947599329 / 825741233 / +14.8%	0.80 / 0.95 / -15.7%
tpch_q18/datafusion:vortex-compact	555364057 / 713123926 / -22.1%	581130803 / 611941489 / -5.0%	0.96 / 1.17 / -18.0%
tpch_q19/datafusion:vortex-compact	486838135 / 542505640 / -10.3%	667378851 / 675053113 / -1.1%	0.73 / 0.80 / -9.2%
tpch_q20/datafusion:vortex-compact	564920846 / 620819444 / -9.0%	875522094 / 700264122 / +25.0%	0.65 / 0.89 / -27.2%
tpch_q21/datafusion:vortex-compact	862451789 / 855451487 / +0.8%	1166079656 / 1004983840 / +16.0%	0.74 / 0.85 / -13.1%
tpch_q22/datafusion:vortex-compact	422064713 / 297534696 / +41.9% 🔴	989744355 / 525526913 / +88.3% 🔴	0.43 / 0.57 / -24.7%

datafusion / parquet / ns (0.932x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	245211867 / 252341326 / -2.8%	643169255 / 885919910 / -27.4%	0.38 / 0.28 / +33.9%
tpch_q02/datafusion:parquet	470849744 / 497026087 / -5.3%	914326838 / 1211288090 / -24.5%	0.51 / 0.41 / +25.5%
tpch_q03/datafusion:parquet	571942268 / 674274227 / -15.2%	1059117836 / 1662155321 / -36.3% 🟢	0.54 / 0.41 / +33.1%
tpch_q04/datafusion:parquet	390420028 / 466370968 / -16.3%	476818943 / 786269196 / -39.4% 🟢	0.82 / 0.59 / +38.0%
tpch_q05/datafusion:parquet	691894895 / 713511101 / -3.0%	794253367 / 886093918 / -10.4%	0.87 / 0.81 / +8.2%
tpch_q06/datafusion:parquet	203270447 / 458726195 / -55.7% 🟢	373222332 / 439319843 / -15.0%	0.54 / 1.04 / -47.8%
tpch_q07/datafusion:parquet	675232750 / 755409571 / -10.6%	768096030 / 822938349 / -6.7%	0.88 / 0.92 / -4.2%
tpch_q08/datafusion:parquet	816287773 / 901303405 / -9.4%	1055675271 / 1376587768 / -23.3%	0.77 / 0.65 / +18.1%
tpch_q09/datafusion:parquet	922672970 / 1194765796 / -22.8%	1114948098 / 1383181335 / -19.4%	0.83 / 0.86 / -4.2%
tpch_q10/datafusion:parquet	1925704809 / 1578815204 / +22.0%	2027063285 / 3206393208 / -36.8% 🟢	0.95 / 0.49 / +92.9%
tpch_q11/datafusion:parquet	382201150 / 394216287 / -3.0%	534749068 / 573219225 / -6.7%	0.71 / 0.69 / +3.9%
tpch_q12/datafusion:parquet	566049436 / 645499610 / -12.3%	558499448 / 747204256 / -25.3%	1.01 / 0.86 / +17.3%
tpch_q13/datafusion:parquet	462281077 / 480116510 / -3.7%	873866383 / 883723622 / -1.1%	0.53 / 0.54 / -2.6%
tpch_q14/datafusion:parquet	596159780 / 433080214 / +37.7% 🔴	732823588 / 693916217 / +5.6%	0.81 / 0.62 / +30.3%
tpch_q15/datafusion:parquet	711223661 / 913684536 / -22.2%	863140116 / 1091297781 / -20.9%	0.82 / 0.84 / -1.6%
tpch_q16/datafusion:parquet	272513812 / 262914527 / +3.7%	622374135 / 541363739 / +15.0%	0.44 / 0.49 / -9.8%
tpch_q17/datafusion:parquet	796971539 / 722241893 / +10.3%	858572059 / 916645873 / -6.3%	0.93 / 0.79 / +17.8%
tpch_q18/datafusion:parquet	906163114 / 859401635 / +5.4%	1031779714 / 1197950970 / -13.9%	0.88 / 0.72 / +22.4%
tpch_q19/datafusion:parquet	577414192 / 480739756 / +20.1%	683166555 / 626965564 / +9.0%	0.85 / 0.77 / +10.2%
tpch_q20/datafusion:parquet	761852619 / 793008022 / -3.9%	960004815 / 1098891584 / -12.6%	0.79 / 0.72 / +10.0%
tpch_q21/datafusion:parquet	950265528 / 1137672261 / -16.5%	1160442812 / 1313831421 / -11.7%	0.82 / 0.87 / -5.4%
tpch_q22/datafusion:parquet	591448174 / 608307871 / -2.8%	790141681 / 1088331937 / -27.4%	0.75 / 0.56 / +33.9%

duckdb / vortex-compact / ns (1.145x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	927155723 / 887803372 / +4.4%	1188447402 / 1884662903 / -36.9% 🟢	0.78 / 0.47 / +65.6%
tpch_q02/duckdb:vortex-compact	738580741 / 471621952 / +56.6% 🔴	1395595239 / 799756606 / +74.5% 🔴	0.53 / 0.59 / -10.3%
tpch_q03/duckdb:vortex-compact	1173007498 / 1032261682 / +13.6%	1296036077 / 1743445980 / -25.7%	0.91 / 0.59 / +52.9%
tpch_q04/duckdb:vortex-compact	764864875 / 710333783 / +7.7%	896291906 / 1034147719 / -13.3%	0.85 / 0.69 / +24.2%
tpch_q05/duckdb:vortex-compact	1180099142 / 1079023150 / +9.4%	1406178603 / 1390872324 / +1.1%	0.84 / 0.78 / +8.2%
tpch_q06/duckdb:vortex-compact	1220579615 / 1062754368 / +14.9%	1209952373 / 1052531316 / +15.0%	1.01 / 1.01 / -0.1%
tpch_q07/duckdb:vortex-compact	1555561288 / 1365224196 / +13.9%	1802373174 / 1383004365 / +30.3% 🔴	0.86 / 0.99 / -12.6%
tpch_q08/duckdb:vortex-compact	1607996885 / 1295839370 / +24.1%	1688422735 / 1554095170 / +8.6%	0.95 / 0.83 / +14.2%
tpch_q09/duckdb:vortex-compact	1937764157 / 1964834346 / -1.4%	2287226897 / 2316587466 / -1.3%	0.85 / 0.85 / -0.1%
tpch_q10/duckdb:vortex-compact	1656412133 / 1302666267 / +27.2%	2112525256 / 1605990425 / +31.5% 🔴	0.78 / 0.81 / -3.3%
tpch_q11/duckdb:vortex-compact	464677893 / 462814027 / +0.4%	716188652 / 628197365 / +14.0%	0.65 / 0.74 / -11.9%
tpch_q12/duckdb:vortex-compact	2154979193 / 1910023304 / +12.8%	2191820549 / 2149632586 / +2.0%	0.98 / 0.89 / +10.7%
tpch_q13/duckdb:vortex-compact	1773677478 / 1159333207 / +53.0% 🔴	1823494822 / 1665184982 / +9.5%	0.97 / 0.70 / +39.7%
tpch_q14/duckdb:vortex-compact	956440481 / 785718620 / +21.7%	998564846 / 828118404 / +20.6%	0.96 / 0.95 / +1.0%
tpch_q15/duckdb:vortex-compact	973473110 / 892684543 / +9.1%	1145505242 / 907970431 / +26.2%	0.85 / 0.98 / -13.6%
tpch_q16/duckdb:vortex-compact	238459873 / 223610104 / +6.6%	341002112 / 257955537 / +32.2% 🔴	0.70 / 0.87 / -19.3%
tpch_q17/duckdb:vortex-compact	1418065100 / 1243292097 / +14.1%	1473463501 / 1284979124 / +14.7%	0.96 / 0.97 / -0.5%
tpch_q18/duckdb:vortex-compact	1390686858 / 1555815245 / -10.6%	1495428151 / 1403974008 / +6.5%	0.93 / 1.11 / -16.1%
tpch_q19/duckdb:vortex-compact	1041393567 / 1033273739 / +0.8%	1401192343 / 1094213329 / +28.1%	0.74 / 0.94 / -21.3%
tpch_q20/duckdb:vortex-compact	1954829268 / 1611041186 / +21.3%	2087338622 / 1734468903 / +20.3%	0.94 / 0.93 / +0.8%
tpch_q21/duckdb:vortex-compact	2560946764 / 2221303104 / +15.3%	2360626849 / 2311850782 / +2.1%	1.08 / 0.96 / +12.9%
tpch_q22/duckdb:vortex-compact	603737455 / 486904008 / +24.0%	848798322 / 623492637 / +36.1% 🔴	0.71 / 0.78 / -8.9%

duckdb / parquet / ns (1.013x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	456759205 / 550007088 / -17.0%	666973037 / 666271442 / +0.1%	0.68 / 0.83 / -17.0%
tpch_q02/duckdb:parquet	750322201 / 751399499 / -0.1%	943047884 / 1513003080 / -37.7% 🟢	0.80 / 0.50 / +60.2%
tpch_q03/duckdb:parquet	991863935 / 1012368974 / -2.0%	1398624665 / 1551848143 / -9.9%	0.71 / 0.65 / +8.7%
tpch_q04/duckdb:parquet	521299791 / 561401187 / -7.1%	597677800 / 681920277 / -12.4%	0.87 / 0.82 / +5.9%
tpch_q05/duckdb:parquet	1159557076 / 1200077429 / -3.4%	1107599749 / 1482723763 / -25.3%	1.05 / 0.81 / +29.3%
tpch_q06/duckdb:parquet	377312359 / 344661392 / +9.5%	426028817 / 349094300 / +22.0%	0.89 / 0.99 / -10.3%
tpch_q07/duckdb:parquet	1062368109 / 1048359252 / +1.3%	1024922545 / 1064384594 / -3.7%	1.04 / 0.98 / +5.2%
tpch_q08/duckdb:parquet	1340604813 / 1403032771 / -4.4%	1165241691 / 1391571169 / -16.3%	1.15 / 1.01 / +14.1%
tpch_q09/duckdb:parquet	1204788874 / 1272934951 / -5.4%	1371791639 / 1781786502 / -23.0%	0.88 / 0.71 / +22.9%
tpch_q10/duckdb:parquet	2204222792 / 2237089440 / -1.5%	3000211637 / 2839903411 / +5.6%	0.73 / 0.79 / -6.7%
tpch_q11/duckdb:parquet	471816613 / 489413344 / -3.6%	526996121 / 572467948 / -7.9%	0.90 / 0.85 / +4.7%
tpch_q12/duckdb:parquet	928480898 / 728298704 / +27.5%	895673899 / 1180740558 / -24.1%	1.04 / 0.62 / +68.1%
tpch_q13/duckdb:parquet	941142384 / 913914468 / +3.0%	1299369888 / 1124398939 / +15.6%	0.72 / 0.81 / -10.9%
tpch_q14/duckdb:parquet	767373413 / 753440062 / +1.8%	857521582 / 859636633 / -0.2%	0.89 / 0.88 / +2.1%
tpch_q15/duckdb:parquet	548463120 / 596558612 / -8.1%	507876641 / 704318217 / -27.9%	1.08 / 0.85 / +27.5%
tpch_q16/duckdb:parquet	666387311 / 644017336 / +3.5%	676555538 / 682415305 / -0.9%	0.98 / 0.94 / +4.4%
tpch_q17/duckdb:parquet	666625107 / 793112938 / -15.9%	654709215 / 785839464 / -16.7%	1.02 / 1.01 / +0.9%
tpch_q18/duckdb:parquet	1018865975 / 835309753 / +22.0%	1069197600 / 858048715 / +24.6%	0.95 / 0.97 / -2.1%
tpch_q19/duckdb:parquet	904499154 / 786963056 / +14.9%	1043959085 / 941280155 / +10.9%	0.87 / 0.84 / +3.6%
tpch_q20/duckdb:parquet	1250576411 / 1305676761 / -4.2%	1524578979 / 1563884059 / -2.5%	0.82 / 0.83 / -1.8%
tpch_q21/duckdb:parquet	1102073066 / 896890836 / +22.9%	1226112137 / 939568597 / +30.5% 🔴	0.90 / 0.95 / -5.8%
tpch_q22/duckdb:parquet	900013877 / 824164139 / +9.2%	1059327685 / 1089233780 / -2.7%	0.85 / 0.76 / +12.3%

github-actions · 2026-09-16T11:26:57Z

Benchmarks: Random Access 📖

Commits: PR 071bb91b vs base 4af09a94
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.5%
Engines: random-access No clear signal (+3.5%, environment too noisy confidence)
Vortex (geomean): hot 0.995x ➖
Parquet (geomean): hot 0.961x ➖
Shifts: Parquet (control) -3.9% · Median polish -1.5%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (0.958x ➖, 2↑ 0↓)

name	ns (PR / base / %diff)
random-access/arrow-tokio-local-disk	70958 / 69326 / +2.4%
random-access/arrow-tokio-local-disk-footer	161349 / 158628 / +1.7%
random-access/feature-vectors/correlated/arrow-tokio-local-disk	1340295 / 1328481 / +0.9%
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer	2093121 / 2075379 / +0.9%
random-access/feature-vectors/uniform/arrow-tokio-local-disk	33681159 / 48211485 / -30.1% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer	33685742 / 58592705 / -42.5% 🟢
random-access/nested-lists/correlated/arrow-tokio-local-disk	56233 / 56860 / -1.1%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer	99556 / 96642 / +3.0%
random-access/nested-lists/uniform/arrow-tokio-local-disk	1074159 / 1109007 / -3.1%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer	1129147 / 1155761 / -2.3%
random-access/nested-structs/correlated/arrow-tokio-local-disk	50452 / 52459 / -3.8%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer	91342 / 88051 / +3.7%
random-access/nested-structs/uniform/arrow-tokio-local-disk	839270 / 869546 / -3.5%
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer	881269 / 908478 / -3.0%
random-access/taxi/correlated/arrow-tokio-local-disk	119581 / 114835 / +4.1%
random-access/taxi/correlated/arrow-tokio-local-disk-footer	215603 / 211841 / +1.8%
random-access/taxi/uniform/arrow-tokio-local-disk	2759804 / 2602723 / +6.0%
random-access/taxi/uniform/arrow-tokio-local-disk-footer	2954146 / 2773315 / +6.5%

random-access / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk	240076 / 246742 / -2.7%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer	1218690 / 1243848 / -2.0%
random-access/feature-vectors/uniform/vortex-tokio-local-disk	1450098 / 1470436 / -1.4%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer	2667413 / 2709978 / -1.6%
random-access/nested-lists/correlated/vortex-tokio-local-disk	226223 / 207650 / +8.9%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer	363282 / 364488 / -0.3%
random-access/nested-lists/uniform/vortex-tokio-local-disk	730071 / 777835 / -6.1%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer	950770 / 915086 / +3.9%
random-access/nested-structs/correlated/vortex-tokio-local-disk	264599 / 286011 / -7.5%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer	528370 / 528302 / +0.0%
random-access/nested-structs/uniform/vortex-tokio-local-disk	657695 / 621869 / +5.8%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer	943671 / 940363 / +0.4%
random-access/taxi/correlated/vortex-tokio-local-disk	663599 / 668650 / -0.8%
random-access/taxi/correlated/vortex-tokio-local-disk-footer	1472482 / 1448907 / +1.6%
random-access/taxi/uniform/vortex-tokio-local-disk	2662678 / 2654275 / +0.3%
random-access/taxi/uniform/vortex-tokio-local-disk-footer	3840801 / 3935657 / -2.4%
random-access/vortex-tokio-local-disk	440677 / 450901 / -2.3%
random-access/vortex-tokio-local-disk-footer	1067958 / 1080973 / -1.2%

random-access / parquet / ns (0.961x ➖, 3↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk	103603711168 / 103927440558 / -0.3%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer	104314064846 / 103710753905 / +0.6%
random-access/feature-vectors/uniform/parquet-tokio-local-disk	104388876938 / 133000000988 / -21.5% 🟢
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer	104299687679 / 103839818223 / +0.4%
random-access/nested-lists/correlated/parquet-tokio-local-disk	131029567 / 132891606 / -1.4%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer	130655774 / 129250914 / +1.1%
random-access/nested-lists/uniform/parquet-tokio-local-disk	130891580 / 130837260 / +0.0%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer	131374710 / 133832481 / -1.8%
random-access/nested-structs/correlated/parquet-tokio-local-disk	7279438 / 8090523 / -10.0% 🟢
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer	7484851 / 8183432 / -8.5%
random-access/nested-structs/uniform/parquet-tokio-local-disk	7298044 / 7337838 / -0.5%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer	7406609 / 8289809 / -10.7% 🟢
random-access/parquet-tokio-local-disk	117794566 / 118492342 / -0.6%
random-access/parquet-tokio-local-disk-footer	117974795 / 121249032 / -2.7%
random-access/taxi/correlated/parquet-tokio-local-disk	176657222 / 178046060 / -0.8%
random-access/taxi/correlated/parquet-tokio-local-disk-footer	177255515 / 181942306 / -2.6%
random-access/taxi/uniform/parquet-tokio-local-disk	186430461 / 193354489 / -3.6%
random-access/taxi/uniform/parquet-tokio-local-disk-footer	186628452 / 194037494 / -3.8%

random-access / lance / ns (0.998x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk	291587 / 291503 / +0.0%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer	1236398 / 1236749 / -0.0%
random-access/feature-vectors/uniform/lance-tokio-local-disk	1034971 / 1033488 / +0.1%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer	1992391 / 1975206 / +0.9%
random-access/lance-tokio-local-disk	520716 / 518277 / +0.5%
random-access/lance-tokio-local-disk-footer	1451519 / 1476023 / -1.7%
random-access/nested-lists/correlated/lance-tokio-local-disk	155147 / 155936 / -0.5%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer	724055 / 722463 / +0.2%
random-access/nested-lists/uniform/lance-tokio-local-disk	843003 / 835834 / +0.9%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer	1401343 / 1430315 / -2.0%
random-access/nested-structs/correlated/lance-tokio-local-disk	266431 / 268292 / -0.7%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer	635073 / 638606 / -0.6%
random-access/nested-structs/uniform/lance-tokio-local-disk	2237996 / 2221070 / +0.8%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer	2594969 / 2710149 / -4.2%
random-access/taxi/correlated/lance-tokio-local-disk	744534 / 745086 / -0.1%
random-access/taxi/correlated/lance-tokio-local-disk-footer	2062412 / 2040162 / +1.1%
random-access/taxi/uniform/lance-tokio-local-disk	8029238 / 8063283 / -0.4%
random-access/taxi/uniform/lance-tokio-local-disk-footer	9097034 / 8881880 / +2.4%

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>

myrrc · 2026-09-16T12:15:07Z

@joseph-isaacs Regressions were due to fmt_err/panic_err still being invoked on call site, so fsl_* and allocate_* functions stopped being vectorized.

myrrc · 2026-09-16T12:36:15Z

I've moved this out, now we only have wins

Continuation of #9903. Buffer/BufferMut are used everywhere, so inlining their panic handlers both increases code size and degrades performance. Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>

Move panic case in vortex_expect/bail/ensure to a cold handler

071bb91

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>

myrrc added the changelog/feature A new feature label Sep 16, 2026

myrrc marked this pull request as ready for review September 16, 2026 10:20

myrrc requested a review from joseph-isaacs September 16, 2026 10:21

joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 16, 2026

github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 16, 2026

myrrc added changelog/performance A performance improvement and removed changelog/feature A new feature labels Sep 16, 2026

joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 16, 2026

github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 16, 2026

fmt_err/panic_err are also cold

b02ec9e

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>

myrrc enabled auto-merge (squash) September 16, 2026 12:36

myrrc requested a review from robert3005 September 16, 2026 15:51

robert3005 approved these changes Sep 16, 2026

View reviewed changes

myrrc merged commit 96b2684 into develop Sep 16, 2026
81 of 82 checks passed

myrrc deleted the myrrc/vortex-panics-cold branch September 16, 2026 16:00

myrrc mentioned this pull request Sep 17, 2026

move Buffer/BufferMut panic helpers into separate functions #9927

Merged

Conversation

myrrc commented Sep 16, 2026

Uh oh!

codspeed Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will regress 1 benchmark

Performance Changes

Footnotes

Uh oh!

joseph-isaacs commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: String Encoding 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Compression 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb S3 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Appian on NVME 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Statistical and Population Genetics 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench on NVME 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-DS SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on NVME 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on S3 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on S3 📖

Uh oh!

github-actions Bot commented Sep 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Random Access 📖

Uh oh!

myrrc commented Sep 16, 2026

Uh oh!

myrrc commented Sep 16, 2026

codspeed Bot commented Sep 16, 2026 •

edited

Loading

joseph-isaacs commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading

github-actions Bot commented Sep 16, 2026 •

edited

Loading