Skip to content

Topn lazy materialize poc#48736

Closed
englefly wants to merge 2 commits intomasterfrom
topn-lazy-materialize-poc
Closed

Topn lazy materialize poc#48736
englefly wants to merge 2 commits intomasterfrom
topn-lazy-materialize-poc

Conversation

@englefly
Copy link
Copy Markdown
Contributor

@englefly englefly commented Mar 6, 2025

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Copy Markdown
Contributor

Thearas commented Mar 6, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@englefly
Copy link
Copy Markdown
Contributor Author

englefly commented Mar 6, 2025

run buildall

@morrySnow morrySnow marked this pull request as draft April 8, 2025 02:14
@HappenLee HappenLee force-pushed the topn-lazy-materialize-poc branch from af9248c to 583ab09 Compare April 30, 2025 12:45
@englefly englefly force-pushed the topn-lazy-materialize-poc branch from 583ab09 to df601ff Compare April 30, 2025 13:49
@englefly
Copy link
Copy Markdown
Contributor Author

run buildall

@HappenLee HappenLee force-pushed the topn-lazy-materialize-poc branch from df601ff to 17283e0 Compare May 1, 2025 16:25
@hubgeter
Copy link
Copy Markdown
Contributor

hubgeter commented May 3, 2025

run buildall

@HappenLee HappenLee force-pushed the topn-lazy-materialize-poc branch from 17283e0 to 58b6777 Compare May 5, 2025 01:47
@englefly
Copy link
Copy Markdown
Contributor Author

englefly commented May 5, 2025

run buildall

1 similar comment
@englefly
Copy link
Copy Markdown
Contributor Author

englefly commented May 5, 2025

run buildall

@doris-robot
Copy link
Copy Markdown

TeamCity cloud ut coverage result:
Function Coverage: 83.08% (1100/1324)
Line Coverage: 65.86% (18402/27940)
Region Coverage: 65.30% (9120/13967)
Branch Coverage: 55.26% (4905/8876)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0a6c729fc108b3ae98f2fdfa98b2e2ef0d8b3b79_0a6c729fc108b3ae98f2fdfa98b2e2ef0d8b3b79_cloud/report/index.html

@doris-robot
Copy link
Copy Markdown

BE UT Coverage Report

Increment line coverage 41.80% (492/1177) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 55.14% (14976/27160)
Line Coverage 44.39% (132086/297528)
Region Coverage 43.12% (67356/156212)
Branch Coverage 37.59% (33913/90224)

@hello-stephen
Copy link
Copy Markdown
Contributor

BE Regression && UT Coverage Report

Increment line coverage 77.89% (916/1176) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 69.00% (18395/26658)
Line Coverage 59.64% (177126/297015)
Region Coverage 57.27% (104735/182864)
Branch Coverage 50.44% (51901/102890)

@englefly englefly force-pushed the topn-lazy-materialize-poc branch from 93dabc6 to c42e574 Compare May 6, 2025 06:25
@englefly
Copy link
Copy Markdown
Contributor Author

englefly commented May 6, 2025

run buildall

@doris-robot
Copy link
Copy Markdown

TeamCity cloud ut coverage result:
Function Coverage: 83.08% (1100/1324)
Line Coverage: 65.90% (18412/27940)
Region Coverage: 65.32% (9123/13967)
Branch Coverage: 55.28% (4907/8876)
Coverage Report: http://coverage.selectdb-in.cc/coverage/c42e57401e7a37cc23b46f43f093c7b2ad491614_c42e57401e7a37cc23b46f43f093c7b2ad491614_cloud/report/index.html

@englefly
Copy link
Copy Markdown
Contributor Author

englefly commented May 6, 2025

run feut

@englefly
Copy link
Copy Markdown
Contributor Author

englefly commented May 7, 2025

run buildall

@doris-robot
Copy link
Copy Markdown

TeamCity cloud ut coverage result:
Function Coverage: 83.08% (1100/1324)
Line Coverage: 65.86% (18402/27940)
Region Coverage: 65.30% (9120/13967)
Branch Coverage: 55.24% (4903/8876)
Coverage Report: http://coverage.selectdb-in.cc/coverage/e43788abf2598fce95c202b204a6d15f705c216e_e43788abf2598fce95c202b204a6d15f705c216e_cloud/report/index.html

@HappenLee HappenLee force-pushed the topn-lazy-materialize-poc branch from e43788a to be79cc5 Compare May 7, 2025 12:10
@englefly
Copy link
Copy Markdown
Contributor Author

englefly commented May 9, 2025

run buildall

@doris-robot
Copy link
Copy Markdown

TeamCity cloud ut coverage result:
Function Coverage: 83.18% (1103/1326)
Line Coverage: 66.12% (18568/28084)
Region Coverage: 65.69% (9244/14073)
Branch Coverage: 55.54% (4976/8960)
Coverage Report: http://coverage.selectdb-in.cc/coverage/8249c5aafd0d771a0cfca17f6c15d8a359071ab7_8249c5aafd0d771a0cfca17f6c15d8a359071ab7_cloud/report/index.html

@englefly
Copy link
Copy Markdown
Contributor Author

englefly commented May 9, 2025

run buildall

@doris-robot
Copy link
Copy Markdown

TeamCity cloud ut coverage result:
Function Coverage: 83.18% (1103/1326)
Line Coverage: 66.12% (18568/28084)
Region Coverage: 65.76% (9255/14073)
Branch Coverage: 55.54% (4976/8960)
Coverage Report: http://coverage.selectdb-in.cc/coverage/daf7dd0dad8fca9d1b257ab22e73e41eb94d58ad_daf7dd0dad8fca9d1b257ab22e73e41eb94d58ad_cloud/report/index.html

@englefly
Copy link
Copy Markdown
Contributor Author

englefly commented May 9, 2025

run beut

@englefly
Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot
Copy link
Copy Markdown

TeamCity cloud ut coverage result:
Function Coverage: 83.18% (1103/1326)
Line Coverage: 66.10% (18563/28084)
Region Coverage: 65.68% (9243/14073)
Branch Coverage: 55.45% (4968/8960)
Coverage Report: http://coverage.selectdb-in.cc/coverage/daf7dd0dad8fca9d1b257ab22e73e41eb94d58ad_daf7dd0dad8fca9d1b257ab22e73e41eb94d58ad_cloud/report/index.html

@HappenLee HappenLee force-pushed the topn-lazy-materialize-poc branch from daf7dd0 to 009f20d Compare May 12, 2025 03:55
@englefly
Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 33889 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b27433faa2410d5d6e217eabf4850fcf0f2d94cc, data reload: false

------ Round 1 ----------------------------------
q1	27148	5064	5047	5047
q2	1972	277	190	190
q3	10405	1242	678	678
q4	10216	996	517	517
q5	7660	2390	2357	2357
q6	181	165	132	132
q7	934	743	609	609
q8	9300	1324	1097	1097
q9	6863	5102	5164	5102
q10	6891	2344	1894	1894
q11	481	288	267	267
q12	353	358	216	216
q13	17779	3641	3121	3121
q14	243	233	228	228
q15	565	505	489	489
q16	436	442	379	379
q17	595	870	355	355
q18	7705	7140	7193	7140
q19	1621	982	559	559
q20	349	348	220	220
q21	3728	3198	2309	2309
q22	1067	1023	983	983
Total cold run time: 116492 ms
Total hot run time: 33889 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5211	5089	5142	5089
q2	236	311	225	225
q3	2176	2679	2328	2328
q4	1380	1784	1464	1464
q5	4540	4399	4372	4372
q6	218	186	130	130
q7	1947	1906	1703	1703
q8	2572	2499	2476	2476
q9	7301	7332	7131	7131
q10	3019	3248	2743	2743
q11	562	513	486	486
q12	677	765	605	605
q13	3494	3961	3216	3216
q14	286	300	261	261
q15	522	482	475	475
q16	437	480	464	464
q17	1149	1510	1379	1379
q18	7743	7511	7629	7511
q19	789	803	902	803
q20	1991	2008	1860	1860
q21	4946	4337	4233	4233
q22	1067	1041	995	995
Total cold run time: 52263 ms
Total hot run time: 49949 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 186806 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b27433faa2410d5d6e217eabf4850fcf0f2d94cc, data reload: false

query1	1022	478	504	478
query2	6558	1951	1916	1916
query3	6762	228	210	210
query4	26790	23874	23233	23233
query5	4365	620	466	466
query6	292	208	184	184
query7	4631	494	290	290
query8	306	253	244	244
query9	8642	2662	2650	2650
query10	490	333	275	275
query11	15851	15068	14873	14873
query12	156	117	105	105
query13	1672	506	388	388
query14	9061	6257	6225	6225
query15	203	186	171	171
query16	7175	650	495	495
query17	1232	744	582	582
query18	1983	408	305	305
query19	194	192	167	167
query20	120	118	123	118
query21	214	125	111	111
query22	4084	4248	4136	4136
query23	34218	33200	33214	33200
query24	8590	2427	2444	2427
query25	601	482	419	419
query26	1258	274	161	161
query27	2746	508	348	348
query28	4362	2121	2112	2112
query29	756	573	428	428
query30	279	222	195	195
query31	953	852	727	727
query32	71	65	65	65
query33	548	381	303	303
query34	809	854	534	534
query35	771	820	763	763
query36	977	1054	890	890
query37	109	96	77	77
query38	4227	4151	4056	4056
query39	1493	1444	1387	1387
query40	214	124	109	109
query41	59	54	56	54
query42	122	109	112	109
query43	520	510	496	496
query44	1314	823	821	821
query45	186	174	171	171
query46	855	1018	644	644
query47	1780	1820	1745	1745
query48	379	405	326	326
query49	779	520	412	412
query50	667	673	405	405
query51	4187	4147	4079	4079
query52	110	109	106	106
query53	224	249	181	181
query54	584	592	502	502
query55	85	80	82	80
query56	328	317	281	281
query57	1145	1176	1121	1121
query58	271	263	256	256
query59	2663	2801	2771	2771
query60	331	332	323	323
query61	126	122	175	122
query62	796	757	635	635
query63	221	186	220	186
query64	4348	1005	673	673
query65	4289	4172	4134	4134
query66	1138	424	306	306
query67	15884	15729	15541	15541
query68	8736	884	522	522
query69	482	313	262	262
query70	1189	1139	1107	1107
query71	492	333	317	317
query72	5543	4760	4739	4739
query73	746	655	348	348
query74	9021	9055	8942	8942
query75	4179	3228	2704	2704
query76	3678	1183	758	758
query77	861	387	282	282
query78	10102	10247	9376	9376
query79	2130	830	572	572
query80	604	516	457	457
query81	481	273	230	230
query82	439	128	96	96
query83	288	250	238	238
query84	298	116	89	89
query85	797	365	317	317
query86	336	323	303	303
query87	4386	4535	4327	4327
query88	3422	2269	2274	2269
query89	397	322	282	282
query90	1933	211	210	210
query91	145	148	113	113
query92	81	64	57	57
query93	1431	942	573	573
query94	717	367	302	302
query95	386	304	287	287
query96	502	568	284	284
query97	2709	2753	2673	2673
query98	234	206	205	205
query99	1434	1397	1262	1262
Total cold run time: 276355 ms
Total hot run time: 186806 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 28.85 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b27433faa2410d5d6e217eabf4850fcf0f2d94cc, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.10	0.12
query3	0.25	0.21	0.19
query4	1.59	0.20	0.11
query5	0.44	0.43	0.44
query6	1.16	0.67	0.65
query7	0.03	0.02	0.01
query8	0.04	0.03	0.03
query9	0.58	0.52	0.52
query10	0.58	0.58	0.57
query11	0.15	0.12	0.11
query12	0.15	0.12	0.12
query13	0.62	0.61	0.60
query14	0.78	0.79	0.81
query15	0.88	0.84	0.85
query16	0.38	0.37	0.38
query17	1.05	1.03	1.04
query18	0.23	0.21	0.21
query19	1.92	1.86	1.81
query20	0.01	0.01	0.02
query21	15.40	0.90	0.54
query22	0.77	1.55	0.92
query23	14.72	1.41	0.64
query24	7.52	0.97	0.31
query25	0.31	0.09	0.14
query26	0.71	0.17	0.14
query27	0.06	0.05	0.04
query28	8.91	0.93	0.45
query29	12.56	4.00	3.29
query30	0.27	0.09	0.08
query31	2.82	0.62	0.40
query32	3.23	0.56	0.47
query33	3.09	3.08	3.13
query34	15.78	5.13	4.52
query35	4.53	4.55	4.53
query36	0.67	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.14	0.13
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 102.83 s
Total hot run time: 28.85 s

@englefly
Copy link
Copy Markdown
Contributor Author

run beut

@englefly
Copy link
Copy Markdown
Contributor Author

run external

@englefly
Copy link
Copy Markdown
Contributor Author

run buildall

@hello-stephen
Copy link
Copy Markdown
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 83.25% (1113/1337)
Line Coverage 66.17% (18676/28223)
Region Coverage 65.76% (9257/14077)
Branch Coverage 55.54% (4979/8964)

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 33929 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b27433faa2410d5d6e217eabf4850fcf0f2d94cc, data reload: false

------ Round 1 ----------------------------------
q1	26400	5119	5011	5011
q2	1949	286	187	187
q3	10418	1237	708	708
q4	10228	986	543	543
q5	7690	2903	2366	2366
q6	179	163	133	133
q7	920	739	610	610
q8	9320	1294	1136	1136
q9	6812	5053	5092	5053
q10	6855	2304	1891	1891
q11	503	296	283	283
q12	346	347	212	212
q13	17811	3686	3148	3148
q14	239	233	206	206
q15	548	485	486	485
q16	424	432	372	372
q17	624	845	407	407
q18	7567	7161	7061	7061
q19	1949	977	554	554
q20	337	340	232	232
q21	3743	3188	2355	2355
q22	1066	1024	976	976
Total cold run time: 115928 ms
Total hot run time: 33929 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5215	5098	5050	5050
q2	242	320	217	217
q3	2175	2630	2308	2308
q4	1364	1798	1428	1428
q5	4449	4383	4390	4383
q6	222	181	130	130
q7	2009	1952	1773	1773
q8	2574	2586	2479	2479
q9	7228	7294	6992	6992
q10	3095	3161	2743	2743
q11	606	516	477	477
q12	663	786	612	612
q13	3519	3900	3289	3289
q14	274	300	305	300
q15	537	482	467	467
q16	453	476	430	430
q17	1169	1579	1401	1401
q18	7888	7633	7604	7604
q19	814	819	862	819
q20	2020	1992	1848	1848
q21	4705	4527	4475	4475
q22	1108	1059	998	998
Total cold run time: 52329 ms
Total hot run time: 50223 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 192722 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b27433faa2410d5d6e217eabf4850fcf0f2d94cc, data reload: false

query1	1408	1083	1062	1062
query2	6262	1820	1808	1808
query3	11015	4673	4530	4530
query4	54121	25769	23033	23033
query5	4998	588	467	467
query6	353	218	198	198
query7	4883	504	302	302
query8	343	256	246	246
query9	5647	2673	2663	2663
query10	401	333	273	273
query11	15134	15001	14778	14778
query12	165	111	103	103
query13	1044	529	411	411
query14	10316	6550	6301	6301
query15	210	198	190	190
query16	7164	669	497	497
query17	1109	767	615	615
query18	1643	410	315	315
query19	216	204	167	167
query20	136	134	124	124
query21	210	125	153	125
query22	4369	4417	4381	4381
query23	34512	33817	33668	33668
query24	6615	2473	2494	2473
query25	477	477	420	420
query26	698	269	150	150
query27	2340	505	340	340
query28	3286	2139	2173	2139
query29	580	577	427	427
query30	269	220	189	189
query31	829	877	773	773
query32	74	61	60	60
query33	464	354	321	321
query34	764	852	542	542
query35	808	837	766	766
query36	984	1012	906	906
query37	118	100	88	88
query38	4300	4323	4207	4207
query39	1569	1477	1435	1435
query40	216	120	106	106
query41	59	56	55	55
query42	139	109	113	109
query43	497	515	494	494
query44	1335	860	849	849
query45	183	177	181	177
query46	852	1050	671	671
query47	1830	1871	1799	1799
query48	408	453	333	333
query49	694	535	449	449
query50	703	696	420	420
query51	4276	4260	4218	4218
query52	118	112	104	104
query53	229	250	184	184
query54	592	579	518	518
query55	97	88	80	80
query56	316	299	312	299
query57	1191	1214	1154	1154
query58	285	264	255	255
query59	2639	2813	2697	2697
query60	341	323	312	312
query61	128	129	137	129
query62	758	725	682	682
query63	226	191	184	184
query64	1832	1075	677	677
query65	4202	4121	4144	4121
query66	733	403	313	313
query67	15816	15548	15571	15548
query68	7108	895	527	527
query69	543	312	270	270
query70	1211	1093	1095	1093
query71	513	337	308	308
query72	5803	4756	4741	4741
query73	1493	629	346	346
query74	8911	8880	8801	8801
query75	4077	3212	2706	2706
query76	4198	1200	759	759
query77	721	386	277	277
query78	10021	10215	9365	9365
query79	2267	892	577	577
query80	588	541	453	453
query81	476	254	226	226
query82	469	131	93	93
query83	247	247	234	234
query84	290	107	94	94
query85	769	354	312	312
query86	364	313	285	285
query87	4538	4444	4303	4303
query88	3972	2281	2344	2281
query89	400	322	282	282
query90	1831	212	211	211
query91	143	147	112	112
query92	80	63	58	58
query93	1810	932	584	584
query94	662	401	313	313
query95	378	295	290	290
query96	511	589	284	284
query97	2734	2739	2642	2642
query98	230	214	217	214
query99	1460	1422	1251	1251
Total cold run time: 299347 ms
Total hot run time: 192722 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 29.91 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b27433faa2410d5d6e217eabf4850fcf0f2d94cc, data reload: false

query1	0.03	0.04	0.02
query2	0.16	0.12	0.10
query3	0.34	0.20	0.20
query4	1.60	0.20	0.21
query5	0.47	0.45	0.46
query6	1.17	0.67	0.66
query7	0.03	0.02	0.02
query8	0.06	0.05	0.05
query9	0.63	0.52	0.51
query10	0.58	0.59	0.58
query11	0.26	0.12	0.12
query12	0.25	0.13	0.14
query13	0.64	0.62	0.62
query14	0.82	0.83	0.82
query15	0.97	0.87	0.88
query16	0.38	0.36	0.36
query17	1.06	1.04	1.10
query18	0.19	0.19	0.18
query19	1.99	1.82	1.86
query20	0.01	0.01	0.02
query21	15.42	0.97	0.67
query22	0.93	1.03	0.85
query23	14.67	1.53	0.76
query24	5.24	0.61	0.31
query25	0.16	0.10	0.09
query26	0.55	0.23	0.19
query27	0.08	0.08	0.08
query28	11.06	1.22	0.61
query29	12.56	4.15	3.41
query30	0.28	0.08	0.07
query31	2.80	0.66	0.43
query32	3.25	0.59	0.51
query33	3.14	3.18	3.13
query34	16.41	5.14	4.46
query35	4.48	4.50	4.43
query36	0.62	0.50	0.50
query37	0.20	0.17	0.16
query38	0.17	0.16	0.16
query39	0.04	0.04	0.05
query40	0.18	0.17	0.15
query41	0.11	0.06	0.05
query42	0.06	0.04	0.06
query43	0.05	0.05	0.05
Total cold run time: 104.1 s
Total hot run time: 29.91 s

@HappenLee HappenLee force-pushed the topn-lazy-materialize-poc branch from b27433f to e6ad28d Compare May 23, 2025 13:07
@englefly
Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot
Copy link
Copy Markdown

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 83.25% (1113/1337)
Line Coverage 66.12% (18662/28224)
Region Coverage 65.79% (9263/14079)
Branch Coverage 55.57% (4982/8966)

@englefly
Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot
Copy link
Copy Markdown

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 83.25% (1113/1337)
Line Coverage 66.15% (18671/28224)
Region Coverage 65.76% (9259/14079)
Branch Coverage 55.60% (4985/8966)

@doris-robot
Copy link
Copy Markdown

BE UT Coverage Report

Increment line coverage 40.62% (496/1221) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 56.11% (14999/26733)
Line Coverage 45.03% (133963/297470)
Region Coverage 44.17% (67401/152591)
Branch Coverage 38.72% (34536/89194)

@englefly englefly force-pushed the topn-lazy-materialize-poc branch from e6ad28d to 94343f0 Compare May 26, 2025 02:56
@englefly
Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot
Copy link
Copy Markdown

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 83.25% (1113/1337)
Line Coverage 66.14% (18667/28224)
Region Coverage 65.77% (9260/14079)
Branch Coverage 55.62% (4987/8966)

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 33872 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 94343f0d6627e5ab6cc4b6fadbb5a74d8f582646, data reload: false

------ Round 1 ----------------------------------
q1	26295	4966	4981	4966
q2	1949	275	175	175
q3	10425	1261	735	735
q4	10225	994	550	550
q5	7700	2400	2296	2296
q6	188	172	132	132
q7	903	724	617	617
q8	9307	1259	1040	1040
q9	6877	5082	5094	5082
q10	6846	2333	1907	1907
q11	507	286	273	273
q12	340	345	208	208
q13	17771	3692	3122	3122
q14	223	231	225	225
q15	555	485	496	485
q16	430	433	376	376
q17	617	861	385	385
q18	7717	7153	7155	7153
q19	1670	980	559	559
q20	338	341	236	236
q21	3954	2537	2378	2378
q22	1039	1034	972	972
Total cold run time: 115876 ms
Total hot run time: 33872 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5130	5038	5036	5036
q2	242	324	219	219
q3	2128	2668	2282	2282
q4	1372	1767	1369	1369
q5	4554	4546	4484	4484
q6	215	170	129	129
q7	2013	1912	1746	1746
q8	2566	2500	2436	2436
q9	7160	7159	7045	7045
q10	3034	3140	2818	2818
q11	575	498	489	489
q12	704	785	606	606
q13	3446	3880	3332	3332
q14	283	320	277	277
q15	517	473	473	473
q16	438	486	442	442
q17	1141	1568	1374	1374
q18	7855	7565	7379	7379
q19	788	781	920	781
q20	1994	2009	1951	1951
q21	4766	4335	4248	4248
q22	1038	1021	991	991
Total cold run time: 51959 ms
Total hot run time: 49907 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 186108 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 94343f0d6627e5ab6cc4b6fadbb5a74d8f582646, data reload: false

query1	998	472	495	472
query2	6557	1821	1795	1795
query3	6744	229	217	217
query4	26528	23612	23513	23513
query5	4344	643	469	469
query6	315	220	199	199
query7	4616	492	293	293
query8	302	251	234	234
query9	8636	2655	2651	2651
query10	495	336	265	265
query11	15678	15250	14818	14818
query12	155	112	117	112
query13	1663	533	418	418
query14	9147	6072	6204	6072
query15	209	184	174	174
query16	7161	647	453	453
query17	1185	697	564	564
query18	1974	385	286	286
query19	186	195	154	154
query20	116	111	116	111
query21	214	125	111	111
query22	4110	4147	4096	4096
query23	33946	32841	33042	32841
query24	8493	2394	2378	2378
query25	541	449	405	405
query26	1247	263	146	146
query27	2777	501	341	341
query28	4303	2136	2110	2110
query29	746	558	422	422
query30	283	212	189	189
query31	920	831	769	769
query32	77	65	66	65
query33	570	376	298	298
query34	774	846	522	522
query35	848	810	726	726
query36	961	1009	903	903
query37	117	107	77	77
query38	4026	4175	4039	4039
query39	1510	1435	1446	1435
query40	218	126	112	112
query41	64	58	65	58
query42	119	112	118	112
query43	526	508	472	472
query44	1294	816	821	816
query45	187	178	168	168
query46	834	1022	627	627
query47	1754	1815	1748	1748
query48	390	420	312	312
query49	812	524	474	474
query50	637	717	402	402
query51	4113	4182	4075	4075
query52	110	108	100	100
query53	222	250	184	184
query54	583	573	503	503
query55	89	81	83	81
query56	308	299	307	299
query57	1158	1149	1084	1084
query58	267	262	246	246
query59	2599	2696	2536	2536
query60	330	337	311	311
query61	129	126	126	126
query62	848	750	663	663
query63	224	188	186	186
query64	4309	1002	664	664
query65	4212	4169	4161	4161
query66	1143	423	334	334
query67	15752	15499	15404	15404
query68	8149	879	565	565
query69	489	305	273	273
query70	1180	1115	1096	1096
query71	506	320	303	303
query72	5741	4696	4803	4696
query73	692	630	351	351
query74	9119	9081	9018	9018
query75	3796	3225	2696	2696
query76	3680	1193	763	763
query77	789	376	293	293
query78	10146	10071	9389	9389
query79	2684	806	575	575
query80	643	529	463	463
query81	456	260	228	228
query82	449	130	109	109
query83	287	252	236	236
query84	290	103	84	84
query85	791	360	332	332
query86	336	305	301	301
query87	4454	4395	4404	4395
query88	3410	2305	2345	2305
query89	407	321	291	291
query90	1955	209	205	205
query91	143	140	115	115
query92	74	60	57	57
query93	1967	935	582	582
query94	663	417	314	314
query95	381	293	282	282
query96	502	573	280	280
query97	2725	2802	2654	2654
query98	236	211	221	211
query99	1425	1401	1245	1245
Total cold run time: 275268 ms
Total hot run time: 186108 ms

@doris-robot
Copy link
Copy Markdown

ClickBench: Total hot run time: 29.22 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 94343f0d6627e5ab6cc4b6fadbb5a74d8f582646, data reload: false

query1	0.04	0.04	0.02
query2	0.12	0.10	0.10
query3	0.25	0.19	0.20
query4	1.59	0.18	0.20
query5	0.44	0.40	0.41
query6	1.17	0.66	0.64
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.58	0.50	0.53
query10	0.57	0.57	0.55
query11	0.15	0.11	0.11
query12	0.15	0.12	0.11
query13	0.61	0.59	0.59
query14	0.81	0.79	0.81
query15	0.87	0.86	0.85
query16	0.39	0.38	0.39
query17	1.01	1.02	1.06
query18	0.22	0.21	0.21
query19	1.96	1.79	1.83
query20	0.01	0.01	0.01
query21	15.40	0.91	0.57
query22	0.74	1.20	0.64
query23	14.96	1.37	0.62
query24	6.87	2.06	1.07
query25	0.46	0.16	0.18
query26	0.59	0.17	0.13
query27	0.05	0.04	0.05
query28	10.00	0.88	0.45
query29	12.52	3.94	3.29
query30	0.25	0.08	0.06
query31	2.83	0.60	0.39
query32	3.23	0.55	0.52
query33	3.01	3.00	3.08
query34	15.85	5.07	4.48
query35	4.50	4.50	4.52
query36	0.67	0.49	0.49
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.14	0.14
query41	0.08	0.02	0.02
query42	0.02	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.4 s
Total hot run time: 29.22 s

@englefly
Copy link
Copy Markdown
Contributor Author

run p0

@englefly englefly marked this pull request as ready for review May 26, 2025 16:05
@HappenLee HappenLee force-pushed the topn-lazy-materialize-poc branch from 94343f0 to a4f9720 Compare May 27, 2025 06:29
@englefly
Copy link
Copy Markdown
Contributor Author

run buildall

@englefly englefly closed this May 29, 2025
@englefly englefly deleted the topn-lazy-materialize-poc branch May 29, 2025 07:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants