Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[opt](resource) Add WorkloadSchedPolicyTest #48154

Merged
merged 3 commits into from
Feb 21, 2025

Conversation

xinyiZzz
Copy link
Contributor

What problem does this PR solve?

[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from WorkloadSchedPolicyTest
[ RUN      ] WorkloadSchedPolicyTest.one_policy_one_condition
[       OK ] WorkloadSchedPolicyTest.one_policy_one_condition (51 ms)
[ RUN      ] WorkloadSchedPolicyTest.one_policy_mutl_condition
[       OK ] WorkloadSchedPolicyTest.one_policy_mutl_condition (50 ms)
[ RUN      ] WorkloadSchedPolicyTest.test_operator
[       OK ] WorkloadSchedPolicyTest.test_operator (0 ms)
[ RUN      ] WorkloadSchedPolicyTest.test_wg_id_set
[       OK ] WorkloadSchedPolicyTest.test_wg_id_set (0 ms)
[----------] 4 tests from WorkloadSchedPolicyTest (103 ms total)

[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (104 ms total)
[  PASSED  ] 4 tests.
=== Finished. Gtest output: /mnt/disk2/zouxinyi/doris/core/be/ut_build_ASAN/gtest_output

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@xinyiZzz
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@doris-robot
Copy link

TPC-H: Total hot run time: 31616 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9f4679552e24af6b30af463e5ef3dbb2e272eb6f, data reload: false

------ Round 1 ----------------------------------
q1	17593	5358	5077	5077
q2	2061	309	168	168
q3	10555	1277	748	748
q4	10218	1012	545	545
q5	7544	2428	2317	2317
q6	189	165	133	133
q7	903	759	601	601
q8	9306	1349	1235	1235
q9	4847	4668	4573	4573
q10	6827	2313	1901	1901
q11	484	279	253	253
q12	347	360	216	216
q13	17785	3658	3099	3099
q14	229	229	218	218
q15	519	474	450	450
q16	635	613	578	578
q17	583	872	349	349
q18	6936	6204	6241	6204
q19	1214	959	543	543
q20	319	333	192	192
q21	2770	2132	1923	1923
q22	365	339	293	293
Total cold run time: 102229 ms
Total hot run time: 31616 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5107	5163	5118	5118
q2	253	332	232	232
q3	2200	2724	2316	2316
q4	1440	1848	1394	1394
q5	4269	4169	4153	4153
q6	207	166	124	124
q7	1879	1845	1704	1704
q8	2610	2657	2591	2591
q9	7338	7313	7201	7201
q10	3032	3203	2769	2769
q11	588	522	489	489
q12	691	799	646	646
q13	3318	3991	3273	3273
q14	276	300	277	277
q15	514	484	457	457
q16	632	711	666	666
q17	1168	1602	1355	1355
q18	7603	7460	7347	7347
q19	846	840	1006	840
q20	2018	2042	1950	1950
q21	5509	5059	4657	4657
q22	603	588	531	531
Total cold run time: 52101 ms
Total hot run time: 50090 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190498 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9f4679552e24af6b30af463e5ef3dbb2e272eb6f, data reload: false

query1	1317	974	937	937
query2	6225	1845	1825	1825
query3	11006	4418	4234	4234
query4	56194	25572	23528	23528
query5	5152	544	518	518
query6	381	190	199	190
query7	5083	510	295	295
query8	322	247	243	243
query9	6208	2562	2575	2562
query10	432	290	239	239
query11	15623	14968	14870	14870
query12	156	117	107	107
query13	1142	508	376	376
query14	10174	6418	6651	6418
query15	212	192	172	172
query16	7101	668	449	449
query17	1092	710	575	575
query18	1551	405	298	298
query19	195	186	174	174
query20	130	118	119	118
query21	218	120	113	113
query22	4623	4555	4562	4555
query23	34044	33231	33520	33231
query24	5848	2476	2408	2408
query25	447	471	393	393
query26	688	290	163	163
query27	1819	498	338	338
query28	2805	2515	2442	2442
query29	576	591	493	493
query30	219	198	173	173
query31	928	878	851	851
query32	80	65	61	61
query33	473	383	314	314
query34	814	877	519	519
query35	807	860	772	772
query36	979	1003	918	918
query37	121	103	72	72
query38	4158	4252	4224	4224
query39	1474	1451	1453	1451
query40	208	112	105	105
query41	50	53	48	48
query42	128	111	117	111
query43	512	519	486	486
query44	1361	816	824	816
query45	181	180	168	168
query46	878	1064	676	676
query47	1845	1875	1797	1797
query48	417	442	310	310
query49	709	493	463	463
query50	704	754	430	430
query51	4273	4252	4249	4249
query52	107	104	95	95
query53	235	258	189	189
query54	506	496	422	422
query55	85	79	82	79
query56	273	261	273	261
query57	1170	1199	1153	1153
query58	250	255	237	237
query59	2858	2941	2625	2625
query60	283	273	260	260
query61	117	117	115	115
query62	726	781	682	682
query63	241	198	199	198
query64	1777	1123	785	785
query65	3208	3114	3131	3114
query66	722	404	309	309
query67	16031	15854	15397	15397
query68	5378	780	535	535
query69	543	307	264	264
query70	1137	1153	1147	1147
query71	441	298	295	295
query72	5928	3612	3630	3612
query73	1110	747	363	363
query74	9060	9194	9018	9018
query75	3456	3130	2644	2644
query76	3805	1173	760	760
query77	529	384	290	290
query78	9969	10059	9387	9387
query79	2235	842	618	618
query80	626	527	432	432
query81	500	277	238	238
query82	231	125	99	99
query83	172	177	149	149
query84	289	93	71	71
query85	723	346	305	305
query86	339	308	297	297
query87	4443	4595	4308	4308
query88	3662	2217	2206	2206
query89	466	380	289	289
query90	1898	193	193	193
query91	126	136	107	107
query92	75	58	58	58
query93	2036	1022	587	587
query94	644	413	296	296
query95	343	269	264	264
query96	477	549	275	275
query97	2814	2887	2694	2694
query98	223	208	206	206
query99	1309	1409	1292	1292
Total cold run time: 295659 ms
Total hot run time: 190498 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.39 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9f4679552e24af6b30af463e5ef3dbb2e272eb6f, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.03	0.04
query3	0.23	0.06	0.07
query4	1.62	0.10	0.11
query5	0.41	0.42	0.40
query6	1.16	0.67	0.65
query7	0.03	0.02	0.02
query8	0.04	0.03	0.04
query9	0.60	0.52	0.52
query10	0.58	0.58	0.57
query11	0.16	0.10	0.11
query12	0.14	0.11	0.11
query13	0.63	0.61	0.61
query14	2.69	2.74	2.72
query15	0.91	0.84	0.86
query16	0.39	0.39	0.37
query17	1.03	1.09	1.03
query18	0.21	0.20	0.20
query19	1.86	1.95	1.80
query20	0.01	0.01	0.01
query21	15.38	0.89	0.54
query22	0.75	1.19	0.65
query23	14.97	1.39	0.65
query24	7.08	1.80	0.63
query25	0.51	0.18	0.10
query26	0.59	0.17	0.13
query27	0.05	0.05	0.05
query28	9.82	0.83	0.43
query29	12.58	3.99	3.29
query30	0.25	0.08	0.06
query31	2.82	0.59	0.39
query32	3.23	0.54	0.46
query33	2.98	3.03	3.00
query34	15.89	5.09	4.51
query35	4.55	4.55	4.50
query36	0.66	0.52	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.41 s
Total hot run time: 30.39 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 44.00% (11692/26573)
Line Coverage: 33.84% (97843/289151)
Region Coverage: 32.93% (50089/152123)
Branch Coverage: 28.62% (25170/87936)
Coverage Report: http://coverage.selectdb-in.cc/coverage/9f4679552e24af6b30af463e5ef3dbb2e272eb6f_9f4679552e24af6b30af463e5ef3dbb2e272eb6f/report/index.html

@xinyiZzz xinyiZzz force-pushed the 20250218_fix_resource_ctx_test branch from 9f46795 to bd6b001 Compare February 20, 2025 16:38
@xinyiZzz
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31574 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bd6b0010fb429730c9f7a96bf619d4394756fc1d, data reload: false

------ Round 1 ----------------------------------
q1	17600	5361	5088	5088
q2	2064	303	181	181
q3	10469	1252	749	749
q4	10199	1008	544	544
q5	7509	2491	2298	2298
q6	196	169	133	133
q7	903	750	609	609
q8	9314	1321	1222	1222
q9	4832	4635	4634	4634
q10	6813	2317	1880	1880
q11	492	278	259	259
q12	347	365	223	223
q13	17768	3685	3050	3050
q14	240	240	211	211
q15	510	489	466	466
q16	604	605	589	589
q17	588	870	346	346
q18	6746	6303	6145	6145
q19	1197	949	564	564
q20	309	327	192	192
q21	2850	2147	1885	1885
q22	368	330	306	306
Total cold run time: 101918 ms
Total hot run time: 31574 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5107	5099	5112	5099
q2	237	325	233	233
q3	2163	2676	2333	2333
q4	1421	1827	1344	1344
q5	4216	4140	4136	4136
q6	201	162	123	123
q7	1867	1820	1634	1634
q8	2577	2500	2839	2500
q9	7247	7174	7157	7157
q10	3015	3250	2779	2779
q11	575	525	492	492
q12	696	784	626	626
q13	3562	3914	3303	3303
q14	293	305	262	262
q15	494	484	466	466
q16	647	689	656	656
q17	1126	1594	1328	1328
q18	7527	7389	7356	7356
q19	794	836	970	836
q20	1973	2123	1848	1848
q21	5427	5035	4770	4770
q22	597	595	555	555
Total cold run time: 51762 ms
Total hot run time: 49836 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190410 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bd6b0010fb429730c9f7a96bf619d4394756fc1d, data reload: false

query1	1297	956	948	948
query2	6204	1822	1843	1822
query3	10952	4479	4565	4479
query4	54542	25019	23355	23355
query5	5124	567	517	517
query6	381	199	183	183
query7	5140	499	298	298
query8	316	251	233	233
query9	6191	2572	2562	2562
query10	429	320	275	275
query11	15208	15067	14869	14869
query12	161	115	107	107
query13	1167	516	418	418
query14	10619	6398	6730	6398
query15	203	198	179	179
query16	7068	663	506	506
query17	1114	744	585	585
query18	1523	437	342	342
query19	205	211	181	181
query20	135	132	123	123
query21	211	122	106	106
query22	4430	4473	4298	4298
query23	34061	33604	33409	33409
query24	5755	2430	2437	2430
query25	448	468	404	404
query26	721	278	152	152
query27	1875	492	350	350
query28	2817	2533	2434	2434
query29	560	574	416	416
query30	210	193	154	154
query31	936	889	788	788
query32	78	62	62	62
query33	452	367	316	316
query34	767	853	545	545
query35	780	832	752	752
query36	955	1001	920	920
query37	121	100	76	76
query38	4292	4339	4204	4204
query39	1506	1408	1475	1408
query40	210	119	104	104
query41	51	50	50	50
query42	129	116	111	111
query43	507	515	486	486
query44	1299	831	823	823
query45	192	172	167	167
query46	895	1036	669	669
query47	1846	1891	1783	1783
query48	407	447	308	308
query49	705	513	418	418
query50	712	761	431	431
query51	4301	4329	4235	4235
query52	120	105	106	105
query53	231	257	191	191
query54	492	514	418	418
query55	82	80	79	79
query56	285	282	268	268
query57	1166	1197	1113	1113
query58	265	258	238	238
query59	2746	2790	2726	2726
query60	301	281	267	267
query61	119	118	118	118
query62	741	761	679	679
query63	235	202	196	196
query64	1792	1061	675	675
query65	3363	3149	3109	3109
query66	733	392	290	290
query67	15943	15596	15377	15377
query68	5354	766	545	545
query69	518	308	268	268
query70	1217	1140	1157	1140
query71	439	295	262	262
query72	5894	3649	3711	3649
query73	1069	759	369	369
query74	9144	9353	8953	8953
query75	3169	3138	2661	2661
query76	3810	1205	717	717
query77	551	354	288	288
query78	10063	10007	9302	9302
query79	2483	827	627	627
query80	672	529	470	470
query81	490	276	235	235
query82	424	126	98	98
query83	180	169	164	164
query84	289	94	74	74
query85	769	350	319	319
query86	373	302	281	281
query87	4406	4507	4450	4450
query88	3778	2238	2208	2208
query89	415	318	287	287
query90	1780	192	194	192
query91	136	182	112	112
query92	71	58	62	58
query93	2070	1006	591	591
query94	686	394	298	298
query95	354	262	264	262
query96	491	549	266	266
query97	2797	2826	2717	2717
query98	243	211	200	200
query99	1353	1401	1309	1309
Total cold run time: 294310 ms
Total hot run time: 190410 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.29 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bd6b0010fb429730c9f7a96bf619d4394756fc1d, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.03
query3	0.24	0.07	0.06
query4	1.61	0.11	0.10
query5	0.42	0.41	0.40
query6	1.15	0.65	0.68
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.61	0.52	0.51
query10	0.57	0.57	0.57
query11	0.14	0.11	0.11
query12	0.15	0.11	0.12
query13	0.62	0.59	0.60
query14	2.74	2.70	2.76
query15	0.92	0.86	0.85
query16	0.38	0.38	0.38
query17	1.02	1.00	1.05
query18	0.22	0.20	0.21
query19	1.87	1.83	2.01
query20	0.01	0.01	0.01
query21	15.65	0.90	0.54
query22	0.87	1.19	0.64
query23	15.09	1.40	0.62
query24	7.33	1.57	0.62
query25	0.57	0.24	0.10
query26	0.63	0.16	0.14
query27	0.05	0.05	0.04
query28	9.49	0.95	0.44
query29	12.58	4.00	3.29
query30	0.24	0.08	0.05
query31	2.83	0.60	0.38
query32	3.23	0.56	0.46
query33	2.99	3.01	3.00
query34	15.71	5.20	4.50
query35	4.49	4.53	4.51
query36	0.68	0.50	0.49
query37	0.10	0.06	0.05
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.75 s
Total hot run time: 30.29 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 44.00% (11692/26573)
Line Coverage: 33.84% (97850/289151)
Region Coverage: 32.93% (50089/152123)
Branch Coverage: 28.62% (25170/87936)
Coverage Report: http://coverage.selectdb-in.cc/coverage/bd6b0010fb429730c9f7a96bf619d4394756fc1d_bd6b0010fb429730c9f7a96bf619d4394756fc1d/report/index.html

Copy link
Contributor

@yiguolei yiguolei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 21, 2025
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@wangbo wangbo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xinyiZzz xinyiZzz merged commit eb90763 into apache:master Feb 21, 2025
24 of 26 checks passed
lzyy2024 pushed a commit to lzyy2024/doris that referenced this pull request Feb 21, 2025
### What problem does this PR solve?

```
[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from WorkloadSchedPolicyTest
[ RUN      ] WorkloadSchedPolicyTest.one_policy_one_condition
[       OK ] WorkloadSchedPolicyTest.one_policy_one_condition (51 ms)
[ RUN      ] WorkloadSchedPolicyTest.one_policy_mutl_condition
[       OK ] WorkloadSchedPolicyTest.one_policy_mutl_condition (50 ms)
[ RUN      ] WorkloadSchedPolicyTest.test_operator
[       OK ] WorkloadSchedPolicyTest.test_operator (0 ms)
[ RUN      ] WorkloadSchedPolicyTest.test_wg_id_set
[       OK ] WorkloadSchedPolicyTest.test_wg_id_set (0 ms)
[----------] 4 tests from WorkloadSchedPolicyTest (103 ms total)

[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (104 ms total)
[  PASSED  ] 4 tests.
=== Finished. Gtest output: /mnt/disk2/zouxinyi/doris/core/be/ut_build_ASAN/gtest_output
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants