Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bugfix] Fix mv column type is not changed when do schema change #34598

Merged
merged 8 commits into from
May 27, 2024

Conversation

Lchangliang
Copy link
Contributor

Proposed changes

Issue Number: close #xxx
When modify column type which also belong mv, the colume type is only changed in baseIndex. The reference mv column is also old type.

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@Lchangliang
Copy link
Contributor Author

run buildall

@Lchangliang
Copy link
Contributor Author

run buildall

@dataroaring
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41714 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f4d5326bfd3e40532915bca7b6896f7bc3c12a4c, data reload: false

------ Round 1 ----------------------------------
q1	17599	4283	4252	4252
q2	2022	187	190	187
q3	10440	1250	1261	1250
q4	10192	726	775	726
q5	7484	2782	2662	2662
q6	219	128	134	128
q7	1055	596	583	583
q8	9232	2145	2099	2099
q9	9049	6707	6709	6707
q10	9135	3856	3852	3852
q11	476	250	239	239
q12	542	224	227	224
q13	17677	3221	3203	3203
q14	275	236	231	231
q15	506	477	480	477
q16	536	402	374	374
q17	974	766	686	686
q18	8408	7638	7727	7638
q19	4123	1538	1545	1538
q20	627	312	320	312
q21	5220	4056	4135	4056
q22	355	290	295	290
Total cold run time: 116146 ms
Total hot run time: 41714 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4446	4425	4360	4360
q2	387	280	278	278
q3	3229	2958	2890	2890
q4	1961	1688	1693	1688
q5	5349	5463	5506	5463
q6	211	119	126	119
q7	2325	2023	1963	1963
q8	3236	3422	3400	3400
q9	8601	8627	8709	8627
q10	4070	3724	3695	3695
q11	606	498	497	497
q12	793	625	625	625
q13	16951	3103	3185	3103
q14	312	264	265	264
q15	529	480	481	480
q16	511	424	438	424
q17	1834	1509	1524	1509
q18	7732	7638	7443	7443
q19	1646	1588	1523	1523
q20	1948	1728	1768	1728
q21	9100	4850	4732	4732
q22	584	495	488	488
Total cold run time: 76361 ms
Total hot run time: 55299 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186972 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f4d5326bfd3e40532915bca7b6896f7bc3c12a4c, data reload: false

query1	904	359	349	349
query2	6453	2476	2424	2424
query3	6639	212	214	212
query4	24121	21312	21201	21201
query5	4216	411	415	411
query6	262	173	184	173
query7	4582	294	280	280
query8	235	198	201	198
query9	8590	2415	2402	2402
query10	454	249	255	249
query11	14683	14301	14051	14051
query12	137	90	91	90
query13	1642	370	371	370
query14	10530	7464	7698	7464
query15	248	177	181	177
query16	8034	267	269	267
query17	1754	572	557	557
query18	2009	285	282	282
query19	204	155	153	153
query20	95	87	89	87
query21	201	133	133	133
query22	5045	4929	4883	4883
query23	34079	33566	33605	33566
query24	8918	2880	2931	2880
query25	616	388	373	373
query26	703	159	157	157
query27	2138	329	336	329
query28	5774	2075	2056	2056
query29	872	625	598	598
query30	252	156	166	156
query31	978	767	752	752
query32	103	56	55	55
query33	650	266	251	251
query34	902	475	502	475
query35	762	706	694	694
query36	1063	916	916	916
query37	107	68	66	66
query38	2957	2810	2779	2779
query39	1641	1575	1564	1564
query40	200	128	125	125
query41	43	40	40	40
query42	106	93	95	93
query43	590	551	560	551
query44	1046	716	730	716
query45	274	258	253	253
query46	1073	700	699	699
query47	2032	1917	1959	1917
query48	361	290	296	290
query49	861	395	397	395
query50	774	388	375	375
query51	6683	6640	6587	6587
query52	102	87	95	87
query53	352	285	279	279
query54	776	427	433	427
query55	71	70	71	70
query56	234	212	215	212
query57	1251	1151	1154	1151
query58	214	197	198	197
query59	3475	3300	3257	3257
query60	260	240	240	240
query61	90	91	90	90
query62	630	517	491	491
query63	305	283	276	276
query64	8431	7344	7340	7340
query65	3183	3064	3097	3064
query66	768	338	337	337
query67	15866	14861	14944	14861
query68	10025	547	554	547
query69	599	306	309	306
query70	1391	1121	1062	1062
query71	507	268	262	262
query72	8715	2558	2351	2351
query73	1596	356	326	326
query74	6650	6172	6144	6144
query75	5421	2619	2624	2619
query76	4941	993	993	993
query77	732	264	260	260
query78	10750	10289	10088	10088
query79	7190	504	514	504
query80	1109	442	428	428
query81	491	215	220	215
query82	240	89	99	89
query83	194	164	168	164
query84	263	83	86	83
query85	885	273	264	264
query86	341	295	312	295
query87	3276	3066	3103	3066
query88	4476	2398	2395	2395
query89	518	394	369	369
query90	2004	183	189	183
query91	123	97	97	97
query92	59	48	47	47
query93	5535	515	501	501
query94	1243	178	182	178
query95	406	295	300	295
query96	595	266	265	265
query97	3166	2995	2965	2965
query98	227	219	221	219
query99	1179	899	892	892
Total cold run time: 298451 ms
Total hot run time: 186972 ms

@dataroaring
Copy link
Contributor

run buildall

@dataroaring
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41815 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a2678a155c2d899644f2d432a5ef2b28459441b1, data reload: false

------ Round 1 ----------------------------------
q1	17608	4271	4236	4236
q2	2024	191	188	188
q3	10465	1211	1128	1128
q4	10191	869	923	869
q5	7489	2696	2705	2696
q6	233	133	137	133
q7	1054	623	577	577
q8	9250	2136	2081	2081
q9	9794	6722	6708	6708
q10	9263	3949	3845	3845
q11	440	234	239	234
q12	409	221	232	221
q13	17384	3147	3207	3147
q14	267	222	209	209
q15	504	473	483	473
q16	497	389	387	387
q17	983	679	683	679
q18	8356	7713	7813	7713
q19	5677	1554	1512	1512
q20	627	328	318	318
q21	5138	4183	4337	4183
q22	346	278	283	278
Total cold run time: 117999 ms
Total hot run time: 41815 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4564	4398	4369	4369
q2	381	270	278	270
q3	3175	2982	2856	2856
q4	1907	1550	1693	1550
q5	5521	5494	5493	5493
q6	213	121	126	121
q7	2333	1958	1981	1958
q8	3220	3374	3709	3374
q9	8647	8679	8620	8620
q10	3935	3843	3836	3836
q11	615	508	521	508
q12	786	635	635	635
q13	15854	3163	3181	3163
q14	296	280	265	265
q15	531	483	485	483
q16	501	427	411	411
q17	1770	1453	1468	1453
q18	7738	7607	7517	7517
q19	1636	1534	1544	1534
q20	1968	1775	1737	1737
q21	8074	4837	4803	4803
q22	560	468	500	468
Total cold run time: 74225 ms
Total hot run time: 55424 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186857 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a2678a155c2d899644f2d432a5ef2b28459441b1, data reload: false

query1	924	392	375	375
query2	6459	2684	2488	2488
query3	6659	215	214	214
query4	22927	21485	21255	21255
query5	4098	421	444	421
query6	283	173	180	173
query7	4587	301	287	287
query8	250	182	184	182
query9	8705	2399	2381	2381
query10	435	270	262	262
query11	15067	14130	14143	14130
query12	137	89	97	89
query13	1654	376	378	376
query14	9961	8395	7422	7422
query15	269	165	169	165
query16	8084	258	251	251
query17	1768	544	532	532
query18	2115	280	268	268
query19	318	145	152	145
query20	94	85	85	85
query21	192	131	128	128
query22	5043	4827	4860	4827
query23	34263	33349	33671	33349
query24	10636	2930	2840	2840
query25	555	383	368	368
query26	695	158	150	150
query27	2150	319	311	311
query28	5947	2059	2069	2059
query29	844	608	600	600
query30	250	177	179	177
query31	968	765	749	749
query32	97	55	55	55
query33	639	250	243	243
query34	880	478	481	478
query35	794	709	677	677
query36	1070	933	935	933
query37	110	69	72	69
query38	2896	2771	2734	2734
query39	1633	1554	1547	1547
query40	192	127	124	124
query41	49	43	46	43
query42	104	96	99	96
query43	605	551	566	551
query44	1085	738	760	738
query45	273	257	251	251
query46	1071	727	699	699
query47	1944	1851	1865	1851
query48	385	307	287	287
query49	851	400	403	400
query50	768	373	393	373
query51	6835	6761	6887	6761
query52	106	86	96	86
query53	347	281	286	281
query54	879	425	429	425
query55	78	73	73	73
query56	244	217	218	217
query57	1231	1137	1176	1137
query58	244	203	201	201
query59	3658	3413	3190	3190
query60	249	235	252	235
query61	92	103	86	86
query62	654	481	496	481
query63	306	284	281	281
query64	8449	7439	7461	7439
query65	3142	3099	3054	3054
query66	782	338	348	338
query67	15283	15220	14936	14936
query68	4554	530	534	530
query69	473	299	312	299
query70	1165	1058	1154	1058
query71	396	273	274	273
query72	7067	2599	2342	2342
query73	705	327	337	327
query74	6509	6055	6208	6055
query75	3336	2631	2586	2586
query76	2434	1040	999	999
query77	397	264	267	264
query78	10527	10266	10074	10074
query79	2296	530	521	521
query80	1068	447	437	437
query81	546	242	235	235
query82	758	97	98	97
query83	236	163	167	163
query84	246	93	90	90
query85	1411	347	351	347
query86	465	294	302	294
query87	3325	3084	3092	3084
query88	4269	2356	2364	2356
query89	479	368	382	368
query90	2012	193	190	190
query91	123	97	100	97
query92	59	49	47	47
query93	1681	497	492	492
query94	1171	176	183	176
query95	392	312	299	299
query96	585	272	271	271
query97	3138	2954	3016	2954
query98	234	230	214	214
query99	1158	889	896	889
Total cold run time: 277577 ms
Total hot run time: 186857 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.91 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a2678a155c2d899644f2d432a5ef2b28459441b1, data reload: false

query1	0.04	0.03	0.03
query2	0.09	0.04	0.04
query3	0.23	0.06	0.06
query4	1.65	0.07	0.08
query5	0.49	0.48	0.51
query6	1.13	0.73	0.73
query7	0.02	0.01	0.01
query8	0.05	0.05	0.05
query9	0.54	0.49	0.49
query10	0.54	0.53	0.53
query11	0.15	0.11	0.12
query12	0.15	0.12	0.12
query13	0.59	0.59	0.60
query14	0.75	0.78	0.78
query15	0.83	0.81	0.81
query16	0.36	0.36	0.37
query17	1.01	0.96	0.98
query18	0.23	0.21	0.29
query19	1.80	1.77	1.76
query20	0.01	0.01	0.02
query21	15.55	0.69	0.68
query22	4.59	7.23	2.29
query23	18.30	1.43	1.26
query24	1.93	0.22	0.22
query25	0.13	0.10	0.08
query26	0.27	0.17	0.18
query27	0.08	0.08	0.07
query28	13.28	1.02	0.99
query29	13.19	3.34	3.25
query30	0.26	0.08	0.07
query31	2.82	0.41	0.39
query32	3.26	0.47	0.47
query33	2.76	2.85	2.85
query34	17.13	4.41	4.40
query35	4.51	4.48	4.56
query36	0.66	0.50	0.46
query37	0.17	0.16	0.15
query38	0.16	0.14	0.14
query39	0.04	0.04	0.03
query40	0.16	0.14	0.15
query41	0.09	0.04	0.04
query42	0.05	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 110.09 s
Total hot run time: 30.91 s

@Lchangliang
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40399 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 84e90d4b42a40dc495cc0a4c425c7901039a4643, data reload: false

------ Round 1 ----------------------------------
q1	18317	4417	4335	4335
q2	2687	190	247	190
q3	11469	1148	1074	1074
q4	10345	796	855	796
q5	7498	2717	2585	2585
q6	222	134	136	134
q7	1026	567	554	554
q8	9225	2086	2045	2045
q9	8771	6481	6442	6442
q10	8859	3712	3728	3712
q11	458	248	230	230
q12	390	211	211	211
q13	17757	2968	2995	2968
q14	258	217	232	217
q15	501	476	497	476
q16	520	397	379	379
q17	961	702	766	702
q18	8083	7431	7441	7431
q19	6169	1524	1524	1524
q20	645	309	300	300
q21	4920	3815	3997	3815
q22	347	279	280	279
Total cold run time: 119428 ms
Total hot run time: 40399 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4332	4208	4197	4197
q2	385	276	276	276
q3	2953	2786	2744	2744
q4	1869	1589	1606	1589
q5	5248	5245	5288	5245
q6	213	123	125	123
q7	2242	1877	1894	1877
q8	3176	3320	3343	3320
q9	8329	8355	8324	8324
q10	3888	3692	3640	3640
q11	574	472	479	472
q12	757	586	584	584
q13	17402	2978	3033	2978
q14	288	265	257	257
q15	508	470	484	470
q16	489	431	423	423
q17	1754	1456	1462	1456
q18	7654	7542	7478	7478
q19	1691	1562	1563	1562
q20	1994	1758	1779	1758
q21	4939	4698	4832	4698
q22	583	486	512	486
Total cold run time: 71268 ms
Total hot run time: 53957 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181436 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 84e90d4b42a40dc495cc0a4c425c7901039a4643, data reload: false

query1	903	407	369	369
query2	6456	2411	2386	2386
query3	6657	214	212	212
query4	24199	21156	21169	21156
query5	4156	404	407	404
query6	284	171	184	171
query7	4592	289	289	289
query8	246	195	191	191
query9	8735	2391	2398	2391
query10	435	256	267	256
query11	14882	14230	14219	14219
query12	145	89	96	89
query13	1657	371	371	371
query14	9945	7579	7776	7579
query15	215	169	173	169
query16	7685	259	254	254
query17	1848	613	532	532
query18	1931	274	267	267
query19	203	145	150	145
query20	90	85	84	84
query21	196	130	127	127
query22	5114	4904	4793	4793
query23	34089	33583	33346	33346
query24	11975	2884	2850	2850
query25	656	358	364	358
query26	1834	156	150	150
query27	3008	313	339	313
query28	7599	2029	2023	2023
query29	1130	614	596	596
query30	306	185	172	172
query31	1004	759	769	759
query32	93	50	52	50
query33	748	252	237	237
query34	1074	466	472	466
query35	832	675	675	675
query36	1090	934	912	912
query37	256	69	74	69
query38	2927	2776	2776	2776
query39	1644	1573	1553	1553
query40	271	122	124	122
query41	48	43	42	42
query42	105	92	98	92
query43	601	548	559	548
query44	1240	717	737	717
query45	272	248	258	248
query46	1069	727	718	718
query47	1978	1891	1933	1891
query48	355	296	299	296
query49	1214	389	384	384
query50	771	380	388	380
query51	6866	6802	6711	6711
query52	98	88	88	88
query53	345	289	275	275
query54	933	419	416	416
query55	73	76	75	75
query56	241	217	217	217
query57	1245	1142	1137	1137
query58	227	197	202	197
query59	3321	3206	3154	3154
query60	264	239	233	233
query61	95	88	86	86
query62	668	470	460	460
query63	308	277	308	277
query64	9788	2220	1710	1710
query65	3260	3079	3098	3079
query66	1374	349	345	345
query67	15488	15114	15108	15108
query68	6287	521	533	521
query69	537	325	303	303
query70	1237	1170	1163	1163
query71	507	261	277	261
query72	7962	2536	2380	2380
query73	813	315	311	311
query74	6679	6256	6323	6256
query75	4080	2629	2614	2614
query76	4485	1039	962	962
query77	633	264	262	262
query78	10548	10139	10055	10055
query79	1061	508	508	508
query80	917	435	421	421
query81	495	241	244	241
query82	230	92	99	92
query83	208	162	161	161
query84	266	82	83	82
query85	966	263	254	254
query86	340	307	306	306
query87	3322	3129	3161	3129
query88	4122	2371	2361	2361
query89	495	381	373	373
query90	2131	188	185	185
query91	133	175	96	96
query92	57	50	50	50
query93	2860	524	494	494
query94	1262	172	191	172
query95	386	292	301	292
query96	589	271	262	262
query97	3210	3003	3009	3003
query98	234	222	207	207
query99	1185	919	894	894
Total cold run time: 291594 ms
Total hot run time: 181436 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.31 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 84e90d4b42a40dc495cc0a4c425c7901039a4643, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.07	0.10
query5	0.49	0.50	0.50
query6	1.16	0.72	0.72
query7	0.02	0.02	0.02
query8	0.05	0.04	0.05
query9	0.54	0.48	0.48
query10	0.54	0.54	0.54
query11	0.15	0.12	0.11
query12	0.15	0.12	0.11
query13	0.59	0.58	0.59
query14	0.77	0.79	0.77
query15	0.84	0.80	0.81
query16	0.37	0.39	0.37
query17	0.93	0.99	1.01
query18	0.22	0.23	0.24
query19	1.88	1.67	1.77
query20	0.01	0.01	0.01
query21	15.74	0.66	0.66
query22	4.22	7.38	1.84
query23	18.27	1.45	1.29
query24	1.94	0.22	0.21
query25	0.16	0.07	0.08
query26	0.27	0.17	0.16
query27	0.08	0.09	0.07
query28	13.30	1.02	1.01
query29	13.24	3.32	3.25
query30	0.24	0.06	0.05
query31	2.87	0.39	0.37
query32	3.27	0.47	0.48
query33	2.89	2.86	2.94
query34	16.87	4.40	4.42
query35	4.51	4.47	4.45
query36	0.66	0.45	0.46
query37	0.17	0.16	0.15
query38	0.15	0.14	0.13
query39	0.04	0.04	0.03
query40	0.16	0.14	0.13
query41	0.08	0.04	0.05
query42	0.06	0.05	0.06
query43	0.04	0.04	0.04
Total cold run time: 109.96 s
Total hot run time: 30.31 s

@Lchangliang
Copy link
Contributor Author

run buildall

1 similar comment
@Lchangliang
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41932 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit de817696f445a6022013e944c05e2e0070f60716, data reload: false

------ Round 1 ----------------------------------
q1	17608	4273	4210	4210
q2	2007	191	187	187
q3	10563	1167	1201	1167
q4	10200	785	794	785
q5	7481	2687	2679	2679
q6	231	134	132	132
q7	975	618	626	618
q8	9212	2136	2095	2095
q9	9466	6752	6772	6752
q10	9400	3915	3864	3864
q11	454	242	243	242
q12	465	222	221	221
q13	17291	3185	3283	3185
q14	275	220	213	213
q15	511	474	484	474
q16	469	387	396	387
q17	1006	760	826	760
q18	8337	7898	7892	7892
q19	6468	1569	1534	1534
q20	651	320	331	320
q21	5076	3936	4015	3936
q22	344	279	279	279
Total cold run time: 118490 ms
Total hot run time: 41932 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4511	4448	4400	4400
q2	372	272	264	264
q3	3137	2971	2869	2869
q4	1843	1620	1598	1598
q5	5461	5464	5484	5464
q6	213	120	122	120
q7	2200	1860	1819	1819
q8	3223	3356	3330	3330
q9	8622	8671	8730	8671
q10	3868	3836	3838	3836
q11	603	489	488	488
q12	798	608	626	608
q13	16977	3091	3144	3091
q14	299	268	277	268
q15	525	502	489	489
q16	485	427	418	418
q17	1766	1524	1450	1450
q18	7747	7597	7424	7424
q19	1657	1538	1561	1538
q20	2001	1791	1771	1771
q21	9259	4634	4736	4634
q22	590	490	482	482
Total cold run time: 76157 ms
Total hot run time: 55032 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 169521 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit de817696f445a6022013e944c05e2e0070f60716, data reload: false

query1	910	383	362	362
query2	6446	2373	2335	2335
query3	6660	205	204	204
query4	21531	17233	17235	17233
query5	4112	425	430	425
query6	244	156	163	156
query7	4579	300	301	300
query8	236	187	187	187
query9	8529	2420	2379	2379
query10	453	304	275	275
query11	10592	10117	10045	10045
query12	136	89	88	88
query13	1633	359	358	358
query14	10024	7624	7462	7462
query15	228	168	171	168
query16	8055	268	260	260
query17	1709	522	518	518
query18	2082	269	274	269
query19	220	160	157	157
query20	98	86	88	86
query21	192	131	134	131
query22	4285	3952	3924	3924
query23	33601	33091	32882	32882
query24	6945	2803	2869	2803
query25	568	359	371	359
query26	703	157	157	157
query27	2164	311	315	311
query28	4593	2036	2040	2036
query29	850	609	604	604
query30	271	172	174	172
query31	967	763	726	726
query32	99	52	57	52
query33	533	308	266	266
query34	850	472	495	472
query35	711	582	596	582
query36	1046	919	905	905
query37	111	68	71	68
query38	2845	2762	2739	2739
query39	826	804	807	804
query40	196	132	125	125
query41	46	45	43	43
query42	106	98	100	98
query43	590	557	532	532
query44	1088	737	748	737
query45	178	171	163	163
query46	1055	684	721	684
query47	1838	1762	1751	1751
query48	366	290	295	290
query49	840	373	389	373
query50	787	389	402	389
query51	6918	6822	6747	6747
query52	103	90	92	90
query53	344	291	286	286
query54	547	430	421	421
query55	75	72	73	72
query56	263	242	244	242
query57	1107	1047	1034	1034
query58	228	219	219	219
query59	3283	3152	3172	3152
query60	271	265	251	251
query61	89	94	119	94
query62	607	448	438	438
query63	316	292	290	290
query64	8413	2213	1748	1748
query65	3211	3074	3131	3074
query66	789	341	334	334
query67	15137	14793	15010	14793
query68	4557	533	530	530
query69	444	275	288	275
query70	1095	1119	1164	1119
query71	361	286	278	278
query72	7778	2690	2555	2555
query73	708	318	320	318
query74	5911	5690	5617	5617
query75	3292	2621	2644	2621
query76	2302	1025	982	982
query77	395	264	270	264
query78	10233	9852	9670	9670
query79	2389	506	516	506
query80	918	439	438	438
query81	547	242	243	242
query82	984	96	96	96
query83	252	187	171	171
query84	247	90	83	83
query85	1466	266	262	262
query86	468	289	312	289
query87	3266	3119	3182	3119
query88	4020	2312	2310	2310
query89	479	404	390	390
query90	2041	200	186	186
query91	122	98	97	97
query92	63	49	48	48
query93	2065	512	488	488
query94	1240	188	185	185
query95	394	308	306	306
query96	579	262	274	262
query97	3175	3017	3020	3017
query98	256	233	220	220
query99	1171	847	851	847
Total cold run time: 262646 ms
Total hot run time: 169521 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.03 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit de817696f445a6022013e944c05e2e0070f60716, data reload: false

query1	0.04	0.04	0.03
query2	0.09	0.04	0.04
query3	0.22	0.05	0.06
query4	1.65	0.08	0.08
query5	0.49	0.48	0.50
query6	1.13	0.71	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.54	0.50	0.49
query10	0.53	0.56	0.53
query11	0.15	0.12	0.12
query12	0.14	0.12	0.11
query13	0.59	0.58	0.60
query14	0.79	0.78	0.78
query15	0.83	0.81	0.81
query16	0.38	0.36	0.37
query17	0.96	0.96	0.96
query18	0.23	0.27	0.23
query19	1.77	1.78	1.66
query20	0.02	0.01	0.01
query21	15.42	0.69	0.68
query22	4.68	6.70	1.45
query23	18.25	1.39	1.29
query24	1.81	0.27	0.21
query25	0.14	0.08	0.09
query26	0.26	0.16	0.16
query27	0.08	0.07	0.08
query28	13.32	1.03	1.00
query29	12.75	3.37	3.26
query30	0.24	0.06	0.05
query31	2.85	0.39	0.38
query32	3.25	0.48	0.47
query33	2.90	2.85	2.93
query34	17.17	4.45	4.45
query35	4.52	4.51	4.50
query36	0.68	0.47	0.48
query37	0.18	0.16	0.15
query38	0.14	0.14	0.15
query39	0.04	0.03	0.04
query40	0.16	0.14	0.14
query41	0.09	0.05	0.04
query42	0.05	0.05	0.05
query43	0.04	0.03	0.04
Total cold run time: 109.64 s
Total hot run time: 30.03 s

@Lchangliang
Copy link
Contributor Author

run feut

@Lchangliang
Copy link
Contributor Author

run feut

starocean999
starocean999 previously approved these changes May 24, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels May 24, 2024
Copy link
Contributor

PR approved by anyone and no changes requested.

@Lchangliang
Copy link
Contributor Author

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label May 27, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 42038 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5e29d53d4755578c8be88d3c81ada65fe7848288, data reload: false

------ Round 1 ----------------------------------
q1	17596	4383	4444	4383
q2	2009	194	192	192
q3	10491	1313	1216	1216
q4	10201	879	783	783
q5	7473	2783	2739	2739
q6	246	131	134	131
q7	969	613	624	613
q8	9228	2148	2140	2140
q9	9406	6719	6756	6719
q10	9117	3949	3859	3859
q11	468	243	235	235
q12	480	247	242	242
q13	18107	3230	3200	3200
q14	274	229	234	229
q15	532	490	476	476
q16	496	407	396	396
q17	997	637	608	608
q18	8512	7921	7768	7768
q19	3658	1600	1532	1532
q20	659	317	323	317
q21	5161	3967	4132	3967
q22	365	300	293	293
Total cold run time: 116445 ms
Total hot run time: 42038 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4534	4439	4412	4412
q2	399	274	273	273
q3	3209	3000	2956	2956
q4	2025	1703	1559	1559
q5	5339	5510	5503	5503
q6	219	127	125	125
q7	2199	1880	1769	1769
q8	3280	3424	3424	3424
q9	8621	8698	8720	8698
q10	4062	3767	3750	3750
q11	624	493	509	493
q12	813	613	634	613
q13	16154	3155	3173	3155
q14	300	289	251	251
q15	536	478	499	478
q16	488	426	479	426
q17	1839	1547	1545	1545
q18	7948	7678	7359	7359
q19	1689	1571	1600	1571
q20	2010	1787	1805	1787
q21	8589	4694	4735	4694
q22	557	497	502	497
Total cold run time: 75434 ms
Total hot run time: 55338 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 170951 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5e29d53d4755578c8be88d3c81ada65fe7848288, data reload: false

query1	925	387	369	369
query2	6469	2460	2238	2238
query3	6644	201	207	201
query4	20001	17396	17331	17331
query5	4107	415	419	415
query6	258	156	154	154
query7	4587	295	284	284
query8	248	180	174	174
query9	8481	2421	2423	2421
query10	456	301	259	259
query11	10575	10138	10143	10138
query12	143	88	84	84
query13	1627	350	354	350
query14	9402	6225	6573	6225
query15	207	162	166	162
query16	7728	263	250	250
query17	1675	519	505	505
query18	1953	264	270	264
query19	203	154	151	151
query20	91	84	84	84
query21	195	132	125	125
query22	4086	3947	3922	3922
query23	33639	32798	32979	32798
query24	10675	2844	2868	2844
query25	579	348	382	348
query26	720	151	151	151
query27	2228	320	312	312
query28	6003	2080	2075	2075
query29	853	598	594	594
query30	241	154	157	154
query31	968	754	742	742
query32	89	50	51	50
query33	665	276	262	262
query34	884	462	462	462
query35	752	605	625	605
query36	1100	898	897	897
query37	131	65	64	64
query38	2947	2786	2781	2781
query39	849	776	789	776
query40	200	124	123	123
query41	48	43	43	43
query42	103	93	95	93
query43	612	573	575	573
query44	1072	708	730	708
query45	178	160	157	157
query46	1060	709	702	702
query47	1859	1746	1783	1746
query48	390	291	294	291
query49	848	380	377	377
query50	766	402	391	391
query51	6886	6745	6626	6626
query52	103	88	92	88
query53	355	286	278	278
query54	861	420	422	420
query55	73	69	69	69
query56	279	235	242	235
query57	1134	1037	1039	1037
query58	238	214	204	204
query59	3549	3180	3195	3180
query60	274	254	251	251
query61	90	86	84	84
query62	622	451	447	447
query63	305	285	276	276
query64	8536	2186	1724	1724
query65	3164	3068	3117	3068
query66	783	330	334	330
query67	15296	14849	14721	14721
query68	4543	524	533	524
query69	448	266	270	266
query70	1159	1044	1191	1044
query71	372	266	266	266
query72	7676	5346	5883	5346
query73	725	321	326	321
query74	6107	5685	5710	5685
query75	3314	2655	2630	2630
query76	2265	925	1003	925
query77	387	264	264	264
query78	10218	9808	9864	9808
query79	2293	512	503	503
query80	1070	438	422	422
query81	515	222	221	221
query82	948	90	91	90
query83	237	173	169	169
query84	236	86	83	83
query85	1226	323	319	319
query86	466	295	309	295
query87	3280	3127	3106	3106
query88	3700	2401	2405	2401
query89	491	404	378	378
query90	1959	182	182	182
query91	123	96	97	96
query92	59	47	47	47
query93	1764	513	484	484
query94	1250	177	183	177
query95	403	310	306	306
query96	601	267	262	262
query97	3191	3029	3017	3017
query98	244	222	233	222
query99	1170	829	846	829
Total cold run time: 265508 ms
Total hot run time: 170951 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.82 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5e29d53d4755578c8be88d3c81ada65fe7848288, data reload: false

query1	0.04	0.03	0.03
query2	0.09	0.04	0.03
query3	0.24	0.04	0.05
query4	1.66	0.07	0.10
query5	0.51	0.48	0.50
query6	1.12	0.71	0.72
query7	0.02	0.01	0.02
query8	0.05	0.05	0.04
query9	0.53	0.49	0.50
query10	0.54	0.56	0.54
query11	0.15	0.11	0.11
query12	0.15	0.11	0.12
query13	0.60	0.61	0.59
query14	0.77	0.77	0.78
query15	0.83	0.81	0.82
query16	0.37	0.37	0.38
query17	1.02	1.02	1.03
query18	0.22	0.26	0.25
query19	1.79	1.72	1.80
query20	0.01	0.01	0.01
query21	15.75	0.67	0.66
query22	4.18	7.24	2.09
query23	18.33	1.38	1.29
query24	1.47	0.38	0.24
query25	0.15	0.09	0.08
query26	0.24	0.16	0.17
query27	0.08	0.08	0.07
query28	13.31	1.00	0.98
query29	13.85	3.28	3.27
query30	0.25	0.06	0.06
query31	2.86	0.38	0.38
query32	3.30	0.47	0.46
query33	2.86	2.89	2.92
query34	17.03	4.45	4.44
query35	4.52	4.50	4.70
query36	0.64	0.48	0.47
query37	0.18	0.15	0.15
query38	0.15	0.14	0.14
query39	0.04	0.04	0.04
query40	0.16	0.13	0.15
query41	0.09	0.05	0.05
query42	0.05	0.04	0.04
query43	0.03	0.04	0.03
Total cold run time: 110.23 s
Total hot run time: 30.82 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label May 27, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@dataroaring dataroaring merged commit ffa5ac3 into apache:master May 27, 2024
25 of 27 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.0.x reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants