Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bug](restore) Fix wrong storage policy in show create stmt after restore #48158

Merged
merged 4 commits into from
Feb 24, 2025

Conversation

xy720
Copy link
Member

@xy720 xy720 commented Feb 20, 2025

What problem does this PR solve?

Issue Number: close #xxx

Fix wrong storage policy in show create stmt after restore

Clipboard_Screenshot_1740054928

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@xy720
Copy link
Member Author

xy720 commented Feb 20, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31531 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ab46cdcd48b2850678923854dbab0c26506dcd01, data reload: false

------ Round 1 ----------------------------------
q1	17580	5513	5053	5053
q2	2039	287	165	165
q3	10429	1269	717	717
q4	10212	1018	546	546
q5	7540	2478	2295	2295
q6	187	173	133	133
q7	909	738	621	621
q8	9315	1336	1150	1150
q9	4879	4665	4645	4645
q10	6821	2303	1874	1874
q11	505	287	264	264
q12	347	362	218	218
q13	17777	3636	3125	3125
q14	225	220	201	201
q15	495	457	445	445
q16	622	605	588	588
q17	586	866	327	327
q18	6699	6245	6230	6230
q19	1073	931	539	539
q20	307	326	185	185
q21	2856	2157	1910	1910
q22	362	322	300	300
Total cold run time: 101765 ms
Total hot run time: 31531 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5119	5085	5118	5085
q2	228	326	223	223
q3	2160	2649	2329	2329
q4	1482	1804	1343	1343
q5	4246	4127	4135	4127
q6	206	161	125	125
q7	1861	1816	1693	1693
q8	2605	2687	2501	2501
q9	7351	7210	7110	7110
q10	2974	3162	2764	2764
q11	602	520	491	491
q12	700	737	591	591
q13	3423	3965	3333	3333
q14	270	289	275	275
q15	502	469	449	449
q16	627	662	633	633
q17	1142	1646	1311	1311
q18	7546	7327	7427	7327
q19	801	866	1023	866
q20	1966	1979	1870	1870
q21	5441	4913	4767	4767
q22	627	555	522	522
Total cold run time: 51879 ms
Total hot run time: 49735 ms

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring
Copy link
Contributor

We should not show policy for partitions, because result of show create table can not be used to create a new table.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 20, 2025
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-DS: Total hot run time: 183612 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ab46cdcd48b2850678923854dbab0c26506dcd01, data reload: false

query1	986	380	367	367
query2	6553	1993	1927	1927
query3	6800	216	213	213
query4	25826	23674	23236	23236
query5	4366	663	495	495
query6	284	190	174	174
query7	4603	487	293	293
query8	283	237	215	215
query9	8633	2550	2562	2550
query10	464	309	266	266
query11	15455	15091	14809	14809
query12	165	111	103	103
query13	1667	535	397	397
query14	9459	6161	6175	6161
query15	214	194	182	182
query16	7596	634	496	496
query17	1202	713	556	556
query18	2012	405	307	307
query19	223	175	154	154
query20	121	114	113	113
query21	210	123	102	102
query22	4301	4228	4366	4228
query23	34571	33409	33057	33057
query24	8093	2353	2369	2353
query25	519	441	396	396
query26	1236	273	150	150
query27	2653	486	325	325
query28	4315	2416	2397	2397
query29	707	541	442	442
query30	226	184	153	153
query31	916	854	799	799
query32	71	66	60	60
query33	558	346	286	286
query34	759	868	507	507
query35	808	822	737	737
query36	957	988	887	887
query37	120	95	83	83
query38	4053	4064	4079	4064
query39	1431	1414	1388	1388
query40	207	113	102	102
query41	51	48	49	48
query42	117	104	103	103
query43	503	495	487	487
query44	1278	796	791	791
query45	176	173	156	156
query46	853	1027	650	650
query47	1751	1809	1747	1747
query48	401	412	308	308
query49	767	488	377	377
query50	672	714	450	450
query51	4184	4145	4118	4118
query52	105	111	98	98
query53	228	255	185	185
query54	473	470	402	402
query55	79	76	78	76
query56	251	267	234	234
query57	1114	1135	1050	1050
query58	242	232	239	232
query59	2889	2756	2877	2756
query60	274	269	254	254
query61	161	119	112	112
query62	824	720	661	661
query63	222	188	185	185
query64	4264	979	661	661
query65	3164	3102	3130	3102
query66	1102	390	295	295
query67	15706	15482	15296	15296
query68	3717	814	535	535
query69	454	298	263	263
query70	1143	1154	1130	1130
query71	388	293	266	266
query72	5703	3649	3705	3649
query73	691	740	355	355
query74	8877	9251	9199	9199
query75	3129	3157	2677	2677
query76	3189	1162	726	726
query77	476	393	280	280
query78	9933	10011	9246	9246
query79	1359	848	603	603
query80	633	528	457	457
query81	486	275	239	239
query82	230	127	95	95
query83	190	169	153	153
query84	244	93	73	73
query85	738	349	302	302
query86	317	292	269	269
query87	4437	4539	4285	4285
query88	2910	2227	2189	2189
query89	387	316	289	289
query90	1826	191	192	191
query91	137	142	109	109
query92	59	58	58	58
query93	1123	986	581	581
query94	601	392	290	290
query95	344	263	255	255
query96	493	524	269	269
query97	2768	2833	2717	2717
query98	225	206	204	204
query99	1287	1402	1294	1294
Total cold run time: 263968 ms
Total hot run time: 183612 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.9 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ab46cdcd48b2850678923854dbab0c26506dcd01, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.04
query3	0.23	0.07	0.07
query4	1.60	0.10	0.11
query5	0.42	0.42	0.40
query6	1.17	0.67	0.65
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.60	0.53	0.53
query10	0.57	0.58	0.57
query11	0.16	0.10	0.10
query12	0.15	0.11	0.11
query13	0.63	0.60	0.60
query14	2.71	2.69	2.69
query15	0.92	0.84	0.84
query16	0.38	0.37	0.38
query17	1.05	1.06	1.02
query18	0.21	0.19	0.20
query19	1.95	1.82	1.96
query20	0.01	0.02	0.02
query21	15.36	0.90	0.57
query22	0.75	1.15	0.92
query23	14.70	1.34	0.60
query24	6.51	1.02	0.89
query25	0.52	0.32	0.13
query26	0.59	0.15	0.14
query27	0.05	0.05	0.06
query28	10.00	0.96	0.44
query29	12.52	4.03	3.33
query30	0.25	0.09	0.06
query31	2.81	0.57	0.38
query32	3.23	0.55	0.47
query33	2.94	3.00	3.02
query34	15.71	5.09	4.47
query35	4.54	4.46	4.53
query36	0.65	0.49	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.02	0.02	0.02
query40	0.17	0.13	0.14
query41	0.08	0.02	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.56 s
Total hot run time: 30.9 s

@xy720
Copy link
Member Author

xy720 commented Feb 20, 2025

We should not show policy for partitions, because result of show create table can not be used to create a new table.

regression-test/suites/cold_heat_separation/empty_table_use_policy/create_table_use_partition_policy.groovy

Already support it.

@xy720
Copy link
Member Author

xy720 commented Feb 20, 2025

relate to #47009

@xy720
Copy link
Member Author

xy720 commented Feb 20, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31373 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 88a17538b25970aaa581bcc546db2bace41fb63e, data reload: false

------ Round 1 ----------------------------------
q1	17605	5273	5043	5043
q2	2047	303	172	172
q3	10430	1231	762	762
q4	10200	1003	528	528
q5	7514	2419	2287	2287
q6	185	171	133	133
q7	926	742	601	601
q8	9305	1305	1189	1189
q9	4879	4549	4570	4549
q10	6807	2295	1883	1883
q11	488	291	256	256
q12	352	359	215	215
q13	17749	3666	3054	3054
q14	225	225	215	215
q15	496	455	462	455
q16	619	612	587	587
q17	592	860	339	339
q18	6687	6157	6203	6157
q19	1205	935	558	558
q20	326	333	196	196
q21	2817	2103	1893	1893
q22	358	339	301	301
Total cold run time: 101812 ms
Total hot run time: 31373 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5106	5067	5111	5067
q2	235	338	232	232
q3	2137	2686	2242	2242
q4	1397	1807	1361	1361
q5	4233	4099	4159	4099
q6	210	164	124	124
q7	1860	1787	1642	1642
q8	2557	2632	2630	2630
q9	7226	7163	7210	7163
q10	2985	3198	2737	2737
q11	568	517	501	501
q12	673	765	634	634
q13	3480	3818	3342	3342
q14	279	296	267	267
q15	520	475	471	471
q16	629	691	620	620
q17	1131	1600	1296	1296
q18	7581	7409	7238	7238
q19	804	826	915	826
q20	1951	2098	1907	1907
q21	5328	4970	4793	4793
q22	617	531	542	531
Total cold run time: 51507 ms
Total hot run time: 49723 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190340 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 88a17538b25970aaa581bcc546db2bace41fb63e, data reload: false

query1	1318	960	954	954
query2	6215	1938	1929	1929
query3	11002	4509	4601	4509
query4	56131	24686	23380	23380
query5	5187	496	474	474
query6	354	184	175	175
query7	5179	527	306	306
query8	328	245	234	234
query9	6188	2565	2574	2565
query10	424	303	247	247
query11	15186	15087	14761	14761
query12	161	105	106	105
query13	1165	528	387	387
query14	10606	6725	6244	6244
query15	213	207	188	188
query16	7082	664	460	460
query17	1036	725	602	602
query18	1559	418	317	317
query19	218	199	178	178
query20	132	128	127	127
query21	211	129	108	108
query22	4477	4495	4315	4315
query23	34082	33258	33290	33258
query24	5707	2508	2466	2466
query25	510	498	454	454
query26	669	338	157	157
query27	1630	505	339	339
query28	2854	2466	2454	2454
query29	655	582	435	435
query30	214	192	161	161
query31	933	842	797	797
query32	84	61	61	61
query33	476	354	314	314
query34	775	886	534	534
query35	808	829	768	768
query36	987	1015	929	929
query37	128	100	74	74
query38	4304	4366	4239	4239
query39	1485	1427	1431	1427
query40	218	119	107	107
query41	54	59	51	51
query42	126	113	105	105
query43	531	522	493	493
query44	1378	853	829	829
query45	186	180	169	169
query46	935	1089	678	678
query47	1812	1913	1822	1822
query48	407	442	308	308
query49	692	503	418	418
query50	754	778	437	437
query51	4303	4264	4201	4201
query52	111	110	100	100
query53	249	279	195	195
query54	504	512	436	436
query55	85	87	80	80
query56	278	279	276	276
query57	1145	1193	1125	1125
query58	253	258	243	243
query59	2723	3073	2778	2778
query60	310	276	274	274
query61	122	122	125	122
query62	752	735	689	689
query63	242	205	204	204
query64	1493	1089	690	690
query65	3186	3103	3133	3103
query66	752	385	293	293
query67	15958	15553	15343	15343
query68	4369	817	541	541
query69	502	294	276	276
query70	1192	1149	1124	1124
query71	418	307	267	267
query72	6343	3612	3709	3612
query73	786	784	352	352
query74	8983	9455	8968	8968
query75	3319	3163	2720	2720
query76	3561	1168	748	748
query77	541	377	290	290
query78	9977	10126	9299	9299
query79	1835	874	624	624
query80	674	537	448	448
query81	509	268	242	242
query82	303	136	94	94
query83	189	180	154	154
query84	300	104	77	77
query85	733	414	311	311
query86	339	326	282	282
query87	4591	4509	4370	4370
query88	3008	2222	2209	2209
query89	401	311	292	292
query90	1946	196	194	194
query91	131	153	105	105
query92	75	62	55	55
query93	2302	1005	593	593
query94	647	416	300	300
query95	354	272	264	264
query96	523	543	279	279
query97	2748	2855	2766	2766
query98	231	212	200	200
query99	1320	1389	1283	1283
Total cold run time: 293382 ms
Total hot run time: 190340 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.83 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 88a17538b25970aaa581bcc546db2bace41fb63e, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.06
query4	1.63	0.10	0.10
query5	0.42	0.42	0.40
query6	1.15	0.65	0.67
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.60	0.51	0.52
query10	0.58	0.58	0.57
query11	0.15	0.10	0.11
query12	0.15	0.12	0.12
query13	0.63	0.60	0.61
query14	2.69	2.73	2.69
query15	0.94	0.86	0.86
query16	0.39	0.39	0.37
query17	1.05	1.05	1.05
query18	0.22	0.20	0.20
query19	1.92	1.84	2.02
query20	0.01	0.01	0.02
query21	15.35	0.91	0.55
query22	0.76	1.04	0.69
query23	15.06	1.39	0.61
query24	6.68	2.43	0.94
query25	0.47	0.27	0.06
query26	0.48	0.17	0.14
query27	0.05	0.05	0.05
query28	9.86	0.89	0.45
query29	12.55	3.98	3.33
query30	0.24	0.09	0.06
query31	2.82	0.57	0.39
query32	3.22	0.55	0.48
query33	3.04	3.02	3.01
query34	15.76	5.16	4.54
query35	4.52	4.50	4.52
query36	0.67	0.51	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.18	0.14	0.12
query41	0.07	0.02	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.02
Total cold run time: 104.97 s
Total hot run time: 30.83 s

@xy720
Copy link
Member Author

xy720 commented Feb 21, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31399 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6af969a7bd9cfaa6206ada4f3d28c9d3efbd69c4, data reload: false

------ Round 1 ----------------------------------
q1	17611	5404	5080	5080
q2	2043	298	177	177
q3	10405	1282	731	731
q4	10207	1007	510	510
q5	7503	2459	2280	2280
q6	189	166	134	134
q7	907	742	598	598
q8	9317	1327	1153	1153
q9	4868	4774	4602	4602
q10	6814	2315	1873	1873
q11	475	276	253	253
q12	348	351	224	224
q13	17756	3647	3071	3071
q14	221	226	216	216
q15	506	466	456	456
q16	611	601	580	580
q17	558	860	345	345
q18	6825	6361	6171	6171
q19	1210	945	516	516
q20	321	317	197	197
q21	2741	2214	1930	1930
q22	366	320	302	302
Total cold run time: 101802 ms
Total hot run time: 31399 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5122	5131	5097	5097
q2	242	332	233	233
q3	2182	2653	2318	2318
q4	1443	1797	1369	1369
q5	4255	4118	4142	4118
q6	205	165	124	124
q7	1867	1830	1648	1648
q8	2605	2719	2547	2547
q9	7364	7157	7166	7157
q10	3025	3502	2740	2740
q11	573	505	481	481
q12	702	743	622	622
q13	3448	3835	3268	3268
q14	279	287	267	267
q15	498	462	459	459
q16	617	683	632	632
q17	1102	1559	1363	1363
q18	7665	7276	7364	7276
q19	761	898	1017	898
q20	1955	2064	1880	1880
q21	5223	4946	4921	4921
q22	646	568	534	534
Total cold run time: 51779 ms
Total hot run time: 49952 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184204 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6af969a7bd9cfaa6206ada4f3d28c9d3efbd69c4, data reload: false

query1	984	367	360	360
query2	6538	1949	1898	1898
query3	6788	223	221	221
query4	26618	23812	23514	23514
query5	4388	652	517	517
query6	291	172	168	168
query7	4605	482	288	288
query8	281	229	225	225
query9	8614	2574	2557	2557
query10	473	296	249	249
query11	15729	15230	14940	14940
query12	162	111	103	103
query13	1644	523	387	387
query14	9732	6186	6266	6186
query15	203	190	175	175
query16	7289	644	476	476
query17	1201	715	566	566
query18	1955	404	300	300
query19	222	208	170	170
query20	118	117	117	117
query21	209	119	105	105
query22	4002	4450	4382	4382
query23	34193	33678	33055	33055
query24	7861	2383	2367	2367
query25	557	457	404	404
query26	1225	274	156	156
query27	2502	488	326	326
query28	4224	2420	2390	2390
query29	787	595	408	408
query30	228	187	152	152
query31	914	832	798	798
query32	70	64	62	62
query33	560	350	298	298
query34	755	846	509	509
query35	803	825	719	719
query36	952	1017	900	900
query37	110	95	70	70
query38	4157	4107	4173	4107
query39	1449	1389	1406	1389
query40	258	113	105	105
query41	54	52	51	51
query42	118	109	102	102
query43	485	516	481	481
query44	1269	787	775	775
query45	181	171	158	158
query46	858	1032	655	655
query47	1760	1803	1718	1718
query48	383	426	300	300
query49	775	501	400	400
query50	675	742	412	412
query51	4137	4199	4130	4130
query52	108	109	100	100
query53	219	251	187	187
query54	466	508	396	396
query55	86	79	81	79
query56	255	284	235	235
query57	1156	1135	1077	1077
query58	245	232	246	232
query59	2798	2822	2693	2693
query60	277	290	246	246
query61	139	117	113	113
query62	804	713	666	666
query63	232	190	196	190
query64	4412	1053	679	679
query65	3274	3195	3169	3169
query66	1124	396	300	300
query67	15629	15658	15432	15432
query68	8115	755	508	508
query69	471	293	265	265
query70	1197	1164	1063	1063
query71	421	292	270	270
query72	5691	3670	3727	3670
query73	703	746	342	342
query74	9212	9112	9056	9056
query75	3223	3159	2707	2707
query76	3347	1158	729	729
query77	506	364	283	283
query78	10059	10001	9256	9256
query79	2814	802	594	594
query80	1340	555	451	451
query81	638	272	237	237
query82	630	122	93	93
query83	171	166	160	160
query84	252	90	76	76
query85	815	339	299	299
query86	432	292	286	286
query87	4428	4604	4410	4410
query88	4308	2274	2200	2200
query89	388	316	290	290
query90	1874	192	189	189
query91	140	135	114	114
query92	74	56	57	56
query93	2585	972	563	563
query94	732	411	249	249
query95	367	264	257	257
query96	478	544	280	280
query97	2753	2851	2740	2740
query98	233	204	199	199
query99	1308	1401	1217	1217
Total cold run time: 275275 ms
Total hot run time: 184204 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.23 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6af969a7bd9cfaa6206ada4f3d28c9d3efbd69c4, data reload: false

query1	0.03	0.03	0.06
query2	0.07	0.04	0.03
query3	0.23	0.06	0.06
query4	1.62	0.10	0.10
query5	0.43	0.44	0.40
query6	1.18	0.66	0.67
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.51	0.54
query10	0.58	0.57	0.56
query11	0.15	0.11	0.11
query12	0.15	0.11	0.11
query13	0.62	0.60	0.62
query14	2.68	2.70	2.71
query15	0.91	0.86	0.86
query16	0.39	0.38	0.39
query17	1.04	1.03	1.00
query18	0.22	0.20	0.20
query19	1.88	1.79	1.99
query20	0.01	0.01	0.02
query21	15.36	0.92	0.55
query22	0.74	1.07	0.71
query23	15.02	1.38	0.66
query24	7.17	1.44	1.25
query25	0.53	0.29	0.12
query26	0.55	0.16	0.13
query27	0.05	0.05	0.05
query28	9.95	0.83	0.42
query29	12.56	3.99	3.33
query30	0.25	0.09	0.06
query31	2.84	0.58	0.38
query32	3.22	0.54	0.47
query33	3.00	3.12	3.02
query34	15.82	5.18	4.55
query35	4.55	4.59	4.61
query36	0.66	0.50	0.48
query37	0.09	0.07	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.16	0.14	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.03
query43	0.04	0.03	0.02
Total cold run time: 105.59 s
Total hot run time: 31.23 s

@xy720
Copy link
Member Author

xy720 commented Feb 21, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31641 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a89e69458b3ffb8cb4b3643ed221ab8a66ce0967, data reload: false

------ Round 1 ----------------------------------
q1	17608	5371	5111	5111
q2	2043	318	170	170
q3	10391	1342	700	700
q4	10211	1018	533	533
q5	7490	2500	2299	2299
q6	211	171	137	137
q7	898	732	649	649
q8	9305	1318	1150	1150
q9	4925	4660	4588	4588
q10	6839	2321	1892	1892
q11	483	280	270	270
q12	360	357	223	223
q13	17763	3704	3092	3092
q14	221	223	214	214
q15	505	476	476	476
q16	625	625	586	586
q17	578	858	347	347
q18	6632	6226	6170	6170
q19	1086	942	557	557
q20	333	337	195	195
q21	2940	2164	1973	1973
q22	371	328	309	309
Total cold run time: 101818 ms
Total hot run time: 31641 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5127	5115	5142	5115
q2	233	339	231	231
q3	2184	2689	2264	2264
q4	1413	1828	1376	1376
q5	4227	4107	4130	4107
q6	213	163	122	122
q7	1847	1803	1660	1660
q8	2623	2568	2582	2568
q9	7336	7160	7141	7141
q10	3017	3179	2791	2791
q11	589	522	503	503
q12	690	744	582	582
q13	3578	3969	3358	3358
q14	274	289	270	270
q15	522	456	455	455
q16	640	686	634	634
q17	1135	1581	1328	1328
q18	7424	7356	7334	7334
q19	827	846	934	846
q20	1929	2013	1875	1875
q21	5351	5024	4830	4830
q22	612	569	538	538
Total cold run time: 51791 ms
Total hot run time: 49928 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184175 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a89e69458b3ffb8cb4b3643ed221ab8a66ce0967, data reload: false

query1	981	383	374	374
query2	6535	1819	1835	1819
query3	6877	209	210	209
query4	26289	23677	23189	23189
query5	4341	636	481	481
query6	303	189	197	189
query7	4604	512	304	304
query8	317	240	242	240
query9	8636	2574	2568	2568
query10	457	314	251	251
query11	15634	15025	14873	14873
query12	165	109	106	106
query13	1646	517	384	384
query14	10066	6613	6537	6537
query15	205	198	177	177
query16	7516	636	467	467
query17	1190	723	556	556
query18	1946	409	302	302
query19	221	194	165	165
query20	128	123	123	123
query21	211	124	104	104
query22	4022	4228	4371	4228
query23	34473	33333	32941	32941
query24	7777	2370	2367	2367
query25	539	474	416	416
query26	1224	294	158	158
query27	2103	507	343	343
query28	3858	2430	2409	2409
query29	770	572	433	433
query30	228	179	158	158
query31	989	858	776	776
query32	74	59	62	59
query33	556	353	293	293
query34	768	849	533	533
query35	790	821	739	739
query36	975	999	896	896
query37	118	101	73	73
query38	4173	4207	4107	4107
query39	1455	1392	1425	1392
query40	207	118	108	108
query41	53	51	52	51
query42	122	104	105	104
query43	487	498	478	478
query44	1302	786	784	784
query45	173	174	163	163
query46	852	1016	647	647
query47	1741	1766	1685	1685
query48	393	425	319	319
query49	789	519	440	440
query50	697	735	434	434
query51	4161	4143	4158	4143
query52	108	103	94	94
query53	222	255	179	179
query54	491	510	405	405
query55	86	80	83	80
query56	260	286	241	241
query57	1105	1121	1050	1050
query58	243	246	246	246
query59	2547	2640	2463	2463
query60	272	284	298	284
query61	123	118	113	113
query62	789	734	694	694
query63	235	185	185	185
query64	4411	1002	661	661
query65	3206	3194	3135	3135
query66	1069	451	293	293
query67	16027	15758	15627	15627
query68	8230	789	515	515
query69	457	308	267	267
query70	1190	1142	1121	1121
query71	428	295	257	257
query72	5509	3650	3759	3650
query73	727	744	357	357
query74	8882	9106	8699	8699
query75	3360	3163	2695	2695
query76	3324	1179	744	744
query77	560	371	292	292
query78	9925	9987	9554	9554
query79	2600	784	619	619
query80	594	585	465	465
query81	515	279	243	243
query82	626	124	94	94
query83	188	177	156	156
query84	251	100	74	74
query85	807	349	369	349
query86	372	320	276	276
query87	4461	4491	4358	4358
query88	4095	2244	2220	2220
query89	409	317	294	294
query90	1917	214	192	192
query91	138	139	116	116
query92	76	62	55	55
query93	1563	1015	601	601
query94	700	419	301	301
query95	345	269	267	267
query96	495	556	268	268
query97	2788	2830	2759	2759
query98	235	201	203	201
query99	1311	1400	1271	1271
Total cold run time: 272409 ms
Total hot run time: 184175 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.91 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a89e69458b3ffb8cb4b3643ed221ab8a66ce0967, data reload: false

query1	0.03	0.03	0.04
query2	0.10	0.03	0.03
query3	0.24	0.06	0.07
query4	1.60	0.10	0.10
query5	0.41	0.43	0.40
query6	1.17	0.65	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.59	0.51	0.53
query10	0.58	0.57	0.57
query11	0.15	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.61
query14	2.67	2.72	2.76
query15	0.93	0.86	0.84
query16	0.39	0.39	0.39
query17	0.99	1.01	1.06
query18	0.22	0.19	0.20
query19	1.95	1.82	1.98
query20	0.01	0.01	0.01
query21	15.36	0.92	0.61
query22	0.74	1.02	0.76
query23	14.98	1.38	0.66
query24	6.71	2.21	0.92
query25	0.51	0.20	0.11
query26	0.59	0.16	0.12
query27	0.06	0.06	0.05
query28	10.11	0.81	0.44
query29	12.58	3.87	3.30
query30	0.25	0.08	0.07
query31	2.82	0.59	0.37
query32	3.23	0.55	0.46
query33	3.00	3.01	3.01
query34	15.57	5.12	4.51
query35	4.58	4.51	4.58
query36	0.65	0.51	0.50
query37	0.09	0.06	0.06
query38	0.05	0.03	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.14
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.08 s
Total hot run time: 30.91 s

@xy720
Copy link
Member Author

xy720 commented Feb 21, 2025

run feut

Copy link
Contributor

@Yulei-Yang Yulei-Yang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xy720 xy720 merged commit f863753 into apache:master Feb 24, 2025
23 of 24 checks passed
github-actions bot pushed a commit that referenced this pull request Feb 24, 2025
…tore (#48158)

Fix wrong storage policy in show create stmt after restore
github-actions bot pushed a commit that referenced this pull request Feb 24, 2025
…tore (#48158)

Fix wrong storage policy in show create stmt after restore
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.x dev/3.0.x reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants