Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](Nerieds) using join bugs #48030

Merged
merged 1 commit into from
Feb 21, 2025
Merged

Conversation

morrySnow
Copy link
Contributor

What problem does this PR solve?

Related PR: #15311

Problem Summary:

  1. select * should only return using columns from left relation
  2. bind expression on using join should not do distinct slot by name on using join's output

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 28338 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9c6bb3735cac3a98e8d4f7c2e015f5bba54ef148, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17841	5269	5108	5108
q2	2206	305	174	174
q3	11450	1244	752	752
q4	10208	1021	558	558
q5	7522	2337	2342	2337
q6	183	166	130	130
q7	874	746	613	613
q8	9287	1269	1056	1056
q9	5121	4597	4802	4597
q10	6811	2340	1859	1859
q11	473	271	246	246
q12	343	348	222	222
q13	q14	226	228	208	208
q15	506	484	448	448
q16	596	594	582	582
q17	571	774	337	337
q18	6542	6166	6223	6166
q19	1075	938	528	528
q20	304	329	186	186
q21	2755	2113	1940	1940
q22	364	321	291	291
Total cold run time: 85258 ms
Total hot run time: 28338 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	5120	5115	5139	5115
q2	234	333	233	233
q3	2147	2675	2328	2328
q4	1467	1825	1370	1370
q5	4208	4105	4141	4105
q6	206	163	123	123
q7	1837	1816	1639	1639
q8	2533	2541	2515	2515
q9	6801	6743	6981	6743
q10	2994	3227	2805	2805
q11	585	501	507	501
q12	701	778	654	654
q13	q14	291	288	283	283
q15	521	461	469	461
q16	624	650	644	644
q17	1167	1662	1259	1259
q18	7841	7287	7261	7261
q19	779	789	787	787
q20	2038	2029	1875	1875
q21	5392	5002	4957	4957
q22	613	601	587	587
Total cold run time: 48099 ms
Total hot run time: 46245 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 161258 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9c6bb3735cac3a98e8d4f7c2e015f5bba54ef148, data reload: false

ship_mode	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:44:00	2023-12-26 22:44:05	NULL	utf-8	NULL	NULL	
store	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
store_returns	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:47:09	NULL	utf-8	NULL	NULL	
store_sales	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:59:20	NULL	utf-8	NULL	NULL	
time_dim	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:44:03	NULL	utf-8	NULL	NULL	
warehouse	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
web_page	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
web_returns	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:45:43	NULL	utf-8	NULL	NULL	
web_sales	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:53:25	NULL	utf-8	NULL	NULL	
web_site	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
============================================
query1	1287	965	933	933
query2	6228	1904	1890	1890
query3	8701	209	197	197
query4	57159	25625	23325	23325
query5	query6	324	191	188	188
query7	5053	410	304	304
query8	334	265	238	238
query9	5742	2518	2517	2517
query10	439	303	265	265
query11	15104	15204	14933	14933
query12	223	109	104	104
query13	1068	519	384	384
query14	11281	6709	6516	6516
query15	211	200	178	178
query16	7207	670	504	504
query17	1300	762	591	591
query18	1549	434	318	318
query19	199	196	164	164
query20	130	119	121	119
query21	215	137	111	111
query22	4804	4941	4607	4607
query23	34004	33162	33275	33162
query24	5660	2460	2421	2421
query25	532	480	406	406
query26	688	285	176	176
query27	1860	502	341	341
query28	2826	2431	2438	2431
query29	596	573	418	418
query30	186	192	157	157
query31	899	870	779	779
query32	77	65	57	57
query33	472	367	307	307
query34	767	837	537	537
query35	835	836	731	731
query36	960	994	887	887
query37	111	103	79	79
query38	4332	4298	4263	4263
query39	1501	1452	1425	1425
query40	query41	50	49	49	49
query42	114	105	112	105
query43	503	502	501	501
query44	1309	811	807	807
query45	179	178	168	168
query46	868	1062	687	687
query47	1806	1905	1851	1851
query48	391	417	300	300
query49	query50	684	709	428	428
query51	query52	102	103	93	93
query53	220	255	198	198
query54	492	543	417	417
query55	81	82	82	82
query56	268	280	251	251
query57	1167	1183	1144	1144
query58	257	236	247	236
query59	2847	2897	2640	2640
query60	308	273	271	271
query61	121	120	116	116
query62	781	744	682	682
query63	230	198	199	198
query64	1870	1024	674	674
query65	3307	3273	3241	3241
query66	732	391	296	296
query67	16589	15830	15458	15458
query68	5758	833	517	517
query69	511	291	273	273
query70	1218	1136	1108	1108
query71	429	286	254	254
query72	query73	1274	566	343	343
query74	9190	8809	8950	8809
query75	query76	5692	1202	811	811
query77	query78	query79	921	993	574	574
query80	query81	519	266	234	234
query82	227	121	91	91
query83	368	179	168	168
query84	275	99	72	72
query85	1188	395	389	389
query86	304	317	291	291
query87	4539	4446	4339	4339
query88	2793	2249	2195	2195
query89	373	323	306	306
query90	1888	189	190	189
query91	181	128	107	107
query92	62	58	56	56
query93	query94	716	394	288	288
query95	373	268	264	264
query96	360	409	273	273
query97	query98	213	207	205	205
query99	1321	1397	1246	1246
Total cold run time: 260833 ms
Total hot run time: 161258 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.32 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9c6bb3735cac3a98e8d4f7c2e015f5bba54ef148, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.24	0.06	0.07
query4	1.63	0.10	0.11
query5	0.41	0.43	0.40
query6	1.17	0.65	0.66
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.58	0.52	0.50
query10	0.58	0.58	0.58
query11	0.15	0.10	0.10
query12	0.14	0.11	0.12
query13	0.63	0.59	0.59
query14	2.71	2.72	2.72
query15	0.92	0.84	0.84
query16	0.38	0.37	0.36
query17	1.02	1.02	1.06
query18	0.21	0.20	0.20
query19	1.85	1.79	2.02
query20	0.01	0.01	0.01
query21	15.35	0.88	0.54
query22	0.75	1.21	0.63
query23	15.31	1.34	0.58
query24	10.46	0.91	0.81
query25	0.50	0.16	0.06
query26	0.91	0.18	0.14
query27	0.05	0.04	0.04
query28	6.72	0.74	0.43
query29	12.53	3.87	3.24
query30	0.25	0.09	0.06
query31	2.83	0.57	0.39
query32	3.23	0.55	0.46
query33	2.97	2.97	3.02
query34	15.74	5.14	4.52
query35	4.54	4.52	4.58
query36	0.66	0.50	0.47
query37	0.09	0.07	0.07
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.07 s
Total hot run time: 30.32 s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31448 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 14090cf6899eb54f708df2a6e293cb55faaee96a, data reload: false

------ Round 1 ----------------------------------
q1	17580	5425	5053	5053
q2	2055	306	172	172
q3	10460	1240	743	743
q4	10204	1004	509	509
q5	7519	2421	2660	2421
q6	192	163	131	131
q7	895	744	604	604
q8	9307	1303	1169	1169
q9	4863	4632	4616	4616
q10	6816	2313	1871	1871
q11	480	276	249	249
q12	346	347	221	221
q13	17755	3692	3062	3062
q14	239	227	219	219
q15	510	462	457	457
q16	618	608	582	582
q17	580	838	329	329
q18	6802	6353	6108	6108
q19	1535	963	537	537
q20	311	319	179	179
q21	2656	2109	1913	1913
q22	374	333	303	303
Total cold run time: 102097 ms
Total hot run time: 31448 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5088	5067	5068	5067
q2	235	336	233	233
q3	2177	2684	2284	2284
q4	1424	1867	1338	1338
q5	4235	4151	4103	4103
q6	209	170	124	124
q7	1873	1829	1648	1648
q8	2626	2565	2500	2500
q9	7228	7207	7160	7160
q10	3031	3234	2797	2797
q11	593	524	487	487
q12	690	782	663	663
q13	3403	3890	3307	3307
q14	287	295	264	264
q15	509	450	465	450
q16	626	669	621	621
q17	1133	1576	1374	1374
q18	7766	7292	7334	7292
q19	759	786	835	786
q20	1998	2068	1891	1891
q21	5411	5137	4811	4811
q22	615	564	581	564
Total cold run time: 51916 ms
Total hot run time: 49764 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189968 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 14090cf6899eb54f708df2a6e293cb55faaee96a, data reload: false

query1	1302	972	963	963
query2	6244	1827	1845	1827
query3	11029	4424	4372	4372
query4	54139	25535	23439	23439
query5	5129	548	485	485
query6	360	191	190	190
query7	5113	496	295	295
query8	318	252	228	228
query9	6091	2548	2539	2539
query10	416	304	257	257
query11	15155	15105	14943	14943
query12	153	107	109	107
query13	1127	525	416	416
query14	10398	6280	6243	6243
query15	195	202	174	174
query16	7064	662	471	471
query17	1089	771	572	572
query18	1519	429	318	318
query19	212	206	177	177
query20	129	136	115	115
query21	218	131	104	104
query22	4656	4515	4244	4244
query23	33951	33484	33380	33380
query24	5754	2477	2421	2421
query25	498	501	475	475
query26	677	273	150	150
query27	1719	479	357	357
query28	2761	2452	2420	2420
query29	554	547	430	430
query30	210	179	163	163
query31	918	884	851	851
query32	73	62	61	61
query33	442	377	324	324
query34	749	868	519	519
query35	786	889	742	742
query36	955	992	896	896
query37	118	95	79	79
query38	4287	4328	4245	4245
query39	1517	1443	1404	1404
query40	207	118	99	99
query41	50	49	48	48
query42	124	114	105	105
query43	503	508	474	474
query44	1302	817	822	817
query45	182	168	164	164
query46	891	1063	669	669
query47	1877	1873	1786	1786
query48	406	448	312	312
query49	691	522	438	438
query50	686	739	422	422
query51	4291	4263	4237	4237
query52	104	105	91	91
query53	235	255	184	184
query54	486	476	419	419
query55	82	82	75	75
query56	259	271	256	256
query57	1150	1204	1124	1124
query58	248	241	243	241
query59	2597	2798	2687	2687
query60	300	275	272	272
query61	153	119	119	119
query62	743	765	664	664
query63	231	194	196	194
query64	1433	1069	660	660
query65	3172	3146	3142	3142
query66	759	385	295	295
query67	16173	15474	15502	15474
query68	5281	781	530	530
query69	516	301	275	275
query70	1200	1079	1101	1079
query71	455	308	260	260
query72	6264	3841	3671	3671
query73	1063	749	352	352
query74	9164	9109	8982	8982
query75	3191	3163	2668	2668
query76	3812	1170	732	732
query77	549	439	289	289
query78	10047	10089	9245	9245
query79	1833	867	606	606
query80	728	535	462	462
query81	512	276	238	238
query82	429	129	102	102
query83	181	167	152	152
query84	294	92	75	75
query85	751	366	308	308
query86	317	310	284	284
query87	4510	4471	4366	4366
query88	2863	2185	2185	2185
query89	397	318	320	318
query90	1668	193	189	189
query91	133	132	103	103
query92	61	57	52	52
query93	1729	1011	588	588
query94	642	415	296	296
query95	336	264	261	261
query96	491	534	274	274
query97	2737	2846	2703	2703
query98	223	205	210	205
query99	1313	1415	1254	1254
Total cold run time: 291050 ms
Total hot run time: 189968 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.24 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 14090cf6899eb54f708df2a6e293cb55faaee96a, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.07	0.06
query4	1.62	0.10	0.10
query5	0.41	0.41	0.40
query6	1.18	0.67	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.60	0.51	0.53
query10	0.59	0.58	0.58
query11	0.15	0.10	0.11
query12	0.14	0.11	0.11
query13	0.63	0.61	0.61
query14	2.67	2.74	2.72
query15	0.93	0.85	0.85
query16	0.37	0.37	0.37
query17	1.04	1.04	1.03
query18	0.21	0.20	0.20
query19	1.95	1.82	2.01
query20	0.02	0.01	0.02
query21	15.72	0.90	0.56
query22	0.92	1.18	0.65
query23	15.08	1.40	0.59
query24	8.71	2.27	1.50
query25	0.48	0.38	0.08
query26	0.67	0.18	0.14
query27	0.05	0.04	0.04
query28	7.51	0.79	0.44
query29	12.54	3.93	3.29
query30	0.24	0.08	0.06
query31	2.84	0.58	0.38
query32	3.23	0.53	0.46
query33	3.13	3.03	3.00
query34	15.79	5.13	4.49
query35	4.51	4.50	4.51
query36	0.67	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.02	0.02	0.02
query40	0.18	0.14	0.14
query41	0.07	0.03	0.02
query42	0.03	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 105.48 s
Total hot run time: 31.24 s

@morrySnow
Copy link
Contributor Author

run buildall

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32662 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 31b9383f1e341ad571993c352ad16257bd744ccd, data reload: false

------ Round 1 ----------------------------------
q1	17584	5516	5250	5250
q2	2063	288	172	172
q3	10428	1264	775	775
q4	10216	1038	537	537
q5	7543	2544	2375	2375
q6	208	172	136	136
q7	931	766	607	607
q8	9297	1494	1321	1321
q9	4932	4729	4711	4711
q10	6864	2333	1903	1903
q11	486	275	255	255
q12	352	382	219	219
q13	17781	3717	3769	3717
q14	230	222	215	215
q15	515	476	480	476
q16	628	596	581	581
q17	573	893	340	340
q18	7210	6300	6093	6093
q19	1218	1044	552	552
q20	329	341	187	187
q21	2874	2321	1939	1939
q22	368	331	301	301
Total cold run time: 102630 ms
Total hot run time: 32662 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5428	5378	5433	5378
q2	265	329	232	232
q3	2165	2683	2345	2345
q4	1472	1872	1372	1372
q5	4233	4181	4195	4181
q6	231	180	128	128
q7	1896	1922	1823	1823
q8	2809	2794	2707	2707
q9	7409	7240	7288	7240
q10	3129	3290	2850	2850
q11	582	497	495	495
q12	715	766	590	590
q13	3494	4100	3377	3377
q14	281	311	267	267
q15	515	485	450	450
q16	639	703	640	640
q17	1155	1643	1386	1386
q18	7595	7367	7321	7321
q19	829	960	1176	960
q20	1996	2032	1887	1887
q21	5687	5024	4799	4799
q22	656	611	576	576
Total cold run time: 53181 ms
Total hot run time: 51004 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192688 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 31b9383f1e341ad571993c352ad16257bd744ccd, data reload: false

query1	1346	971	969	969
query2	6147	1854	1825	1825
query3	11081	4642	4663	4642
query4	54977	26024	23322	23322
query5	5096	611	532	532
query6	375	200	189	189
query7	5178	527	297	297
query8	329	259	249	249
query9	6204	2551	2568	2551
query10	408	303	255	255
query11	15660	15472	15377	15377
query12	160	116	112	112
query13	1143	510	370	370
query14	10942	6735	6606	6606
query15	204	190	182	182
query16	6983	713	474	474
query17	1080	758	619	619
query18	1417	432	334	334
query19	245	201	180	180
query20	143	141	131	131
query21	221	131	113	113
query22	4329	4637	4402	4402
query23	34374	33427	33551	33427
query24	5850	2521	2518	2518
query25	523	530	437	437
query26	674	291	174	174
query27	1851	534	358	358
query28	2873	2486	2444	2444
query29	559	574	434	434
query30	217	197	170	170
query31	885	888	844	844
query32	79	69	61	61
query33	450	368	356	356
query34	804	914	531	531
query35	878	859	768	768
query36	959	1005	918	918
query37	136	104	71	71
query38	4293	4350	4364	4350
query39	1708	1509	1495	1495
query40	213	120	104	104
query41	55	55	51	51
query42	132	108	102	102
query43	520	525	489	489
query44	1374	839	813	813
query45	196	169	167	167
query46	927	1135	698	698
query47	1869	1873	1785	1785
query48	404	439	314	314
query49	723	528	434	434
query50	747	783	438	438
query51	4399	4409	4319	4319
query52	113	112	98	98
query53	232	275	196	196
query54	503	504	423	423
query55	79	84	80	80
query56	271	272	263	263
query57	1179	1201	1119	1119
query58	254	244	260	244
query59	2589	2675	2860	2675
query60	299	286	274	274
query61	119	116	118	116
query62	733	754	706	706
query63	241	207	204	204
query64	1482	1027	659	659
query65	3460	3251	3210	3210
query66	774	389	325	325
query67	15916	15687	15419	15419
query68	5277	806	517	517
query69	514	307	270	270
query70	1252	1158	1120	1120
query71	428	286	263	263
query72	6333	3690	3898	3690
query73	1031	778	354	354
query74	9239	9146	8913	8913
query75	3272	3193	2717	2717
query76	3862	1214	762	762
query77	533	400	281	281
query78	10578	10471	9670	9670
query79	2555	885	660	660
query80	654	553	459	459
query81	522	291	255	255
query82	215	129	101	101
query83	193	181	155	155
query84	361	89	75	75
query85	759	360	311	311
query86	336	308	305	305
query87	4517	4546	4375	4375
query88	3806	2216	2215	2215
query89	435	331	304	304
query90	1815	201	195	195
query91	138	139	113	113
query92	71	63	57	57
query93	2236	1039	580	580
query94	741	428	303	303
query95	355	275	265	265
query96	508	568	271	271
query97	2851	2909	2726	2726
query98	241	211	203	203
query99	1329	1433	1391	1391
Total cold run time: 297541 ms
Total hot run time: 192688 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.33 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 31b9383f1e341ad571993c352ad16257bd744ccd, data reload: false

query1	0.04	0.03	0.02
query2	0.07	0.03	0.03
query3	0.24	0.06	0.06
query4	1.63	0.10	0.10
query5	0.41	0.42	0.39
query6	1.17	0.65	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.52	0.51
query10	0.57	0.59	0.58
query11	0.15	0.11	0.11
query12	0.14	0.11	0.11
query13	0.64	0.61	0.61
query14	2.72	2.73	2.72
query15	0.93	0.86	0.85
query16	0.37	0.38	0.37
query17	1.02	1.03	1.03
query18	0.22	0.20	0.19
query19	1.92	1.82	2.03
query20	0.01	0.01	0.02
query21	15.36	0.91	0.55
query22	0.76	1.16	0.76
query23	14.84	1.36	0.61
query24	11.55	1.00	0.38
query25	0.35	0.23	0.16
query26	0.95	0.17	0.14
query27	0.05	0.05	0.04
query28	6.31	0.81	0.42
query29	12.52	3.92	3.24
query30	0.25	0.09	0.07
query31	2.83	0.59	0.37
query32	3.23	0.54	0.47
query33	2.95	3.02	3.07
query34	15.83	5.16	4.53
query35	4.62	4.56	4.58
query36	0.67	0.50	0.47
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.03
query40	0.18	0.13	0.12
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.48 s
Total hot run time: 30.33 s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31748 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9c38dfc41cc1fc7add59fa0bc629fbfef6548860, data reload: false

------ Round 1 ----------------------------------
q1	17582	5324	5115	5115
q2	2051	304	179	179
q3	10427	1301	721	721
q4	10278	1013	523	523
q5	7945	2486	2331	2331
q6	193	171	135	135
q7	924	751	635	635
q8	9308	1368	1239	1239
q9	4935	4750	4527	4527
q10	6830	2331	1867	1867
q11	490	289	256	256
q12	355	370	226	226
q13	17779	3677	3146	3146
q14	234	226	213	213
q15	518	459	458	458
q16	629	621	583	583
q17	601	896	343	343
q18	6985	6188	6153	6153
q19	1473	968	547	547
q20	318	328	194	194
q21	2890	2156	2048	2048
q22	371	335	309	309
Total cold run time: 103116 ms
Total hot run time: 31748 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5164	5130	5130	5130
q2	232	331	237	237
q3	2165	2678	2255	2255
q4	1414	1824	1349	1349
q5	4258	4171	4113	4113
q6	210	162	126	126
q7	1852	1844	1751	1751
q8	2682	2603	2630	2603
q9	7321	7167	7210	7167
q10	3017	3171	2764	2764
q11	577	519	502	502
q12	704	755	625	625
q13	3591	4080	3247	3247
q14	263	291	268	268
q15	505	480	445	445
q16	636	692	636	636
q17	1163	1593	1351	1351
q18	7461	7363	7329	7329
q19	856	924	1102	924
q20	1938	1994	1874	1874
q21	5481	5007	4872	4872
q22	620	568	540	540
Total cold run time: 52110 ms
Total hot run time: 50108 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183980 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9c38dfc41cc1fc7add59fa0bc629fbfef6548860, data reload: false

query1	987	376	387	376
query2	6530	1867	1814	1814
query3	6803	212	216	212
query4	26301	23890	23357	23357
query5	4342	654	501	501
query6	289	192	181	181
query7	4607	495	298	298
query8	292	231	237	231
query9	8597	2568	2558	2558
query10	482	354	258	258
query11	15433	15106	14974	14974
query12	159	108	107	107
query13	1663	531	398	398
query14	8851	6113	6355	6113
query15	202	183	173	173
query16	7140	627	435	435
query17	1002	690	537	537
query18	1938	390	290	290
query19	194	181	154	154
query20	118	115	117	115
query21	207	122	103	103
query22	4354	4528	4343	4343
query23	34415	33380	33045	33045
query24	8178	2382	2377	2377
query25	542	455	394	394
query26	1234	270	152	152
query27	2596	502	332	332
query28	4280	2424	2410	2410
query29	769	544	427	427
query30	230	189	156	156
query31	914	819	828	819
query32	73	72	63	63
query33	549	369	298	298
query34	771	851	500	500
query35	790	861	760	760
query36	959	1000	884	884
query37	115	103	78	78
query38	4117	4065	4140	4065
query39	1448	1385	1390	1385
query40	206	112	102	102
query41	55	50	50	50
query42	126	108	105	105
query43	494	508	480	480
query44	1305	805	787	787
query45	173	164	159	159
query46	880	1055	647	647
query47	1729	1774	1726	1726
query48	405	407	305	305
query49	771	562	381	381
query50	686	749	457	457
query51	4133	4143	4137	4137
query52	105	105	94	94
query53	233	251	184	184
query54	509	512	417	417
query55	91	85	83	83
query56	246	247	244	244
query57	1149	1145	1057	1057
query58	248	232	225	225
query59	2568	2713	2480	2480
query60	304	272	264	264
query61	122	117	117	117
query62	800	697	656	656
query63	239	183	196	183
query64	4448	1016	672	672
query65	3211	3125	3197	3125
query66	1132	393	302	302
query67	16020	15499	15433	15433
query68	2278	846	567	567
query69	431	314	269	269
query70	1179	1095	1134	1095
query71	326	276	276	276
query72	5182	3543	3901	3543
query73	638	743	365	365
query74	9120	9316	9028	9028
query75	3089	3173	2749	2749
query76	2215	1152	743	743
query77	340	374	283	283
query78	9881	10073	9288	9288
query79	1057	908	628	628
query80	1293	553	476	476
query81	535	284	241	241
query82	1059	129	98	98
query83	245	172	167	167
query84	278	94	72	72
query85	830	366	310	310
query86	392	291	286	286
query87	4400	4594	4486	4486
query88	2993	2282	2229	2229
query89	389	319	291	291
query90	1811	195	199	195
query91	136	137	111	111
query92	63	65	56	56
query93	1101	988	584	584
query94	654	415	298	298
query95	349	270	258	258
query96	494	539	283	283
query97	2772	2873	2714	2714
query98	232	217	206	206
query99	1290	1416	1240	1240
Total cold run time: 261911 ms
Total hot run time: 183980 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.75 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9c38dfc41cc1fc7add59fa0bc629fbfef6548860, data reload: false

query1	0.04	0.04	0.03
query2	0.09	0.03	0.04
query3	0.24	0.06	0.06
query4	1.63	0.10	0.10
query5	0.42	0.42	0.40
query6	1.19	0.66	0.65
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.59	0.52	0.53
query10	0.59	0.60	0.57
query11	0.15	0.10	0.11
query12	0.15	0.11	0.11
query13	0.61	0.60	0.62
query14	2.71	2.73	2.69
query15	0.92	0.85	0.85
query16	0.37	0.38	0.38
query17	1.03	1.02	1.02
query18	0.21	0.19	0.19
query19	1.90	1.83	2.02
query20	0.02	0.01	0.02
query21	15.36	0.88	0.53
query22	0.77	1.18	0.67
query23	15.24	1.35	0.65
query24	10.33	1.22	1.11
query25	0.49	0.20	0.07
query26	0.81	0.18	0.14
query27	0.05	0.04	0.05
query28	7.38	0.78	0.44
query29	12.61	3.88	3.22
query30	0.25	0.08	0.06
query31	2.83	0.59	0.38
query32	3.23	0.54	0.47
query33	3.00	3.01	3.02
query34	15.75	5.10	4.49
query35	4.55	4.48	4.55
query36	0.67	0.49	0.48
query37	0.08	0.06	0.07
query38	0.05	0.04	0.04
query39	0.02	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.71 s
Total hot run time: 30.75 s

1. select * should only return using columns from left relation
2. bind expression on using join should not do distinct slot by name on
   using join's output
@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31646 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e58e4d368100f29fe435ca3c684b2225c92914de, data reload: false

------ Round 1 ----------------------------------
q1	17595	5278	5110	5110
q2	2057	304	174	174
q3	10396	1348	722	722
q4	10215	1015	552	552
q5	7506	2446	2348	2348
q6	186	170	136	136
q7	903	757	611	611
q8	9311	1322	1132	1132
q9	4873	4613	4579	4579
q10	6836	2332	1916	1916
q11	477	275	255	255
q12	343	356	228	228
q13	17767	3694	3096	3096
q14	230	229	218	218
q15	505	479	468	468
q16	635	611	594	594
q17	567	852	340	340
q18	6897	6152	6239	6152
q19	1209	951	542	542
q20	316	333	201	201
q21	2737	2200	1966	1966
q22	366	333	306	306
Total cold run time: 101927 ms
Total hot run time: 31646 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5135	5140	5087	5087
q2	242	344	232	232
q3	2171	2655	2264	2264
q4	1399	1879	1392	1392
q5	4208	4134	4154	4134
q6	203	162	125	125
q7	1881	1832	1679	1679
q8	2612	2686	2563	2563
q9	7300	7151	7035	7035
q10	3040	3150	2747	2747
q11	587	504	496	496
q12	733	802	651	651
q13	3514	3953	3250	3250
q14	298	307	279	279
q15	506	464	472	464
q16	636	675	626	626
q17	1120	1613	1374	1374
q18	7572	7495	7255	7255
q19	787	824	843	824
q20	1972	2006	1822	1822
q21	5369	4972	4955	4955
q22	627	571	550	550
Total cold run time: 51912 ms
Total hot run time: 49804 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183018 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e58e4d368100f29fe435ca3c684b2225c92914de, data reload: false

query1	966	398	382	382
query2	6534	1810	1820	1810
query3	6801	216	212	212
query4	26411	23668	22860	22860
query5	4327	663	475	475
query6	290	221	194	194
query7	4601	505	308	308
query8	295	255	236	236
query9	8610	2530	2544	2530
query10	474	351	250	250
query11	15380	15094	14852	14852
query12	152	110	105	105
query13	1647	516	379	379
query14	9112	7077	6184	6184
query15	199	189	179	179
query16	7120	650	443	443
query17	907	695	535	535
query18	1941	394	306	306
query19	194	174	156	156
query20	127	115	110	110
query21	202	121	105	105
query22	4210	4139	4488	4139
query23	34417	33430	32975	32975
query24	7758	2400	2355	2355
query25	505	443	379	379
query26	1229	268	154	154
query27	2158	499	331	331
query28	3941	2416	2389	2389
query29	720	539	413	413
query30	225	181	152	152
query31	927	814	849	814
query32	76	66	59	59
query33	552	352	298	298
query34	765	845	515	515
query35	808	805	754	754
query36	954	992	907	907
query37	118	91	71	71
query38	4221	4136	4053	4053
query39	1432	1409	1388	1388
query40	208	111	101	101
query41	53	52	48	48
query42	127	102	104	102
query43	485	488	475	475
query44	1272	785	786	785
query45	175	167	158	158
query46	858	1034	649	649
query47	1739	1817	1742	1742
query48	396	426	305	305
query49	798	488	410	410
query50	701	725	427	427
query51	4125	4147	4144	4144
query52	103	99	98	98
query53	226	250	182	182
query54	503	497	415	415
query55	84	83	76	76
query56	277	290	268	268
query57	1111	1130	1061	1061
query58	257	254	242	242
query59	2522	2837	2548	2548
query60	288	276	278	276
query61	122	124	116	116
query62	758	725	669	669
query63	232	188	191	188
query64	4264	994	656	656
query65	3225	3130	3114	3114
query66	1134	394	301	301
query67	15582	15625	15413	15413
query68	2402	778	557	557
query69	449	300	262	262
query70	1184	1140	1138	1138
query71	332	311	258	258
query72	5888	3565	3760	3565
query73	638	815	357	357
query74	9148	9181	9020	9020
query75	3106	3144	2680	2680
query76	2216	1151	742	742
query77	337	369	282	282
query78	9910	10128	9309	9309
query79	978	887	611	611
query80	1224	538	440	440
query81	529	288	238	238
query82	402	125	97	97
query83	262	194	154	154
query84	294	89	78	78
query85	782	343	315	315
query86	374	285	271	271
query87	4407	4445	4427	4427
query88	2946	2236	2250	2236
query89	381	326	284	284
query90	1814	206	200	200
query91	135	148	112	112
query92	57	62	58	58
query93	1106	981	585	585
query94	652	405	295	295
query95	351	268	259	259
query96	493	543	297	297
query97	2739	2879	2681	2681
query98	245	201	200	200
query99	1309	1452	1284	1284
Total cold run time: 260021 ms
Total hot run time: 183018 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.65 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e58e4d368100f29fe435ca3c684b2225c92914de, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.03	0.03
query3	0.23	0.08	0.07
query4	1.61	0.10	0.11
query5	0.42	0.42	0.38
query6	1.18	0.68	0.64
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.50	0.52
query10	0.58	0.57	0.56
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.59	0.61
query14	2.70	2.70	2.74
query15	0.92	0.84	0.86
query16	0.36	0.38	0.39
query17	1.04	1.05	1.03
query18	0.21	0.20	0.20
query19	1.90	1.80	2.02
query20	0.02	0.01	0.01
query21	15.36	0.91	0.53
query22	0.78	1.40	0.91
query23	14.75	1.39	0.63
query24	7.36	1.34	0.61
query25	0.45	0.31	0.23
query26	0.67	0.16	0.13
query27	0.05	0.05	0.05
query28	9.57	0.93	0.42
query29	12.57	3.98	3.30
query30	0.26	0.08	0.07
query31	2.84	0.60	0.38
query32	3.24	0.56	0.47
query33	3.02	3.03	3.02
query34	15.87	5.13	4.50
query35	4.56	4.49	4.52
query36	0.66	0.49	0.48
query37	0.09	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.12	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.04
Total cold run time: 105.32 s
Total hot run time: 30.65 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 20, 2025
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@morrySnow morrySnow merged commit 5a7454e into apache:master Feb 21, 2025
25 of 26 checks passed
@morrySnow morrySnow deleted the fix_using_join branch February 21, 2025 12:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. kind/behavior-changed reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants