Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [fix](nereids) analyzing job should not be blocked by enable_stats=false #46630 #46690

Open
wants to merge 1 commit into
base: branch-3.0
Choose a base branch
from

Conversation

github-actions[bot]
Copy link
Contributor

@github-actions github-actions bot commented Jan 9, 2025

Cherry-picked from #46630

…lse (#46630)

### What problem does this PR solve?

 enable_stats is used to tell planner use column stats or not. It should not block analyze job
@Thearas
Copy link
Contributor

Thearas commented Jan 9, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this Jan 9, 2025
@dataroaring dataroaring reopened this Jan 9, 2025
@Thearas
Copy link
Contributor

Thearas commented Jan 9, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40683 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3292a27f6685bc1a3354bf748ad2f7673f7c4e56, data reload: false

------ Round 1 ----------------------------------
q1	17607	7627	7197	7197
q2	2048	176	170	170
q3	10819	1077	1115	1077
q4	10550	719	776	719
q5	7737	2846	2729	2729
q6	237	148	142	142
q7	976	609	604	604
q8	9349	1938	1974	1938
q9	6589	6406	6373	6373
q10	7043	2250	2286	2250
q11	470	279	267	267
q12	404	213	213	213
q13	17817	3032	3019	3019
q14	237	209	222	209
q15	586	542	525	525
q16	707	610	635	610
q17	965	684	550	550
q18	7298	6878	6891	6878
q19	1395	1038	1056	1038
q20	473	215	208	208
q21	3992	3228	2988	2988
q22	1068	988	979	979
Total cold run time: 108367 ms
Total hot run time: 40683 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7229	7195	7201	7195
q2	330	232	234	232
q3	2890	2950	2933	2933
q4	2030	1804	1830	1804
q5	5702	5719	5708	5708
q6	228	139	139	139
q7	2248	1808	1834	1808
q8	3351	3486	3495	3486
q9	8818	8840	8846	8840
q10	3564	3513	3498	3498
q11	600	516	491	491
q12	792	600	621	600
q13	10202	3130	3131	3130
q14	294	266	269	266
q15	572	529	520	520
q16	711	705	664	664
q17	1852	1729	1605	1605
q18	8332	7767	7597	7597
q19	1684	1541	1537	1537
q20	2104	1908	1852	1852
q21	5484	5427	5245	5245
q22	1134	1052	1025	1025
Total cold run time: 70151 ms
Total hot run time: 60175 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197127 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3292a27f6685bc1a3354bf748ad2f7673f7c4e56, data reload: false

query1	1339	932	918	918
query2	6230	2136	2001	2001
query3	10851	4328	4349	4328
query4	65781	30247	23443	23443
query5	5058	448	436	436
query6	404	177	170	170
query7	5631	307	311	307
query8	306	216	222	216
query9	9052	2682	2680	2680
query10	449	267	255	255
query11	17386	15048	15919	15048
query12	155	103	104	103
query13	1543	451	425	425
query14	10434	8088	6787	6787
query15	221	178	187	178
query16	6978	470	495	470
query17	1058	570	579	570
query18	1657	325	309	309
query19	207	156	158	156
query20	119	107	110	107
query21	214	108	101	101
query22	4746	4664	4499	4499
query23	34921	34198	34240	34198
query24	6121	2984	2906	2906
query25	543	442	426	426
query26	676	167	171	167
query27	1822	351	368	351
query28	4606	2507	2476	2476
query29	744	486	451	451
query30	235	163	164	163
query31	1005	818	846	818
query32	66	61	60	60
query33	416	304	296	296
query34	920	511	535	511
query35	855	731	727	727
query36	1070	973	970	970
query37	120	76	72	72
query38	4116	4142	4078	4078
query39	1536	1496	1500	1496
query40	202	102	101	101
query41	53	51	50	50
query42	117	108	102	102
query43	532	509	492	492
query44	1213	851	823	823
query45	183	168	167	167
query46	1118	749	761	749
query47	2019	1935	1920	1920
query48	507	402	390	390
query49	757	388	383	383
query50	824	423	424	423
query51	7345	7269	7193	7193
query52	103	90	96	90
query53	258	186	183	183
query54	549	449	456	449
query55	78	81	79	79
query56	270	243	250	243
query57	1199	1093	1109	1093
query58	215	200	208	200
query59	3178	2905	3185	2905
query60	278	254	259	254
query61	132	115	105	105
query62	784	650	675	650
query63	218	192	187	187
query64	1282	666	632	632
query65	3262	3208	3202	3202
query66	696	326	298	298
query67	16113	15889	15467	15467
query68	4123	584	568	568
query69	437	271	266	266
query70	1210	1145	1111	1111
query71	321	268	251	251
query72	6322	4097	4002	4002
query73	750	347	349	347
query74	10218	9107	9005	9005
query75	3341	2687	2674	2674
query76	1884	1125	1073	1073
query77	531	267	276	267
query78	10559	9640	9582	9582
query79	1680	601	595	595
query80	1518	421	426	421
query81	528	245	239	239
query82	1261	115	121	115
query83	271	146	145	145
query84	282	82	75	75
query85	1045	344	297	297
query86	405	301	299	299
query87	4431	4247	4335	4247
query88	3644	2388	2346	2346
query89	421	287	297	287
query90	1977	189	183	183
query91	183	149	149	149
query92	69	49	50	49
query93	2268	555	544	544
query94	833	295	292	292
query95	359	255	255	255
query96	630	283	286	283
query97	3390	3184	3181	3181
query98	214	208	197	197
query99	1587	1279	1305	1279
Total cold run time: 319768 ms
Total hot run time: 197127 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.32 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3292a27f6685bc1a3354bf748ad2f7673f7c4e56, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.06	0.06
query4	1.62	0.10	0.10
query5	0.52	0.52	0.50
query6	1.12	0.73	0.73
query7	0.02	0.02	0.02
query8	0.04	0.05	0.04
query9	0.58	0.51	0.51
query10	0.55	0.54	0.56
query11	0.14	0.11	0.11
query12	0.15	0.11	0.11
query13	0.61	0.60	0.59
query14	2.96	2.92	2.94
query15	0.91	0.82	0.84
query16	0.38	0.36	0.38
query17	1.01	1.07	1.04
query18	0.23	0.21	0.22
query19	1.85	1.89	2.02
query20	0.01	0.01	0.01
query21	15.35	0.58	0.57
query22	2.62	2.83	2.08
query23	17.24	0.83	0.86
query24	3.70	0.98	1.15
query25	0.21	0.08	0.10
query26	0.48	0.14	0.14
query27	0.05	0.05	0.03
query28	9.98	1.14	1.08
query29	12.58	3.18	3.18
query30	0.25	0.05	0.05
query31	2.86	0.38	0.37
query32	3.25	0.46	0.47
query33	2.98	3.02	3.06
query34	16.86	4.52	4.52
query35	4.51	4.50	4.52
query36	0.65	0.50	0.50
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.13	0.12
query41	0.08	0.02	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.11 s
Total hot run time: 33.32 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants