hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vineet Garg <vg...@hortonworks.com>
Subject Re: Review Request 61165: HIVE-16811 Estimate statistics in absence of stats
Date Wed, 23 Aug 2017 20:38:05 GMT


> On Aug. 16, 2017, 10:58 p.m., Ashutosh Chauhan wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/RelOptHiveTable.java
> > Lines 304 (patched)
> > <https://reviews.apache.org/r/61165/diff/2/?file=1793116#file1793116line311>
> >
> >     Can this ever be null ?

I think it could be null for columns which have complex data type


> On Aug. 16, 2017, 10:58 p.m., Ashutosh Chauhan wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/stats/StatsUtils.java
> > Lines 227 (patched)
> > <https://reviews.apache.org/r/61165/diff/2/?file=1793118#file1793118line227>
> >
> >     I think we shall intro a config variable here, which can be configured to
> >     a) Throw unchecked exception which is not caught above and fails query: mostly
for testing.
> >     b) warning: should be default. Shall print warning about missing stats. Logic
which is there in RelOptHiveTable.
> >     c) Throw checked exception: which is caught above and turns off cbo. This will
be useful for cloud setting, where any FS interaction is slow and not worth slowing down compilation.

Regarding c) Problem with adding this functionality is that this code is shared among logical
planning and physical planning. Throwing checked exception will work for logical planning
only but not physical planning and I don't think we want to throw an exception during physical
planning when there is nothing to fall back on. Regarding a) I am not sure what are the scenarios
where we will ever need this for testing. I am concerned about making this code more complicated
by introducing too many configs/code paths. Regarding b) I agree we should have a way to warn
users about missing statistics. I'll add code to show warnings about missing stats.


> On Aug. 16, 2017, 10:58 p.m., Ashutosh Chauhan wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/stats/StatsUtils.java
> > Lines 295-296 (original), 371-374 (patched)
> > <https://reviews.apache.org/r/61165/diff/2/?file=1793118#file1793118line371>
> >
> >     Can be merged.

Sorry not sure what you mean by that. Can you explain what could be merged?


> On Aug. 16, 2017, 10:58 p.m., Ashutosh Chauhan wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/stats/StatsUtils.java
> > Lines 866 (patched)
> > <https://reviews.apache.org/r/61165/diff/2/?file=1793118#file1793118line866>
> >
> >     Same config as described above can be used here too.

See above response.


> On Aug. 16, 2017, 10:58 p.m., Ashutosh Chauhan wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/stats/StatsUtils.java
> > Lines 868 (patched)
> > <https://reviews.apache.org/r/61165/diff/2/?file=1793118#file1793118line868>
> >
> >     Also, colstate should be set to NONE in this case.

ColStatistics do not keep any state, Statistics keep the state which is dervied based on if
there is ColStatistics object or not. 
So we can't mark the state to NONE here. So we will to go through methods which call this
function and set the state there. I'll update the code


> On Aug. 16, 2017, 10:58 p.m., Ashutosh Chauhan wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/stats/StatsUtils.java
> > Lines 914 (patched)
> > <https://reviews.apache.org/r/61165/diff/2/?file=1793118#file1793118line914>
> >
> >     its an estimate anyway, may use hive.stats.max.variable.length to return this.

The estimation is not done assuming that hive doesn't support computing column statistics
for complex data type. Let me add estimation for complex data types in another patch because
I don't know what are the repercussions of adding estimation for complex data types. I don't
think it is trivial either and I would like to do it properly.


> On Aug. 16, 2017, 10:58 p.m., Ashutosh Chauhan wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/stats/StatsUtils.java
> > Lines 1220 (patched)
> > <https://reviews.apache.org/r/61165/diff/2/?file=1793118#file1793118line1220>
> >
> >     Better is to traverse inside this complex type and do recursive call of this
method. 
> >     Or, leave a TODO and use hive.stats.max.variable.length, hive.stats.list.num.entries
, hive.stats.map.num.entries configs to make an estimate.

Since we just get the name of datatype it is not possible to traverse within types here. I'll
see if we can add an estimate for complex data types


- Vineet


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/61165/#review183073
-----------------------------------------------------------


On Aug. 8, 2017, 8:10 p.m., Vineet Garg wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/61165/
> -----------------------------------------------------------
> 
> (Updated Aug. 8, 2017, 8:10 p.m.)
> 
> 
> Review request for hive and Ashutosh Chauhan.
> 
> 
> Bugs: HIVE-16811
>     https://issues.apache.org/jira/browse/HIVE-16811
> 
> 
> Repository: hive-git
> 
> 
> Description
> -------
> 
> This patch introduces estimation of statistics if stats doesn't already exist.
> 
> 
> Diffs
> -----
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java c16880ed2b 
>   itests/src/test/resources/testconfiguration.properties 772113acda 
>   ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/RelOptHiveTable.java 1d49568c8c

>   ql/src/java/org/apache/hadoop/hive/ql/optimizer/stats/annotation/StatsRulesProcFactory.java
6cb0559ea0 
>   ql/src/java/org/apache/hadoop/hive/ql/stats/StatsUtils.java 3b9ab41bed 
>   ql/src/test/queries/clientpositive/join_reordering_no_stats.q PRE-CREATION 
>   ql/src/test/results/clientpositive/annotate_stats_filter.q.out e22c3ef0fc 
>   ql/src/test/results/clientpositive/annotate_stats_groupby.q.out fccfabd5d1 
>   ql/src/test/results/clientpositive/annotate_stats_part.q.out 866d30a8ea 
>   ql/src/test/results/clientpositive/annotate_stats_select.q.out 67d134ba4a 
>   ql/src/test/results/clientpositive/annotate_stats_table.q.out efc3c1f123 
>   ql/src/test/results/clientpositive/auto_join_reordering_values.q.out 156be41502 
>   ql/src/test/results/clientpositive/auto_join_stats.q.out e80af96fcb 
>   ql/src/test/results/clientpositive/auto_join_stats2.q.out 6ea5afa920 
>   ql/src/test/results/clientpositive/auto_sortmerge_join_12.q.out d129807f55 
>   ql/src/test/results/clientpositive/cbo_rp_annotate_stats_groupby.q.out 23f5fcfc76 
>   ql/src/test/results/clientpositive/columnStatsUpdateForStatsOptimizer_2.q.out a7c9b3fc41

>   ql/src/test/results/clientpositive/explain_rearrange.q.out 2e5f9e4626 
>   ql/src/test/results/clientpositive/filter_join_breaktask.q.out 8f9b6363f4 
>   ql/src/test/results/clientpositive/join19.q.out dd167ecabf 
>   ql/src/test/results/clientpositive/join42.q.out 0cd31c6d66 
>   ql/src/test/results/clientpositive/join43.q.out 24168ca4fe 
>   ql/src/test/results/clientpositive/join_cond_pushdown_unqual1.q.out f77c75c232 
>   ql/src/test/results/clientpositive/join_cond_pushdown_unqual2.q.out f04519f8c5 
>   ql/src/test/results/clientpositive/join_cond_pushdown_unqual3.q.out f15d536945 
>   ql/src/test/results/clientpositive/join_cond_pushdown_unqual4.q.out 1ec5dc415c 
>   ql/src/test/results/clientpositive/join_hive_626.q.out 33a5fbd628 
>   ql/src/test/results/clientpositive/join_star.q.out 261fb53bf9 
>   ql/src/test/results/clientpositive/llap/acid_bucket_pruning.q.out 97f8d6b4cc 
>   ql/src/test/results/clientpositive/llap/auto_smb_mapjoin_14.q.out 8bc280cedd 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_1.q.out 4b646dcba5 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_10.q.out ab94c37fed 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_11.q.out 7e3fe4c862 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_12.q.out 054cf1af7e 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_13.q.out 9c37848896 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_14.q.out 21f1b3faff 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_15.q.out 03ff5a6659 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_2.q.out 42e4cb7a5c 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_3.q.out 64c10ce953 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_4.q.out 96854a9665 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_5.q.out b77a879b78 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_6.q.out 9e6053675b 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_7.q.out 13d3accf4c 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_8.q.out 7fc90fd19f 
>   ql/src/test/results/clientpositive/llap/auto_sortmerge_join_9.q.out 278c55b3e4 
>   ql/src/test/results/clientpositive/llap/bucket_groupby.q.out 5913768a6d 
>   ql/src/test/results/clientpositive/llap/bucket_map_join_tez1.q.out 649afb502a 
>   ql/src/test/results/clientpositive/llap/bucket_map_join_tez2.q.out bac4ae086c 
>   ql/src/test/results/clientpositive/llap/bucketmapjoin1.q.out feb3bbcfc4 
>   ql/src/test/results/clientpositive/llap/bucketmapjoin2.q.out bda8070ba5 
>   ql/src/test/results/clientpositive/llap/bucketmapjoin3.q.out ae17c1b707 
>   ql/src/test/results/clientpositive/llap/bucketmapjoin4.q.out aab43431e6 
>   ql/src/test/results/clientpositive/llap/bucketmapjoin7.q.out 3a2cbb2b14 
>   ql/src/test/results/clientpositive/llap/bucketpruning1.q.out 922f23a29e 
>   ql/src/test/results/clientpositive/llap/bucketsortoptimize_insert_2.q.out e4fed1124b

>   ql/src/test/results/clientpositive/llap/bucketsortoptimize_insert_6.q.out 67e925ad99

>   ql/src/test/results/clientpositive/llap/bucketsortoptimize_insert_7.q.out 8691d0d34e

>   ql/src/test/results/clientpositive/llap/columnStatsUpdateForStatsOptimizer_1.q.out
6d941fd4f2 
>   ql/src/test/results/clientpositive/llap/column_access_stats.q.out c56c818617 
>   ql/src/test/results/clientpositive/llap/column_table_stats.q.out c7726fec30 
>   ql/src/test/results/clientpositive/llap/column_table_stats_orc.q.out 6dff50f9f1 
>   ql/src/test/results/clientpositive/llap/constprog_dpp.q.out 8f51db31b8 
>   ql/src/test/results/clientpositive/llap/constprog_semijoin.q.out 4bdb186dfa 
>   ql/src/test/results/clientpositive/llap/correlationoptimizer4.q.out 0f8ce658e5 
>   ql/src/test/results/clientpositive/llap/count.q.out 0ef26e57ab 
>   ql/src/test/results/clientpositive/llap/cross_product_check_1.q.out 2bc17cb532 
>   ql/src/test/results/clientpositive/llap/cross_product_check_2.q.out c8657881ee 
>   ql/src/test/results/clientpositive/llap/cte_3.q.out b6cda54493 
>   ql/src/test/results/clientpositive/llap/cte_5.q.out 58a963b8a2 
>   ql/src/test/results/clientpositive/llap/cte_mat_3.q.out 31c59596f6 
>   ql/src/test/results/clientpositive/llap/cte_mat_4.q.out c23e9851c5 
>   ql/src/test/results/clientpositive/llap/cte_mat_5.q.out 6fa26157a7 
>   ql/src/test/results/clientpositive/llap/disable_merge_for_bucketing.q.out 4a2294f71e

>   ql/src/test/results/clientpositive/llap/dynamic_partition_pruning.q.out 3de40ce871

>   ql/src/test/results/clientpositive/llap/dynamic_partition_pruning_2.q.out e78429fc7f

>   ql/src/test/results/clientpositive/llap/dynamic_semijoin_reduction_2.q.out 1da1121d6a

>   ql/src/test/results/clientpositive/llap/dynamic_semijoin_reduction_3.q.out 78c907084a

>   ql/src/test/results/clientpositive/llap/dynpart_sort_opt_vectorization.q.out 453711c57c

>   ql/src/test/results/clientpositive/llap/dynpart_sort_optimization.q.out 1dc9ed5a8c

>   ql/src/test/results/clientpositive/llap/dynpart_sort_optimization2.q.out 90756c6776

>   ql/src/test/results/clientpositive/llap/dynpart_sort_optimization_acid.q.out 788854aa04

>   ql/src/test/results/clientpositive/llap/empty_join.q.out 19aa89f068 
>   ql/src/test/results/clientpositive/llap/except_distinct.q.out 7d2222bb6d 
>   ql/src/test/results/clientpositive/llap/explainuser_1.q.out b36fe2a83f 
>   ql/src/test/results/clientpositive/llap/explainuser_2.q.out 4f1a4a1f14 
>   ql/src/test/results/clientpositive/llap/filter_join_breaktask.q.out c5cdb77afc 
>   ql/src/test/results/clientpositive/llap/hybridgrace_hashjoin_1.q.out b63ad36ac1 
>   ql/src/test/results/clientpositive/llap/insert1.q.out aa09585da8 
>   ql/src/test/results/clientpositive/llap/insert_into1.q.out 5caefe8e43 
>   ql/src/test/results/clientpositive/llap/intersect_all.q.out 1a3a035b0b 
>   ql/src/test/results/clientpositive/llap/intersect_distinct.q.out a871ba3ef5 
>   ql/src/test/results/clientpositive/llap/intersect_merge.q.out 654cd64166 
>   ql/src/test/results/clientpositive/llap/jdbc_handler.q.out 54f5a4e8e4 
>   ql/src/test/results/clientpositive/llap/join46.q.out 079acddb28 
>   ql/src/test/results/clientpositive/llap/join_emit_interval.q.out 4dfb09bdea 
>   ql/src/test/results/clientpositive/llap/join_is_not_distinct_from.q.out eaf09ca056

>   ql/src/test/results/clientpositive/llap/join_nullsafe.q.out 71685aa9db 
>   ql/src/test/results/clientpositive/llap/join_reordering_no_stats.q.out PRE-CREATION

>   ql/src/test/results/clientpositive/llap/lateral_view.q.out 7e4ad81324 
>   ql/src/test/results/clientpositive/llap/llap_nullscan.q.out 430bdaf834 
>   ql/src/test/results/clientpositive/llap/llap_partitioned.q.out d35501e82b 
>   ql/src/test/results/clientpositive/llap/llap_smb.q.out f5eec29172 
>   ql/src/test/results/clientpositive/llap/llap_stats.q.out fda614f7b5 
>   ql/src/test/results/clientpositive/llap/llap_udf.q.out 7a95c8b4b7 
>   ql/src/test/results/clientpositive/llap/llapdecider.q.out 9411169802 
>   ql/src/test/results/clientpositive/llap/lvj_mapjoin.q.out c7c4c70916 
>   ql/src/test/results/clientpositive/llap/mapjoin3.q.out 45992144d1 
>   ql/src/test/results/clientpositive/llap/mapjoin46.q.out efada10a2b 
>   ql/src/test/results/clientpositive/llap/mapjoin_decimal.q.out 38b8f92701 
>   ql/src/test/results/clientpositive/llap/mapjoin_emit_interval.q.out fdbca8af8d 
>   ql/src/test/results/clientpositive/llap/merge1.q.out 649c2f714b 
>   ql/src/test/results/clientpositive/llap/merge2.q.out dd726894fd 
>   ql/src/test/results/clientpositive/llap/mergejoin.q.out 9df5e42df2 
>   ql/src/test/results/clientpositive/llap/metadata_only_queries.q.out 594e7e7fd6 
>   ql/src/test/results/clientpositive/llap/multiMapJoin1.q.out 6d756a822e 
>   ql/src/test/results/clientpositive/llap/multiMapJoin2.q.out 8e7b456d0c 
>   ql/src/test/results/clientpositive/llap/multi_count_distinct_null.q.out 0f4f803369

>   ql/src/test/results/clientpositive/llap/multi_insert_lateral_view.q.out e5497d5a79

>   ql/src/test/results/clientpositive/llap/optimize_nullscan.q.out ea129b44e9 
>   ql/src/test/results/clientpositive/llap/orc_llap_nonvector.q.out 01adcd47fa 
>   ql/src/test/results/clientpositive/llap/orc_merge3.q.out fd79d9d05f 
>   ql/src/test/results/clientpositive/llap/orc_merge4.q.out 6e2617b15d 
>   ql/src/test/results/clientpositive/llap/orc_merge5.q.out 47096bba65 
>   ql/src/test/results/clientpositive/llap/orc_merge6.q.out 3969a9631c 
>   ql/src/test/results/clientpositive/llap/orc_merge7.q.out d86d2dcf2c 
>   ql/src/test/results/clientpositive/llap/orc_merge_incompat1.q.out e5101f449d 
>   ql/src/test/results/clientpositive/llap/orc_merge_incompat2.q.out 6fcb45a600 
>   ql/src/test/results/clientpositive/llap/orc_predicate_pushdown.q.out 8c6f97e613 
>   ql/src/test/results/clientpositive/llap/parquet_predicate_pushdown.q.out aecbcfdfe4

>   ql/src/test/results/clientpositive/llap/partition_shared_scan.q.out bd3d247d48 
>   ql/src/test/results/clientpositive/llap/ppd_union_view.q.out 543d17630a 
>   ql/src/test/results/clientpositive/llap/ptf_matchpath.q.out 6c60f98192 
>   ql/src/test/results/clientpositive/llap/rcfile_createas1.q.out 7d1f52657c 
>   ql/src/test/results/clientpositive/llap/rcfile_merge3.q.out 11b0b48189 
>   ql/src/test/results/clientpositive/llap/rcfile_merge4.q.out 443014b99e 
>   ql/src/test/results/clientpositive/llap/reduce_deduplicate.q.out d74e4c7c78 
>   ql/src/test/results/clientpositive/llap/reduce_deduplicate_distinct.q.out e5b8d11c58

>   ql/src/test/results/clientpositive/llap/sample10.q.out a3da78754f 
>   ql/src/test/results/clientpositive/llap/schema_evol_orc_nonvec_part.q.out 0ebb378d08

>   ql/src/test/results/clientpositive/llap/schema_evol_orc_nonvec_part_all_complex.q.out
22c7745345 
>   ql/src/test/results/clientpositive/llap/schema_evol_orc_nonvec_part_all_primitive.q.out
4e94322705 
>   ql/src/test/results/clientpositive/llap/schema_evol_orc_nonvec_table.q.out 103284ea03

>   ql/src/test/results/clientpositive/llap/schema_evol_orc_vec_part.q.out c6fc7b5dc6 
>   ql/src/test/results/clientpositive/llap/schema_evol_orc_vec_part_all_complex.q.out
f57481dcc1 
>   ql/src/test/results/clientpositive/llap/schema_evol_orc_vec_part_all_primitive.q.out
3a5232ad2e 
>   ql/src/test/results/clientpositive/llap/schema_evol_orc_vec_table.q.out 2cd6005c55

>   ql/src/test/results/clientpositive/llap/schema_evol_text_nonvec_part.q.out 8daee2883f

>   ql/src/test/results/clientpositive/llap/schema_evol_text_nonvec_part_all_complex.q.out
12c7db4af8 
>   ql/src/test/results/clientpositive/llap/schema_evol_text_nonvec_part_all_primitive.q.out
757ea3a6c0 
>   ql/src/test/results/clientpositive/llap/schema_evol_text_nonvec_table.q.out e0a4ffb6ef

>   ql/src/test/results/clientpositive/llap/schema_evol_text_vec_part.q.out 45635eeb4c

>   ql/src/test/results/clientpositive/llap/schema_evol_text_vec_part_all_complex.q.out
5e0c8f709a 
>   ql/src/test/results/clientpositive/llap/schema_evol_text_vec_part_all_primitive.q.out
17b078fb0c 
>   ql/src/test/results/clientpositive/llap/schema_evol_text_vec_table.q.out 2faf88a3fe

>   ql/src/test/results/clientpositive/llap/schema_evol_text_vecrow_part.q.out d687506241

>   ql/src/test/results/clientpositive/llap/schema_evol_text_vecrow_part_all_complex.q.out
afaf69faf3 
>   ql/src/test/results/clientpositive/llap/schema_evol_text_vecrow_part_all_primitive.q.out
59d6797d63 
>   ql/src/test/results/clientpositive/llap/schema_evol_text_vecrow_table.q.out 2fb3fe8111

>   ql/src/test/results/clientpositive/llap/semijoin.q.out 57866737f3 
>   ql/src/test/results/clientpositive/llap/skewjoin.q.out f4fc43edfa 
>   ql/src/test/results/clientpositive/llap/skewjoinopt15.q.out 1f667c0873 
>   ql/src/test/results/clientpositive/llap/smb_cache.q.out 932b21105b 
>   ql/src/test/results/clientpositive/llap/smb_mapjoin_14.q.out 63984cc941 
>   ql/src/test/results/clientpositive/llap/smb_mapjoin_15.q.out df89454387 
>   ql/src/test/results/clientpositive/llap/smb_mapjoin_17.q.out 183c022a5d 
>   ql/src/test/results/clientpositive/llap/smb_mapjoin_18.q.out e2d5e4e4c2 
>   ql/src/test/results/clientpositive/llap/smb_mapjoin_19.q.out c3b29ea2bd 
>   ql/src/test/results/clientpositive/llap/smb_mapjoin_4.q.out fbfc902e85 
>   ql/src/test/results/clientpositive/llap/smb_mapjoin_5.q.out 1589329c38 
>   ql/src/test/results/clientpositive/llap/smb_mapjoin_6.q.out 2c1ee962bc 
>   ql/src/test/results/clientpositive/llap/sqlmerge.q.out 562d4440ba 
>   ql/src/test/results/clientpositive/llap/stats11.q.out 48d76cf179 
>   ql/src/test/results/clientpositive/llap/stats_only_null.q.out ab91ea738c 
>   ql/src/test/results/clientpositive/llap/subquery_exists.q.out 4d223923a7 
>   ql/src/test/results/clientpositive/llap/subquery_in.q.out a8312896dc 
>   ql/src/test/results/clientpositive/llap/subquery_multi.q.out 5673f0ee8c 
>   ql/src/test/results/clientpositive/llap/subquery_notin.q.out 3c6e95ae70 
>   ql/src/test/results/clientpositive/llap/subquery_scalar.q.out 05d4fc8093 
>   ql/src/test/results/clientpositive/llap/subquery_select.q.out fd108986b9 
>   ql/src/test/results/clientpositive/llap/sysdb.q.out d476b3b1a7 
>   ql/src/test/results/clientpositive/llap/table_access_keys_stats.q.out 85459229f5 
>   ql/src/test/results/clientpositive/llap/temp_table.q.out e97b3dd741 
>   ql/src/test/results/clientpositive/llap/tez_bmj_schema_evolution.q.out c83da8b123 
>   ql/src/test/results/clientpositive/llap/tez_dml.q.out ece6946fb8 
>   ql/src/test/results/clientpositive/llap/tez_join.q.out 69a830d2d2 
>   ql/src/test/results/clientpositive/llap/tez_join_hash.q.out e313bad4dc 
>   ql/src/test/results/clientpositive/llap/tez_join_result_complex.q.out a7ec89529b 
>   ql/src/test/results/clientpositive/llap/tez_nway_join.q.out 86f040234b 
>   ql/src/test/results/clientpositive/llap/tez_self_join.q.out 8ba9761d76 
>   ql/src/test/results/clientpositive/llap/tez_smb_1.q.out 2fcf0fc71c 
>   ql/src/test/results/clientpositive/llap/tez_smb_empty.q.out e4c246afec 
>   ql/src/test/results/clientpositive/llap/tez_smb_main.q.out e5f6940e48 
>   ql/src/test/results/clientpositive/llap/tez_union_group_by.q.out 67cd110a61 
>   ql/src/test/results/clientpositive/llap/unionDistinct_1.q.out 8d97fa4fab 
>   ql/src/test/results/clientpositive/llap/union_remove_26.q.out 9ddc2c807e 
>   ql/src/test/results/clientpositive/llap/vector_adaptor_usage_mode.q.out e63cbf8063

>   ql/src/test/results/clientpositive/llap/vector_aggregate_9.q.out cf3dc23281 
>   ql/src/test/results/clientpositive/llap/vector_aggregate_without_gby.q.out 0cf62d364c

>   ql/src/test/results/clientpositive/llap/vector_auto_smb_mapjoin_14.q.out b4386c8673

>   ql/src/test/results/clientpositive/llap/vector_between_columns.q.out bcf9cd268c 
>   ql/src/test/results/clientpositive/llap/vector_between_in.q.out 664e342990 
>   ql/src/test/results/clientpositive/llap/vector_binary_join_groupby.q.out 9f059b9312

>   ql/src/test/results/clientpositive/llap/vector_bround.q.out d463f1a6e7 
>   ql/src/test/results/clientpositive/llap/vector_bucket.q.out 6dd0cfb8b0 
>   ql/src/test/results/clientpositive/llap/vector_cast_constant.q.out 2b8aaaa0df 
>   ql/src/test/results/clientpositive/llap/vector_char_2.q.out 48c62812f0 
>   ql/src/test/results/clientpositive/llap/vector_char_4.q.out d164ebef3c 
>   ql/src/test/results/clientpositive/llap/vector_char_mapjoin1.q.out ab67adcc35 
>   ql/src/test/results/clientpositive/llap/vector_coalesce_2.q.out 55a1d4208a 
>   ql/src/test/results/clientpositive/llap/vector_coalesce_3.q.out 85ddc7cc8d 
>   ql/src/test/results/clientpositive/llap/vector_complex_all.q.out 4503cc4696 
>   ql/src/test/results/clientpositive/llap/vector_complex_join.q.out e389cd36c2 
>   ql/src/test/results/clientpositive/llap/vector_count.q.out c1a24cceb7 
>   ql/src/test/results/clientpositive/llap/vector_count_distinct.q.out d45a15ffb8 
>   ql/src/test/results/clientpositive/llap/vector_data_types.q.out b9bb0a20aa 
>   ql/src/test/results/clientpositive/llap/vector_date_1.q.out d80da7ea65 
>   ql/src/test/results/clientpositive/llap/vector_decimal_1.q.out b3ff557bf4 
>   ql/src/test/results/clientpositive/llap/vector_decimal_10_0.q.out f105c5ad2f 
>   ql/src/test/results/clientpositive/llap/vector_decimal_2.q.out 947ac81001 
>   ql/src/test/results/clientpositive/llap/vector_decimal_aggregate.q.out 8ea03f7446 
>   ql/src/test/results/clientpositive/llap/vector_decimal_expressions.q.out 28478077ec

>   ql/src/test/results/clientpositive/llap/vector_decimal_mapjoin.q.out c62e25a0e5 
>   ql/src/test/results/clientpositive/llap/vector_decimal_math_funcs.q.out e0c680e169

>   ql/src/test/results/clientpositive/llap/vector_decimal_precision.q.out 3f32eb2822 
>   ql/src/test/results/clientpositive/llap/vector_decimal_round.q.out d7a4e87396 
>   ql/src/test/results/clientpositive/llap/vector_decimal_round_2.q.out a3bf091fc1 
>   ql/src/test/results/clientpositive/llap/vector_decimal_udf.q.out 56127a51f4 
>   ql/src/test/results/clientpositive/llap/vector_decimal_udf2.q.out e00de78470 
>   ql/src/test/results/clientpositive/llap/vector_distinct_2.q.out b7f6a80686 
>   ql/src/test/results/clientpositive/llap/vector_groupby4.q.out 43995549f6 
>   ql/src/test/results/clientpositive/llap/vector_groupby6.q.out a91b715780 
>   ql/src/test/results/clientpositive/llap/vector_groupby_3.q.out cd9ff27350 
>   ql/src/test/results/clientpositive/llap/vector_groupby_cube1.q.out ced38dc564 
>   ql/src/test/results/clientpositive/llap/vector_groupby_grouping_id1.q.out aabe7d6933

>   ql/src/test/results/clientpositive/llap/vector_groupby_grouping_id2.q.out d16044c0e9

>   ql/src/test/results/clientpositive/llap/vector_groupby_grouping_id3.q.out 22a71e4eeb

>   ql/src/test/results/clientpositive/llap/vector_groupby_grouping_sets1.q.out 5d3434792f

>   ql/src/test/results/clientpositive/llap/vector_groupby_grouping_sets2.q.out 4deef94c54

>   ql/src/test/results/clientpositive/llap/vector_groupby_grouping_sets3.q.out 95964155ad

>   ql/src/test/results/clientpositive/llap/vector_groupby_grouping_sets4.q.out 4f914c8525

>   ql/src/test/results/clientpositive/llap/vector_groupby_grouping_sets5.q.out c9b666c2de

>   ql/src/test/results/clientpositive/llap/vector_groupby_grouping_sets6.q.out 4081ea966b

>   ql/src/test/results/clientpositive/llap/vector_groupby_grouping_sets_grouping.q.out
fccb6d6f54 
>   ql/src/test/results/clientpositive/llap/vector_groupby_grouping_sets_limit.q.out 18e032a398

>   ql/src/test/results/clientpositive/llap/vector_groupby_grouping_window.q.out 5d0b23c7c7

>   ql/src/test/results/clientpositive/llap/vector_groupby_reduce.q.out 56afa70575 
>   ql/src/test/results/clientpositive/llap/vector_groupby_rollup1.q.out d1002e486b 
>   ql/src/test/results/clientpositive/llap/vector_grouping_sets.q.out a84da2ccd8 
>   ql/src/test/results/clientpositive/llap/vector_include_no_sel.q.out f5cbe53836 
>   ql/src/test/results/clientpositive/llap/vector_inner_join.q.out 3e2ed6f1b5 
>   ql/src/test/results/clientpositive/llap/vector_interval_1.q.out bc3486fd9a 
>   ql/src/test/results/clientpositive/llap/vector_interval_2.q.out 1509926360 
>   ql/src/test/results/clientpositive/llap/vector_interval_arithmetic.q.out 2d4db5ecfa

>   ql/src/test/results/clientpositive/llap/vector_interval_mapjoin.q.out 0024fea77a 
>   ql/src/test/results/clientpositive/llap/vector_join30.q.out 6b5e604b33 
>   ql/src/test/results/clientpositive/llap/vector_left_outer_join2.q.out 8912bd47a4 
>   ql/src/test/results/clientpositive/llap/vector_leftsemi_mapjoin.q.out c02f879d02 
>   ql/src/test/results/clientpositive/llap/vector_mr_diff_schema_alias.q.out 03c6d3fe54

>   ql/src/test/results/clientpositive/llap/vector_multi_insert.q.out d537297c85 
>   ql/src/test/results/clientpositive/llap/vector_nullsafe_join.q.out 6225986136 
>   ql/src/test/results/clientpositive/llap/vector_number_compare_projection.q.out a172fd2b15

>   ql/src/test/results/clientpositive/llap/vector_orderby_5.q.out a99cb2b412 
>   ql/src/test/results/clientpositive/llap/vector_outer_join0.q.out 5017c00239 
>   ql/src/test/results/clientpositive/llap/vector_partition_diff_num_cols.q.out 4683b4bb62

>   ql/src/test/results/clientpositive/llap/vector_partitioned_date_time.q.out c5f7128d9d

>   ql/src/test/results/clientpositive/llap/vector_ptf_part_simple.q.out 805d5a23ef 
>   ql/src/test/results/clientpositive/llap/vector_reduce1.q.out 4a4e710854 
>   ql/src/test/results/clientpositive/llap/vector_reduce2.q.out d937146489 
>   ql/src/test/results/clientpositive/llap/vector_reduce3.q.out 382841f7d3 
>   ql/src/test/results/clientpositive/llap/vector_reduce_groupby_decimal.q.out 579bb61d38

>   ql/src/test/results/clientpositive/llap/vector_string_concat.q.out d5331ec830 
>   ql/src/test/results/clientpositive/llap/vector_struct_in.q.out d583f09cb1 
>   ql/src/test/results/clientpositive/llap/vector_udf1.q.out b8d19c5637 
>   ql/src/test/results/clientpositive/llap/vector_udf_character_length.q.out 559a82b1a4

>   ql/src/test/results/clientpositive/llap/vector_udf_octet_length.q.out cee832212e 
>   ql/src/test/results/clientpositive/llap/vector_varchar_4.q.out 5979f8be7f 
>   ql/src/test/results/clientpositive/llap/vector_varchar_mapjoin1.q.out c96b9dff68 
>   ql/src/test/results/clientpositive/llap/vector_varchar_simple.q.out 4e48a27e71 
>   ql/src/test/results/clientpositive/llap/vector_when_case_null.q.out f137c63aa0 
>   ql/src/test/results/clientpositive/llap/vector_windowing_navfn.q.out 6d66a55d8a 
>   ql/src/test/results/clientpositive/llap/vectorization_decimal_date.q.out 74455f5a52

>   ql/src/test/results/clientpositive/llap/vectorization_part_project.q.out 85c4dd0f63

>   ql/src/test/results/clientpositive/llap/vectorization_short_regress.q.out 38598b489a

>   ql/src/test/results/clientpositive/llap/vectorized_bucketmapjoin1.q.out 0ba948174c

>   ql/src/test/results/clientpositive/llap/vectorized_context.q.out 855a50f91c 
>   ql/src/test/results/clientpositive/llap/vectorized_date_funcs.q.out 39e8096bed 
>   ql/src/test/results/clientpositive/llap/vectorized_distinct_gby.q.out fe9f0d22f6 
>   ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out
690cab80d2 
>   ql/src/test/results/clientpositive/llap/vectorized_dynamic_semijoin_reduction.q.out
0af7204256 
>   ql/src/test/results/clientpositive/llap/vectorized_join46.q.out c31934bd07 
>   ql/src/test/results/clientpositive/llap/vectorized_parquet.q.out e904286cb4 
>   ql/src/test/results/clientpositive/llap/vectorized_parquet_types.q.out cdf6b3d225 
>   ql/src/test/results/clientpositive/llap/vectorized_ptf.q.out cf5bdea294 
>   ql/src/test/results/clientpositive/llap/vectorized_timestamp.q.out 24f8d36912 
>   ql/src/test/results/clientpositive/llap/vectorized_timestamp_funcs.q.out f6dcb7cc54

>   ql/src/test/results/clientpositive/merge_join_1.q.out 4d2c4cf0f4 
>   ql/src/test/results/clientpositive/mergejoin.q.out 1961d83c68 
>   ql/src/test/results/clientpositive/mergejoins_mixed.q.out e1125e9cb8 
>   ql/src/test/results/clientpositive/perf/query14.q.out 74c7660398 
>   ql/src/test/results/clientpositive/perf/query23.q.out ebd2271108 
>   ql/src/test/results/clientpositive/ppd_join5.q.out 551769c73a 
>   ql/src/test/results/clientpositive/ppd_outer_join5.q.out 75b73800ed 
>   ql/src/test/results/clientpositive/ppd_repeated_alias.q.out 738424bb5b 
>   ql/src/test/results/clientpositive/smb_mapjoin_47.q.out 34ed7b87c4 
>   ql/src/test/results/clientpositive/spark/auto_join_reordering_values.q.out 29b4419e94

>   ql/src/test/results/clientpositive/spark/auto_join_stats.q.out db98adc55a 
>   ql/src/test/results/clientpositive/spark/auto_join_stats2.q.out 9064cbc4e0 
>   ql/src/test/results/clientpositive/spark/auto_smb_mapjoin_14.q.out 7a2422f528 
>   ql/src/test/results/clientpositive/spark/auto_sortmerge_join_12.q.out d76360de6c 
>   ql/src/test/results/clientpositive/spark/auto_sortmerge_join_6.q.out de08021150 
>   ql/src/test/results/clientpositive/spark/auto_sortmerge_join_9.q.out 8a302b6d0e 
>   ql/src/test/results/clientpositive/spark/bucket_map_join_tez1.q.out 08d115d105 
>   ql/src/test/results/clientpositive/spark/bucket_map_join_tez2.q.out 4837ebfaa1 
>   ql/src/test/results/clientpositive/spark/column_access_stats.q.out b1c494cba7 
>   ql/src/test/results/clientpositive/spark/filter_join_breaktask.q.out 718346f83a 
>   ql/src/test/results/clientpositive/spark/join19.q.out 35d9942cb0 
>   ql/src/test/results/clientpositive/spark/join_cond_pushdown_unqual1.q.out 40695ef998

>   ql/src/test/results/clientpositive/spark/join_cond_pushdown_unqual2.q.out df23dbf548

>   ql/src/test/results/clientpositive/spark/join_cond_pushdown_unqual3.q.out 248512a3db

>   ql/src/test/results/clientpositive/spark/join_cond_pushdown_unqual4.q.out cc8d633f2d

>   ql/src/test/results/clientpositive/spark/join_hive_626.q.out f304bb9d35 
>   ql/src/test/results/clientpositive/spark/join_star.q.out 5d747ec73d 
>   ql/src/test/results/clientpositive/spark/mergejoins_mixed.q.out 9306718274 
>   ql/src/test/results/clientpositive/spark/ppd_join5.q.out 2b05a1c917 
>   ql/src/test/results/clientpositive/spark/ppd_outer_join5.q.out 0813d6fcb5 
>   ql/src/test/results/clientpositive/spark/spark_dynamic_partition_pruning.q.out d9da7627b3

>   ql/src/test/results/clientpositive/spark/spark_dynamic_partition_pruning_mapjoin_only.q.out
564a6a24ba 
>   ql/src/test/results/clientpositive/spark/spark_explainuser_1.q.out bf0708b432 
>   ql/src/test/results/clientpositive/spark/spark_use_op_stats.q.out b277ddc4b4 
>   ql/src/test/results/clientpositive/spark/stats_only_null.q.out 94f955c82d 
>   ql/src/test/results/clientpositive/spark/table_access_keys_stats.q.out 9291c01867 
>   ql/src/test/results/clientpositive/stats_only_null.q.out de1b017989 
>   ql/src/test/results/clientpositive/stats_partial_size.q.out c779741314 
>   ql/src/test/results/clientpositive/stats_ppr_all.q.out d4060c600b 
>   ql/src/test/results/clientpositive/tez/explainanalyze_2.q.out c86717790d 
>   ql/src/test/results/clientpositive/tez/explainanalyze_3.q.out 9d47066297 
>   ql/src/test/results/clientpositive/tez/explainanalyze_5.q.out 1764164a91 
>   ql/src/test/results/clientpositive/tez/explainuser_3.q.out f70d711fc4 
>   ql/src/test/results/clientpositive/tez/hybridgrace_hashjoin_1.q.out 8ee4f4d716 
>   ql/src/test/results/clientpositive/tez/multi_count_distinct.q.out 82c09faa5c 
>   ql/src/test/results/clientpositive/tez/tez-tag.q.out 1201ee4954 
>   ql/src/test/results/clientpositive/tez/vector_join_part_col_char.q.out 2b9882e390 
>   ql/src/test/results/clientpositive/tez/vector_non_string_partition.q.out e09cbb91e5

>   ql/src/test/results/clientpositive/vector_mr_diff_schema_alias.q.out a659b9e869 
>   ql/src/test/results/clientpositive/vector_outer_join6.q.out 75d3fcb240 
>   ql/src/test/results/clientpositive/vectorized_context.q.out dac9b6b143 
> 
> 
> Diff: https://reviews.apache.org/r/61165/diff/2/
> 
> 
> Testing
> -------
> 
> * Updated existing tests
> * Added new test
> 
> 
> Thanks,
> 
> Vineet Garg
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message