hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vineet Garg <vg...@hortonworks.com>
Subject Review Request 61165: HIVE-16811 Estimate statistics in absence of stats
Date Wed, 26 Jul 2017 23:03:34 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/61165/
-----------------------------------------------------------

Review request for hive and Ashutosh Chauhan.


Bugs: HIVE-16811
    https://issues.apache.org/jira/browse/HIVE-16811


Repository: hive-git


Description
-------

This patch introduces estimation of statistics if stats doesn't already exist.


Diffs
-----

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 05f6cc9592 
  itests/src/test/resources/testconfiguration.properties f66e19be3e 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/RelOptHiveTable.java 1d49568c8c

  ql/src/java/org/apache/hadoop/hive/ql/stats/StatsUtils.java 3b9ab41bed 
  ql/src/test/queries/clientpositive/join_reordering_no_stats.q PRE-CREATION 
  ql/src/test/results/clientpositive/annotate_stats_part.q.out 866d30a8ea 
  ql/src/test/results/clientpositive/auto_join_reordering_values.q.out 156be41502 
  ql/src/test/results/clientpositive/auto_join_stats.q.out e80af96fcb 
  ql/src/test/results/clientpositive/auto_join_stats2.q.out 6ea5afa920 
  ql/src/test/results/clientpositive/auto_sortmerge_join_12.q.out d129807f55 
  ql/src/test/results/clientpositive/explain_rearrange.q.out 2e5f9e4626 
  ql/src/test/results/clientpositive/filter_join_breaktask.q.out 8f9b6363f4 
  ql/src/test/results/clientpositive/join19.q.out dd167ecabf 
  ql/src/test/results/clientpositive/join42.q.out 0cd31c6d66 
  ql/src/test/results/clientpositive/join43.q.out 24168ca4fe 
  ql/src/test/results/clientpositive/join_cond_pushdown_unqual1.q.out f77c75c232 
  ql/src/test/results/clientpositive/join_cond_pushdown_unqual2.q.out f04519f8c5 
  ql/src/test/results/clientpositive/join_cond_pushdown_unqual3.q.out f15d536945 
  ql/src/test/results/clientpositive/join_cond_pushdown_unqual4.q.out 1ec5dc415c 
  ql/src/test/results/clientpositive/join_hive_626.q.out 33a5fbd628 
  ql/src/test/results/clientpositive/join_star.q.out 261fb53bf9 
  ql/src/test/results/clientpositive/llap/auto_smb_mapjoin_14.q.out 8bc280cedd 
  ql/src/test/results/clientpositive/llap/auto_sortmerge_join_11.q.out 7e3fe4c862 
  ql/src/test/results/clientpositive/llap/auto_sortmerge_join_9.q.out 278c55b3e4 
  ql/src/test/results/clientpositive/llap/bucket_map_join_tez1.q.out 649afb502a 
  ql/src/test/results/clientpositive/llap/bucketmapjoin1.q.out feb3bbcfc4 
  ql/src/test/results/clientpositive/llap/bucketpruning1.q.out 922f23a29e 
  ql/src/test/results/clientpositive/llap/bucketsortoptimize_insert_7.q.out 8691d0d34e 
  ql/src/test/results/clientpositive/llap/columnStatsUpdateForStatsOptimizer_1.q.out 6d941fd4f2

  ql/src/test/results/clientpositive/llap/column_access_stats.q.out c56c818617 
  ql/src/test/results/clientpositive/llap/column_table_stats.q.out c7726fec30 
  ql/src/test/results/clientpositive/llap/dynamic_partition_pruning.q.out 3de40ce871 
  ql/src/test/results/clientpositive/llap/dynamic_partition_pruning_2.q.out e78429fc7f 
  ql/src/test/results/clientpositive/llap/dynpart_sort_optimization.q.out 1dc9ed5a8c 
  ql/src/test/results/clientpositive/llap/dynpart_sort_optimization2.q.out 90756c6776 
  ql/src/test/results/clientpositive/llap/dynpart_sort_optimization_acid.q.out 788854aa04

  ql/src/test/results/clientpositive/llap/explainuser_1.q.out b36fe2a83f 
  ql/src/test/results/clientpositive/llap/filter_join_breaktask.q.out c5cdb77afc 
  ql/src/test/results/clientpositive/llap/join_reordering_no_stats.q.out PRE-CREATION 
  ql/src/test/results/clientpositive/llap/llap_partitioned.q.out d35501e82b 
  ql/src/test/results/clientpositive/llap/mergejoin.q.out 9df5e42df2 
  ql/src/test/results/clientpositive/llap/metadata_only_queries.q.out 594e7e7fd6 
  ql/src/test/results/clientpositive/llap/partition_shared_scan.q.out bd3d247d48 
  ql/src/test/results/clientpositive/llap/ppd_union_view.q.out 543d17630a 
  ql/src/test/results/clientpositive/llap/reduce_deduplicate.q.out d74e4c7c78 
  ql/src/test/results/clientpositive/llap/sample10.q.out a3da78754f 
  ql/src/test/results/clientpositive/llap/schema_evol_orc_nonvec_part.q.out 0ebb378d08 
  ql/src/test/results/clientpositive/llap/schema_evol_orc_nonvec_part_all_complex.q.out 22c7745345

  ql/src/test/results/clientpositive/llap/schema_evol_orc_nonvec_part_all_primitive.q.out
4e94322705 
  ql/src/test/results/clientpositive/llap/schema_evol_orc_vec_part.q.out c6fc7b5dc6 
  ql/src/test/results/clientpositive/llap/schema_evol_orc_vec_part_all_complex.q.out f57481dcc1

  ql/src/test/results/clientpositive/llap/schema_evol_orc_vec_part_all_primitive.q.out 3a5232ad2e

  ql/src/test/results/clientpositive/llap/schema_evol_text_nonvec_part.q.out 8daee2883f 
  ql/src/test/results/clientpositive/llap/schema_evol_text_nonvec_part_all_complex.q.out 12c7db4af8

  ql/src/test/results/clientpositive/llap/schema_evol_text_nonvec_part_all_primitive.q.out
757ea3a6c0 
  ql/src/test/results/clientpositive/llap/schema_evol_text_vec_part.q.out 45635eeb4c 
  ql/src/test/results/clientpositive/llap/schema_evol_text_vec_part_all_complex.q.out 5e0c8f709a

  ql/src/test/results/clientpositive/llap/schema_evol_text_vec_part_all_primitive.q.out 17b078fb0c

  ql/src/test/results/clientpositive/llap/schema_evol_text_vecrow_part.q.out d687506241 
  ql/src/test/results/clientpositive/llap/schema_evol_text_vecrow_part_all_complex.q.out afaf69faf3

  ql/src/test/results/clientpositive/llap/schema_evol_text_vecrow_part_all_primitive.q.out
59d6797d63 
  ql/src/test/results/clientpositive/llap/smb_mapjoin_18.q.out e2d5e4e4c2 
  ql/src/test/results/clientpositive/llap/smb_mapjoin_19.q.out c3b29ea2bd 
  ql/src/test/results/clientpositive/llap/stats_only_null.q.out ab91ea738c 
  ql/src/test/results/clientpositive/llap/table_access_keys_stats.q.out 85459229f5 
  ql/src/test/results/clientpositive/llap/tez_dml.q.out ece6946fb8 
  ql/src/test/results/clientpositive/llap/tez_smb_empty.q.out e4c246afec 
  ql/src/test/results/clientpositive/llap/tez_smb_main.q.out e5f6940e48 
  ql/src/test/results/clientpositive/llap/tez_union_group_by.q.out 67cd110a61 
  ql/src/test/results/clientpositive/llap/unionDistinct_1.q.out 8d97fa4fab 
  ql/src/test/results/clientpositive/llap/vector_auto_smb_mapjoin_14.q.out b4386c8673 
  ql/src/test/results/clientpositive/llap/vector_count_distinct.q.out d45a15ffb8 
  ql/src/test/results/clientpositive/llap/vector_mr_diff_schema_alias.q.out 03c6d3fe54 
  ql/src/test/results/clientpositive/llap/vector_partition_diff_num_cols.q.out 4683b4bb62

  ql/src/test/results/clientpositive/llap/vector_partitioned_date_time.q.out c5f7128d9d 
  ql/src/test/results/clientpositive/llap/vectorized_context.q.out 855a50f91c 
  ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out 690cab80d2

  ql/src/test/results/clientpositive/merge_join_1.q.out 4d2c4cf0f4 
  ql/src/test/results/clientpositive/mergejoin.q.out 1961d83c68 
  ql/src/test/results/clientpositive/mergejoins_mixed.q.out e1125e9cb8 
  ql/src/test/results/clientpositive/ppd_join5.q.out 551769c73a 
  ql/src/test/results/clientpositive/ppd_outer_join5.q.out 75b73800ed 
  ql/src/test/results/clientpositive/ppd_repeated_alias.q.out 738424bb5b 
  ql/src/test/results/clientpositive/spark/auto_join_stats.q.out db98adc55a 
  ql/src/test/results/clientpositive/spark/auto_join_stats2.q.out 9064cbc4e0 
  ql/src/test/results/clientpositive/spark/auto_smb_mapjoin_14.q.out 7a2422f528 
  ql/src/test/results/clientpositive/spark/auto_sortmerge_join_9.q.out 8a302b6d0e 
  ql/src/test/results/clientpositive/spark/bucket_map_join_tez1.q.out 08d115d105 
  ql/src/test/results/clientpositive/spark/column_access_stats.q.out b1c494cba7 
  ql/src/test/results/clientpositive/spark/filter_join_breaktask.q.out 718346f83a 
  ql/src/test/results/clientpositive/spark/join19.q.out 35d9942cb0 
  ql/src/test/results/clientpositive/spark/join_cond_pushdown_unqual1.q.out 40695ef998 
  ql/src/test/results/clientpositive/spark/join_cond_pushdown_unqual2.q.out df23dbf548 
  ql/src/test/results/clientpositive/spark/join_cond_pushdown_unqual3.q.out 248512a3db 
  ql/src/test/results/clientpositive/spark/join_cond_pushdown_unqual4.q.out cc8d633f2d 
  ql/src/test/results/clientpositive/spark/join_hive_626.q.out f304bb9d35 
  ql/src/test/results/clientpositive/spark/join_star.q.out 5d747ec73d 
  ql/src/test/results/clientpositive/spark/mergejoins_mixed.q.out 9306718274 
  ql/src/test/results/clientpositive/spark/ppd_join5.q.out 2b05a1c917 
  ql/src/test/results/clientpositive/spark/ppd_outer_join5.q.out 0813d6fcb5 
  ql/src/test/results/clientpositive/spark/stats_only_null.q.out 94f955c82d 
  ql/src/test/results/clientpositive/spark/table_access_keys_stats.q.out 9291c01867 
  ql/src/test/results/clientpositive/stats_only_null.q.out de1b017989 
  ql/src/test/results/clientpositive/stats_partial_size.q.out c779741314 
  ql/src/test/results/clientpositive/stats_ppr_all.q.out d4060c600b 
  ql/src/test/results/clientpositive/tez/explainanalyze_3.q.out 9d47066297 
  ql/src/test/results/clientpositive/tez/explainuser_3.q.out f70d711fc4 
  ql/src/test/results/clientpositive/tez/vector_join_part_col_char.q.out 2b9882e390 
  ql/src/test/results/clientpositive/tez/vector_non_string_partition.q.out e09cbb91e5 
  ql/src/test/results/clientpositive/vector_mr_diff_schema_alias.q.out a659b9e869 
  ql/src/test/results/clientpositive/vector_outer_join6.q.out 75d3fcb240 
  ql/src/test/results/clientpositive/vectorized_context.q.out dac9b6b143 


Diff: https://reviews.apache.org/r/61165/diff/1/


Testing
-------

* Updated existing tests
* Added new test


Thanks,

Vineet Garg


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message