hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan" <hashut...@apache.org>
Subject Re: Review Request 15184: Store state of stats
Date Wed, 06 Nov 2013 16:35:16 GMT


> On Nov. 5, 2013, 2:04 a.m., Thejas Nair wrote:
> > trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java, line
208
> > <https://reviews.apache.org/r/15184/diff/1/?file=376593#file376593line208>
> >
> >     Can you also add a test case where analyze table is followed by an alter table,
to verify that stats invalidation is happening in such cases ?

Added new test stats_invalidation.q


- Ashutosh


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15184/#review28167
-----------------------------------------------------------


On Nov. 6, 2013, 4:32 p.m., Ashutosh Chauhan wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/15184/
> -----------------------------------------------------------
> 
> (Updated Nov. 6, 2013, 4:32 p.m.)
> 
> 
> Review request for hive and Thejas Nair.
> 
> 
> Bugs: HIVE-3777
>     https://issues.apache.org/jira/browse/HIVE-3777
> 
> 
> Repository: hive
> 
> 
> Description
> -------
> 
> Store state of stats.
> 
> 
> Diffs
> -----
> 
>   trunk/common/src/java/org/apache/hadoop/hive/common/StatsSetupConst.java 1539099 
>   trunk/hbase-handler/src/test/results/positive/hbase_stats.q.out 1539099 
>   trunk/hbase-handler/src/test/results/positive/hbase_stats2.q.out 1539099 
>   trunk/hbase-handler/src/test/results/positive/hbase_stats3.q.out 1539099 
>   trunk/hbase-handler/src/test/results/positive/hbase_stats_empty_partition.q.out 1539099

>   trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java 1539099

>   trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/StatsTask.java 1539099 
>   trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 1539099 
>   trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/StatsOptimizer.java 1539099 
>   trunk/ql/src/test/queries/clientpositive/stats_invalidation.q PRE-CREATION 
>   trunk/ql/src/test/queries/clientpositive/stats_only_null.q 1539099 
>   trunk/ql/src/test/results/clientnegative/stats_partialscan_autogether.q.out 1539099

>   trunk/ql/src/test/results/clientnegative/unset_table_property.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/alter_numbuckets_partitioned_table.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/alter_numbuckets_partitioned_table2.q.out
1539099 
>   trunk/ql/src/test/results/clientpositive/alter_partition_clusterby_sortby.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/alter_partition_coltype.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/alter_skewed_table.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/alter_table_not_sorted.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/alter_table_serde2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/auto_join_reordering_values.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_11.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_12.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_3.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_4.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_5.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_7.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_8.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/binary_output_format.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucket1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucket2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucket3.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucket4.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucket5.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucket_map_join_1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucket_map_join_2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketcontext_1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketcontext_2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketcontext_3.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketcontext_4.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketcontext_5.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketcontext_6.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketcontext_7.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketcontext_8.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketizedhiveinputformat.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketmapjoin1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketmapjoin10.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketmapjoin11.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketmapjoin12.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketmapjoin13.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketmapjoin2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketmapjoin7.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative3.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/columnstats_partlvl.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/columnstats_tbllvl.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/combine2_hadoop20.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/create_alter_list_bucketing_table1.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/ctas_colname.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/ctas_hadoop20.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/ctas_uses_database_location.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/describe_comment_nonascii.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/describe_table.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/disable_merge_for_bucketing.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/dynamic_partition_skip_default.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/filter_join_breaktask.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/groupby_map_ppr.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/groupby_map_ppr_multi_distinct.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/groupby_ppr.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/groupby_ppr_multi_distinct.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/groupby_sort_1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/groupby_sort_6.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/groupby_sort_skew_1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/infer_bucket_sort.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/infer_bucket_sort_bucketed_table.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/infer_bucket_sort_convert_join.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/infer_bucket_sort_dyn_part.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/infer_bucket_sort_grouping_operators.q.out
1539099 
>   trunk/ql/src/test/results/clientpositive/infer_bucket_sort_map_operators.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/infer_bucket_sort_merge.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/infer_bucket_sort_multi_insert.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/infer_bucket_sort_num_buckets.q.out 1539099

>   trunk/ql/src/test/results/clientpositive/infer_bucket_sort_reducers_power_two.q.out
1539099 
>   trunk/ql/src/test/results/clientpositive/input23.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/input42.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/input_part1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/input_part2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/input_part7.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/input_part9.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/join17.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/join26.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/join32.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/join32_lessSize.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/join33.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/join34.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/join35.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/join9.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/join_filters_overlap.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/join_map_ppr.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/list_bucket_dml_10.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/load_dyn_part8.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/louter_join_ppr.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/merge3.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/metadata_only_queries.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/outer_join_ppr.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/parallel_orderby.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/pcr.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/ppd_join_filter.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/ppd_union_view.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/ppd_vc.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/ppr_allchildsarenull.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/push_or.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/rand_partitionpruner1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/rand_partitionpruner2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/rand_partitionpruner3.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/rcfile_default_format.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/reduce_deduplicate.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/regexp_extract.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/router_join_ppr.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/sample1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/sample10.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/sample2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/sample4.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/sample5.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/sample6.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/sample7.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/sample8.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/sample9.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/serde_user_properties.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/show_create_table_alter.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/show_tblproperties.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/smb_mapjoin_11.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/smb_mapjoin_12.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/smb_mapjoin_13.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/smb_mapjoin_15.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_5.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_6.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_7.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats0.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats10.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats11.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats12.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats13.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats14.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats15.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats16.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats18.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats19.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats3.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats4.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats5.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats6.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats7.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats8.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats9.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats_empty_partition.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats_invalidation.q.out PRE-CREATION 
>   trunk/ql/src/test/results/clientpositive/stats_noscan_1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats_noscan_2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats_only_null.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/stats_partscan_1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/transform_ppr1.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/transform_ppr2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/truncate_column.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/udf_explode.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/udf_reflect2.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/udtf_explode.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/union22.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/union24.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/union_ppr.q.out 1539099 
>   trunk/ql/src/test/results/clientpositive/unset_table_view_property.q.out 1539099 
>   trunk/ql/src/test/results/compiler/plan/case_sensitivity.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/cast1.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/groupby1.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/groupby2.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/groupby3.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/groupby4.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/groupby5.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/groupby6.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input1.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input2.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input20.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input3.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input4.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input5.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input6.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input7.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input8.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input9.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input_part1.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input_testsequencefile.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input_testxpath.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/input_testxpath2.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/join1.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/join2.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/join3.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/join4.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/join5.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/join6.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/join7.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/join8.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/sample1.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/sample2.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/sample3.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/sample4.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/sample5.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/sample6.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/sample7.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/subq.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/udf1.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/udf6.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/udf_case.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/udf_when.q.xml 1539099 
>   trunk/ql/src/test/results/compiler/plan/union.q.xml 1539099 
> 
> Diff: https://reviews.apache.org/r/15184/diff/
> 
> 
> Testing
> -------
> 
> Existing tests suffice.
> 
> 
> Thanks,
> 
> Ashutosh Chauhan
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message