hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject Re: Review Request 14243: HIVE-5325: Implement statistics providing ORC writer and reader interfaces
Date Tue, 24 Sep 2013 22:18:37 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated Sept. 24, 2013, 10:18 p.m.)

Review request for hive, Ashutosh Chauhan and Owen O'Malley.


Refreshed the patch after HIVE-5324 changes.

Bugs: HIVE-5325

Repository: hive-git


HIVE-5324 adds new interfaces that can be implemented by ORC reader/writer to provide statistics.
Writer provided statistics is used to update table/partition level statistics in metastore.
Reader provided statistics can be used for reducer estimation, CBO etc. in the absence of
metastore statistics.

Diffs (updated)

  ql/src/java/org/apache/hadoop/hive/ql/io/orc/ PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/ 6268617 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/ c80fb02 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/ c454f32 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/ 72e779a 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/ 44961ce 
  ql/src/java/org/apache/hadoop/hive/ql/stats/ PRE-CREATION 
  ql/src/protobuf/org/apache/hadoop/hive/ql/io/orc/orc_proto.proto edbf822 
  ql/src/test/org/apache/hadoop/hive/ql/io/orc/ 34b2305 
  ql/src/test/org/apache/hadoop/hive/ql/io/orc/ e6569f4 
  ql/src/test/org/apache/hadoop/hive/ql/io/orc/ b93db84 
  ql/src/test/org/apache/hadoop/hive/ql/io/orc/ PRE-CREATION 
  ql/src/test/resources/orc-file-dump-dictionary-threshold.out 003c132 
  ql/src/test/resources/orc-file-dump.out fac5326 



ORC related unit and qfile tests are passing.



  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message