hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5325) Implement statistics providing ORC writer and reader interfaces
Date Wed, 02 Oct 2013 06:26:25 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783698#comment-13783698
] 

Hudson commented on HIVE-5325:
------------------------------

ABORTED: Integrated in Hive-trunk-hadoop2 #468 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/468/])
HIVE-5325 : Implement statistics providing ORC writer and reader interfaces (Prasanth J via
Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1528108)
* /hive/trunk/ql/src/gen/protobuf/gen-java/org/apache/hadoop/hive/ql/io/orc/OrcProto.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/BinaryColumnStatistics.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/ColumnStatisticsImpl.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcOutputFormat.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/ReaderImpl.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/StringColumnStatistics.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/WriterImpl.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/util/JavaDataModel.java
* /hive/trunk/ql/src/protobuf/org/apache/hadoop/hive/ql/io/orc/orc_proto.proto
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestOrcFile.java
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestOrcNullOptimization.java
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestOrcSerDeStats.java
* /hive/trunk/ql/src/test/resources/orc-file-dump-dictionary-threshold.out
* /hive/trunk/ql/src/test/resources/orc-file-dump.out


> Implement statistics providing ORC writer and reader interfaces
> ---------------------------------------------------------------
>
>                 Key: HIVE-5325
>                 URL: https://issues.apache.org/jira/browse/HIVE-5325
>             Project: Hive
>          Issue Type: New Feature
>    Affects Versions: 0.13.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>              Labels: orcfile, statistics
>             Fix For: 0.13.0
>
>         Attachments: HIVE-5325.1.patch.txt, HIVE-5325.2.patch.txt, HIVE-5325.3.patch.txt,
HIVE-5325-java-only.1.patch.txt, HIVE-5325-java-only.2.patch.txt, HIVE-5325-java-only.3.patch.txt
>
>
> HIVE-5324 adds new interfaces that can be implemented by ORC reader/writer to provide
statistics. Writer provided statistics is used to update table/partition level statistics
in metastore. Reader provided statistics can be used for reducer estimation, CBO etc. in the
absence of metastore statistics.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message