hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth J (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-6578) Use ORC file footer statistics through StatsProvidingRecordReader interface for analyze command
Date Sun, 16 Mar 2014 06:30:50 GMT

     [ https://issues.apache.org/jira/browse/HIVE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Prasanth J updated HIVE-6578:
-----------------------------

    Attachment: HIVE-6578.4.patch.txt

reuploading for jenkins

> Use ORC file footer statistics through StatsProvidingRecordReader interface for analyze
command
> -----------------------------------------------------------------------------------------------
>
>                 Key: HIVE-6578
>                 URL: https://issues.apache.org/jira/browse/HIVE-6578
>             Project: Hive
>          Issue Type: New Feature
>    Affects Versions: 0.13.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>              Labels: orcfile
>         Attachments: HIVE-6578.1.patch, HIVE-6578.2.patch, HIVE-6578.3.patch, HIVE-6578.4.patch,
HIVE-6578.4.patch.txt
>
>
> ORC provides file level statistics which can be used in analyze partialscan and noscan
cases to compute basic statistics like number of rows, number of files, total file size and
raw data size. On the writer side, a new interface was added earlier (StatsProvidingRecordWriter)
that exposed stats when writing a table. Similarly, a new interface StatsProvidingRecordReader
can be added which when implemented should provide stats that are gathered by the underlying
file format.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message