hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-6578) Use ORC file footer statistics through StatsProvidingRecordReader interface for analyze command
Date Sun, 16 Mar 2014 19:40:47 GMT

    [ https://issues.apache.org/jira/browse/HIVE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13937304#comment-13937304
] 

Hive QA commented on HIVE-6578:
-------------------------------



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12634958/HIVE-6578.4.patch.txt

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 5407 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucketmapjoin6
{noformat}

Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1852/testReport
Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1852/console

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12634958

> Use ORC file footer statistics through StatsProvidingRecordReader interface for analyze
command
> -----------------------------------------------------------------------------------------------
>
>                 Key: HIVE-6578
>                 URL: https://issues.apache.org/jira/browse/HIVE-6578
>             Project: Hive
>          Issue Type: New Feature
>    Affects Versions: 0.13.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>              Labels: orcfile
>         Attachments: HIVE-6578.1.patch, HIVE-6578.2.patch, HIVE-6578.3.patch, HIVE-6578.4.patch,
HIVE-6578.4.patch.txt
>
>
> ORC provides file level statistics which can be used in analyze partialscan and noscan
cases to compute basic statistics like number of rows, number of files, total file size and
raw data size. On the writer side, a new interface was added earlier (StatsProvidingRecordWriter)
that exposed stats when writing a table. Similarly, a new interface StatsProvidingRecordReader
can be added which when implemented should provide stats that are gathered by the underlying
file format.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message