hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5876) Split elimination in ORC breaks for partitioned tables
Date Sat, 23 Nov 2013 08:17:35 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13830617#comment-13830617
] 

Hive QA commented on HIVE-5876:
-------------------------------



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12615421/HIVE-5876.1.patch

{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 4680 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.io.orc.TestOrcSplitElimination.testSplitEliminationComplexExpr
org.apache.hadoop.hive.ql.io.orc.TestOrcSplitElimination.testSplitEliminationLargeMaxSplit
org.apache.hadoop.hive.ql.io.orc.TestOrcSplitElimination.testSplitEliminationSmallMaxSplit
{noformat}

Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/415/testReport
Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/415/console

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 3 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12615421

> Split elimination in ORC breaks for partitioned tables
> ------------------------------------------------------
>
>                 Key: HIVE-5876
>                 URL: https://issues.apache.org/jira/browse/HIVE-5876
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.13.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>              Labels: orcfile
>         Attachments: HIVE-5876.1.patch
>
>
> HIVE-5632 eliminates ORC stripes from split computation that do not satisfy SARG condition.
SARG expression can also refer to partition columns. But partition column will not be contained
in the column names list in ORC file. This was causing ArrayIndexOutOfBoundException in split
elimination logic when used with partitioned tables. The fix is to ignore evaluation of partition
column expressions in split elimination.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message