hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8740) Sorted dynamic partition does not work correctly with constant folding
Date Wed, 05 Nov 2014 12:26:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14198322#comment-14198322
] 

Hive QA commented on HIVE-8740:
-------------------------------



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12679485/HIVE-8740.1.patch

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 6673 tests executed
*Failed tests:*
{noformat}
org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection
{noformat}

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1644/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1644/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1644/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12679485 - PreCommit-HIVE-TRUNK-Build

> Sorted dynamic partition does not work correctly with constant folding
> ----------------------------------------------------------------------
>
>                 Key: HIVE-8740
>                 URL: https://issues.apache.org/jira/browse/HIVE-8740
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>         Attachments: HIVE-8740.1.patch
>
>
> Sorted dynamic partition optimization looks for partition columns from the operator above
FileSinkOperator. As per hive convention it expects partition columns at the last. But with
HIVE-8585 equality filters on partition columns gets folded to constant. The column pruner
then prunes the constant expression as they don't reference any columns. This in some cases
will yield unexpected results (throw ArrayIndexOutOfBounds exception) with sorted dynamic
partition insert optimization. In such we don't really need sorted dynamic partition optimization.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message