hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15369) Extend column pruner to account for residual filter expression in Join operator
Date Tue, 06 Dec 2016 16:51:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726029#comment-15726029
] 

Hive QA commented on HIVE-15369:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12841982/HIVE-15369.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 8 failed/errored test(s), 10768 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample2] (batchId=5)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample4] (batchId=15)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample6] (batchId=61)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample7] (batchId=60)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample9] (batchId=38)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[orc_ppd_schema_evol_3a] (batchId=134)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[transform_ppr2] (batchId=134)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[stats_based_fetch_decision]
(batchId=150)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/2443/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/2443/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-2443/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 8 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12841982 - PreCommit-HIVE-Build

> Extend column pruner to account for residual filter expression in Join operator
> -------------------------------------------------------------------------------
>
>                 Key: HIVE-15369
>                 URL: https://issues.apache.org/jira/browse/HIVE-15369
>             Project: Hive
>          Issue Type: Bug
>          Components: Logical Optimizer
>    Affects Versions: 2.2.0
>            Reporter: Jesus Camacho Rodriguez
>            Assignee: Jesus Camacho Rodriguez
>         Attachments: HIVE-15369.patch
>
>
> Introduced by HIVE-15251.
> We need to extend ColumnPruner logic to take into account residual filter expressions
in Join operator. Otherwise, query will fail at execution time.
> Issue can be reproduced as follows:
> {code:sql}
> set hive.strict.checks.cartesian.product=false;
> CREATE TABLE test1 (key INT, value INT, col_1 STRING);
> INSERT INTO test1 VALUES (NULL, NULL, 'None'), (98, NULL, 'None'),
>     (99, 0, 'Alice'), (99, 2, 'Mat'), (100, 1, 'Bob'), (101, 2, 'Car');
> CREATE TABLE test2 (key INT, value INT, col_2 STRING);
> INSERT INTO test2 VALUES (102, 2, 'Del'), (103, 2, 'Ema'),
>     (104, 3, 'Fli'), (105, NULL, 'None');
> -- Complex condition and column projection
> EXPLAIN
> SELECT col_1, col_2
> FROM test1 LEFT OUTER JOIN test2
> ON (test1.value=test2.value
>       OR test1.key=test2.key);
> SELECT col_1, col_2
> FROM test1 LEFT OUTER JOIN test2
> ON (test1.value=test2.value
>       OR test1.key=test2.key);
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message