hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13102) CBO: Reduce operations in Calcite do not fold as tight as rule-based folding
Date Wed, 24 Feb 2016 01:51:18 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15160046#comment-15160046
] 

Hive QA commented on HIVE-13102:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12789243/HIVE-13102.01.patch

{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 9820 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_uri_import
org.apache.hadoop.hive.metastore.TestHiveMetaStorePartitionSpecs.testGetPartitionSpecs_WithAndWithoutPartitionGrouping
org.apache.hive.jdbc.TestSSL.testSSLVersion
{noformat}

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/7072/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/7072/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-7072/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12789243 - PreCommit-HIVE-TRUNK-Build

> CBO: Reduce operations in Calcite do not fold as tight as rule-based folding
> ----------------------------------------------------------------------------
>
>                 Key: HIVE-13102
>                 URL: https://issues.apache.org/jira/browse/HIVE-13102
>             Project: Hive
>          Issue Type: Improvement
>          Components: CBO
>    Affects Versions: 2.1.0
>            Reporter: Gopal V
>            Assignee: Jesus Camacho Rodriguez
>            Priority: Minor
>         Attachments: HIVE-13102.01.patch, HIVE-13102.patch
>
>
> With CBO
> {code}
> create temporary table table1(id int, val int, val1 int, dimid int);
> create temporary table table3(id int, val int, val1 int);
> hive> explain select table1.id, table1.val, table1.val1 from table1 inner join table3
on table1.dimid = table3.id and table3.id = 1 where table1.dimid <>1 ;
> Warning: Map Join MAPJOIN[14][bigTable=?] in task 'Map 1' is a cross product
> OK
> Plan optimized by CBO.
> Vertex dependency in root stage
> Map 1 <- Map 2 (BROADCAST_EDGE)
> Stage-0
>   Fetch Operator
>     limit:-1
>     Stage-1
>       Map 1 llap
>       File Output Operator [FS_11]
>         Map Join Operator [MAPJOIN_14] (rows=1 width=0)
>           Conds:(Inner),Output:["_col0","_col1","_col2"]
>         <-Map 2 [BROADCAST_EDGE] llap
>           BROADCAST [RS_8]
>             Select Operator [SEL_5] (rows=1 width=0)
>               Filter Operator [FIL_13] (rows=1 width=0)
>                 predicate:(id = 1)
>                 TableScan [TS_3] (rows=1 width=0)
>                   default@table3,table3,Tbl:PARTIAL,Col:NONE,Output:["id"]
>         <-Select Operator [SEL_2] (rows=1 width=0)
>             Output:["_col0","_col1","_col2"]
>             Filter Operator [FIL_12] (rows=1 width=0)
>               predicate:((dimid = 1) and (dimid <> 1))
>               TableScan [TS_0] (rows=1 width=0)
>                 default@table1,table1,Tbl:PARTIAL,Col:NONE,Output:["id","val","val1","dimid"]
> {code}
> without CBO
> {code}
> hive> explain select table1.id, table1.val, table1.val1 from table1 inner join table3
on table1.dimid = table3.id and table3.id = 1 where table1.dimid <>1 ;
> OK
> Vertex dependency in root stage
> Map 1 <- Map 2 (BROADCAST_EDGE)
> Stage-0
>   Fetch Operator
>     limit:-1
>     Stage-1
>       Map 1 llap
>       File Output Operator [FS_9]
>         Map Join Operator [MAPJOIN_14] (rows=1 width=0)
>           Conds:FIL_12.1=RS_17.1(Inner),Output:["_col0","_col1","_col2"]
>         <-Map 2 [BROADCAST_EDGE] vectorized, llap
>           BROADCAST [RS_17]
>             PartitionCols:1
>             Filter Operator [FIL_16] (rows=1 width=0)
>               predicate:false
>               TableScan [TS_1] (rows=1 width=0)
>                 default@table3,table3,Tbl:PARTIAL,Col:COMPLETE
>         <-Filter Operator [FIL_12] (rows=1 width=0)
>             predicate:false
>             TableScan [TS_0] (rows=1 width=0)
>               default@table1,table1,Tbl:PARTIAL,Col:NONE,Output:["id","val","val1"]
> Time taken: 0.044 seconds, Fetched: 23 row(s)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message