hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12477) CBO: Left Semijoins are incompatible with a cross-product
Date Fri, 04 Dec 2015 04:12:10 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039720#comment-15039720
] 

Hive QA commented on HIVE-12477:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12775428/HIVE-12477.01.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 25 failed/errored test(s), 9859 tests executed
*Failed tests:*
{noformat}
TestHWISessionManager - did not produce a TEST-*.xml file
TestMiniTezCliDriver-vector_decimal_10_0.q-vector_acid3.q-vector_decimal_trailing.q-and-12-more
- did not produce a TEST-*.xml file
TestMiniTezCliDriver-vector_decimal_round.q-cbo_windowing.q-tez_schema_evolution.q-and-12-more
- did not produce a TEST-*.xml file
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_acid_globallimit
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cbo_udf_max
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver_dynamic_partition_pruning
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver_vectorized_dynamic_partition_pruning
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_acid_globallimit
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_mergejoin
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_uri_import
org.apache.hadoop.hive.metastore.TestHiveMetaStorePartitionSpecs.testAddPartitions
org.apache.hadoop.hive.metastore.TestHiveMetaStorePartitionSpecs.testFetchingPartitionsWithDifferentSchemas
org.apache.hadoop.hive.metastore.TestHiveMetaStorePartitionSpecs.testGetPartitionSpecs_WithAndWithoutPartitionGrouping
org.apache.hadoop.hive.metastore.TestMetaStoreEventListenerOnlyOnCommit.testEventStatus
org.apache.hadoop.hive.metastore.TestMetaStoreInitListener.testMetaStoreInitListener
org.apache.hadoop.hive.ql.security.TestClientSideAuthorizationProvider.testSimplePrivileges
org.apache.hadoop.hive.ql.security.TestMultiAuthorizationPreEventListener.org.apache.hadoop.hive.ql.security.TestMultiAuthorizationPreEventListener
org.apache.hadoop.hive.ql.security.TestStorageBasedClientSideAuthorizationProvider.testSimplePrivileges
org.apache.hadoop.hive.ql.security.TestStorageBasedMetastoreAuthorizationDrops.testDropDatabase
org.apache.hadoop.hive.ql.security.TestStorageBasedMetastoreAuthorizationDrops.testDropPartition
org.apache.hadoop.hive.ql.security.TestStorageBasedMetastoreAuthorizationProviderWithACL.testSimplePrivileges
org.apache.hive.jdbc.TestSSL.testSSLFetchHttp
org.apache.hive.jdbc.TestSSL.testSSLVersion
org.apache.hive.jdbc.miniHS2.TestHs2Metrics.testMetrics
org.apache.tez.dag.app.rm.TestLlapTaskSchedulerService.testSimpleLocalAllocation
{noformat}

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/6224/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/6224/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-6224/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 25 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12775428 - PreCommit-HIVE-TRUNK-Build

> CBO: Left Semijoins are incompatible with a cross-product
> ---------------------------------------------------------
>
>                 Key: HIVE-12477
>                 URL: https://issues.apache.org/jira/browse/HIVE-12477
>             Project: Hive
>          Issue Type: Bug
>          Components: CBO
>    Affects Versions: 2.0.0
>            Reporter: Gopal V
>            Assignee: Jesus Camacho Rodriguez
>         Attachments: HIVE-12477.01.patch, HIVE-12477.patch
>
>
> with HIVE-12017 in place, a few queries generate left sem-joins without a key.
> This is an invalid plan and can be produced by doing.
> {code}
> explain logical select count(1) from store_sales where ss_sold_date_sk in (select d_date_sk
from date_dim where d_date_sk = 1);
> LOGICAL PLAN:  
> $hdt$_0:$hdt$_0:$hdt$_0:store_sales
>   TableScan (TS_0)
>     alias: store_sales
>     filterExpr: (ss_sold_date_sk = 1) (type: boolean)
>     Filter Operator (FIL_20)
>       predicate: (ss_sold_date_sk = 1) (type: boolean)
>       Select Operator (SEL_2)
>         Reduce Output Operator (RS_9)
>           sort order: 
>           Join Operator (JOIN_11)
>             condition map:
>                  Left Semi Join 0 to 1
>             keys:
>               0 
>               1 
>             Group By Operator (GBY_14)
>               aggregations: count(1)
>               mode: hash
> {code}
> without CBO
> {code}
> sq_1:date_dim
>   TableScan (TS_1)
>     alias: date_dim
>     filterExpr: ((1) IN (RS[6]) and (d_date_sk = 1)) (type: boolean)
>     Filter Operator (FIL_21)
>       predicate: ((1) IN (RS[6]) and (d_date_sk = 1)) (type: boolean)
>       Select Operator (SEL_3)
>         expressions: 1 (type: int)
>         outputColumnNames: _col0
>         Group By Operator (GBY_5)
>           keys: _col0 (type: int)
>           mode: hash
>           outputColumnNames: _col0
>           Reduce Output Operator (RS_8)
>             key expressions: _col0 (type: int)
>             sort order: +
>             Map-reduce partition columns: _col0 (type: int)
>             Join Operator (JOIN_9)
>               condition map:
>                    Left Semi Join 0 to 1
>               keys:
>                 0 ss_sold_date_sk (type: int)
>                 1 _col0 (type: int)
>               Group By Operator (GBY_12)
>                 aggregations: count(1)
>                 mode: hash
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message