hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10462) CBO (Calcite Return Path): MapJoin and SMBJoin conversion not triggered
Date Sun, 26 Apr 2015 20:51:38 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14513254#comment-14513254
] 

Ashutosh Chauhan commented on HIVE-10462:
-----------------------------------------

I think this is a better approach. It keeps translation separate from new return path vs old
return path. +1 
I guess you lifted these tests from other existing tests. In that case, we may not want to
add these, since that will result in duplication once we enable return path by default. Else,
if you wrote these new tests, we can keep them.

> CBO (Calcite Return Path): MapJoin and SMBJoin conversion not triggered
> -----------------------------------------------------------------------
>
>                 Key: HIVE-10462
>                 URL: https://issues.apache.org/jira/browse/HIVE-10462
>             Project: Hive
>          Issue Type: Sub-task
>          Components: CBO
>            Reporter: Jesus Camacho Rodriguez
>            Assignee: Jesus Camacho Rodriguez
>             Fix For: 1.2.0
>
>         Attachments: HIVE-10462.01.patch, HIVE-10462.02.patch, HIVE-10462.03.patch, HIVE-10462.patch
>
>
> When the return path is on, the mapjoin conversion optimization fails as some DS in the
Join descriptor have not been initialized properly.
> The failure can be reproduced with auto_join4.q. In particular, the following Exception
is thrown:
> {noformat}
> org.apache.hadoop.hive.ql.parse.SemanticException: Generate Map Join Task Error: null
>         at org.apache.hadoop.hive.ql.optimizer.physical.CommonJoinTaskDispatcher.processCurrentTask(CommonJoinTaskDispatcher.java:516)
>         at org.apache.hadoop.hive.ql.optimizer.physical.AbstractJoinTaskDispatcher.dispatch(AbstractJoinTaskDispatcher.java:179)
>         at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.dispatch(TaskGraphWalker.java:111)
>         at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.walk(TaskGraphWalker.java:180)
>         at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.startWalking(TaskGraphWalker.java:125)
>         at org.apache.hadoop.hive.ql.optimizer.physical.CommonJoinResolver.resolve(CommonJoinResolver.java:79)
>         at org.apache.hadoop.hive.ql.optimizer.physical.PhysicalOptimizer.optimize(PhysicalOptimizer.java:107)
>         at org.apache.hadoop.hive.ql.parse.MapReduceCompiler.optimizeTaskPlan(MapReduceCompiler.java:270)
>         at org.apache.hadoop.hive.ql.parse.TaskCompiler.compile(TaskCompiler.java:227)
>         at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10084)
>         at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:203)
>         at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:225)
>         at org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(ExplainSemanticAnalyzer.java:74)
>         at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:225)
> ...
> {noformat}
> SMBJoin conversion is not triggered either.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message