hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9424) SparkMapJoinResolver shouldn't process newly generated SparkTask [Spark Branch]
Date Wed, 21 Jan 2015 19:37:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286137#comment-14286137
] 

Xuefu Zhang commented on HIVE-9424:
-----------------------------------

I see. Please feel free to include this in your prototyping. We will visit this when we review
that work. Thanks.

> SparkMapJoinResolver shouldn't process newly generated SparkTask [Spark Branch]
> -------------------------------------------------------------------------------
>
>                 Key: HIVE-9424
>                 URL: https://issues.apache.org/jira/browse/HIVE-9424
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: spark-branch
>            Reporter: Chao
>            Assignee: Chao
>         Attachments: HIVE-9424.1-spark.patch
>
>
> Sometimes, in SparkMapJoinResolver, after a new SparkTask is generated and added to context,
it may be processed by the {{dispatch}} method in this class. This could introduce wrong plan
since {{generateLocalWork}} will overwrite existing local work in the SparkTask.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message