hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chengxiang Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9099) infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Spark Branch]
Date Mon, 15 Dec 2014 08:31:13 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246445#comment-14246445
] 

Chengxiang Li commented on HIVE-9099:
-------------------------------------

[~csun] and [~szehon]
Just found that this may related to HIVE-8981, we may need to remove infer_bucket_sort_convert_join.q
and mapjoin_hook.q from auto test list if we does not support backup task for mapjoin query
with Spark, It fails the qtest after HIVE-9078(which it should be).

> infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Spark Branch]
> -------------------------------------------------------------------------
>
>                 Key: HIVE-9099
>                 URL: https://issues.apache.org/jira/browse/HIVE-9099
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Chengxiang Li
>              Labels: Spark-M4
>
> infer_bucket_sort_convert_join.q and mapjoin_hook.q failed after HIVE-9078 due to same
reason.
> With the following settings in 2 qfiles:
> {noformat}
> set hive.auto.convert.join = true;
> set hive.mapjoin.localtask.max.memory.usage = 0.0001;
> set hive.mapjoin.check.memory.rows = 2;
> set hive.auto.convert.join.noconditionaltask = false;
> {noformat}
> With MR, MapRedTask of join query would failed at first and then driver execute its backup
task which would succeed, while we do not have backup task in Spark mode. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message