hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gunther Hagleitner (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13343) Need to disable hybrid grace hash join in llap mode except for dynamically partitioned hash join
Date Mon, 25 Apr 2016 21:15:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257066#comment-15257066
] 

Gunther Hagleitner commented on HIVE-13343:
-------------------------------------------

The map join list only gets cleaned when the task can run in llap, but should be cleared always
- or better yet, initialized each time we run the decider. I think it's working right now,
because the compiler initializes a new decider each time a query is compiled. 

Also, two of the log statements are not very helpful, I think. They repeat stuff that's already
logged (mode) or tell you something obvious (reducer not running when mode=map).

> Need to disable hybrid grace hash join in llap mode except for dynamically partitioned
hash join
> ------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-13343
>                 URL: https://issues.apache.org/jira/browse/HIVE-13343
>             Project: Hive
>          Issue Type: Bug
>          Components: llap
>    Affects Versions: 2.1.0
>            Reporter: Vikram Dixit K
>            Assignee: Vikram Dixit K
>         Attachments: HIVE-13343.1.patch, HIVE-13343.2.patch
>
>
> Due to performance reasons, we should disable use of hybrid grace hash join in llap when
dynamic partition hash join is not used. With dynamic partition hash join, we need hybrid
grace hash join due to the possibility of skews.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message