hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "zhuwei (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-19450) OOM due to map join and backup task not invoked
Date Wed, 23 May 2018 02:27:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-19450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

zhuwei updated HIVE-19450:
--------------------------
    Attachment: HIVE-19450.2.patch

> OOM due to map join and backup task not invoked
> -----------------------------------------------
>
>                 Key: HIVE-19450
>                 URL: https://issues.apache.org/jira/browse/HIVE-19450
>             Project: Hive
>          Issue Type: Bug
>            Reporter: zhuwei
>            Assignee: zhuwei
>            Priority: Major
>         Attachments: HIVE-19450.1.patch, HIVE-19450.2.patch
>
>
> Map join task may cause OOM due to orc compression , in most cases , a backup task will
be invoked. However , if the size of hash table is close to memory limit, the task which load
the hash table will NOT fail . OOM will happen in next task witch do local join. The load
task has a backup but next task not. So in this case , the whole query will fail.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message