hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Seth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15347) LLAP: Executor memory and Xmx should have some headroom for other services
Date Wed, 04 Jan 2017 00:26:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796677#comment-15796677
] 

Siddharth Seth commented on HIVE-15347:
---------------------------------------

hive --service llap takes the following 3 parameters before the patch 
cache - the actual cache size
size - the cotnainer size
xmx - the xmx size for the process

Also, checking the headroom within LlapDaemon doesn't really help - since the Xmx value has
already been set. Executors may not use this - but JVM can grow to this size before GC actually
kicks in.
These should be enough to control the headroom. I don't think we need another explicit config
for the headroom. Thoughts?

> LLAP: Executor memory and Xmx should have some headroom for other services
> --------------------------------------------------------------------------
>
>                 Key: HIVE-15347
>                 URL: https://issues.apache.org/jira/browse/HIVE-15347
>             Project: Hive
>          Issue Type: Bug
>          Components: llap
>    Affects Versions: 2.2.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Critical
>              Labels: TODOC2.2
>             Fix For: 2.2.0
>
>         Attachments: HIVE-15347.1.patch
>
>
> If executor memory + cache memory is configured close or equal to Xmx, the task attempts
that is causing OOM can take down the LLAP daemon. Provide some leeway for other services
during memory crunch. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message