ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Wagle (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-11870) HDP-2.3 'hive.tez.java.opts' should not contain Xmx and add additional JDK1.8 params
Date Fri, 12 Jun 2015 18:20:00 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583831#comment-14583831
] 

Siddharth Wagle commented on AMBARI-11870:
------------------------------------------

+1 patch looks good.

> HDP-2.3 'hive.tez.java.opts' should not contain Xmx and add additional JDK1.8 params
> ------------------------------------------------------------------------------------
>
>                 Key: AMBARI-11870
>                 URL: https://issues.apache.org/jira/browse/AMBARI-11870
>             Project: Ambari
>          Issue Type: Bug
>          Components: contrib
>    Affects Versions: 2.1.0
>            Reporter: Srimanth Gunturi
>            Assignee: Srimanth Gunturi
>             Fix For: 2.1.0
>
>         Attachments: AMBARI-11870.patch, AMBARI-11870_2.patch
>
>
> {{hive.tez.java.opts}} for HDP-2.3 should not contain the Xmx JVM parameter. The reason
for this is:
> {noformat}
> Tez does it based on the allocated container (i.e if you use a 1.5Gig container.size
and YARN returns a 4Gig one, Tez should use a 0.8*4096).
> https://github.com/apache/tez/blob/master/tez-api/src/main/java/org/apache/tez/client/TezClientUtils.java#L920
> This would work much better if you removed the whole Xmx parameter from the config in
hive-site.xml.
> {noformat}
> Also, for JDK8 the preferred GC isn't {{-XX:+UseParallelGC}} it is {{-XX:+UseG1GC -XX:+ResizeTLAB}}
while retaining all the other java parameters. In some JDK7 versions, the G1GC occasionally
segfaults, so the choice of those two are based on whether the install is on JDK8 or not.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message