ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weiqing Yang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AMBARI-16757) Spark History Server heap size is not exposed (History Server crashed with OOM)
Date Thu, 19 May 2016 05:53:12 GMT

     [ https://issues.apache.org/jira/browse/AMBARI-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Weiqing Yang updated AMBARI-16757:
----------------------------------
    Priority: Minor  (was: Critical)

> Spark History Server heap size is not exposed (History Server crashed with OOM)
> -------------------------------------------------------------------------------
>
>                 Key: AMBARI-16757
>                 URL: https://issues.apache.org/jira/browse/AMBARI-16757
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 2.0.0
>            Reporter: Weiqing Yang
>            Priority: Minor
>             Fix For: 2.4.0
>
>         Attachments: AMBARI-16757-1.patch
>
>
> Ambari is not exposing the heap size parameter for Spark History Server.
> The workaround is to modify spark-env and add "SPARK_DAEMON_MEMORY=2g" for example.
> The newer versions of Spark defaults this to 1g, but on the older versions, it was defaulting
to 512m it seems, and it was causing OOM.
> So in the patch, "SPARK_DAEMON_MEMORY=1G" is added in the spark-env template (default:
1G).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message