ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-17489) Remove spark.yarn.max.executor.failures configuration in Spark Ambari definition
Date Fri, 01 Jul 2016 17:06:12 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-17489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15359286#comment-15359286
] 

Jeff Zhang commented on AMBARI-17489:
-------------------------------------

Correct, the default value is numExecutors * 2, with minimum of 3, we should use the default
value. 

> Remove spark.yarn.max.executor.failures configuration in Spark Ambari definition
> --------------------------------------------------------------------------------
>
>                 Key: AMBARI-17489
>                 URL: https://issues.apache.org/jira/browse/AMBARI-17489
>             Project: Ambari
>          Issue Type: Bug
>          Components: stacks
>    Affects Versions: 2.4.0
>            Reporter: Saisai Shao
>            Assignee: Saisai Shao
>
> Currently spark.yarn.max.executor.failures should be configured in Ambari web UI, which
makes it inflexible to change, actually the default default in Spark is more reasonable than
here as "3", so propose to remove this configuration starting from Spark 1.6.0.
> CC [~zjffdu], please suggest.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message