hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sunil G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs
Date Tue, 27 Jan 2015 19:21:34 GMT

    [ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294012#comment-14294012
] 

Sunil G commented on YARN-2005:
-------------------------------

Yes [~jlowe]
A buggy application is my concern too.

If an application's AM is failed in a node, prevent RM to launch its further attempts on same
node.
2 or more different applications failed on a node. Such nodes can be given lesser priority
(lower rank) in scheduling AM for newer application.

Generally this logic can only prioritize the nodes to be selected for AM scheduling. In worst
cases, lowest ranked NM can still be scheduled for a new AM.

> Blacklisting support for scheduling AMs
> ---------------------------------------
>
>                 Key: YARN-2005
>                 URL: https://issues.apache.org/jira/browse/YARN-2005
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: resourcemanager
>    Affects Versions: 0.23.10, 2.4.0
>            Reporter: Jason Lowe
>
> It would be nice if the RM supported blacklisting a node for an AM launch after the same
node fails a configurable number of AM attempts.  This would be similar to the blacklisting
support for scheduling task attempts in the MapReduce AM but for scheduling AM attempts on
the RM side.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message