hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sunil G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs
Date Thu, 29 Jan 2015 15:03:35 GMT

    [ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14296970#comment-14296970

Sunil G commented on YARN-2005:

bq.  we could implement an app-specific blacklisting approach similar to what is done by the
MapReduce AM today.

+1 Yes. I also feel this can be the first step. Without much complicating, a step can be made
For that, we need changes in RMAppImpl transitions to keep track of host which previous failed
attempt ran. Then pass that to Scheduler as an exclude list only for AM schedule. Could I
work on this, and I can share a prototype soon. Then later it can made to production standard
by splitting to appropriate subjira.

> Blacklisting support for scheduling AMs
> ---------------------------------------
>                 Key: YARN-2005
>                 URL: https://issues.apache.org/jira/browse/YARN-2005
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: resourcemanager
>    Affects Versions: 0.23.10, 2.4.0
>            Reporter: Jason Lowe
> It would be nice if the RM supported blacklisting a node for an AM launch after the same
node fails a configurable number of AM attempts.  This would be similar to the blacklisting
support for scheduling task attempts in the MapReduce AM but for scheduling AM attempts on
the RM side.

This message was sent by Atlassian JIRA

View raw message