Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: yarn-issues@hadoop.apache.org
Date: Mon, 18 May 2015 05:21:00 +0000 (UTC)
From: "Raju Bairishetti (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.12829786.1431582906000.140049.1431926460693@Atlassian.JIRA>
In-Reply-To: <JIRA.12829786.1431582906000@Atlassian.JIRA>
References: <JIRA.12829786.1431582906000@Atlassian.JIRA>
 <JIRA.12829786.1431582906975@arcas>
Subject: [jira] [Commented] (YARN-3644) Node manager shuts down if unable to
 connect with RM
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/YARN-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547544#comment-14547544 ] 

Raju Bairishetti commented on YARN-3644:
----------------------------------------

W can have a new config like NODEMANAGER_ALIVE_ON_RM_CONNECTION_FAILURES? Based on this config value NM takes a decision on shutdown. In this way we can honour the existing behaviour as well.

I will provide a patch shortly. Not able to assign myself. Can anyone help me in assigning?

> Node manager shuts down if unable to connect with RM
> ----------------------------------------------------
>
>                 Key: YARN-3644
>                 URL: https://issues.apache.org/jira/browse/YARN-3644
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>            Reporter: Srikanth Sundarrajan
>
> When NM is unable to connect to RM, NM shuts itself down.
> {code}
>           } catch (ConnectException e) {
>             //catch and throw the exception if tried MAX wait time to connect RM
>             dispatcher.getEventHandler().handle(
>                 new NodeManagerEvent(NodeManagerEventType.SHUTDOWN));
>             throw new YarnRuntimeException(e);
> {code}
> In large clusters, if RM is down for maintenance for longer period, all the NMs shuts themselves down, requiring additional work to bring up the NMs.
> Setting the yarn.resourcemanager.connect.wait-ms to -1 has other side effects, where non connection failures are being retried infinitely by all YarnClients (via RMProxy).


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)