hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1734) RM should get the updated Configurations when it transits from Standby to Active
Date Mon, 03 Mar 2014 18:24:26 GMT

    [ https://issues.apache.org/jira/browse/YARN-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13918365#comment-13918365
] 

Karthik Kambatla commented on YARN-1734:
----------------------------------------

In our case, we plan to use the LocalConfiguration and not the FileSystemBased one. So, in
the HA case, we would update the local configs on both RMs and call the appropriate refresh
command on both RMs - this is what we do for HDFS as well. The expectation is that the Active
picks these up immediately, and the Standby picks them eventually when it becomes Active.
In other words, the expectation is that these updates are not lost. 

With the current code, the Standby would throw a StandbyException, thereby telling the user
that the config refresh has failed. This is not exactly true, because the Standby would actually
pick the latest configs when transitioning to Active. No? 

Let me think more on this, but thought I should raise this concern. 
 

> RM should get the updated Configurations when it transits from Standby to Active
> --------------------------------------------------------------------------------
>
>                 Key: YARN-1734
>                 URL: https://issues.apache.org/jira/browse/YARN-1734
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Xuan Gong
>            Assignee: Xuan Gong
>            Priority: Critical
>             Fix For: 2.4.0
>
>         Attachments: YARN-1734.1.patch, YARN-1734.2.patch, YARN-1734.3.patch, YARN-1734.4.patch,
YARN-1734.5.patch, YARN-1734.6.patch, YARN-1734.7.patch
>
>
> Currently, we have ConfigurationProvider which can support LocalConfiguration, and FileSystemBasedConfiguration.
When HA is enabled, and FileSystemBasedConfiguration is enabled, RM can not get the updated
Configurations when it transits from Standby to Active



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message