hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1029) Allow embedding leader election into the RM
Date Mon, 16 Dec 2013 10:46:09 GMT

    [ https://issues.apache.org/jira/browse/YARN-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13849016#comment-13849016

Tom White commented on YARN-1029:

> RM HA uses ZK itself for shared storage, so it already has a dependency on ZK.

This is true when using the ZKRMStateStore, but there are other stores, like the FileSystemRMStateStore
which don't introduce a ZK dependency. However, I agree with your and Karthik's argument about
not needing an external ZKFC option, or at least doing this JIRA before YARN-1177. That's
because supporting different RMStateStore implementations for RM HA is more work and potentially
confusing for users, so we could say to them that for RM HA you have to use the ZKRMStateStore,
and leader election is embedded in the RM so there is no external ZKFC to use.

> Allow embedding leader election into the RM
> -------------------------------------------
>                 Key: YARN-1029
>                 URL: https://issues.apache.org/jira/browse/YARN-1029
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Bikas Saha
>            Assignee: Karthik Kambatla
>         Attachments: embedded-zkfc-approach.patch, yarn-1029-0.patch, yarn-1029-0.patch,
> It should be possible to embed common ActiveStandyElector into the RM such that ZooKeeper
based leader election and notification is in-built. In conjunction with a ZK state store,
this configuration will be a simple deployment option.

This message was sent by Atlassian JIRA

View raw message