hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lei Guo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's
Date Wed, 08 Jul 2015 14:05:07 GMT

    [ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618627#comment-14618627

Lei Guo commented on YARN-2915:

Thanks [~subru] and [~curino], maybe we should also consider the router to be per DC.

Another question, for [~curino]'s comment, " the AMRMProxy of YARN-2884 can be run only on
a small cluster that work as a launch pad for the federation.", can you elaborate a little
bit on the desired end to end behavior? The description in the design is different to the
comment, "The AMRMProxy runs on all the NM machines and acts as a proxy to the YARN RM for
the AMs by implementing the ApplicationMasterProtocol." 

> Enable YARN RM scale out via federation using multiple RM's
> -----------------------------------------------------------
>                 Key: YARN-2915
>                 URL: https://issues.apache.org/jira/browse/YARN-2915
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: nodemanager, resourcemanager
>            Reporter: Sriram Rao
>            Assignee: Subru Krishnan
>         Attachments: FEDERATION_CAPACITY_ALLOCATION_JIRA.pdf, Yarn_federation_design_v1.pdf,
> This is an umbrella JIRA that proposes to scale out YARN to support large clusters comprising
of tens of thousands of nodes.   That is, rather than limiting a YARN managed cluster to about
4k in size, the proposal is to enable the YARN managed cluster to be elastically scalable.

This message was sent by Atlassian JIRA

View raw message