hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lei Guo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's
Date Wed, 08 Jul 2015 14:05:07 GMT

    [ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618627#comment-14618627
] 

Lei Guo commented on YARN-2915:
-------------------------------

Thanks [~subru] and [~curino], maybe we should also consider the router to be per DC.

Another question, for [~curino]'s comment, " the AMRMProxy of YARN-2884 can be run only on
a small cluster that work as a launch pad for the federation.", can you elaborate a little
bit on the desired end to end behavior? The description in the design is different to the
comment, "The AMRMProxy runs on all the NM machines and acts as a proxy to the YARN RM for
the AMs by implementing the ApplicationMasterProtocol." 

> Enable YARN RM scale out via federation using multiple RM's
> -----------------------------------------------------------
>
>                 Key: YARN-2915
>                 URL: https://issues.apache.org/jira/browse/YARN-2915
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: nodemanager, resourcemanager
>            Reporter: Sriram Rao
>            Assignee: Subru Krishnan
>         Attachments: FEDERATION_CAPACITY_ALLOCATION_JIRA.pdf, Yarn_federation_design_v1.pdf,
federation-prototype.patch
>
>
> This is an umbrella JIRA that proposes to scale out YARN to support large clusters comprising
of tens of thousands of nodes.   That is, rather than limiting a YARN managed cluster to about
4k in size, the proposal is to enable the YARN managed cluster to be elastically scalable.
 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message