hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Subru Krishnan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's
Date Sat, 16 May 2015 01:42:02 GMT

     [ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Subru Krishnan updated YARN-2915:
---------------------------------
    Attachment: Yarn_federation_design_v1.pdf

Uploading a proposal of design based on offline design discussions within our team and with
[~kasha], [~adhoot], [~vinodkv], [~acmurthy], [~tucu00] and more people (apologize if I missed
anyone).  We validated the proposed design by developing a prototype and we have a basic end2end
functioning system where we can stitch multiple YARN clusters into a unified federated cluster
and run jobs that transparently span across all of them.

> Enable YARN RM scale out via federation using multiple RM's
> -----------------------------------------------------------
>
>                 Key: YARN-2915
>                 URL: https://issues.apache.org/jira/browse/YARN-2915
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: nodemanager, resourcemanager
>            Reporter: Sriram Rao
>            Assignee: Subru Krishnan
>         Attachments: Yarn_federation_design_v1.pdf
>
>
> This is an umbrella JIRA that proposes to scale out YARN to support large clusters comprising
of tens of thousands of nodes.   That is, rather than limiting a YARN managed cluster to about
4k in size, the proposal is to enable the YARN managed cluster to be elastically scalable.
 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message