hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Subru Krishnan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's
Date Sat, 16 May 2015 01:42:02 GMT

     [ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Subru Krishnan updated YARN-2915:
    Attachment: Yarn_federation_design_v1.pdf

Uploading a proposal of design based on offline design discussions within our team and with
[~kasha], [~adhoot], [~vinodkv], [~acmurthy], [~tucu00] and more people (apologize if I missed
anyone).  We validated the proposed design by developing a prototype and we have a basic end2end
functioning system where we can stitch multiple YARN clusters into a unified federated cluster
and run jobs that transparently span across all of them.

> Enable YARN RM scale out via federation using multiple RM's
> -----------------------------------------------------------
>                 Key: YARN-2915
>                 URL: https://issues.apache.org/jira/browse/YARN-2915
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: nodemanager, resourcemanager
>            Reporter: Sriram Rao
>            Assignee: Subru Krishnan
>         Attachments: Yarn_federation_design_v1.pdf
> This is an umbrella JIRA that proposes to scale out YARN to support large clusters comprising
of tens of thousands of nodes.   That is, rather than limiting a YARN managed cluster to about
4k in size, the proposal is to enable the YARN managed cluster to be elastically scalable.

This message was sent by Atlassian JIRA

View raw message