hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Subru Krishnan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-4083) Add a discovery mechanism for the scheduler addresss
Date Tue, 25 Aug 2015 23:45:46 GMT
Subru Krishnan created YARN-4083:

             Summary: Add a discovery mechanism for the scheduler addresss
                 Key: YARN-4083
                 URL: https://issues.apache.org/jira/browse/YARN-4083
             Project: Hadoop YARN
          Issue Type: Sub-task
          Components: nodemanager, resourcemanager
            Reporter: Subru Krishnan
            Assignee: Kishore Chaliparambil

We introduce the notion of an RMProxy, running on each node (or once per rack). Upon start
the AM is forced (via tokens and configuration) to direct all its requests to a new services
running on the NM that provide a proxy to the central RM. 

This give us a place to:
1) perform distributed scheduling decisions
2) throttling mis-behaving AMs
3) mask the access to a federation of RMs

This message was sent by Atlassian JIRA

View raw message