hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jian Fang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-3490) Add an application decorator to ClientRMService
Date Wed, 15 Apr 2015 17:59:59 GMT
Jian Fang created YARN-3490:

             Summary: Add an application decorator to ClientRMService
                 Key: YARN-3490
                 URL: https://issues.apache.org/jira/browse/YARN-3490
             Project: Hadoop YARN
          Issue Type: New Feature
          Components: resourcemanager
            Reporter: Jian Fang

Per the discussion on MAPREDUCE-6304, hadoop cloud service provider wants to hook in some
logic to control the allocation of an application on the resource manager side because it
is sometimes impractical to control the client side of a hadoop cluster in cloud. Hadoop service
provider and hadoop users usually have different privileges, control, and access on a hadoop
cluster in cloud. 

One good example is that application masters should not be allocated to spot instances on
Amazon EC2. To achieve that, an application decorator could be provided to orchestrate the
ApplicationSubmissionContext by specifying the AM label expression, for example. 

Hadoop could provide a dummy decorator that does nothing by default, but it should allow users
to replace this decorator with their own decorators to meet their specific needs.

This message was sent by Atlassian JIRA

View raw message