hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jian Fang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6304) Specifying node labels when submitting MR jobs
Date Wed, 08 Apr 2015 16:58:13 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14485532#comment-14485532
] 

Jian Fang commented on MAPREDUCE-6304:
--------------------------------------

mapreduce.job.label may not be enough. There should be at least another parameter such as
mapreduce.job.am.label for the application master. For example, on EC2, we don't want to run
an application master on a spot instance, but we do allow MR tasks to run on spot instances
(otherwise, what is the purpose to use instances?). Furthermore, Application Master is a special
Yarn container and MRAppMaster does not run as a YarnChild, right?

> Specifying node labels when submitting MR jobs
> ----------------------------------------------
>
>                 Key: MAPREDUCE-6304
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6304
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Jian Fang
>            Assignee: Naganarasimha G R
>
> Per the discussion on YARN-796, we need a mechanism in MAPREDUCE to specify node labels
when submitting MR jobs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message