hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6304) Specifying node labels when submitting MR jobs
Date Mon, 27 Apr 2015 18:41:40 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514669#comment-14514669

Wangda Tan commented on MAPREDUCE-6304:

Hi [~Naganarasimha],
Just took a look at the patch, some comments about syntax:
- Beyond AM/Job node-labels setting, should we support Mapper/Reducer setting? 
- When job and AM (or mapper/reducer) set together, AM (or mapper/reducer)'s node-label-expression
should overwrite job's setting.
- If we need support mapper/reducer's node-label-expression. We may need add some changes
in MR AM side and some tests.

Any ideas? [~lohit]. 

> Specifying node labels when submitting MR jobs
> ----------------------------------------------
>                 Key: MAPREDUCE-6304
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6304
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Jian Fang
>            Assignee: Naganarasimha G R
>             Fix For: 2.8.0
>         Attachments: MAPREDUCE-6304.20150410-1.patch, MAPREDUCE-6304.20150411-1.patch
> Per the discussion on YARN-796, we need a mechanism in MAPREDUCE to specify node labels
when submitting MR jobs.

This message was sent by Atlassian JIRA

View raw message