hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yuliya Feldman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6304) Specifying node labels when submitting MR jobs
Date Wed, 08 Apr 2015 19:16:13 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14485844#comment-14485844

Yuliya Feldman commented on MAPREDUCE-6304:

I do not think labels should be dictated by RM, since different types of jobs may require
different types of resources. It is definitely true that cluster admins label nodes so those
labels can be used while making a decision from the application prospective.
It is true that job is submitted from the client, but it is not like you submit different
classes of jobs every time, so eventually job owner will know what resources he/she needs
for that specific class of jobs. 
The case you described warrants just setting labels in mapred-site.xml on client side and
be done. If you submit all sorts of jobs then may be you don't even care about labels.
Yet another choice is to utilize labels on Queues - this will be set on the cluster so for
jobs submitted to a specific queue specific labels will be applied

> Specifying node labels when submitting MR jobs
> ----------------------------------------------
>                 Key: MAPREDUCE-6304
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6304
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Jian Fang
>            Assignee: Naganarasimha G R
> Per the discussion on YARN-796, we need a mechanism in MAPREDUCE to specify node labels
when submitting MR jobs.

This message was sent by Atlassian JIRA

View raw message