hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jian Fang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6304) Specifying node labels when submitting MR jobs
Date Wed, 08 Apr 2015 19:04:13 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14485817#comment-14485817

Jian Fang commented on MAPREDUCE-6304:

YarnRunner is the right place to set the labels for a MR job. However, there is one concern
here. If I understand correctly, YarnRunner runs at the job client side, right? There should
also be a way to hook in the labels on the server side, i.e., resource manager side. The reason
is that many Hadoop users do not understand or set the labels by themselves and they simply
rely on the Hadoop platform provider (or system admins for on-premise clusters) to set up
the labels for them. I am not sure if this is a general use case, but it is definitely a feature
that we need.

> Specifying node labels when submitting MR jobs
> ----------------------------------------------
>                 Key: MAPREDUCE-6304
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6304
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Jian Fang
>            Assignee: Naganarasimha G R
> Per the discussion on YARN-796, we need a mechanism in MAPREDUCE to specify node labels
when submitting MR jobs.

This message was sent by Atlassian JIRA

View raw message