hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bikas Saha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-752) Throw exception if AMRMClient.ContainerRequest is given invalid locations
Date Mon, 03 Jun 2013 20:24:20 GMT

    [ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13673512#comment-13673512

Bikas Saha commented on YARN-752:

I was going to open a jira for the second option actually. Given yarn's defaults on relaxing
locality etc. it makes sense for the client to automatically add racks when a node is present
without its rack. So users can specify mix of nodes and racks and the client will fill in
missing racks for the nodes if needed. If strict locality is enabled then it will not add
the racks.
If anyone knows the node to rack mapping (as understood by the RM and thats what matters)
then its the amrmclient.
It is perfectly valid for users to specify nodes without racks to amrmclient.
> Throw exception if AMRMClient.ContainerRequest is given invalid locations
> -------------------------------------------------------------------------
>                 Key: YARN-752
>                 URL: https://issues.apache.org/jira/browse/YARN-752
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: api, applications
>    Affects Versions: 2.0.4-alpha
>            Reporter: Sandy Ryza
>            Assignee: Sandy Ryza
> A ContainerRequest that includes node-level requests must also include matching rack-level
requests for the racks that those nodes are on.  At the very least, an exception should be
thrown if one is constructed with a non-empty set of nodes but an empty set of racks.
> If possible, it would also be nice to validate that the given nodes are on the racks
that are given.  Although if that is possible, then it might be even better to just automatically
fill in racks for nodes.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message