Devaraj K created MAPREDUCE-5622:
------------------------------------
Summary: MRAppMaster doesn't assign all allocated NODE_LOCAL containers to node-local
maps
Key: MAPREDUCE-5622
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5622
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: applicationmaster
Affects Versions: 2.2.0
Reporter: Devaraj K
MRAppMaster will request containers for all the splits to launch map tasks, RM will give Node
Local containers for all these if available. When the RM gives all containers as Node Local,
MR AM may assign these NODE-LOCAL containers to non-local maps.
\\
\\
|node1|split1|split2| |split4|
|node2| |split2|split3| |
|node3|split1|split2|split3|split4|
|node4|split1| |split3|split4|
\\
Consider this instance, assume RM has given one NODE LOCAL container on each node to process
all the splits as local maps. While assigning, if the AM gives node1-container for split1,
node2-container for split3, node3-container for split3 and node4-container can be given to
only split2 which is not local.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
|