hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj K (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5622) MRAppMaster doesn't assign all allocated NODE_LOCAL containers to node-local maps
Date Wed, 13 Nov 2013 06:24:17 GMT
Devaraj K created MAPREDUCE-5622:
------------------------------------

             Summary: MRAppMaster doesn't assign all allocated NODE_LOCAL containers to node-local
maps
                 Key: MAPREDUCE-5622
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5622
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: applicationmaster
    Affects Versions: 2.2.0
            Reporter: Devaraj K


MRAppMaster will request containers for all the splits to launch map tasks, RM will give Node
Local containers for all these if available. When the RM gives all containers as Node Local,
MR AM may assign these  NODE-LOCAL containers to non-local maps.
\\
\\
|node1|split1|split2| |split4|
|node2| |split2|split3| |
|node3|split1|split2|split3|split4|
|node4|split1| |split3|split4|
\\
Consider this instance, assume RM has given one NODE LOCAL container on each node to process
all the splits as local maps. While assigning, if the AM gives node1-container for split1,
node2-container for split3, node3-container for split3 and node4-container can be given to
only split2 which is not local. 



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message