hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sharad Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2646) MR-279: AM with same sized maps and reduces hangs in presence of failing maps
Date Wed, 06 Jul 2011 05:42:17 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13060304#comment-13060304
] 

Sharad Agarwal commented on MAPREDUCE-2646:
-------------------------------------------

Vinod and I discussed this. It seems like in the returned container list from RM, priority
at which the respective
container got allocated is needed. Without which AM cant update the ask/release data structures
correctly leading to
resource table in AM and RM going out of sync.

> MR-279: AM with same sized maps and reduces hangs in presence of failing maps
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2646
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2646
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Sharad Agarwal
>            Assignee: Sharad Agarwal
>
> Currently AM can assign a container given by RM to any map or reduce. However RM allocates
for a particular priority. This leads to AM and RM data structures going out of sync.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message