hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sharad Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4358) Reducers are assigned containers before all maps are assigned containers
Date Thu, 21 Jun 2012 12:52:43 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398398#comment-13398398

Sharad Agarwal commented on MAPREDUCE-4358:

This is already handled by actively looking at the available headroom for the job and ramp
down (pre-empt) the reduces if needed. Are you seeing this issue in your cluster ?
> Reducers are assigned containers before all maps are assigned containers
> ------------------------------------------------------------------------
>                 Key: MAPREDUCE-4358
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4358
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.0.0-alpha
>            Reporter: Ahmed Radwan
> Reducers start to get containers before all maps are. We have seen this issue and it
is problematic since if there is no avaialable resources for the remaining maps, the job will
just stall where reducers are waiting for mappers which are unable to start because there
is no containers available.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message