hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Eagles (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-1060) JT should kill running maps when all the reducers have completed
Date Wed, 27 Jul 2011 21:57:10 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072047#comment-13072047
] 

Jonathan Eagles commented on MAPREDUCE-1060:
--------------------------------------------

This patch is for 20-security only.

> JT should kill running maps when all the reducers have completed
> ----------------------------------------------------------------
>
>                 Key: MAPREDUCE-1060
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1060
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Jothi Padmanabhan
>            Assignee: Jonathan Eagles
>             Fix For: 0.20.205.0
>
>         Attachments: MAPREDUCE-1060-branch-0.20-security.manualtest.patch, MAPREDUCE-1060-branch-0.20-security.patch
>
>
> We have seen some situations where maps are still running when all the reducers have
completed. This could happen because of lost TT's, interplay of speculative tasks with bad
TT's etc. If the maps take a long time to run, it unnecessarily delays the job completion
time, as this map output is not required anyways. The JT should possibly kill running maps
when all the reducers have completed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message