hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adam Kramer (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-2857) When reducers are complete, trailing mappers delay job completion
Date Thu, 18 Aug 2011 18:40:27 GMT
When reducers are complete, trailing mappers delay job completion
-----------------------------------------------------------------

                 Key: MAPREDUCE-2857
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2857
             Project: Hadoop Map/Reduce
          Issue Type: Bug
            Reporter: Adam Kramer
            Priority: Minor


Sometimes, mappers restart themselves for some reason (there are several reasons, for example,
because it has lost access to the data it generated which a reducer may later need.). However,
not all reducers will depend on that mapper. Accordingly,  jobs can get into a state in which
all reducers have completed but some mappers are still running. This is a bug--when the reducers
have completed, the job should be marked as completed immediately and any trailing map tasks
killed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message