hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5533) Speculative execution does not function for reduce
Date Fri, 04 Oct 2013 04:46:48 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Vinod Kumar Vavilapalli updated MAPREDUCE-5533:

    Attachment: MAPREDUCE-5533.6.patch

Same patch as Xuan's with the following modifications
 - Changed the waiting time to be 9 secs on 3 task-heartbeats
 - Added lots of java comments
 - Renamed variables/methods for better readability
 - Fixed formatting
 - Refactored test to not duplicate code
 - Increased test timeout so that it doesn't fail randomly due to timeouts

Will check this in when Jenkins says okay.

> Speculative execution does not function for reduce
> --------------------------------------------------
>                 Key: MAPREDUCE-5533
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5533
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: applicationmaster
>            Reporter: Tassapol Athiapinya
>            Assignee: Xuan Gong
>         Attachments: MAPREDUCE-5533.1.patch, MAPREDUCE-5533.2.patch, MAPREDUCE-5533.3.patch,
MAPREDUCE-5533.4.patch, MAPREDUCE-5533.5.patch, MAPREDUCE-5533.6.patch
> We have sort job where reduce attempt does not send heartbeat in timely manner to application
master. The AM should kick off another attempt to let job succeeds. What we find is the job
fails and there is no speculation happening.

This message was sent by Atlassian JIRA

View raw message