hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5533) Speculative execution does not function for reduce
Date Fri, 04 Oct 2013 17:37:49 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13786382#comment-13786382
] 

Hudson commented on MAPREDUCE-5533:
-----------------------------------

SUCCESS: Integrated in Hadoop-trunk-Commit #4538 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/4538/])
MAPREDUCE-5533. Fixed MR speculation code to track any TaskAttempts that aren't heart-beating
for a while, so that we can aggressively speculate instead of waiting for task-timeout. Contributed
by Xuan Gong. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1529229)
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/speculate/DefaultSpeculator.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/MRApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestSpeculativeExecutionWithMRApp.java


> Speculative execution does not function for reduce
> --------------------------------------------------
>
>                 Key: MAPREDUCE-5533
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5533
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: applicationmaster
>            Reporter: Tassapol Athiapinya
>            Assignee: Xuan Gong
>             Fix For: 2.1.2-beta
>
>         Attachments: MAPREDUCE-5533.1.patch, MAPREDUCE-5533.2.patch, MAPREDUCE-5533.3.patch,
MAPREDUCE-5533.4.patch, MAPREDUCE-5533.5.patch, MAPREDUCE-5533.6.patch
>
>
> We have sort job where reduce attempt does not send heartbeat in timely manner to application
master. The AM should kick off another attempt to let job succeeds. What we find is the job
fails and there is no speculation happening.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message