hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (Jira)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-7278) Speculative execution behavior is observed even when mapreduce.map.speculative and mapreduce.reduce.speculative are false
Date Thu, 28 May 2020 03:51:00 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17118275#comment-17118275
] 

Hudson commented on MAPREDUCE-7278:
-----------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18303 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/18303/])
MAPREDUCE-7278. Speculative execution behavior is observed even when (wilfreds: rev 10db97df1c8562a9e29b00e60d5bde1773c09188)
* (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskImpl.java
* (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestSpeculativeExecution.java


> Speculative execution behavior is observed even when mapreduce.map.speculative and mapreduce.reduce.speculative
are false
> -------------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-7278
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7278
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: task
>    Affects Versions: 2.8.0, 3.4.0
>            Reporter: Tarun Parimi
>            Assignee: Tarun Parimi
>            Priority: Major
>             Fix For: 3.3.0, 3.2.2, 3.4.0
>
>         Attachments: MAPREDUCE-7278.001.patch, MAPREDUCE-7278.002.patch, MAPREDUCE-7278.003.patch,
MAPREDUCE-7278.004.patch, Screen Shot 2020-04-30 at 8.04.27 PM.png
>
>
> When a failed task attempt container is stuck in FAIL_FINISHING_CONTAINER state for some
time, we observe two task attempts are launched simultaneously even when speculative execution
is disabled.
> This results in the below message shown in the killed attempts, indicating speculation
has occurred. This is an issue for jobs which require speculative execution to be strictly
disabled.
>   !Screen Shot 2020-04-30 at 8.04.27 PM.png!
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message