hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nigel Daley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1542) Speculative execution used when property set to false
Date Thu, 28 Jun 2007 05:22:26 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12508733

Nigel Daley commented on HADOOP-1542:

Is it possible that setting speculation off in mapred-default.xml on my job submission host
has no effect and that i really need to set it off in hadoop-site.xml?  

If that is the case, then speculation would be on -- which explains perfectly the immediate
execution of task_0005_m_000004_1.  In which case this should be filed as a dfs bug since
the file created by the first map (task_0005_m_000004_0) is getting lost.

> Speculative execution used when property set to false
> -----------------------------------------------------
>                 Key: HADOOP-1542
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1542
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Nigel Daley
>         Attachments: jobtracker.log, namenode.log
> Speculative execution is now on by default.  When running TestDFSIO, I set speculative
execution off in my mapred-default.xml since this test has maps that create files in DFS (side-effects).
> However, it seems that speculative tasks get started even though I have set speculation
off.  I'll attached the NN and JT logs.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message