Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hadoop-dev@lucene.apache.org
Message-ID: <29521977.1183006946050.JavaMail.jira@brutus>
Date: Wed, 27 Jun 2007 22:02:26 -0700 (PDT)
From: "Nigel Daley (JIRA)" <jira@apache.org>
To: hadoop-dev@lucene.apache.org
Subject: [jira] Updated: (HADOOP-1542) Speculative execution used when
 property set to false
In-Reply-To: <27153124.1183006405863.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HADOOP-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nigel Daley updated HADOOP-1542:
--------------------------------

    Attachment: jobtracker.log

Here's the jobtracker log.  Follow the life cycle of task_0005_m_000004.  This is a TestDFSIO map task that should be writing data.

Note that task_0005_m_000004_1 is created right after task_0005_m_000004_0 even though speculative execution should be off.  task_0005_m_000004_0 seems to complete fine (task_0005_m_000004_1 fails with AlreadyBeingCreatedException -- see namenode.log) but the file it creates (/benchmarks/TestDFSIO/io_data/test_io_12) seems to get lost.

> Speculative execution used when property set to false
> -----------------------------------------------------
>
>                 Key: HADOOP-1542
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1542
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Nigel Daley
>         Attachments: jobtracker.log
>
>
> Speculative execution is now on by default.  When running TestDFSIO, I set speculative execution off in my mapred-default.xml since this test has maps that create files in DFS (side-effects).  
> However, it seems that speculative tasks get started even though I have set speculation off.  I'll attached the NN and JT logs.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.