Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 20911 invoked from network); 19 Sep 2006 10:41:01 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 19 Sep 2006 10:41:01 -0000 Received: (qmail 8972 invoked by uid 500); 19 Sep 2006 10:41:00 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 8950 invoked by uid 500); 19 Sep 2006 10:40:59 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 8941 invoked by uid 99); 19 Sep 2006 10:40:59 -0000 Received: from idunn.apache.osuosl.org (HELO idunn.apache.osuosl.org) (140.211.166.84) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Sep 2006 03:40:59 -0700 X-ASF-Spam-Status: No, hits=1.1 required=5.0 tests=SUBJ_FOR_ONLY Received: from ([209.237.227.198:41206] helo=brutus.apache.org) by idunn.apache.osuosl.org (ecelerity 2.1 r(10620)) with ESMTP id 3D/60-26148-939CF054 for ; Tue, 19 Sep 2006 03:40:57 -0700 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 970AB7142FB for ; Tue, 19 Sep 2006 10:37:22 +0000 (GMT) Message-ID: <19199550.1158662242615.JavaMail.jira@brutus> Date: Tue, 19 Sep 2006 03:37:22 -0700 (PDT) From: "Sanjay Dahiya (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Created: (HADOOP-546) Jobtracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled tasks) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Jobtracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled tasks) ---------------------------------------------------------------------------------------------------- Key: HADOOP-546 URL: http://issues.apache.org/jira/browse/HADOOP-546 Project: Hadoop Issue Type: Bug Components: mapred Affects Versions: 0.6.2 Reporter: Sanjay Dahiya Priority: Critical For many of the rescheduled tasks job tracker doesn't generate job.xml the task fails on job tracker itself and is rescheduled for another node and fails again as the file is still not generated, causing the job to fail. possibly related to Hadoop-543 2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0001_m_022869_3: java.io.FileNotFoundException: .../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml (No such file or directory) at java.io.FileOutputStream.open(Native Method) at java.io.FileOutputStream.(FileOutputStream.java:179) at java.io.FileOutputStream.(FileOutputStream.java:131) at org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.(LocalFileSystem.java:133) at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172) at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180) at org.apache.hadoop.fs.FSDataOutputStream$Summer.(FSDataOutputStream.java:56) at org.apache.hadoop.fs.FSDataOutputStream$Summer.(FSDataOutputStream.java:45) at org.apache.hadoop.fs.FSDataOutputStream.(FSDataOutputStream.java:146) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177) at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810) at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858) at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282) at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275) at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669) at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486) at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689) at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290) -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira