hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Dahiya (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-546) Jobtracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled tasks)
Date Tue, 19 Sep 2006 10:37:22 GMT
Jobtracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled
tasks)
----------------------------------------------------------------------------------------------------

                 Key: HADOOP-546
                 URL: http://issues.apache.org/jira/browse/HADOOP-546
             Project: Hadoop
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.6.2
            Reporter: Sanjay Dahiya
            Priority: Critical


For many of the rescheduled tasks job tracker doesn't generate job.xml the task fails on job
tracker itself and is rescheduled for another node and fails again as the file is still not
generated, causing the job to fail. 

possibly related to Hadoop-543

2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0001_m_022869_3:
java.io.FileNotFoundException: .../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml
(No such file or directory)
        at java.io.FileOutputStream.open(Native Method)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
        at org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.<init>(LocalFileSystem.java:133)
        at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172)
        at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180)
        at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:56)
        at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:45)
        at org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:146)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177)
        at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810)
        at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858)
        at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282)
        at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275)
        at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669)
        at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486)
        at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689)
        at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290)


-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message