hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HADOOP-1057) IOException: job.xml already exists
Date Fri, 20 Mar 2009 15:38:50 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Owen O'Malley resolved HADOOP-1057.
-----------------------------------

    Resolution: Cannot Reproduce

I think we fixed this when various race conditions in the job tracker and task were fixed.
I haven't seen it in years.

> IOException: job.xml already exists
> -----------------------------------
>
>                 Key: HADOOP-1057
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1057
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.11.2
>            Reporter: Nigel Daley
>
> Running TestMiniMRLocalFS on Linux, I saw this exception during the 2nd job that it runs:
>     [junit] 2007-02-28 21:09:50,076 INFO  mapred.JobInProgress (JobInProgress.java:findNewTask(573))
- Choosing normal task tip_0002_r_000000
>     [junit] 2007-02-28 21:09:50,079 INFO  mapred.JobTracker (JobTracker.java:createTaskEntry(709))
- Adding task 'task_0002_r_000000_0' to tip tip_0002_r_000000, for tracker 'tracker_foo.com:60042'
>     [junit] 2007-02-28 21:09:50,080 INFO  mapred.TaskTracker (TaskTracker.java:startNewTask(849))
- LaunchTaskAction: task_0002_r_000000_0
>     [junit] 2007-02-28 21:09:50,089 WARN  mapred.TaskTracker (TaskTracker.java:startNewTask(866))
- Error initializing task_0002_r_000000_0:
>     [junit] java.io.IOException: Target /foo/trunk/build/test/mapred/local/60044_0/taskTracker/jobcache/job_0002/job.xml
already exists
>     [junit] 	at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:226)
>     [junit] 	at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:70)
>     [junit] 	at org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:55)
>     [junit] 	at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:766)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:351)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:862)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:530)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:898)
>     [junit] 	at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:130)
>     [junit] 	at java.lang.Thread.run(Thread.java:595)
>     [junit] 2007-02-28 21:09:51,115 INFO  mapred.TaskTracker (TaskTracker.java:reportProgress(1056))
- task_0002_m_000000_0 1.0% file:/foo/trunk/build/test/data/wc/input/part-0:0+47
>     [junit] 2007-02-28 21:09:51,117 INFO  mapred.TaskTracker (TaskTracker.java:reportDone(1106))
- Task task_0002_m_000000_0 is done.
>     [junit] 2007-02-28 21:09:51,203 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(616))
- Task 'task_0002_m_000000_0' has completed tip_0002_m_000000 successfully.
>     [junit] 2007-02-28 21:09:51,203 INFO  mapred.TaskInProgress (TaskInProgress.java:completedTask(411))
- Task 'task_0002_m_000000_0' has completed.
>     [junit] 2007-02-28 21:09:51,847 INFO  mapred.TaskInProgress (TaskInProgress.java:updateStatus(328))
- Error from task_0002_r_000000_0: Error initializing task_0002_r_000000_0:
>     [junit] java.io.IOException: Target /foo/trunk/build/test/mapred/local/60044_0/taskTracker/jobcache/job_0002/job.xml
already exists
>     [junit] 	at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:226)
>     [junit] 	at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:70)
>     [junit] 	at org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:55)
>     [junit] 	at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:766)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:351)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:862)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:530)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:898)
>     [junit] 	at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:130)
>     [junit] 	at java.lang.Thread.run(Thread.java:595)
>     [junit] 2007-02-28 21:09:51,848 INFO  mapred.TaskInProgress (TaskInProgress.java:failedSubTask(380))
- Task 'task_0002_r_000000_0' has been lost.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message