hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adrian Woodhead (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1642) Jobs using LocalJobRunner + JobControl fails
Date Thu, 01 Nov 2007 11:34:53 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539339

Adrian Woodhead commented on HADOOP-1642:

I just checked out the 0.15 branch and I don't see the code  mentioned in the patch commited

Anyway, I applied the most recent patch, rebuilt hadoop and then put the new jar files in
our project. I get the same behaviour as Johan:

11-01 10:57:02] Thread-1 (LocalJobRunner.java:186) - job_local_2
java.io.IOException: Target /tmp/hadoop-adrian/mapred/local/map_0000/file.out already exists
	at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:246)
	at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:125)
	at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:116)
	at org.apache.hadoop.fs.RawLocalFileSystem.rename(RawLocalFileSystem.java:180)
	at org.apache.hadoop.fs.ChecksumFileSystem.rename(ChecksumFileSystem.java:394)
	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.mergeParts(MapTask.java:501)
	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:607)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:193)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:132)

So I don't think this issue should be marked as resolved.

> Jobs using LocalJobRunner + JobControl fails
> --------------------------------------------
>                 Key: HADOOP-1642
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1642
>             Project: Hadoop
>          Issue Type: Bug
>    Affects Versions: 0.13.0
>            Reporter: Johan Oskarsson
>            Assignee: Doug Cutting
>            Priority: Critical
>             Fix For: 0.16.0
>         Attachments: HADOOP-1642-2.patch, HADOOP-1642.patch
> If I run several jobs at the same time using JobControl and the LocalJobRunner i get:
> java.io.IOException: Target /tmp/hadoop-johan/mapred/local/localRunner/job_local_1.xml
already exists.
> It seems like the JobControl class tries to run multiple jobs with the same jobid, causing
the exception.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message