hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Johan Oskarsson (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1642) Jobs using LocalJobRunner + JobControl fails
Date Fri, 19 Oct 2007 10:44:50 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12536177

Johan Oskarsson commented on HADOOP-1642:

I applied the patch to the 0.15 branch and reran my program, this time it got a bit further.
The above error didn't show up.
Instead i got this:

java.io.IOException: Target /tmp/hadoop-johan/mapred/local/map_0000/file.out already exists
        at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:246)
        at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:125)
        at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:116)
        at org.apache.hadoop.fs.RawLocalFileSystem.rename(RawLocalFileSystem.java:180)
        at org.apache.hadoop.fs.ChecksumFileSystem.rename(ChecksumFileSystem.java:380)
        at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.mergeParts(MapTask.java:501)
        at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:607)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:193)
        at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:133)

> Jobs using LocalJobRunner + JobControl fails
> --------------------------------------------
>                 Key: HADOOP-1642
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1642
>             Project: Hadoop
>          Issue Type: Bug
>    Affects Versions: 0.13.0
>            Reporter: Johan Oskarsson
>            Assignee: Doug Cutting
>            Priority: Critical
>             Fix For: 0.15.0
>         Attachments: HADOOP-1642.patch
> If I run several jobs at the same time using JobControl and the LocalJobRunner i get:
> java.io.IOException: Target /tmp/hadoop-johan/mapred/local/localRunner/job_local_1.xml
already exists.
> It seems like the JobControl class tries to run multiple jobs with the same jobid, causing
the exception.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message