hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: java.io.FileNotFoundException
Date Sun, 02 May 2010 13:39:40 GMT
Looks like localFs.mkdirs(tmpDir) failed. Can you check whether you can
manually create
E:/tmp/hadoop-SYSTEM/mapred/local/taskTracker/jobcache/job_201005020105_0001/attempt_201005020105_0001_m_000002_0/work/tmp
?

Also, what do you set mapred.local.dir to ? Try not using /tmp.

On Sat, May 1, 2010 at 9:42 PM, Carlos Eduardo Moreira dos Santos <
cems@cemshost.com.br> wrote:

> Hadoop is working fine in Linux. In Windows (using cygwin) I can't get
> mapred to work, though hdfs is ok. This is the stacktrace:
>
> java.io.FileNotFoundException: File
>
> E:/tmp/hadoop-SYSTEM/mapred/local/taskTracker/jobcache/job_201005020105_0001/attempt_201005020105_0001_m_000002_0/work/tmp
> does not exist.
>        at
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>        at
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>        at
> org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519)
>        at org.apache.hadoop.mapred.Child.main(Child.java:155)
>
> The beginning of the path (E:/) seems strange (I was hoping for
> something like /cygdrive/e or just /tmp). I read TaskRunner.java:519
> and I tried to use an absolute path in mapred.child.tmp in
> conf/mapred-site.xml, but it keeps looking for the same path even if I
> restart mapred. The path exists until jobcache
>
> The tasktracker log shows:
>
> 2010-05-02 01:06:23,765 INFO org.apache.hadoop.mapred.TaskTracker:
> LaunchTaskAction (registerTask): attempt_201005020105_0001_m_000002_0
> task's state:UNASSIGNED^M
> 2010-05-02 01:06:23,765 INFO org.apache.hadoop.mapred.TaskTracker:
> LaunchTaskAction (registerTask): attempt_201005020105_0001_m_000003_0
> task's state:UNASSIGNED^M
> 2010-05-02 01:06:23,765 INFO org.apache.hadoop.mapred.TaskTracker:
> Trying to launch : attempt_201005020105_0001_m_000002_0^M
> 2010-05-02 01:06:23,765 INFO org.apache.hadoop.mapred.TaskTracker: In
> TaskLauncher, current free slots : 2 and trying to launch
> attempt_201005020105_0001_m_000002_0^M
> 2010-05-02 01:06:37,562 INFO org.apache.hadoop.mapred.TaskTracker:
> Trying to launch : attempt_201005020105_0001_m_000003_0^M
> 2010-05-02 01:06:37,562 INFO org.apache.hadoop.mapred.TaskTracker: In
> TaskLauncher, current free slots : 1 and trying to launch
> attempt_201005020105_0001_m_000003_0^M
> 2010-05-02 01:06:37,625 INFO org.apache.hadoop.mapred.JvmManager: In
> JvmRunner constructed JVM ID: jvm_201005020105_0001_m_518928642^M
> 2010-05-02 01:06:37,625 INFO org.apache.hadoop.mapred.JvmManager: JVM
> Runner jvm_201005020105_0001_m_518928642 spawned.^M
> 2010-05-02 01:06:37,921 INFO org.apache.hadoop.mapred.JvmManager: In
> JvmRunner constructed JVM ID: jvm_201005020105_0001_m_1918177803^M
> 2010-05-02 01:06:37,921 INFO org.apache.hadoop.mapred.JvmManager: JVM
> Runner jvm_201005020105_0001_m_1918177803 spawned.^M
> 2010-05-02 01:06:40,312 INFO org.apache.hadoop.mapred.TaskTracker: JVM
> with ID: jvm_201005020105_0001_m_518928642 given task:
> attempt_201005020105_0001_m_000002_0^M
> 2010-05-02 01:06:40,578 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201005020105_0001_m_000002_0 0.0% ^M
> 2010-05-02 01:06:40,687 INFO org.apache.hadoop.mapred.JvmManager: JVM
> : jvm_201005020105_0001_m_518928642 exited. Number of tasks it ran:
> 0^M
> 2010-05-02 01:06:41,046 INFO org.apache.hadoop.mapred.TaskTracker: JVM
> with ID: jvm_201005020105_0001_m_1918177803 given task:
> attempt_201005020105_0001_m_000003_0^M
> 2010-05-02 01:06:41,265 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201005020105_0001_m_000003_0 0.0% ^M
> 2010-05-02 01:06:41,421 INFO org.apache.hadoop.mapred.JvmManager: JVM
> : jvm_201005020105_0001_m_1918177803 exited. Number of tasks it ran:
> 0^M
> 2010-05-02 01:06:43,687 INFO org.apache.hadoop.mapred.TaskRunner:
> attempt_201005020105_0001_m_000002_0 done; removing files.^M
> 2010-05-02 01:06:43,687 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 1^M
> 2010-05-02 01:06:44,421 INFO org.apache.hadoop.mapred.TaskRunner:
> attempt_201005020105_0001_m_000003_0 done; removing files.^M
> 2010-05-02 01:06:44,421 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 2^M
> 2010-05-02 01:07:20,953 INFO org.apache.hadoop.mapred.TaskTracker:
> Received 'KillJobAction' for job: job_201005020105_0001
>
> Any idea?
>
> Thank you,
> Carlos Eduardo
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message