hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Carlos Eduardo Moreira dos Santos <c...@cemshost.com.br>
Subject java.io.FileNotFoundException
Date Sun, 02 May 2010 04:42:20 GMT
Hadoop is working fine in Linux. In Windows (using cygwin) I can't get
mapred to work, though hdfs is ok. This is the stacktrace:

java.io.FileNotFoundException: File
E:/tmp/hadoop-SYSTEM/mapred/local/taskTracker/jobcache/job_201005020105_0001/attempt_201005020105_0001_m_000002_0/work/tmp
does not exist.
	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
	at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519)
	at org.apache.hadoop.mapred.Child.main(Child.java:155)

The beginning of the path (E:/) seems strange (I was hoping for
something like /cygdrive/e or just /tmp). I read TaskRunner.java:519
and I tried to use an absolute path in mapred.child.tmp in
conf/mapred-site.xml, but it keeps looking for the same path even if I
restart mapred. The path exists until jobcache

The tasktracker log shows:

2010-05-02 01:06:23,765 INFO org.apache.hadoop.mapred.TaskTracker:
LaunchTaskAction (registerTask): attempt_201005020105_0001_m_000002_0
task's state:UNASSIGNED^M
2010-05-02 01:06:23,765 INFO org.apache.hadoop.mapred.TaskTracker:
LaunchTaskAction (registerTask): attempt_201005020105_0001_m_000003_0
task's state:UNASSIGNED^M
2010-05-02 01:06:23,765 INFO org.apache.hadoop.mapred.TaskTracker:
Trying to launch : attempt_201005020105_0001_m_000002_0^M
2010-05-02 01:06:23,765 INFO org.apache.hadoop.mapred.TaskTracker: In
TaskLauncher, current free slots : 2 and trying to launch
attempt_201005020105_0001_m_000002_0^M
2010-05-02 01:06:37,562 INFO org.apache.hadoop.mapred.TaskTracker:
Trying to launch : attempt_201005020105_0001_m_000003_0^M
2010-05-02 01:06:37,562 INFO org.apache.hadoop.mapred.TaskTracker: In
TaskLauncher, current free slots : 1 and trying to launch
attempt_201005020105_0001_m_000003_0^M
2010-05-02 01:06:37,625 INFO org.apache.hadoop.mapred.JvmManager: In
JvmRunner constructed JVM ID: jvm_201005020105_0001_m_518928642^M
2010-05-02 01:06:37,625 INFO org.apache.hadoop.mapred.JvmManager: JVM
Runner jvm_201005020105_0001_m_518928642 spawned.^M
2010-05-02 01:06:37,921 INFO org.apache.hadoop.mapred.JvmManager: In
JvmRunner constructed JVM ID: jvm_201005020105_0001_m_1918177803^M
2010-05-02 01:06:37,921 INFO org.apache.hadoop.mapred.JvmManager: JVM
Runner jvm_201005020105_0001_m_1918177803 spawned.^M
2010-05-02 01:06:40,312 INFO org.apache.hadoop.mapred.TaskTracker: JVM
with ID: jvm_201005020105_0001_m_518928642 given task:
attempt_201005020105_0001_m_000002_0^M
2010-05-02 01:06:40,578 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201005020105_0001_m_000002_0 0.0% ^M
2010-05-02 01:06:40,687 INFO org.apache.hadoop.mapred.JvmManager: JVM
: jvm_201005020105_0001_m_518928642 exited. Number of tasks it ran:
0^M
2010-05-02 01:06:41,046 INFO org.apache.hadoop.mapred.TaskTracker: JVM
with ID: jvm_201005020105_0001_m_1918177803 given task:
attempt_201005020105_0001_m_000003_0^M
2010-05-02 01:06:41,265 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201005020105_0001_m_000003_0 0.0% ^M
2010-05-02 01:06:41,421 INFO org.apache.hadoop.mapred.JvmManager: JVM
: jvm_201005020105_0001_m_1918177803 exited. Number of tasks it ran:
0^M
2010-05-02 01:06:43,687 INFO org.apache.hadoop.mapred.TaskRunner:
attempt_201005020105_0001_m_000002_0 done; removing files.^M
2010-05-02 01:06:43,687 INFO org.apache.hadoop.mapred.TaskTracker:
addFreeSlot : current free slots : 1^M
2010-05-02 01:06:44,421 INFO org.apache.hadoop.mapred.TaskRunner:
attempt_201005020105_0001_m_000003_0 done; removing files.^M
2010-05-02 01:06:44,421 INFO org.apache.hadoop.mapred.TaskTracker:
addFreeSlot : current free slots : 2^M
2010-05-02 01:07:20,953 INFO org.apache.hadoop.mapred.TaskTracker:
Received 'KillJobAction' for job: job_201005020105_0001

Any idea?

Thank you,
Carlos Eduardo

Mime
View raw message