hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Björn-Elmar Macek <ma...@cs.uni-kassel.de>
Subject Logs cannot be created
Date Wed, 08 Aug 2012 14:04:12 GMT
Hi,

after having successfully tested my Hadoop program with small sets of 
data, i began applying Hadoop to the original data set (~63gig).
Somehow the logs cannot be written. My log looks like this:

12/08/07 17:23:02 WARN mapred.JobClient: Use GenericOptionsParser for 
parsing the arguments. Applications should implement Tool for the same.
12/08/07 17:23:02 INFO util.NativeCodeLoader: Loaded the native-hadoop 
library
12/08/07 17:23:02 WARN snappy.LoadSnappy: Snappy native library not loaded
12/08/07 17:23:02 INFO mapred.FileInputFormat: Total input paths to 
process : 1
12/08/07 17:23:03 INFO mapred.JobClient: Running job: job_201208071709_0001
12/08/07 17:23:04 INFO mapred.JobClient:  map 0% reduce 0%
12/08/07 17:33:13 INFO mapred.JobClient: Task Id : 
attempt_201208071709_0001_m_000951_0, Status : FAILED
Task attempt_201208071709_0001_m_000951_0 failed to report status for 
602 seconds. Killing!
12/08/07 17:43:16 INFO mapred.JobClient: Task Id : 
attempt_201208071709_0001_r_000002_0, Status : FAILED
Task attempt_201208071709_0001_r_000002_0 failed to report status for 
600 seconds. Killing!
12/08/07 17:52:08 INFO mapred.JobClient: Task Id : 
attempt_201208071709_0001_m_000002_0, Status : FAILED
java.lang.Throwable: Child Error
     at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Creation of 
/tmp/hadoop-bmacek/mapred/local/userlogs/job_201208071709_0001/attempt_201208071709_0001_m_000002_0

failed.
     at 
org.apache.hadoop.mapred.TaskLog.createTaskAttemptLogDir(TaskLog.java:102)
     at 
org.apache.hadoop.mapred.DefaultTaskController.createLogDir(DefaultTaskController.java:71)
     at 
org.apache.hadoop.mapred.TaskRunner.prepareLogFiles(TaskRunner.java:316)
     at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:228)

12/08/07 17:52:08 WARN mapred.JobClient: Error reading task 
outputhttp://its-cs231.its.uni-kassel.de:50060/tasklog?plaintext=true&attemptid=attempt_201208071709_0001_m_000002_0&filter=stdout
12/08/07 17:52:08 WARN mapred.JobClient: Error reading task 
outputhttp://its-cs231.its.uni-kassel.de:50060/tasklog?plaintext=true&attemptid=attempt_201208071709_0001_m_000002_0&filter=stderr
12/08/07 17:52:08 INFO mapred.JobClient: Task Id : 
attempt_201208071709_0001_m_000004_0, Status : FAILED
java.lang.Throwable: Child Error
     at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Creation of 
/tmp/hadoop-bmacek/mapred/local/userlogs/job_201208071709_0001/attempt_201208071709_0001_m_000004_0

failed.
     at 
org.apache.hadoop.mapred.TaskLog.createTaskAttemptLogDir(TaskLog.java:102)
     at 
org.apache.hadoop.mapred.DefaultTaskController.createLogDir(DefaultTaskController.java:71)
     at 
org.apache.hadoop.mapred.TaskRunner.prepareLogFiles(TaskRunner.java:316)
     at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:228)


And this repeats kind of endlessly.

I have informed myself about this error message and i found several 
posts saying, that space restrictions might be the root of the problem, 
but since i clean all working directories *before* running Hadoop i 
doubt this is the reason.

I also looked up some of the slaves' logs (they are about 12MB big) and 
they contain similar errors but others as well.

Can anybody tell me please, what's going wrong here?

Thanks in advance and best regards,
Björn

Mime
View raw message