hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harshit Kumar <hkumar.ar...@gmail.com>
Subject org.apache.hadoop.util.DiskChecker$DiskErrorException
Date Tue, 20 Oct 2009 02:37:33 GMT
Hi
I get the following error on executing a map-reduce application on EC2.
Can any one please pass suggest some pointers what is going wrong?

I tried searching the mailing list, but couldnt find any help regarding this
type of error.

*[root@ip-10-243-47-69 hadoop-0.19.0]# bin/hadoop jar lubm.jar
bike.lubm.SubPredObj In*
*09/10/19 22:26:41 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName=JobTracker, sessionId=*
*09/10/19 22:26:41 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.*
*09/10/19 22:26:42 INFO mapred.FileInputFormat: Total input paths to process
: 1*
*09/10/19 22:26:42 INFO mapred.JobClient: Running job: job_local_0001*
*09/10/19 22:26:42 INFO mapred.FileInputFormat: Total input paths to process
: 1*
*09/10/19 22:26:43 INFO mapred.MapTask: numReduceTasks: 1*
*09/10/19 22:26:43 INFO mapred.MapTask: io.sort.mb = 100*
*09/10/19 22:26:43 INFO mapred.MapTask: data buffer = 79691776/99614720*
*09/10/19 22:26:43 INFO mapred.MapTask: record buffer = 262144/327680*
*09/10/19 22:26:43 INFO mapred.JobClient:  map 0% reduce 0%*
*09/10/19 22:26:44 WARN impl.RDFDefaultErrorHandler: unknown-source: {W136}
Relative URIs are not permitted in RDF: specifically <RDF/XML>*
*09/10/19 22:26:44 ERROR impl.RDFDefaultErrorHandler:
file:///usr/local/hadoop-0.19.0/RDF/XML(line 9 column 28): {E215} Resolving
against relative URI <RDF/XML>: <>*
*09/10/19 22:26:44 WARN impl.RDFDefaultErrorHandler:
file:///usr/local/hadoop-0.19.0/RDF/XML(line 9 column 28): {W136} Relative
URIs are not permitted in RDF: specifically <RDF/XML>*
*09/10/19 22:26:49 INFO mapred.MapTask: Starting flush of map output*
*09/10/19 22:26:49 WARN mapred.LocalJobRunner: job_local_0001*
*org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any
valid local directory for
taskTracker/jobcache/job_local_0001/attempt_local_0001_m_000000_0/output/spill0.out
*
*        at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:335)
*
*        at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
*
*        at
org.apache.hadoop.mapred.MapOutputFile.getSpillFileForWrite(MapOutputFile.java:107)
*
*        at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:920)
*
*        at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:832)*
*        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)*
*        at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:138)*
*java.io.IOException: Job failed!*
*        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1217)*
*        at bike.lubm.SubPredObj.getSPOFile(SubPredObj.java:63)*
*        at bike.lubm.SubPredObj.main(SubPredObj.java:12)*
*        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*
*        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
*
*        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
*
*        at java.lang.reflect.Method.invoke(Method.java:597)*
*        at org.apache.hadoop.util.RunJar.main(RunJar.java:165)*
*        at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)*
*        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)*
*        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)*
*        at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)*

Thanks
H. Kumar
skype: harshit900
Blog: http://harshitkumar.wordpress.com
Website: http:/kumarharmuscat.tripod.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message