hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ion Badita <ion.bad...@mcr.ro>
Subject Exception in MergeQueue.merge
Date Tue, 06 Feb 2007 09:21:31 GMT
I keep receiving the same exception when running simple tasks like wordcount example but with
big data as input.
After some System.err's i founded that the code causing this is:

            Path outputFile = conf.getLocalPath("mapred.local.dir",
                                  (outFile.suffix("." + passNo)).toString());

In this code outFile is null.

The full stacktrace is below: 

	at org.apache.hadoop.io.SequenceFile$Sorter$MergeQueue.merge(SequenceFile.java:2397)
	at org.apache.hadoop.io.SequenceFile$Sorter.merge(SequenceFile.java:2089)
	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.mergeParts(MapTask.java:498)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:191)
	at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1372)

I have a 6 nodes + 1 master cluster, running java 6 and hadoop 0.11


View raw message