hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Evans <ev...@yahoo-inc.com>
Subject Re: Map Rask has IO exception
Date Mon, 07 Nov 2011 16:27:49 GMT
What version of Hadoop are you using?


On 11/5/11 11:09 AM, "Steve Lewis" <lordjoe2000@gmail.com> wrote:

My job is dying during a  map task write. This happened in enough task to kill the job although
most tasks succeeded -

Any ideas as to where to start diagnosing the problem



Caused by: java.lang.NullPointerException
 at org.apache.hadoop.io.compress.BZip2Codec$BZip2CompressionOutputStream.write(BZip2Codec.java:200)
 at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:41)
 at java.io.DataOutputStream.writeByte(DataOutputStream.java:136)
 at org.apache.hadoop.io.WritableUtils.writeVLong(WritableUtils.java:263)
 at org.apache.hadoop.io.WritableUtils.writeVInt(WritableUtils.java:243)
 at org.apache.hadoop.mapred.IFile$Writer.close(IFile.java:126)
 at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1242)
 at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.access$1800(MapTask.java:648)
 at org.apache.hadoop.mapred.MapTask$MapOutputBuffer$SpillThread.run(MapTask.java:1135)


Mime
View raw message