hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sam liu <samliuhad...@gmail.com>
Subject ArrayIndexOutOfBoundsException occurs from MapTask
Date Thu, 12 Sep 2013 01:37:12 GMT
Hi,

We are using Hadoop-1.1.1. When run a big workload mapreduce application,
it threw a ArrayIndexOutOfBoundsException as below. Seems the issue was
threw in line 'System.arraycopy(b, off, kvbuffer, bufindex, gaplen);' in
MapTask. I am not familiar with the code of MapTask.java, and want to know
which situations will cause this kind of exception?

Caused by: java.lang.ArrayIndexOutOfBoundsException
        at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer$Buffer.write(MapTask.java:1270)
        at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer$Buffer.write(MapTask.java:1193)
        at java.io.DataOutputStream.write(DataOutputStream.java:82)
        at java.io.DataOutputStream.writeInt(DataOutputStream.java:191)

Thanks!

Mime
View raw message