Reduce tasks failing with OOM
-----------------------------
Key: HADOOP-3550
URL: https://issues.apache.org/jira/browse/HADOOP-3550
Project: Hadoop Core
Issue Type: Bug
Affects Versions: 0.17.0
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Priority: Blocker
Fix For: 0.17.1
Map-Reduce jobs which worked with 0.16.* are failing with OOM with the following trace:
{noformat}
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:2786)
at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
at java.io.DataOutputStream.write(DataOutputStream.java:90)
at org.apache.hadoop.io.SequenceFile$UncompressedBytes.writeUncompressedBytes(SequenceFile.java:617)
at org.apache.hadoop.mapred.ReduceTask$ValuesIterator.readNextValue(ReduceTask.java:289)
at org.apache.hadoop.mapred.ReduceTask$ValuesIterator.next(ReduceTask.java:232)
at org.apache.hadoop.mapred.ReduceTask$ReduceValuesIterator.next(ReduceTask.java:311)
at org.apache.hadoop.streaming.PipeReducer.reduce(PipeReducer.java:67)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
{noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
|