hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-3550) Reduce tasks failing with OOM
Date Fri, 13 Jun 2008 02:56:45 GMT
Reduce tasks failing with OOM

                 Key: HADOOP-3550
                 URL: https://issues.apache.org/jira/browse/HADOOP-3550
             Project: Hadoop Core
          Issue Type: Bug
    Affects Versions: 0.17.0
            Reporter: Arun C Murthy
            Assignee: Arun C Murthy
            Priority: Blocker
             Fix For: 0.17.1

Map-Reduce jobs which worked with 0.16.* are failing with OOM with the following trace:
java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOf(Arrays.java:2786)
        at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
        at java.io.DataOutputStream.write(DataOutputStream.java:90)
        at org.apache.hadoop.io.SequenceFile$UncompressedBytes.writeUncompressedBytes(SequenceFile.java:617)
        at org.apache.hadoop.mapred.ReduceTask$ValuesIterator.readNextValue(ReduceTask.java:289)
        at org.apache.hadoop.mapred.ReduceTask$ValuesIterator.next(ReduceTask.java:232)
        at org.apache.hadoop.mapred.ReduceTask$ReduceValuesIterator.next(ReduceTask.java:311)
        at org.apache.hadoop.streaming.PipeReducer.reduce(PipeReducer.java:67)
        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:391)
        at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message