hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liyin Liang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-143) OOM in the TaskTracker while serving map outputs
Date Tue, 07 Jun 2011 01:52:59 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045237#comment-13045237
] 

Liyin Liang commented on MAPREDUCE-143:
---------------------------------------

bq. I think we ran into the same issue, any work around or config tweak to avoid running into
this? Thanks. 
I have created MAPREDUCE-2510 for this problem. As Chris's comment, Jetty 6.1.26 does not
have this behavior. However, Jetty 6.1.26 has its own bugs MAPREDUCE-2529 and MAPREDUCE-2530
which are more serious than OOM. 

> OOM in the TaskTracker while serving map outputs
> ------------------------------------------------
>
>                 Key: MAPREDUCE-143
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-143
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Devaraj Das
>
> Saw this exception in the TT logs:
> 2009-02-06 06:18:08,553 ERROR org.mortbay.log: EXCEPTION
> java.lang.OutOfMemoryError: GC overhead limit exceeded
> 2009-02-06 06:18:11,247 ERROR org.mortbay.log: Error for /mapOutput
> java.lang.OutOfMemoryError: GC overhead limit exceeded
> 2009-02-06 06:18:11,247 ERROR org.mortbay.log: Error for /mapOutput
> java.lang.OutOfMemoryError: Java heap space
>         at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:39)
>         at java.nio.ByteBuffer.allocate(ByteBuffer.java:312)
>         at org.mortbay.io.nio.IndirectNIOBuffer.<init>(IndirectNIOBuffer.java:28)
>         at org.mortbay.jetty.nio.AbstractNIOConnector.newBuffer(AbstractNIOConnector.java:71)
>         at org.mortbay.jetty.AbstractBuffers.getBuffer(AbstractBuffers.java:131)
>         at org.mortbay.jetty.HttpGenerator.addContent(HttpGenerator.java:145)
>         at org.mortbay.jetty.AbstractGenerator$Output.write(AbstractGenerator.java:642)
>         at org.mortbay.jetty.AbstractGenerator$Output.write(AbstractGenerator.java:577)
>         at org.apache.hadoop.mapred.TaskTracker$MapOutputServlet.doGet(TaskTracker.java:2879)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message