hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Some Body" <someb...@squareplanet.de>
Subject RE: Killed : GC overhead limit exceeded
Date Fri, 16 Jul 2010 12:40:03 GMT

I tried again and connected to my task tracker via JMX but I still dont see what's wrong.
Here's the log, it was spilling records then ran out of memory?

2010-07-16 05:27:04,295 INFO org.apache.hadoop.mapred.MapTask: Spilling map output: buffer
full= true
2010-07-16 05:27:04,295 INFO org.apache.hadoop.mapred.MapTask: bufstart = 19279; bufend =
159403424; bufvoid = 199229440
2010-07-16 05:27:04,295 INFO org.apache.hadoop.mapred.MapTask: kvstart = 205295; kvend = 342047;
length = 655360
2010-07-16 05:27:14,118 INFO org.apache.hadoop.mapred.MapTask: Finished spill 35
2010-07-16 05:28:13,294 FATAL org.apache.hadoop.mapred.TaskTracker: 
  Error running child : java.lang.OutOfMemoryError: GC overhead limit exceeded
    at java.util.regex.Pattern.compile(Pattern.java:823)
    at java.lang.String.split(String.java:2292)
    at java.lang.String.split(String.java:2334)
    at com.synopsys.hadoop.ComputeSeqMapper.map(MyMapper.java:143)
    at com.synopsys.hadoop.ComputeSeqMapper.map(MyMapper.java:35)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)

2010-07-16 05:28:16,473 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics
with processName=CLEANUP, sessionId=
2010-07-16 05:28:16,588 INFO org.apache.hadoop.mapred.TaskRunner: Runnning cleanup for the
task

See the attached graph of the tasks memory usage via jconsole.
Note: ignore the 9 hour offset from the log and the image, I'm in a different time zone than
the cluster.

Alan




Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message