hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "charles du" <taiping...@gmail.com>
Subject Re: JobTracker Faiing to respond with OutOfMemory error
Date Fri, 05 Dec 2008 18:58:09 GMT
Any update on this?

We got a similar problem after we ran a hadoop job with a lot of mappers.
Restarting jobtracker solved the problem for a few times. But right now, we
got the out of memory error right after we restarted the jobtracker. Thanks.





On Wed, Nov 19, 2008 at 8:40 PM, Palleti, Pallavi <
pallavi.palleti@corp.aol.com> wrote:

> Hi all,
>
>
>
>  We are using hadoop-0.17.2 for some time now.  Since yesterday, We have
> been seeing jobTracker failing to respond with an OutOfMemory Error very
> frequently. Things are going fine after restarting it. But the problem
> is occurring after a while. Below is the exception that we are seeing in
> jobtracker logs.  Can someone please suggest what is going wrong in
> this?
>
>
>
>
>
> 2008-11-19 14:17:46,059 INFO org.apache.hadoop.ipc.Server: IPC Server
> handler 9 on 9001, call
> heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@2b152f32, false,
> true, 16068)
>
> from 205.188.170.107:51492: error: java.io.IOException:
> java.lang.OutOfMemoryError: Java heap space
>
> java.io.IOException: java.lang.OutOfMemoryError: Java heap space
>
>        at java.util.regex.Pattern.compile(Pattern.java:1452)
>
>        at java.util.regex.Pattern.<init>(Pattern.java:1133)
>
>        at java.util.regex.Pattern.compile(Pattern.java:847)
>
>        at java.lang.String.replace(String.java:2208)
>
>        at org.apache.hadoop.fs.Path.normalizePath(Path.java:146)
>
>        at org.apache.hadoop.fs.Path.initialize(Path.java:137)
>
>        at org.apache.hadoop.fs.Path.<init>(Path.java:126)
>
>        at org.apache.hadoop.fs.Path.<init>(Path.java:50)
>
>        at
> org.apache.hadoop.mapred.Task.getTaskOutputPath(Task.java:214)
>
>        at org.apache.hadoop.mapred.Task.setConf(Task.java:517)
>
>        at
> org.apache.hadoop.mapred.TaskInProgress.getTaskToRun(TaskInProgress.java
> :745)
>
>        at
> org.apache.hadoop.mapred.JobInProgress.obtainNewMapTask(JobInProgress.ja
> va:664)
>
>        at
> org.apache.hadoop.mapred.JobTracker.getNewTaskForTaskTracker(JobTracker.
> java:1585)
>
>        at
> org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:1309)
>
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>        at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
> a:39)
>
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
> Impl.java:25)
>
>        at java.lang.reflect.Method.invoke(Method.java:597)
>
>        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:446)
>
>        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
>
> 2008-11-19 14:18:11,869 WARN org.apache.hadoop.ipc.Server: IPC Server
> handler 4 on 9001, call
> heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@24d86be, false,
> true, 16077) f
>
> rom 205.188.170.84:54871: discarded for being too old (133957)
>
> 2008-11-19 14:18:11,869 WARN org.apache.hadoop.ipc.Server: IPC Server
> handler 4 on 9001, call
> heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@3ea47062, false,
> true, 16082)
>
> from 205.188.170.90:32934: discarded for being too old (133957)
>
>
>
>
> Thanks
>
> Pallavi
>
>


-- 
tp

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message