hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James Seigel <ja...@tynt.com>
Subject Re: Hadoop JobTracker Hanging
Date Fri, 18 Jun 2010 01:21:00 GMT
Up the memory from the default to about 4x the default (heap setting).  This should make it
better I’d think!

We’d been having the same issue...I believe this fixed it.

James

On 2010-06-17, at 3:00 PM, Li, Tan wrote:

> Folks,
> 
> I need some help on job tracker.
> I am running a two hadoop clusters (with 30+ nodes) on Ubuntu. One is with version 0.19.1
(apache) and the other one is with version 0.20. 1+169.68 (Cloudera).
> 
> I have the same problem with both the clusters: the job tracker hangs almost once a day.
> Symptom: The job tracker web page can not be loaded, the command "hadoop job -list" hangs
and jobtracker.log file stops being updated.
> No useful information can I find in the job tracker log file.
> The symptom is gone after I restart the job tracker and the cluster runs fine for another
20+ hour period. And then the symptom comes back.
> 
> I do not have serious problem with HDFS.
> 
> Any ideas about the causes? Any configuration parameter that I can change to reduce the
chances of the problem?
> Any tips for diagnosing and troubleshooting?
> 
> Thanks!
> 
> Tan
> 
> 
> 


Mime
View raw message