hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das" <d...@yahoo-inc.com>
Subject RE: a million log lines from one job tracker startup
Date Wed, 26 Sep 2007 15:46:16 GMT
This is okay. At the JobTracker startup, it connects to the namenode, and
tries to delete the configured system dir. It fails to do so since the
namenode is in safe mode. The JT keeps on retrying the delete until it
succeeds. It should eventually succeed if the hdfs starts up fine.

> -----Original Message-----
> From: kate rhodes [mailto:masukomi@gmail.com] 
> Sent: Wednesday, September 26, 2007 7:55 PM
> To: hadoop-user@lucene.apache.org
> Subject: Re: a million log lines from one job tracker startup
> 
> on a related note
> 433,797 log lines in the namenode log from the same startup 
> (shorter version of same stack trace repeated)
> 
> 
> 
> On 9/26/07, kate rhodes <masukomi@gmail.com> wrote:
> > running r578879.
> > I shut everything down, wiped out all logs, then ran 
> bin/start-all.sh
> >
> > when the jobtracker starts up i get 939,805 lines composed of some 
> > startup messages, and then on stack trace repeated again and again 
> > (see below). After that is the following line and then it 
> sits there 
> > happily doing nothing (nothing is being run through the system):
> > 2007-09-26 09:58:34,192 INFO org.apache.hadoop.mapred.JobTracker:
> > Starting RUNNING
> >
> > I'm wondering why i'm seeing this repeated stack trace and why i'm 
> > seeing almost *a million lines worth* of it just from one startup?
> >
> >
> >
> > The repeated stack trace is:
> >
> > 2007-09-26 09:58:06,472 INFO org.apache.hadoop.mapred.JobTracker:
> > problem cleaning system directory:
> > /home/krhodes/hadoop_files/temp/krhodes/mapred/system
> > org.apache.hadoop.ipc.RemoteException:
> > org.apache.hadoop.dfs.SafeModeException: Cannot delete 
> > /home/krhodes/hadoop_files/temp/krhodes/mapred/system. Name 
> node is in 
> > safe mode.
> > Safe mode will be turned off automatically.
> >         at 
> org.apache.hadoop.dfs.FSNamesystem.deleteInternal(FSNamesystem
> .java:1222)
> >         at 
> org.apache.hadoop.dfs.FSNamesystem.delete(FSNamesystem.java:1200)
> >         at org.apache.hadoop.dfs.NameNode.delete(NameNode.java:399)
> >         at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccess
> orImpl.java:39)
> >         at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth
> odAccessorImpl.java:25)
> >         at java.lang.reflect.Method.invoke(Method.java:585)
> >         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
> >         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)
> >
> >         at org.apache.hadoop.ipc.Client.call(Client.java:470)
> >         at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:165)
> >         at org.apache.hadoop.dfs.$Proxy0.delete(Unknown Source)
> >         at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccess
> orImpl.java:39)
> >         at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth
> odAccessorImpl.java:25)
> >         at java.lang.reflect.Method.invoke(Method.java:585)
> >         at 
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod
> (RetryInvocationHandler.java:82)
> >         at 
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(Retry
> InvocationHandler.java:59)
> >         at org.apache.hadoop.dfs.$Proxy0.delete(Unknown Source)
> >         at 
> org.apache.hadoop.dfs.DFSClient.delete(DFSClient.java:406)
> >         at 
> org.apache.hadoop.dfs.DistributedFileSystem.delete(Distributed
> FileSystem.java:150)
> >         at 
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:690)
> >         at 
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:116)
> >         at 
> > org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:1851)
> >
> >
> >
> > --
> > - kate = masukomi
> > http://weblog.masukomi.org/
> >
> 
> 
> --
> - kate = masukomi
> http://weblog.masukomi.org/
> 


Mime
View raw message