hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "kate rhodes" <masuk...@gmail.com>
Subject Re: a million log lines from one job tracker startup
Date Wed, 26 Sep 2007 14:25:03 GMT
on a related note
433,797 log lines in the namenode log from the same startup (shorter
version of same stack trace repeated)



On 9/26/07, kate rhodes <masukomi@gmail.com> wrote:
> running r578879.
> I shut everything down, wiped out all logs, then ran bin/start-all.sh
>
> when the jobtracker starts up i get 939,805 lines composed of some
> startup messages, and then on stack trace repeated again and again
> (see below). After that is the following line and then it sits there
> happily doing nothing (nothing is being run through the system):
> 2007-09-26 09:58:34,192 INFO org.apache.hadoop.mapred.JobTracker:
> Starting RUNNING
>
> I'm wondering why i'm seeing this repeated stack trace and why i'm
> seeing almost *a million lines worth* of it just from one startup?
>
>
>
> The repeated stack trace is:
>
> 2007-09-26 09:58:06,472 INFO org.apache.hadoop.mapred.JobTracker:
> problem cleaning system directory:
> /home/krhodes/hadoop_files/temp/krhodes/mapred/system
> org.apache.hadoop.ipc.RemoteException:
> org.apache.hadoop.dfs.SafeModeException: Cannot delete
> /home/krhodes/hadoop_files/temp/krhodes/mapred/system. Name node is in
> safe mode.
> Safe mode will be turned off automatically.
>         at org.apache.hadoop.dfs.FSNamesystem.deleteInternal(FSNamesystem.java:1222)
>         at org.apache.hadoop.dfs.FSNamesystem.delete(FSNamesystem.java:1200)
>         at org.apache.hadoop.dfs.NameNode.delete(NameNode.java:399)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:585)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)
>
>         at org.apache.hadoop.ipc.Client.call(Client.java:470)
>         at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:165)
>         at org.apache.hadoop.dfs.$Proxy0.delete(Unknown Source)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:585)
>         at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>         at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>         at org.apache.hadoop.dfs.$Proxy0.delete(Unknown Source)
>         at org.apache.hadoop.dfs.DFSClient.delete(DFSClient.java:406)
>         at org.apache.hadoop.dfs.DistributedFileSystem.delete(DistributedFileSystem.java:150)
>         at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:690)
>         at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:116)
>         at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:1851)
>
>
>
> --
> - kate = masukomi
> http://weblog.masukomi.org/
>


-- 
- kate = masukomi
http://weblog.masukomi.org/

Mime
View raw message