hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "kate rhodes" <masuk...@gmail.com>
Subject a million log lines from one job tracker startup
Date Wed, 26 Sep 2007 14:20:52 GMT
running r578879.
I shut everything down, wiped out all logs, then ran bin/start-all.sh

when the jobtracker starts up i get 939,805 lines composed of some
startup messages, and then on stack trace repeated again and again
(see below). After that is the following line and then it sits there
happily doing nothing (nothing is being run through the system):
2007-09-26 09:58:34,192 INFO org.apache.hadoop.mapred.JobTracker:
Starting RUNNING

I'm wondering why i'm seeing this repeated stack trace and why i'm
seeing almost *a million lines worth* of it just from one startup?



The repeated stack trace is:

2007-09-26 09:58:06,472 INFO org.apache.hadoop.mapred.JobTracker:
problem cleaning system directory:
/home/krhodes/hadoop_files/temp/krhodes/mapred/system
org.apache.hadoop.ipc.RemoteException:
org.apache.hadoop.dfs.SafeModeException: Cannot delete
/home/krhodes/hadoop_files/temp/krhodes/mapred/system. Name node is in
safe mode.
Safe mode will be turned off automatically.
        at org.apache.hadoop.dfs.FSNamesystem.deleteInternal(FSNamesystem.java:1222)
        at org.apache.hadoop.dfs.FSNamesystem.delete(FSNamesystem.java:1200)
        at org.apache.hadoop.dfs.NameNode.delete(NameNode.java:399)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

        at org.apache.hadoop.ipc.Client.call(Client.java:470)
        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:165)
        at org.apache.hadoop.dfs.$Proxy0.delete(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
        at org.apache.hadoop.dfs.$Proxy0.delete(Unknown Source)
        at org.apache.hadoop.dfs.DFSClient.delete(DFSClient.java:406)
        at org.apache.hadoop.dfs.DistributedFileSystem.delete(DistributedFileSystem.java:150)
        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:690)
        at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:116)
        at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:1851)



-- 
- kate = masukomi
http://weblog.masukomi.org/

Mime
View raw message