hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zmir <ziyad...@gmail.com>
Subject Re: Setting up a Single Node Hadoop Cluster
Date Sat, 25 Jun 2011 00:45:01 GMT
Here is the namenode log file:

2011-06-20 13:46:44,549 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = limbo/10.72.67.209
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.20.203.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203
-r 1099333; compiled by 'oom' on Wed May  4 07:57:50 PDT 2011
************************************************************/
2011-06-20 13:46:44,715 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
loaded properties from hadoop-metrics2.properties
2011-06-20 13:46:44,729 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2011-06-20 13:46:44,730 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
at 10 second(s).
2011-06-20 13:46:44,730 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system
started
2011-06-20 13:46:44,884 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
registered.
2011-06-20 13:46:44,888 WARN
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
exists!
2011-06-20 13:46:44,895 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source jvm
registered.
2011-06-20 13:46:44,896 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
NameNode registered.
2011-06-20 13:46:44,926 INFO org.apache.hadoop.hdfs.util.GSet: VM type      
= 32-bit
2011-06-20 13:46:44,926 INFO org.apache.hadoop.hdfs.util.GSet: 2% max memory
= 17.77875 MB
2011-06-20 13:46:44,926 INFO org.apache.hadoop.hdfs.util.GSet: capacity     
= 2^22 = 4194304 entries
2011-06-20 13:46:44,926 INFO org.apache.hadoop.hdfs.util.GSet:
recommended=4194304, actual=4194304
2011-06-20 13:46:44,961 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner=root
2011-06-20 13:46:44,961 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup=supergroup
2011-06-20 13:46:44,961 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
isPermissionEnabled=true
2011-06-20 13:46:44,966 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
dfs.block.invalidate.limit=100
2011-06-20 13:46:44,966 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s),
accessTokenLifetime=0 min(s)
2011-06-20 13:46:45,488 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered
FSNamesystemStateMBean and NameNodeMXBean
2011-06-20 13:46:45,511 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring
more than 10 times 
2011-06-20 13:46:45,525 INFO org.apache.hadoop.hdfs.server.common.Storage:
Number of files = 1
2011-06-20 13:46:45,531 INFO org.apache.hadoop.hdfs.server.common.Storage:
Number of files under construction = 0
2011-06-20 13:46:45,531 INFO org.apache.hadoop.hdfs.server.common.Storage:
Image file of size 112 loaded in 0 seconds.
2011-06-20 13:46:45,531 INFO org.apache.hadoop.hdfs.server.common.Storage:
Edits file /app/hadoop/tmp/dfs/name/current/edits of size 4 edits # 0 loaded
in 0 seconds.
2011-06-20 13:46:45,532 INFO org.apache.hadoop.hdfs.server.common.Storage:
Image file of size 112 saved in 0 seconds.
2011-06-20 13:46:45,799 INFO org.apache.hadoop.hdfs.server.common.Storage:
Image file of size 112 saved in 0 seconds.
2011-06-20 13:46:45,992 INFO
org.apache.hadoop.hdfs.server.namenode.NameCache: initialized with 0 entries
0 lookups
2011-06-20 13:46:45,992 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Finished loading
FSImage in 1037 msecs
2011-06-20 13:46:46,005 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Total number of blocks
= 0
2011-06-20 13:46:46,005 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of invalid
blocks = 0
2011-06-20 13:46:46,005 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of
under-replicated blocks = 0
2011-06-20 13:46:46,005 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of 
over-replicated blocks = 0
2011-06-20 13:46:46,006 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe
mode termination scan for invalid, over- and under-replicated blocks
completed in 11 msec
2011-06-20 13:46:46,006 INFO org.apache.hadoop.hdfs.StateChange: STATE*
Leaving safe mode after 1 secs.
2011-06-20 13:46:46,006 INFO org.apache.hadoop.hdfs.StateChange: STATE*
Network topology has 0 racks and 0 datanodes
2011-06-20 13:46:46,006 INFO org.apache.hadoop.hdfs.StateChange: STATE*
UnderReplicatedBlocks has 0 blocks
2011-06-20 13:46:46,013 INFO org.apache.hadoop.util.HostsFileReader:
Refreshing hosts (include/exclude) list
2011-06-20 13:46:46,013 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicateQueue
QueueProcessingStatistics: First cycle completed 0 blocks in 1 msec
2011-06-20 13:46:46,013 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicateQueue
QueueProcessingStatistics: Queue flush completed 0 blocks in 1 msec
processing time, 1 msec clock time, 1 cycles
2011-06-20 13:46:46,013 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: InvalidateQueue
QueueProcessingStatistics: First cycle completed 0 blocks in 0 msec
2011-06-20 13:46:46,013 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: InvalidateQueue
QueueProcessingStatistics: Queue flush completed 0 blocks in 0 msec
processing time, 0 msec clock time, 1 cycles
2011-06-20 13:46:46,020 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
FSNamesystemMetrics registered.
2011-06-20 13:46:46,036 INFO org.apache.hadoop.ipc.Server: Starting
SocketReader
2011-06-20 13:46:46,039 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
RpcDetailedActivityForPort54310 registered.
2011-06-20 13:46:46,039 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
RpcActivityForPort54310 registered.
2011-06-20 13:46:46,042 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: Namenode up at:
localhost/127.0.0.0:54310
2011-06-20 13:46:51,155 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2011-06-20 13:46:51,280 INFO org.apache.hadoop.http.HttpServer: Added global
filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2011-06-20 13:46:51,289 INFO org.apache.hadoop.http.HttpServer: Port
returned by webServer.getConnectors()[0].getLocalPort() before open() is -1.
Opening the listener on 50070
2011-06-20 13:46:51,291 INFO org.apache.hadoop.http.HttpServer:
listener.getLocalPort() returned 50070
webServer.getConnectors()[0].getLocalPort() returned 50070
2011-06-20 13:46:51,291 INFO org.apache.hadoop.http.HttpServer: Jetty bound
to port 50070
2011-06-20 13:46:51,291 INFO org.mortbay.log: jetty-6.1.26
2011-06-20 13:46:51,890 INFO org.mortbay.log: Started
SelectChannelConnector@0.0.0.0:50070
2011-06-20 13:46:51,890 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: Web-server up at:
0.0.0.0:50070
2011-06-20 13:46:51,900 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2011-06-20 13:46:51,910 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 54310: starting
2011-06-20 13:46:51,911 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 54310: starting
2011-06-20 13:46:51,918 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 54310: starting
2011-06-20 13:46:51,926 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 54310: starting
2011-06-20 13:46:51,937 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 54310: starting
2011-06-20 13:46:51,946 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 54310: starting
2011-06-20 13:46:51,958 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 5 on 54310: starting
2011-06-20 13:46:51,972 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 6 on 54310: starting
2011-06-20 13:46:51,982 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 7 on 54310: starting
2011-06-20 13:46:51,993 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 8 on 54310: starting
2011-06-20 13:46:52,003 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 54310: starting
2011-06-20 13:46:53,071 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: localhost/127.0.0.0:54310. Already tried 0 time(s).
2011-06-20 13:46:54,071 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: localhost/127.0.0.0:54310. Already tried 1 time(s).
2011-06-20 13:46:55,072 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: localhost/127.0.0.0:54310. Already tried 2 time(s).
2011-06-20 13:46:56,073 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: localhost/127.0.0.0:54310. Already tried 3 time(s).
2011-06-20 13:46:57,073 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: localhost/127.0.0.0:54310. Already tried 4 time(s).
2011-06-20 13:46:58,074 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: localhost/127.0.0.0:54310. Already tried 5 time(s).
2011-06-20 13:46:59,074 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: localhost/127.0.0.0:54310. Already tried 6 time(s).
2011-06-20 13:47:00,075 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: localhost/127.0.0.0:54310. Already tried 7 time(s).
2011-06-20 13:47:01,076 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: localhost/127.0.0.0:54310. Already tried 8 time(s).
2011-06-20 13:47:02,076 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: localhost/127.0.0.0:54310. Already tried 9 time(s).
2011-06-20 13:47:02,078 INFO org.mortbay.log: Stopped
SelectChannelConnector@0.0.0.0:50070
2011-06-20 13:47:02,181 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicationMonitor
thread received InterruptedException.java.lang.InterruptedException: sleep
interrupted
2011-06-20 13:47:02,181 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of transactions:
0 Total time for transactions(ms): 0Number of transactions batched in Syncs:
0 Number of syncs: 0 SyncTimes(ms): 0 
2011-06-20 13:47:02,184 INFO
org.apache.hadoop.hdfs.server.namenode.DecommissionManager: Interrupted
Monitor
java.lang.InterruptedException: sleep interrupted
	at java.lang.Thread.sleep(Native Method)
	at
org.apache.hadoop.hdfs.server.namenode.DecommissionManager$Monitor.run(DecommissionManager.java:65)
	at java.lang.Thread.run(Thread.java:662)
2011-06-20 13:47:02,240 INFO org.apache.hadoop.ipc.Server: Stopping server
on 54310
2011-06-20 13:47:02,240 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 54310: exiting
2011-06-20 13:47:02,240 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 54310: exiting
2011-06-20 13:47:02,241 INFO
org.apache.hadoop.ipc.metrics.RpcInstrumentation: shut down
2011-06-20 13:47:02,241 ERROR
org.apache.hadoop.hdfs.server.namenode.NameNode: java.io.IOException: Call
to localhost/127.0.0.0:54310 failed on local exception:
java.net.SocketException: Network is unreachable
	at org.apache.hadoop.ipc.Client.wrapException(Client.java:1065)
	at org.apache.hadoop.ipc.Client.call(Client.java:1033)
	at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224)
	at $Proxy5.getProtocolVersion(Unknown Source)
	at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:364)
	at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)
	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:208)
	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:175)
	at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1310)
	at org.apache.hadoop.fs.FileSystem.access$100(FileSystem.java:65)
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1328)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:109)
	at org.apache.hadoop.fs.Trash.<init>(Trash.java:62)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.startTrashEmptier(NameNode.java:292)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:288)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:434)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1153)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1162)
Caused by: java.net.SocketException: Network is unreachable
	at sun.nio.ch.Net.connect(Native Method)
	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:500)
	at
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:192)
	at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:406)
	at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:414)
	at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:527)
	at org.apache.hadoop.ipc.Client$Connection.access$1800(Client.java:187)
	at org.apache.hadoop.ipc.Client.getConnection(Client.java:1164)
	at org.apache.hadoop.ipc.Client.call(Client.java:1010)
	... 18 more

2011-06-20 13:47:02,242 INFO org.apache.hadoop.ipc.Server: Stopping IPC
Server Responder
2011-06-20 13:47:02,247 INFO org.apache.hadoop.ipc.Server: Stopping IPC
Server listener on 54310
2011-06-20 13:47:02,247 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 54310: exiting
2011-06-20 13:47:02,247 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 54310: exiting
2011-06-20 13:47:02,247 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 54310: exiting
2011-06-20 13:47:02,247 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 5 on 54310: exiting
2011-06-20 13:47:02,247 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 6 on 54310: exiting
2011-06-20 13:47:02,247 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 7 on 54310: exiting
2011-06-20 13:47:02,247 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 8 on 54310: exiting
2011-06-20 13:47:02,247 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at limbo/10.72.67.209
************************************************************/
2011-06-20 13:47:02,248 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 54310: exiting
2011-06-20 13:50:04,791 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = limbo/10.72.67.209
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.20.203.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203
-r 1099333; compiled by 'oom' on Wed May  4 07:57:50 PDT 2011
************************************************************/
2011-06-20 13:50:04,984 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
loaded properties from hadoop-metrics2.properties
2011-06-20 13:50:04,997 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2011-06-20 13:50:04,999 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
at 10 second(s).
2011-06-20 13:50:04,999 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system
started
2011-06-20 13:50:05,157 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
registered.
2011-06-20 13:50:05,161 WARN
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
exists!
2011-06-20 13:50:05,169 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source jvm
registered.
2011-06-20 13:50:05,170 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
NameNode registered.
2011-06-20 13:50:05,199 INFO org.apache.hadoop.hdfs.util.GSet: VM type      
= 32-bit
2011-06-20 13:50:05,199 INFO org.apache.hadoop.hdfs.util.GSet: 2% max memory
= 17.77875 MB
2011-06-20 13:50:05,199 INFO org.apache.hadoop.hdfs.util.GSet: capacity     
= 2^22 = 4194304 entries
2011-06-20 13:50:05,199 INFO org.apache.hadoop.hdfs.util.GSet:
recommended=4194304, actual=4194304
2011-06-20 13:50:05,233 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner=root
2011-06-20 13:50:05,233 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup=supergroup
2011-06-20 13:50:05,234 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
isPermissionEnabled=true
2011-06-20 13:50:05,239 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
dfs.block.invalidate.limit=100
2011-06-20 13:50:05,239 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s),
accessTokenLifetime=0 min(s)
2011-06-20 13:50:05,746 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered
FSNamesystemStateMBean and NameNodeMXBean
2011-06-20 13:50:05,768 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring
more than 10 times 
2011-06-20 13:50:05,782 INFO org.apache.hadoop.hdfs.server.common.Storage:
Number of files = 1
2011-06-20 13:50:05,792 INFO org.apache.hadoop.hdfs.server.common.Storage:
Number of files under construction = 0
2011-06-20 13:50:05,792 INFO org.apache.hadoop.hdfs.server.common.Storage:
Image file of size 112 loaded in 0 seconds.
2011-06-20 13:50:05,793 INFO org.apache.hadoop.hdfs.server.common.Storage:
Edits file /app/hadoop/tmp/dfs/name/current/edits of size 4 edits # 0 loaded
in 0 seconds.
2011-06-20 13:50:05,794 INFO org.apache.hadoop.hdfs.server.common.Storage:
Image file of size 112 saved in 0 seconds.
2011-06-20 13:50:06,086 INFO org.apache.hadoop.hdfs.server.common.Storage:
Image file of size 112 saved in 0 seconds.
2011-06-20 13:50:06,284 INFO
org.apache.hadoop.hdfs.server.namenode.NameCache: initialized with 0 entries
0 lookups
2011-06-20 13:50:06,284 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Finished loading
FSImage in 1056 msecs
2011-06-20 13:50:06,296 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Total number of blocks
= 0
2011-06-20 13:50:06,296 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of invalid
blocks = 0
2011-06-20 13:50:06,296 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of
under-replicated blocks = 0
2011-06-20 13:50:06,296 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of 
over-replicated blocks = 0
2011-06-20 13:50:06,296 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe
mode termination scan for invalid, over- and under-replicated blocks
completed in 11 msec
2011-06-20 13:50:06,296 INFO org.apache.hadoop.hdfs.StateChange: STATE*
Leaving safe mode after 1 secs.
2011-06-20 13:50:06,297 INFO org.apache.hadoop.hdfs.StateChange: STATE*
Network topology has 0 racks and 0 datanodes
2011-06-20 13:50:06,297 INFO org.apache.hadoop.hdfs.StateChange: STATE*
UnderReplicatedBlocks has 0 blocks
2011-06-20 13:50:06,303 INFO org.apache.hadoop.util.HostsFileReader:
Refreshing hosts (include/exclude) list
2011-06-20 13:50:06,304 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicateQueue
QueueProcessingStatistics: First cycle completed 0 blocks in 1 msec
2011-06-20 13:50:06,304 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicateQueue
QueueProcessingStatistics: Queue flush completed 0 blocks in 1 msec
processing time, 1 msec clock time, 1 cycles
2011-06-20 13:50:06,304 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: InvalidateQueue
QueueProcessingStatistics: First cycle completed 0 blocks in 0 msec
2011-06-20 13:50:06,304 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: InvalidateQueue
QueueProcessingStatistics: Queue flush completed 0 blocks in 0 msec
processing time, 0 msec clock time, 1 cycles
2011-06-20 13:50:06,309 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
FSNamesystemMetrics registered.
2011-06-20 13:50:06,326 INFO org.apache.hadoop.ipc.Server: Starting
SocketReader
2011-06-20 13:50:06,328 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
RpcDetailedActivityForPort50070 registered.
2011-06-20 13:50:06,329 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
RpcActivityForPort50070 registered.
2011-06-20 13:50:06,331 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: Namenode up at:
localhost/127.0.0.0:50070
2011-06-20 13:50:11,467 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2011-06-20 13:50:11,659 INFO org.apache.hadoop.http.HttpServer: Added global
filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2011-06-20 13:50:11,667 INFO org.apache.hadoop.http.HttpServer: Port
returned by webServer.getConnectors()[0].getLocalPort() before open() is -1.
Opening the listener on 50070
2011-06-20 13:50:11,669 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicationMonitor
thread received InterruptedException.java.lang.InterruptedException: sleep
interrupted
2011-06-20 13:50:11,670 INFO
org.apache.hadoop.hdfs.server.namenode.DecommissionManager: Interrupted
Monitor
java.lang.InterruptedException: sleep interrupted
	at java.lang.Thread.sleep(Native Method)
	at
org.apache.hadoop.hdfs.server.namenode.DecommissionManager$Monitor.run(DecommissionManager.java:65)
	at java.lang.Thread.run(Thread.java:662)
2011-06-20 13:50:11,671 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of transactions:
0 Total time for transactions(ms): 0Number of transactions batched in Syncs:
0 Number of syncs: 0 SyncTimes(ms): 0 
2011-06-20 13:50:11,724 INFO org.apache.hadoop.ipc.Server: Stopping server
on 50070
2011-06-20 13:50:11,724 INFO
org.apache.hadoop.ipc.metrics.RpcInstrumentation: shut down
2011-06-20 13:50:11,725 ERROR
org.apache.hadoop.hdfs.server.namenode.NameNode: java.net.BindException:
Address already in use
	at sun.nio.ch.Net.bind(Native Method)
	at
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:126)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
	at
org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
	at org.apache.hadoop.http.HttpServer.start(HttpServer.java:562)
	at org.apache.hadoop.hdfs.server.namenode.NameNode$1.run(NameNode.java:383)
	at org.apache.hadoop.hdfs.server.namenode.NameNode$1.run(NameNode.java:331)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:331)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:283)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:434)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1153)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1162)

2011-06-20 13:50:11,726 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at limbo/10.72.67.209
************************************************************/
2011-06-20 17:27:15,813 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = limbo/10.72.38.63
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.20.203.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203
-r 1099333; compiled by 'oom' on Wed May  4 07:57:50 PDT 2011
************************************************************/
2011-06-20 17:27:15,998 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
loaded properties from hadoop-metrics2.properties
2011-06-20 17:27:16,012 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2011-06-20 17:27:16,013 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period
at 10 second(s).
2011-06-20 17:27:16,013 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system
started
2011-06-20 17:27:16,166 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
registered.
2011-06-20 17:27:16,170 WARN
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
exists!
2011-06-20 17:27:16,178 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source jvm
registered.
2011-06-20 17:27:16,179 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
NameNode registered.
2011-06-20 17:27:16,208 INFO org.apache.hadoop.hdfs.util.GSet: VM type      
= 32-bit
2011-06-20 17:27:16,208 INFO org.apache.hadoop.hdfs.util.GSet: 2% max memory
= 17.77875 MB
2011-06-20 17:27:16,208 INFO org.apache.hadoop.hdfs.util.GSet: capacity     
= 2^22 = 4194304 entries
2011-06-20 17:27:16,208 INFO org.apache.hadoop.hdfs.util.GSet:
recommended=4194304, actual=4194304
2011-06-20 17:27:16,242 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner=root
2011-06-20 17:27:16,242 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup=supergroup
2011-06-20 17:27:16,242 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
isPermissionEnabled=true
2011-06-20 17:27:16,248 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
dfs.block.invalidate.limit=100
2011-06-20 17:27:16,248 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s),
accessTokenLifetime=0 min(s)
2011-06-20 17:27:16,758 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered
FSNamesystemStateMBean and NameNodeMXBean
2011-06-20 17:27:16,781 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring
more than 10 times 
2011-06-20 17:27:16,810 INFO org.apache.hadoop.hdfs.server.common.Storage:
Number of files = 1
2011-06-20 17:27:16,820 INFO org.apache.hadoop.hdfs.server.common.Storage:
Number of files under construction = 0
2011-06-20 17:27:16,821 INFO org.apache.hadoop.hdfs.server.common.Storage:
Image file of size 110 loaded in 0 seconds.
2011-06-20 17:27:16,821 INFO org.apache.hadoop.hdfs.server.common.Storage:
Edits file /app/hadoop/tmp/dfs/name/current/edits of size 4 edits # 0 loaded
in 0 seconds.
2011-06-20 17:27:16,827 INFO org.apache.hadoop.hdfs.server.common.Storage:
Image file of size 110 saved in 0 seconds.
2011-06-20 17:27:17,062 INFO org.apache.hadoop.hdfs.server.common.Storage:
Image file of size 110 saved in 0 seconds.
2011-06-20 17:27:17,260 INFO
org.apache.hadoop.hdfs.server.namenode.NameCache: initialized with 0 entries
0 lookups
2011-06-20 17:27:17,260 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Finished loading
FSImage in 1024 msecs
2011-06-20 17:27:17,272 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Total number of blocks
= 0
2011-06-20 17:27:17,272 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of invalid
blocks = 0
2011-06-20 17:27:17,272 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of
under-replicated blocks = 0
2011-06-20 17:27:17,272 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of 
over-replicated blocks = 0
2011-06-20 17:27:17,272 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe
mode termination scan for invalid, over- and under-replicated blocks
completed in 11 msec
2011-06-20 17:27:17,273 INFO org.apache.hadoop.hdfs.StateChange: STATE*
Leaving safe mode after 1 secs.
2011-06-20 17:27:17,273 INFO org.apache.hadoop.hdfs.StateChange: STATE*
Network topology has 0 racks and 0 datanodes
2011-06-20 17:27:17,273 INFO org.apache.hadoop.hdfs.StateChange: STATE*
UnderReplicatedBlocks has 0 blocks
2011-06-20 17:27:17,279 INFO org.apache.hadoop.util.HostsFileReader:
Refreshing hosts (include/exclude) list
2011-06-20 17:27:17,280 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicateQueue
QueueProcessingStatistics: First cycle completed 0 blocks in 1 msec
2011-06-20 17:27:17,280 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicateQueue
QueueProcessingStatistics: Queue flush completed 0 blocks in 1 msec
processing time, 1 msec clock time, 1 cycles
2011-06-20 17:27:17,280 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: InvalidateQueue
QueueProcessingStatistics: First cycle completed 0 blocks in 0 msec
2011-06-20 17:27:17,280 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: InvalidateQueue
QueueProcessingStatistics: Queue flush completed 0 blocks in 0 msec
processing time, 0 msec clock time, 1 cycles
2011-06-20 17:27:17,286 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
FSNamesystemMetrics registered.
2011-06-20 17:27:17,334 INFO org.apache.hadoop.ipc.Server: Starting
SocketReader
2011-06-20 17:27:17,338 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
RpcDetailedActivityForPort50070 registered.
2011-06-20 17:27:17,338 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
RpcActivityForPort50070 registered.
2011-06-20 17:27:17,341 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: Namenode up at:
localhost.localdomain/127.0.0.1:50070
2011-06-20 17:27:22,612 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2011-06-20 17:27:22,783 INFO org.apache.hadoop.http.HttpServer: Added global
filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2011-06-20 17:27:22,791 INFO org.apache.hadoop.http.HttpServer: Port
returned by webServer.getConnectors()[0].getLocalPort() before open() is -1.
Opening the listener on 50070
2011-06-20 17:27:22,793 WARN
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicationMonitor
thread received InterruptedException.java.lang.InterruptedException: sleep
interrupted
2011-06-20 17:27:22,794 INFO
org.apache.hadoop.hdfs.server.namenode.DecommissionManager: Interrupted
Monitor
java.lang.InterruptedException: sleep interrupted
	at java.lang.Thread.sleep(Native Method)
	at
org.apache.hadoop.hdfs.server.namenode.DecommissionManager$Monitor.run(DecommissionManager.java:65)
	at java.lang.Thread.run(Thread.java:662)
2011-06-20 17:27:22,795 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of transactions:
0 Total time for transactions(ms): 0Number of transactions batched in Syncs:
0 Number of syncs: 0 SyncTimes(ms): 0 
2011-06-20 17:27:22,875 INFO org.apache.hadoop.ipc.Server: Stopping server
on 50070
2011-06-20 17:27:22,875 INFO
org.apache.hadoop.ipc.metrics.RpcInstrumentation: shut down
2011-06-20 17:27:22,876 ERROR
org.apache.hadoop.hdfs.server.namenode.NameNode: java.net.BindException:
Address already in use
	at sun.nio.ch.Net.bind(Native Method)
	at
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:126)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
	at
org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
	at org.apache.hadoop.http.HttpServer.start(HttpServer.java:562)
	at org.apache.hadoop.hdfs.server.namenode.NameNode$1.run(NameNode.java:383)
	at org.apache.hadoop.hdfs.server.namenode.NameNode$1.run(NameNode.java:331)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:331)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:283)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:434)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1153)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1162)

2011-06-20 17:27:22,877 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at limbo/10.72.38.63
************************************************************/

--
View this message in context: http://lucene.472066.n3.nabble.com/Setting-up-a-Single-Node-Hadoop-Cluster-tp3088655p3106839.html
Sent from the Hadoop lucene-users mailing list archive at Nabble.com.

Mime
View raw message