hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashok Varma" <varma1...@gmail.com>
Subject Error in starting datanode(new one)
Date Wed, 22 Oct 2008 13:03:52 GMT
Sorry in my previous post i forgot to give hadoop-site.xml contents here i'm
putting below
Hi everybody!

when i tried to start the dfs and mapred daemons i'm facing the following
problems:

I have configured two machines as: one(Host machine) is Master as well as
Slave and other machine (Guest OS) as Slave. There are no errors in
master side. But IPC errors are arising in  slave(guest) machine . I can
able to SSH and PING both the ways from master to slave and slave to master
even though i'm not able get where is going wrong! . Below are log files on
both machines.......


Can any body Help me!!

*hadoop-hadoop-namenode-master.log:*
2008-10-22 15:51:35,872 INFO org.apache.hadoop.dfs.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = master/192.168.4.104
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 15:51:37,059 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=NameNode, port=54310
2008-10-22 15:51:37,111 INFO org.apache.hadoop.dfs.NameNode: Namenode up at:
master/192.168.4.104:54310
2008-10-22 15:51:37,115 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=NameNode, sessionId=null
2008-10-22 15:51:37,129 INFO org.apache.hadoop.dfs.NameNodeMetrics:
Initializing NameNodeMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2008-10-22 15:51:37,360 INFO org.apache.hadoop.fs.FSNamesystem:
fsOwner=hadoop,hadoop
2008-10-22 15:51:37,360 INFO org.apache.hadoop.fs.FSNamesystem:
supergroup=supergroup
2008-10-22 15:51:37,360 INFO org.apache.hadoop.fs.FSNamesystem:
isPermissionEnabled=true
2008-10-22 15:51:37,392 INFO org.apache.hadoop.dfs.FSNamesystemMetrics:
Initializing FSNamesystemMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2008-10-22 15:51:37,393 INFO org.apache.hadoop.fs.FSNamesystem: Registered
FSNamesystemStatusMBean
2008-10-22 15:51:37,441 INFO org.apache.hadoop.dfs.Storage: Storage
directory /home/hadoop/Hadoop/hadoop-0.18.0/Temp/dfs/name does not exist.
2008-10-22 15:51:37,446 ERROR org.apache.hadoop.fs.FSNamesystem:
FSNamesystem initialization failed.
org.apache.hadoop.dfs.InconsistentFSStateException: Directory
/home/hadoop/Hadoop/hadoop-0.18.0/Temp/dfs/name is in an inconsistent state:
storage directory does not exist or is not accessible.
    at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:211)
    at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:296)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:275)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:830)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:839)
2008-10-22 15:51:37,447 INFO org.apache.hadoop.ipc.Server: Stopping server
on 54310
2008-10-22 15:51:37,448 ERROR org.apache.hadoop.dfs.NameNode:
org.apache.hadoop.dfs.InconsistentFSStateException: Directory
/home/hadoop/Hadoop/hadoop-0.18.0/Temp/dfs/name is in an inconsistent state:
storage directory does not exist or is not accessible.
    at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:211)
    at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:296)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:275)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:830)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:839)

2008-10-22 15:51:37,453 INFO org.apache.hadoop.dfs.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at master/192.168.4.104
************************************************************/
2008-10-22 16:32:55,187 INFO org.apache.hadoop.dfs.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = master/192.168.4.104
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 16:32:55,332 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=NameNode, port=54310
2008-10-22 16:32:55,341 INFO org.apache.hadoop.dfs.NameNode: Namenode up at:
master/192.168.4.104:54310
2008-10-22 16:32:55,353 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=NameNode, sessionId=null
2008-10-22 16:32:55,360 INFO org.apache.hadoop.dfs.NameNodeMetrics:
Initializing NameNodeMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2008-10-22 16:32:55,465 INFO org.apache.hadoop.fs.FSNamesystem:
fsOwner=hadoop,hadoop
2008-10-22 16:32:55,465 INFO org.apache.hadoop.fs.FSNamesystem:
supergroup=supergroup
2008-10-22 16:32:55,465 INFO org.apache.hadoop.fs.FSNamesystem:
isPermissionEnabled=true
2008-10-22 16:32:55,477 INFO org.apache.hadoop.dfs.FSNamesystemMetrics:
Initializing FSNamesystemMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2008-10-22 16:32:55,479 INFO org.apache.hadoop.fs.FSNamesystem: Registered
FSNamesystemStatusMBean
2008-10-22 16:32:55,529 INFO org.apache.hadoop.dfs.Storage: Number of files
= 0
2008-10-22 16:32:55,529 INFO org.apache.hadoop.dfs.Storage: Number of files
under construction = 0
2008-10-22 16:32:55,529 INFO org.apache.hadoop.dfs.Storage: Image file of
size 80 loaded in 0 seconds.
2008-10-22 16:32:55,532 INFO org.apache.hadoop.dfs.Storage: Edits file edits
of size 4 edits # 0 loaded in 0 seconds.
2008-10-22 16:32:55,536 INFO org.apache.hadoop.fs.FSNamesystem: Finished
loading FSImage in 111 msecs
2008-10-22 16:32:55,539 INFO org.apache.hadoop.dfs.StateChange: STATE*
Leaving safe mode after 0 secs.
2008-10-22 16:32:55,539 INFO org.apache.hadoop.dfs.StateChange: STATE*
Network topology has 0 racks and 0 datanodes
2008-10-22 16:32:55,540 INFO org.apache.hadoop.dfs.StateChange: STATE*
UnderReplicatedBlocks has 0 blocks
2008-10-22 16:32:55,728 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-10-22 16:32:55,859 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-10-22 16:32:55,860 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-10-22 16:32:55,860 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-10-22 16:32:56,447 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@7cbde6
2008-10-22 16:32:56,547 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-10-22 16:32:56,550 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50070
2008-10-22 16:32:56,550 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@ff057f
2008-10-22 16:32:56,550 INFO org.apache.hadoop.fs.FSNamesystem: Web-server
up at: 0.0.0.0:50070
2008-10-22 16:32:56,551 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2008-10-22 16:32:56,553 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 54310: starting
2008-10-22 16:32:56,553 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 54310: starting
2008-10-22 16:32:56,554 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 54310: starting
2008-10-22 16:32:56,554 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 54310: starting
2008-10-22 16:32:56,554 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 54310: starting
2008-10-22 16:32:56,555 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 54310: starting
2008-10-22 16:32:56,555 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 5 on 54310: starting
2008-10-22 16:32:56,560 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 7 on 54310: starting
2008-10-22 16:32:56,560 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 8 on 54310: starting
2008-10-22 16:32:56,563 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 6 on 54310: starting
2008-10-22 16:32:56,581 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 54310: starting
2008-10-22 16:32:58,037 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.registerDatanode: node registration from
192.168.4.104:50010storage
DS-1779431755-192.168.4.104-50010-1224673378033
2008-10-22 16:32:58,044 INFO org.apache.hadoop.net.NetworkTopology: Adding a
new node: /default-rack/192.168.4.104:50010
2008-10-22 16:38:08,816 INFO org.apache.hadoop.fs.FSNamesystem: Roll Edit
Log from 192.168.4.104
2008-10-22 16:38:08,816 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 0 Total time for transactions(ms): 0 Number of syncs: 0
SyncTimes(ms): 0
2008-10-22 16:38:09,683 INFO org.apache.hadoop.fs.FSNamesystem: Roll FSImage
from 192.168.4.104
2008-10-22 16:38:09,684 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 0 Total time for transactions(ms): 0 Number of syncs: 0
SyncTimes(ms): 0
2008-10-22 16:51:58,164 INFO org.apache.hadoop.dfs.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at master/192.168.4.104
************************************************************/
2008-10-22 16:53:04,181 INFO org.apache.hadoop.dfs.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = master/192.168.4.104
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 16:53:04,329 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=NameNode, port=54310
2008-10-22 16:53:04,337 INFO org.apache.hadoop.dfs.NameNode: Namenode up at:
master/192.168.4.104:54310
2008-10-22 16:53:04,342 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=NameNode, sessionId=null
2008-10-22 16:53:04,349 INFO org.apache.hadoop.dfs.NameNodeMetrics:
Initializing NameNodeMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2008-10-22 16:53:04,461 INFO org.apache.hadoop.fs.FSNamesystem:
fsOwner=hadoop,hadoop
2008-10-22 16:53:04,461 INFO org.apache.hadoop.fs.FSNamesystem:
supergroup=supergroup
2008-10-22 16:53:04,461 INFO org.apache.hadoop.fs.FSNamesystem:
isPermissionEnabled=true
2008-10-22 16:53:04,482 INFO org.apache.hadoop.dfs.FSNamesystemMetrics:
Initializing FSNamesystemMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2008-10-22 16:53:04,483 INFO org.apache.hadoop.fs.FSNamesystem: Registered
FSNamesystemStatusMBean
2008-10-22 16:53:04,536 INFO org.apache.hadoop.dfs.Storage: Number of files
= 0
2008-10-22 16:53:04,537 INFO org.apache.hadoop.dfs.Storage: Number of files
under construction = 0
2008-10-22 16:53:04,537 INFO org.apache.hadoop.dfs.Storage: Image file of
size 80 loaded in 0 seconds.
2008-10-22 16:53:04,540 INFO org.apache.hadoop.dfs.Storage: Edits file edits
of size 4 edits # 0 loaded in 0 seconds.
2008-10-22 16:53:04,544 INFO org.apache.hadoop.fs.FSNamesystem: Finished
loading FSImage in 120 msecs
2008-10-22 16:53:04,547 INFO org.apache.hadoop.dfs.StateChange: STATE*
Leaving safe mode after 0 secs.
2008-10-22 16:53:04,547 INFO org.apache.hadoop.dfs.StateChange: STATE*
Network topology has 0 racks and 0 datanodes
2008-10-22 16:53:04,547 INFO org.apache.hadoop.dfs.StateChange: STATE*
UnderReplicatedBlocks has 0 blocks
2008-10-22 16:53:04,745 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-10-22 16:53:04,899 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-10-22 16:53:04,900 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-10-22 16:53:04,900 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-10-22 16:53:05,367 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@7cbde6
2008-10-22 16:53:05,427 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-10-22 16:53:05,430 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50070
2008-10-22 16:53:05,430 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@ff057f
2008-10-22 16:53:05,431 INFO org.apache.hadoop.fs.FSNamesystem: Web-server
up at: 0.0.0.0:50070
2008-10-22 16:53:05,431 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2008-10-22 16:53:05,434 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 54310: starting
2008-10-22 16:53:05,434 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 54310: starting
2008-10-22 16:53:05,434 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 54310: starting
2008-10-22 16:53:05,435 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 54310: starting
2008-10-22 16:53:05,435 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 54310: starting
2008-10-22 16:53:05,435 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 54310: starting
2008-10-22 16:53:05,435 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 5 on 54310: starting
2008-10-22 16:53:05,440 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 7 on 54310: starting
2008-10-22 16:53:05,441 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 8 on 54310: starting
2008-10-22 16:53:05,447 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 54310: starting
2008-10-22 16:53:05,448 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 6 on 54310: starting
2008-10-22 16:53:16,183 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.registerDatanode: node registration from
192.168.4.104:50010storage
DS-1684365730-192.168.4.104-50010-1224674596171
2008-10-22 16:53:16,189 INFO org.apache.hadoop.net.NetworkTopology: Adding a
new node: /default-rack/192.168.4.104:50010
2008-10-22 16:56:14,913 INFO org.apache.hadoop.dfs.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at master/192.168.4.104
************************************************************/
2008-10-22 16:56:48,668 INFO org.apache.hadoop.dfs.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = master/192.168.4.104
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 16:56:48,832 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=NameNode, port=54310
2008-10-22 16:56:48,841 INFO org.apache.hadoop.dfs.NameNode: Namenode up at:
master/192.168.4.104:54310
2008-10-22 16:56:48,846 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=NameNode, sessionId=null
2008-10-22 16:56:48,853 INFO org.apache.hadoop.dfs.NameNodeMetrics:
Initializing NameNodeMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2008-10-22 16:56:48,964 INFO org.apache.hadoop.fs.FSNamesystem:
fsOwner=hadoop,hadoop
2008-10-22 16:56:48,964 INFO org.apache.hadoop.fs.FSNamesystem:
supergroup=supergroup
2008-10-22 16:56:48,964 INFO org.apache.hadoop.fs.FSNamesystem:
isPermissionEnabled=true
2008-10-22 16:56:48,976 INFO org.apache.hadoop.dfs.FSNamesystemMetrics:
Initializing FSNamesystemMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2008-10-22 16:56:48,977 INFO org.apache.hadoop.fs.FSNamesystem: Registered
FSNamesystemStatusMBean
2008-10-22 16:56:49,029 INFO org.apache.hadoop.dfs.Storage: Number of files
= 0
2008-10-22 16:56:49,029 INFO org.apache.hadoop.dfs.Storage: Number of files
under construction = 0
2008-10-22 16:56:49,029 INFO org.apache.hadoop.dfs.Storage: Image file of
size 80 loaded in 0 seconds.
2008-10-22 16:56:49,041 INFO org.apache.hadoop.dfs.Storage: Edits file edits
of size 559 edits # 8 loaded in 0 seconds.
2008-10-22 16:56:49,055 INFO org.apache.hadoop.dfs.Storage: Image file of
size 648 saved in 0 seconds.
2008-10-22 16:56:49,080 INFO org.apache.hadoop.fs.FSNamesystem: Finished
loading FSImage in 154 msecs
2008-10-22 16:56:49,083 INFO org.apache.hadoop.dfs.StateChange: STATE*
Leaving safe mode after 0 secs.
2008-10-22 16:56:49,083 INFO org.apache.hadoop.dfs.StateChange: STATE*
Network topology has 0 racks and 0 datanodes
2008-10-22 16:56:49,083 INFO org.apache.hadoop.dfs.StateChange: STATE*
UnderReplicatedBlocks has 0 blocks
2008-10-22 16:56:49,248 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-10-22 16:56:49,396 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-10-22 16:56:49,397 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-10-22 16:56:49,397 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-10-22 16:56:50,019 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@90c06f
2008-10-22 16:56:50,086 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-10-22 16:56:50,089 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50070
2008-10-22 16:56:50,089 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@b76fa
2008-10-22 16:56:50,089 INFO org.apache.hadoop.fs.FSNamesystem: Web-server
up at: 0.0.0.0:50070
2008-10-22 16:56:50,089 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2008-10-22 16:56:50,096 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 54310: starting
2008-10-22 16:56:50,096 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 54310: starting
2008-10-22 16:56:50,096 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 54310: starting
2008-10-22 16:56:50,097 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 54310: starting
2008-10-22 16:56:50,097 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 54310: starting
2008-10-22 16:56:50,097 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 5 on 54310: starting
2008-10-22 16:56:50,097 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 6 on 54310: starting
2008-10-22 16:56:50,098 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 7 on 54310: starting
2008-10-22 16:56:50,098 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 8 on 54310: starting
2008-10-22 16:56:50,104 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 54310: starting
2008-10-22 16:56:50,104 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 54310: starting
2008-10-22 16:56:51,176 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.registerDatanode: node registration from
192.168.4.104:50010storage
DS-1684365730-192.168.4.104-50010-1224674596171
2008-10-22 16:56:51,181 INFO org.apache.hadoop.net.NetworkTopology: Adding a
new node: /default-rack/192.168.4.104:50010
2008-10-22 16:59:41,685 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 7 Total time for transactions(ms): 1 Number of syncs: 3
SyncTimes(ms): 23
2008-10-22 17:00:15,782 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.allocateBlock: /user/hadoop/input-test/input/4300.txt.
blk_-8228592051448522537_1001
2008-10-22 17:00:15,960 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 192.168.4.104:50010 is added to
blk_-8228592051448522537_1001 size 1573044
2008-10-22 17:01:58,298 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 10 Total time for transactions(ms): 1 Number of syncs: 6
SyncTimes(ms): 73
2008-10-22 17:01:58,413 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.allocateBlock:
/home/hadoop/Hadoop/hadoop-0.18.0/Temp/mapred/system/job_200810221657_0001/job.jar.
blk_8172038061044370796_1002
2008-10-22 17:01:58,453 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 192.168.4.104:50010 is added to
blk_8172038061044370796_1002 size 91176
2008-10-22 17:01:58,478 INFO org.apache.hadoop.fs.FSNamesystem: Increasing
replication for file
/home/hadoop/Hadoop/hadoop-0.18.0/Temp/mapred/system/job_200810221657_0001/job.jar.
New replication is 10
2008-10-22 17:01:58,582 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.allocateBlock:
/home/hadoop/Hadoop/hadoop-0.18.0/Temp/mapred/system/job_200810221657_0001/job.split.
blk_5514849033523567365_1003
2008-10-22 17:01:58,589 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 192.168.4.104:50010 is added to
blk_5514849033523567365_1003 size 249
2008-10-22 17:01:58,916 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.allocateBlock:
/home/hadoop/Hadoop/hadoop-0.18.0/Temp/mapred/system/job_200810221657_0001/job.xml.
blk_-8578406311900418029_1004
2008-10-22 17:01:58,933 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 192.168.4.104:50010 is added to
blk_-8578406311900418029_1004 size 13308
2008-10-22 17:01:59,711 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.allocateBlock:
/user/hadoop/input-test/output/_logs/history/master_1224674823136_job_200810221657_0001_conf.xml.
blk_2920003867684152670_1006
2008-10-22 17:01:59,732 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 192.168.4.104:50010 is added to
blk_2920003867684152670_1006 size 13295
2008-10-22 17:02:02,555 INFO org.apache.hadoop.fs.FSNamesystem: Roll Edit
Log from 192.168.4.104
2008-10-22 17:02:02,555 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 34 Total time for transactions(ms): 1 Number of syncs: 23
SyncTimes(ms): 202
2008-10-22 17:02:03,864 INFO org.apache.hadoop.fs.FSNamesystem: Roll FSImage
from 192.168.4.104
2008-10-22 17:02:03,864 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 0 Total time for transactions(ms): 0 Number of syncs: 0
SyncTimes(ms): 0
2008-10-22 17:02:09,340 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.allocateBlock:
/user/hadoop/input-test/output/_temporary/_attempt_200810221657_0001_r_000000_0/part-00000.
blk_-5637541331225267825_1007
2008-10-22 17:02:09,672 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 192.168.4.104:50010 is added to
blk_-5637541331225267825_1007 size 527522
2008-10-22 17:02:10,251 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.delete: blk_8172038061044370796 is added to invalidSet of
192.168.4.104:50010
2008-10-22 17:02:10,251 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.delete: blk_5514849033523567365 is added to invalidSet of
192.168.4.104:50010
2008-10-22 17:02:10,252 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.delete: blk_-8578406311900418029 is added to invalidSet of
192.168.4.104:50010
2008-10-22 17:02:10,265 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.allocateBlock:
/user/hadoop/input-test/output/_logs/history/master_1224674823136_job_200810221657_0001_hadoop_wordcount.
blk_4415374644475806525_1007
2008-10-22 17:02:10,276 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 192.168.4.104:50010 is added to
blk_4415374644475806525_1007 size 4201
2008-10-22 17:02:10,573 INFO org.apache.hadoop.dfs.StateChange: BLOCK* ask
192.168.4.104:50010 to delete  blk_8172038061044370796_1002
blk_5514849033523567365_1003 blk_-8578406311900418029_1004
2008-10-22 17:08:06,427 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.delete: blk_-8228592051448522537 is added to invalidSet of
192.168.4.104:50010
2008-10-22 17:08:06,427 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 10 Total time for transactions(ms): 0 Number of syncs: 8
SyncTimes(ms): 140
2008-10-22 17:08:08,073 INFO org.apache.hadoop.dfs.StateChange: BLOCK* ask
192.168.4.104:50010 to delete  blk_-8228592051448522537_1001
2008-10-22 17:08:15,096 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.delete: blk_2920003867684152670 is added to invalidSet of
192.168.4.104:50010
2008-10-22 17:08:15,096 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.delete: blk_4415374644475806525 is added to invalidSet of
192.168.4.104:50010
2008-10-22 17:08:15,097 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.delete: blk_-5637541331225267825 is added to invalidSet of
192.168.4.104:50010
2008-10-22 17:08:17,086 INFO org.apache.hadoop.dfs.StateChange: BLOCK* ask
192.168.4.104:50010 to delete  blk_2920003867684152670_1006
blk_-5637541331225267825_1007 blk_4415374644475806525_1007
2008-10-22 17:09:06,697 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 14 Total time for transactions(ms): 0 Number of syncs: 11
SyncTimes(ms): 150
2008-10-22 17:09:06,710 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.allocateBlock: /user/hadoop/input/4300.txt.
blk_-6871744471025859799_1008
2008-10-22 17:09:06,828 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 192.168.4.104:50010 is added to
blk_-6871744471025859799_1008 size 1573044
2008-10-22 17:09:21,191 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.allocateBlock: /user/hadoop/input/20417.txt.
blk_3084624268010503327_1009
2008-10-22 17:09:21,293 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.addStoredBlock: blockMap updated: 192.168.4.104:50010 is added to
blk_3084624268010503327_1009 size 674762
2008-10-22 17:27:24,021 INFO org.apache.hadoop.dfs.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at master/192.168.4.104
************************************************************/
2008-10-22 17:28:40,680 INFO org.apache.hadoop.dfs.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = master/192.168.3.171
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 17:28:40,873 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=NameNode, port=54310
2008-10-22 17:28:40,881 INFO org.apache.hadoop.dfs.NameNode: Namenode up at:
master/192.168.3.171:54310
2008-10-22 17:28:40,893 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=NameNode, sessionId=null
2008-10-22 17:28:40,900 INFO org.apache.hadoop.dfs.NameNodeMetrics:
Initializing NameNodeMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2008-10-22 17:28:41,012 INFO org.apache.hadoop.fs.FSNamesystem:
fsOwner=hadoop,hadoop
2008-10-22 17:28:41,012 INFO org.apache.hadoop.fs.FSNamesystem:
supergroup=supergroup
2008-10-22 17:28:41,012 INFO org.apache.hadoop.fs.FSNamesystem:
isPermissionEnabled=true
2008-10-22 17:28:41,029 INFO org.apache.hadoop.dfs.FSNamesystemMetrics:
Initializing FSNamesystemMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2008-10-22 17:28:41,030 INFO org.apache.hadoop.fs.FSNamesystem: Registered
FSNamesystemStatusMBean
2008-10-22 17:28:41,092 INFO org.apache.hadoop.dfs.Storage: Number of files
= 0
2008-10-22 17:28:41,093 INFO org.apache.hadoop.dfs.Storage: Number of files
under construction = 0
2008-10-22 17:28:41,093 INFO org.apache.hadoop.dfs.Storage: Image file of
size 80 loaded in 0 seconds.
2008-10-22 17:28:41,093 INFO org.apache.hadoop.dfs.Storage: Edits file edits
of size 4 edits # 0 loaded in 0 seconds.
2008-10-22 17:28:41,103 INFO org.apache.hadoop.fs.FSNamesystem: Finished
loading FSImage in 130 msecs
2008-10-22 17:28:41,105 INFO org.apache.hadoop.dfs.StateChange: STATE*
Leaving safe mode after 0 secs.
2008-10-22 17:28:41,106 INFO org.apache.hadoop.dfs.StateChange: STATE*
Network topology has 0 racks and 0 datanodes
2008-10-22 17:28:41,106 INFO org.apache.hadoop.dfs.StateChange: STATE*
UnderReplicatedBlocks has 0 blocks
2008-10-22 17:28:41,272 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-10-22 17:28:41,582 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-10-22 17:28:41,583 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-10-22 17:28:41,583 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-10-22 17:28:42,527 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@7cbde6
2008-10-22 17:28:42,603 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-10-22 17:28:42,606 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50070
2008-10-22 17:28:42,606 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@ff057f
2008-10-22 17:28:42,606 INFO org.apache.hadoop.fs.FSNamesystem: Web-server
up at: 0.0.0.0:50070
2008-10-22 17:28:42,607 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2008-10-22 17:28:42,610 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 54310: starting
2008-10-22 17:28:42,610 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 54310: starting
2008-10-22 17:28:42,610 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 54310: starting
2008-10-22 17:28:42,611 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 54310: starting
2008-10-22 17:28:42,611 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 54310: starting
2008-10-22 17:28:42,611 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 54310: starting
2008-10-22 17:28:42,611 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 5 on 54310: starting
2008-10-22 17:28:42,612 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 6 on 54310: starting
2008-10-22 17:28:42,617 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 8 on 54310: starting
2008-10-22 17:28:42,624 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 54310: starting
2008-10-22 17:28:42,624 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 7 on 54310: starting
2008-10-22 17:28:44,569 INFO org.apache.hadoop.dfs.StateChange: BLOCK*
NameSystem.registerDatanode: node registration from
192.168.3.171:50010storage
DS-1849696136-192.168.3.171-50010-1224676724562
2008-10-22 17:28:44,575 INFO org.apache.hadoop.net.NetworkTopology: Adding a
new node: /default-rack/192.168.3.171:50010
2008-10-22 17:32:19,826 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 0 Total time for transactions(ms): 0 Number of syncs: 0
SyncTimes(ms): 0
2008-10-22 17:33:44,998 INFO org.apache.hadoop.fs.FSNamesystem: Roll Edit
Log from 192.168.3.171
2008-10-22 17:33:44,999 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 8 Total time for transactions(ms): 0 Number of syncs: 3
SyncTimes(ms): 105
2008-10-22 17:33:45,633 INFO org.apache.hadoop.fs.FSNamesystem: Roll FSImage
from 192.168.3.171
2008-10-22 17:33:45,634 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 0 Total time for transactions(ms): 0 Number of syncs: 0
SyncTimes(ms): 0

*hadoop-hadoop-tasktracker-master.log:
*2008-10-22 15:53:02,802 INFO org.apache.hadoop.mapred.TaskTracker:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = master/192.168.4.104
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 15:53:03,098 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-10-22 15:53:03,334 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-10-22 15:53:03,335 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-10-22 15:53:03,335 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-10-22 15:53:03,692 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@134e4fb
2008-10-22 15:53:03,745 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-10-22 15:53:03,748 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50060
2008-10-22 15:53:03,748 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@1ded0fd
2008-10-22 15:53:03,756 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=TaskTracker, sessionId=
2008-10-22 15:53:03,784 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=TaskTracker, port=46076
2008-10-22 15:53:03,861 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2008-10-22 15:53:03,863 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 46076: starting
2008-10-22 15:53:03,863 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 46076: starting
2008-10-22 15:53:03,864 INFO org.apache.hadoop.mapred.TaskTracker:
TaskTracker up at: localhost.localdomain/127.0.0.1:46076
2008-10-22 15:53:03,864 INFO org.apache.hadoop.mapred.TaskTracker: Starting
tracker tracker_master:localhost.localdomain/127.0.0.1:46076
2008-10-22 15:53:03,865 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 46076: starting
2008-10-22 15:53:03,990 INFO org.apache.hadoop.mapred.TaskTracker: Starting
thread: Map-events fetcher for all reduce tasks on
tracker_master:localhost.localdomain/127.0.0.1:46076
2008-10-22 16:10:27,369 INFO org.apache.hadoop.mapred.TaskTracker:
SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at master/192.168.4.104
************************************************************/
2008-10-22 16:53:33,470 INFO org.apache.hadoop.mapred.TaskTracker:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = master/192.168.4.104
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 16:53:33,692 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-10-22 16:53:33,839 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-10-22 16:53:33,841 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-10-22 16:53:33,841 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-10-22 16:53:34,192 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@134e4fb
2008-10-22 16:53:34,253 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-10-22 16:53:34,264 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50060
2008-10-22 16:53:34,264 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@1ded0fd
2008-10-22 16:53:34,272 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=TaskTracker, sessionId=
2008-10-22 16:53:34,305 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=TaskTracker, port=36040
2008-10-22 16:53:34,373 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2008-10-22 16:53:34,375 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 36040: starting
2008-10-22 16:53:34,376 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 36040: starting
2008-10-22 16:53:34,377 INFO org.apache.hadoop.mapred.TaskTracker:
TaskTracker up at: localhost.localdomain/127.0.0.1:36040
2008-10-22 16:53:34,377 INFO org.apache.hadoop.mapred.TaskTracker: Starting
tracker tracker_master:localhost.localdomain/127.0.0.1:36040
2008-10-22 16:53:34,395 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 36040: starting
2008-10-22 16:53:34,462 INFO org.apache.hadoop.mapred.TaskTracker: Starting
thread: Map-events fetcher for all reduce tasks on
tracker_master:localhost.localdomain/127.0.0.1:36040
2008-10-22 16:56:04,807 INFO org.apache.hadoop.mapred.TaskTracker:
SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at master/192.168.4.104
************************************************************/
2008-10-22 16:57:03,995 INFO org.apache.hadoop.mapred.TaskTracker:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = master/192.168.4.104
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 16:57:04,302 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-10-22 16:57:04,448 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-10-22 16:57:04,449 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-10-22 16:57:04,450 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-10-22 16:57:04,820 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@134e4fb
2008-10-22 16:57:04,908 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-10-22 16:57:04,912 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50060
2008-10-22 16:57:04,912 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@1ded0fd
2008-10-22 16:57:04,919 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=TaskTracker, sessionId=
2008-10-22 16:57:04,941 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=TaskTracker, port=38621
2008-10-22 16:57:05,024 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2008-10-22 16:57:05,026 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 38621: starting
2008-10-22 16:57:05,026 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 38621: starting
2008-10-22 16:57:05,027 INFO org.apache.hadoop.mapred.TaskTracker:
TaskTracker up at: localhost.localdomain/127.0.0.1:38621
2008-10-22 16:57:05,027 INFO org.apache.hadoop.mapred.TaskTracker: Starting
tracker tracker_master:localhost.localdomain/127.0.0.1:38621
2008-10-22 16:57:05,039 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 38621: starting
2008-10-22 16:57:05,114 INFO org.apache.hadoop.mapred.TaskTracker: Starting
thread: Map-events fetcher for all reduce tasks on
tracker_master:localhost.localdomain/127.0.0.1:38621
2008-10-22 17:02:00,546 INFO org.apache.hadoop.mapred.TaskTracker:
LaunchTaskAction: attempt_200810221657_0001_m_000000_0
2008-10-22 17:02:01,047 INFO org.apache.hadoop.mapred.TaskTracker:
LaunchTaskAction: attempt_200810221657_0001_m_000001_0
2008-10-22 17:02:04,466 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_200810221657_0001_m_000000_0 1.0%
hdfs://master:54310/user/hadoop/input-test/input/4300.txt:0+786522
2008-10-22 17:02:04,471 INFO org.apache.hadoop.mapred.TaskTracker: Task
attempt_200810221657_0001_m_000000_0 is done.
2008-10-22 17:02:04,530 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_200810221657_0001_m_000001_0 1.0%
hdfs://master:54310/user/hadoop/input-test/input/4300.txt:786522+786522
2008-10-22 17:02:04,535 INFO org.apache.hadoop.mapred.TaskTracker: Task
attempt_200810221657_0001_m_000001_0 is done.
2008-10-22 17:02:05,221 INFO org.apache.hadoop.mapred.TaskTracker:
LaunchTaskAction: attempt_200810221657_0001_r_000000_0
2008-10-22 17:02:06,316 INFO org.apache.hadoop.mapred.TaskTracker: Sent out
409245 bytes for reduce: 0 from map: attempt_200810221657_0001_m_000000_0
given 409245/409245 from 0 with (7, 4)
2008-10-22 17:02:08,157 INFO org.apache.hadoop.mapred.TaskTracker: Sent out
450912 bytes for reduce: 0 from map: attempt_200810221657_0001_m_000001_0
given 450912/450912 from 0 with (6, 4)
2008-10-22 17:02:09,697 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_200810221657_0001_r_000000_0 0.9539398% reduce > reduce
2008-10-22 17:02:09,706 INFO org.apache.hadoop.mapred.TaskTracker: Task
attempt_200810221657_0001_r_000000_0 is done.
2008-10-22 17:02:10,310 INFO org.apache.hadoop.mapred.TaskTracker: Received
'KillJobAction' for job: job_200810221657_0001
2008-10-22 17:02:10,310 INFO org.apache.hadoop.mapred.TaskRunner:
attempt_200810221657_0001_m_000000_0 done; removing files.
2008-10-22 17:02:10,313 INFO org.apache.hadoop.mapred.TaskRunner:
attempt_200810221657_0001_m_000001_0 done; removing files.
2008-10-22 17:02:10,315 INFO org.apache.hadoop.mapred.TaskRunner:
attempt_200810221657_0001_r_000000_0 done; removing files.
2008-10-22 17:27:23,954 INFO org.apache.hadoop.mapred.TaskTracker:
SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at master/192.168.4.104
************************************************************/
2008-10-22 17:32:20,207 INFO org.apache.hadoop.mapred.TaskTracker:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = master/192.168.3.171
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 17:32:20,474 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-10-22 17:32:20,617 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-10-22 17:32:20,619 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-10-22 17:32:20,619 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-10-22 17:32:20,999 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@1126b07
2008-10-22 17:32:21,067 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-10-22 17:32:21,070 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50060
2008-10-22 17:32:21,071 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@1ded0fd
2008-10-22 17:32:21,078 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=TaskTracker, sessionId=
2008-10-22 17:32:21,110 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=TaskTracker, port=47885
2008-10-22 17:32:21,197 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2008-10-22 17:32:21,199 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 47885: starting
2008-10-22 17:32:21,200 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 47885: starting
2008-10-22 17:32:21,200 INFO org.apache.hadoop.mapred.TaskTracker:
TaskTracker up at: localhost.localdomain/127.0.0.1:47885
2008-10-22 17:32:21,200 INFO org.apache.hadoop.mapred.TaskTracker: Starting
tracker tracker_master:localhost.localdomain/127.0.0.1:47885
2008-10-22 17:32:21,228 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 47885: starting
2008-10-22 17:32:21,289 INFO org.apache.hadoop.mapred.TaskTracker: Starting
thread: Map-events fetcher for all reduce tasks on
tracker_master:localhost.localdomain/127.0.0.1:47885
*hadoop-hadoop-datanode-slave.log:
*2008-10-22 15:52:06,557 INFO org.apache.hadoop.dfs.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG:   host = slave/192.168.3.200
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 15:52:28,331 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 0 time(s).
2008-10-22 15:52:49,336 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 1 time(s).
2008-10-22 15:53:10,341 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 2 time(s).
2008-10-22 15:53:31,346 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 3 time(s).
2008-10-22 15:53:52,351 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 4 time(s).
2008-10-22 15:54:13,356 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 5 time(s).
2008-10-22 15:54:34,362 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 6 time(s).
2008-10-22 15:54:55,367 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 7 time(s).
2008-10-22 15:55:16,372 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 8 time(s).
2008-10-22 15:55:37,377 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 9 time(s).
2008-10-22 15:55:58,382 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 10 time(s).
2008-10-22 15:56:19,388 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 11 time(s).
2008-10-22 15:56:40,393 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 12 time(s).
2008-10-22 15:57:01,398 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 13 time(s).
2008-10-22 15:57:22,403 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 14 time(s).
2008-10-22 15:57:43,408 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 15 time(s).
2008-10-22 15:58:04,414 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 16 time(s).
2008-10-22 15:58:25,419 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 17 time(s).
2008-10-22 15:58:46,424 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 18 time(s).
2008-10-22 15:59:07,429 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 19 time(s).
2008-10-22 15:59:28,434 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 20 time(s).
2008-10-22 15:59:49,440 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 21 time(s).
2008-10-22 16:00:10,445 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 22 time(s).
2008-10-22 16:00:31,450 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 23 time(s).
2008-10-22 16:00:52,455 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 24 time(s).
2008-10-22 16:01:13,460 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 25 time(s).
2008-10-22 16:01:34,466 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 26 time(s).
2008-10-22 16:01:55,471 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 27 time(s).
2008-10-22 16:02:16,476 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 28 time(s).
2008-10-22 16:02:37,481 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 29 time(s).
2008-10-22 16:02:58,486 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 30 time(s).
2008-10-22 16:03:19,492 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 31 time(s).
2008-10-22 16:03:40,497 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 32 time(s).
2008-10-22 16:04:01,502 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 33 time(s).
2008-10-22 16:04:22,507 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 34 time(s).
2008-10-22 16:04:43,512 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 35 time(s).
2008-10-22 16:05:04,518 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 36 time(s).
2008-10-22 16:05:25,523 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 37 time(s).
2008-10-22 16:05:46,528 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 38 time(s).
2008-10-22 16:06:07,572 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 39 time(s).
2008-10-22 16:06:28,578 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 40 time(s).
2008-10-22 16:06:49,584 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 41 time(s).
2008-10-22 16:07:10,589 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 42 time(s).
2008-10-22 16:07:31,594 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 43 time(s).
2008-10-22 16:07:52,599 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 44 time(s).
2008-10-22 16:08:12,619 ERROR org.apache.hadoop.dfs.DataNode:
java.io.IOException: Call failed on local exception
    at org.apache.hadoop.ipc.Client.call(Client.java:718)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:216)
    at org.apache.hadoop.dfs.$Proxy4.getProtocolVersion(Unknown Source)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:319)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:306)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:343)
    at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:288)
    at org.apache.hadoop.dfs.DataNode.startDataNode(DataNode.java:244)
    at org.apache.hadoop.dfs.DataNode.<init>(DataNode.java:190)
    at org.apache.hadoop.dfs.DataNode.makeInstance(DataNode.java:2987)
    at
org.apache.hadoop.dfs.DataNode.instantiateDataNode(DataNode.java:2942)
    at org.apache.hadoop.dfs.DataNode.createDataNode(DataNode.java:2950)
    at org.apache.hadoop.dfs.DataNode.main(DataNode.java:3072)
Caused by: java.net.SocketTimeoutException
    at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:109)
    at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:300)
    at org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:177)
    at org.apache.hadoop.ipc.Client.getConnection(Client.java:789)
    at org.apache.hadoop.ipc.Client.call(Client.java:704)
    ... 12 more

2008-10-22 16:08:12,626 INFO org.apache.hadoop.dfs.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at slave/192.168.3.200
************************************************************/
2008-10-22 16:33:05,654 INFO org.apache.hadoop.dfs.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG:   host = slave/192.168.3.200
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 16:33:26,883 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 0 time(s).
2008-10-22 16:33:47,888 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 1 time(s).
2008-10-22 16:34:08,893 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 2 time(s).
2008-10-22 16:34:29,898 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 3 time(s).
2008-10-22 16:34:50,903 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 4 time(s).
2008-10-22 16:35:11,909 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 5 time(s).
2008-10-22 16:35:32,914 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 6 time(s).
2008-10-22 16:35:53,919 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 7 time(s).
2008-10-22 16:36:14,924 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 8 time(s).
2008-10-22 16:36:35,929 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 9 time(s).
2008-10-22 16:36:56,935 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 10 time(s).
2008-10-22 16:37:17,940 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 11 time(s).
2008-10-22 16:37:38,945 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 12 time(s).
2008-10-22 16:37:59,950 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 13 time(s).
2008-10-22 16:38:20,955 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 14 time(s).
2008-10-22 16:38:41,961 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 15 time(s).
2008-10-22 16:39:02,966 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 16 time(s).
2008-10-22 16:39:23,971 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 17 time(s).
2008-10-22 16:39:44,976 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 18 time(s).
2008-10-22 16:40:05,981 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 19 time(s).
2008-10-22 16:40:26,987 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 20 time(s).
2008-10-22 16:40:47,992 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 21 time(s).
2008-10-22 16:41:08,997 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 22 time(s).
2008-10-22 16:41:30,002 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 23 time(s).
2008-10-22 16:41:51,007 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 24 time(s).
2008-10-22 16:42:12,012 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 25 time(s).
2008-10-22 16:42:33,018 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 26 time(s).
2008-10-22 16:42:54,023 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 27 time(s).
2008-10-22 16:43:15,028 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 28 time(s).
2008-10-22 16:43:36,033 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 29 time(s).
2008-10-22 16:43:57,038 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 30 time(s).
2008-10-22 16:44:18,044 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 31 time(s).
2008-10-22 16:44:39,049 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 32 time(s).
2008-10-22 16:45:00,054 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 33 time(s).
2008-10-22 16:45:21,059 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 34 time(s).
2008-10-22 16:45:42,064 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 35 time(s).
2008-10-22 16:46:03,070 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 36 time(s).
2008-10-22 16:46:24,075 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 37 time(s).
2008-10-22 16:46:45,088 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 38 time(s).
2008-10-22 16:47:06,093 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 39 time(s).
2008-10-22 16:47:27,098 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 40 time(s).
2008-10-22 16:47:48,104 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 41 time(s).
2008-10-22 16:48:09,109 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 42 time(s).
2008-10-22 16:48:30,114 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 43 time(s).
2008-10-22 16:48:51,119 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 44 time(s).
2008-10-22 16:49:11,123 ERROR org.apache.hadoop.dfs.DataNode:
java.io.IOException: Call failed on local exception
    at org.apache.hadoop.ipc.Client.call(Client.java:718)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:216)
    at org.apache.hadoop.dfs.$Proxy4.getProtocolVersion(Unknown Source)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:319)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:306)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:343)
    at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:288)
    at org.apache.hadoop.dfs.DataNode.startDataNode(DataNode.java:244)
    at org.apache.hadoop.dfs.DataNode.<init>(DataNode.java:190)
    at org.apache.hadoop.dfs.DataNode.makeInstance(DataNode.java:2987)
    at
org.apache.hadoop.dfs.DataNode.instantiateDataNode(DataNode.java:2942)
    at org.apache.hadoop.dfs.DataNode.createDataNode(DataNode.java:2950)
    at org.apache.hadoop.dfs.DataNode.main(DataNode.java:3072)
Caused by: java.net.SocketTimeoutException
    at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:109)
    at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:300)
    at org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:177)
    at org.apache.hadoop.ipc.Client.getConnection(Client.java:789)
    at org.apache.hadoop.ipc.Client.call(Client.java:704)
    ... 12 more

2008-10-22 16:49:11,129 INFO org.apache.hadoop.dfs.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at slave/192.168.3.200
************************************************************/
2008-10-22 16:51:31,255 INFO org.apache.hadoop.dfs.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG:   host = slave/192.168.3.200
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 16:51:52,510 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 0 time(s).
2008-10-22 16:52:07,499 INFO org.apache.hadoop.dfs.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at slave/192.168.3.200
************************************************************/
2008-10-22 16:53:14,681 INFO org.apache.hadoop.dfs.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG:   host = slave/192.168.3.200
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 16:53:35,924 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 0 time(s).
2008-10-22 16:53:56,929 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 1 time(s).
2008-10-22 16:54:17,934 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 2 time(s).
2008-10-22 16:54:38,939 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 3 time(s).
2008-10-22 16:54:59,944 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 4 time(s).
2008-10-22 16:55:20,950 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 5 time(s).
2008-10-22 16:55:41,955 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 6 time(s).
2008-10-22 16:56:02,960 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 7 time(s).
2008-10-22 16:56:23,965 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 8 time(s).
2008-10-22 16:56:24,266 INFO org.apache.hadoop.dfs.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at slave/192.168.3.200
************************************************************/
2008-10-22 16:56:59,105 INFO org.apache.hadoop.dfs.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG:   host = slave/192.168.3.200
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 16:57:20,344 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 0 time(s).
2008-10-22 16:57:41,349 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 1 time(s).
2008-10-22 16:58:02,355 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 2 time(s).
2008-10-22 16:58:23,360 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 3 time(s).
2008-10-22 16:58:44,365 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 4 time(s).
2008-10-22 16:59:05,370 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 5 time(s).
2008-10-22 16:59:26,375 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 6 time(s).
2008-10-22 16:59:47,381 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 7 time(s).
2008-10-22 17:00:08,386 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 8 time(s).
2008-10-22 17:00:29,391 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 9 time(s).
2008-10-22 17:00:50,396 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 10 time(s).
2008-10-22 17:01:11,406 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 11 time(s).
2008-10-22 17:01:32,411 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 12 time(s).
2008-10-22 17:01:53,416 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 13 time(s).
2008-10-22 17:02:14,421 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 14 time(s).
2008-10-22 17:02:35,426 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 15 time(s).
2008-10-22 17:02:56,431 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 16 time(s).
2008-10-22 17:03:17,437 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 17 time(s).
2008-10-22 17:03:38,442 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 18 time(s).
2008-10-22 17:03:59,447 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 19 time(s).
2008-10-22 17:04:20,452 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 20 time(s).
2008-10-22 17:04:41,457 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 21 time(s).
2008-10-22 17:05:02,463 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 22 time(s).
2008-10-22 17:05:23,468 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 23 time(s).
2008-10-22 17:05:44,473 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 24 time(s).
2008-10-22 17:06:05,478 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 25 time(s).
2008-10-22 17:06:26,483 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 26 time(s).
2008-10-22 17:06:47,489 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 27 time(s).
2008-10-22 17:07:08,494 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 28 time(s).
2008-10-22 17:07:29,499 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 29 time(s).
2008-10-22 17:07:50,504 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 30 time(s).
2008-10-22 17:08:11,509 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 31 time(s).
2008-10-22 17:08:32,515 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 32 time(s).
2008-10-22 17:08:53,520 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 33 time(s).
2008-10-22 17:09:14,525 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 34 time(s).
2008-10-22 17:09:35,530 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 35 time(s).
2008-10-22 17:09:56,535 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 36 time(s).
2008-10-22 17:10:17,541 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 37 time(s).
2008-10-22 17:10:38,546 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 38 time(s).
2008-10-22 17:10:59,551 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 39 time(s).
2008-10-22 17:11:20,556 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 40 time(s).
2008-10-22 17:11:41,561 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 41 time(s).
2008-10-22 17:12:02,567 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 42 time(s).
2008-10-22 17:12:23,572 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 43 time(s).
2008-10-22 17:12:44,577 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54310. Already tried 44 time(s).
2008-10-22 17:13:04,580 ERROR org.apache.hadoop.dfs.DataNode:
java.io.IOException: Call failed on local exception
    at org.apache.hadoop.ipc.Client.call(Client.java:718)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:216)
    at org.apache.hadoop.dfs.$Proxy4.getProtocolVersion(Unknown Source)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:319)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:306)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:343)
    at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:288)
    at org.apache.hadoop.dfs.DataNode.startDataNode(DataNode.java:244)
    at org.apache.hadoop.dfs.DataNode.<init>(DataNode.java:190)
    at org.apache.hadoop.dfs.DataNode.makeInstance(DataNode.java:2987)
    at
org.apache.hadoop.dfs.DataNode.instantiateDataNode(DataNode.java:2942)
    at org.apache.hadoop.dfs.DataNode.createDataNode(DataNode.java:2950)
    at org.apache.hadoop.dfs.DataNode.main(DataNode.java:3072)
Caused by: java.net.SocketTimeoutException
    at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:109)
    at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:300)
    at org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:177)
    at org.apache.hadoop.ipc.Client.getConnection(Client.java:789)
    at org.apache.hadoop.ipc.Client.call(Client.java:704)
    ... 12 more

2008-10-22 17:13:04,581 INFO org.apache.hadoop.dfs.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at slave/192.168.3.200
************************************************************/
2008-10-22 17:28:41,017 INFO org.apache.hadoop.dfs.DataNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG:   host = slave/192.168.3.200
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 17:28:42,280 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54310. Already tried 0 time(s).
2008-10-22 17:28:43,284 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54310. Already tried 1 time(s).
2008-10-22 17:28:44,288 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54310. Already tried 2 time(s).
2008-10-22 17:28:45,292 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54310. Already tried 3 time(s).
2008-10-22 17:28:46,296 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54310. Already tried 4 time(s).
2008-10-22 17:28:47,300 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54310. Already tried 5 time(s).
2008-10-22 17:28:48,304 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54310. Already tried 6 time(s).
2008-10-22 17:28:49,308 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54310. Already tried 7 time(s).
2008-10-22 17:28:50,312 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54310. Already tried 8 time(s).
2008-10-22 17:28:51,316 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54310. Already tried 9 time(s).
2008-10-22 17:28:51,319 ERROR org.apache.hadoop.dfs.DataNode:
java.io.IOException: Call failed on local exception
    at org.apache.hadoop.ipc.Client.call(Client.java:718)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:216)
    at org.apache.hadoop.dfs.$Proxy4.getProtocolVersion(Unknown Source)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:319)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:306)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:343)
    at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:288)
    at org.apache.hadoop.dfs.DataNode.startDataNode(DataNode.java:244)
    at org.apache.hadoop.dfs.DataNode.<init>(DataNode.java:190)
    at org.apache.hadoop.dfs.DataNode.makeInstance(DataNode.java:2987)
    at
org.apache.hadoop.dfs.DataNode.instantiateDataNode(DataNode.java:2942)
    at org.apache.hadoop.dfs.DataNode.createDataNode(DataNode.java:2950)
    at org.apache.hadoop.dfs.DataNode.main(DataNode.java:3072)
Caused by: java.net.NoRouteToHostException: No route to host
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
    at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:100)
    at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:300)
    at org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:177)
    at org.apache.hadoop.ipc.Client.getConnection(Client.java:789)
    at org.apache.hadoop.ipc.Client.call(Client.java:704)
    ... 12 more

2008-10-22 17:28:51,320 INFO org.apache.hadoop.dfs.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at slave/192.168.3.200
************************************************************/
*hadoop-hadoop-tasktracker-slave.log:
*2008-10-22 15:53:11,448 INFO org.apache.hadoop.mapred.TaskTracker:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = slave/192.168.3.200
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 15:53:22,070 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-10-22 15:53:22,452 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-10-22 15:53:22,479 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-10-22 15:53:22,479 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-10-22 15:53:23,195 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@c24c0
2008-10-22 15:53:23,329 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-10-22 15:53:23,332 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50060
2008-10-22 15:53:23,332 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@1aaa14a
2008-10-22 15:53:23,347 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=TaskTracker, sessionId=
2008-10-22 15:53:23,405 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=TaskTracker, port=33619
2008-10-22 15:53:23,485 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2008-10-22 15:53:23,488 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 33619: starting
2008-10-22 15:53:23,486 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 33619: starting
2008-10-22 15:53:23,489 INFO org.apache.hadoop.mapred.TaskTracker:
TaskTracker up at: localhost6.localdomain6/127.0.0.1:33619
2008-10-22 15:53:23,489 INFO org.apache.hadoop.mapred.TaskTracker: Starting
tracker tracker_slave:localhost6.localdomain6/127.0.0.1:33619
2008-10-22 15:53:23,490 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 33619: starting
2008-10-22 15:53:44,575 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 0 time(s).
2008-10-22 15:54:05,616 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 1 time(s).
2008-10-22 15:54:26,621 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 2 time(s).
2008-10-22 15:54:47,626 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 3 time(s).
2008-10-22 15:55:08,632 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 4 time(s).
2008-10-22 15:55:29,642 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 5 time(s).
2008-10-22 15:55:50,646 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 6 time(s).
2008-10-22 15:56:11,651 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 7 time(s).
2008-10-22 15:56:32,656 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 8 time(s).
2008-10-22 15:56:53,662 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 9 time(s).
2008-10-22 15:57:14,667 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 10 time(s).
2008-10-22 15:57:35,672 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 11 time(s).
2008-10-22 15:57:56,677 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 12 time(s).
2008-10-22 15:58:17,682 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 13 time(s).
2008-10-22 15:58:38,688 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 14 time(s).
2008-10-22 15:58:59,693 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 15 time(s).
2008-10-22 15:59:20,698 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 16 time(s).
2008-10-22 15:59:41,703 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 17 time(s).
2008-10-22 16:00:02,708 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 18 time(s).
2008-10-22 16:00:23,714 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 19 time(s).
2008-10-22 16:00:44,719 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 20 time(s).
2008-10-22 16:01:05,724 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 21 time(s).
2008-10-22 16:01:26,729 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 22 time(s).
2008-10-22 16:01:47,734 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 23 time(s).
2008-10-22 16:02:08,740 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 24 time(s).
2008-10-22 16:02:29,745 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 25 time(s).
2008-10-22 16:02:50,750 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 26 time(s).
2008-10-22 16:03:11,755 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 27 time(s).
2008-10-22 16:03:32,760 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 28 time(s).
2008-10-22 16:03:53,766 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 29 time(s).
2008-10-22 16:04:14,771 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 30 time(s).
2008-10-22 16:04:35,776 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 31 time(s).
2008-10-22 16:04:56,781 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 32 time(s).
2008-10-22 16:05:17,786 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 33 time(s).
2008-10-22 16:05:38,792 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 34 time(s).
2008-10-22 16:05:59,797 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 35 time(s).
2008-10-22 16:06:20,802 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 36 time(s).
2008-10-22 16:06:41,807 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 37 time(s).
2008-10-22 16:07:02,812 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 38 time(s).
2008-10-22 16:07:23,818 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 39 time(s).
2008-10-22 16:07:44,823 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 40 time(s).
2008-10-22 16:08:05,828 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 41 time(s).
2008-10-22 16:08:26,833 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 42 time(s).
2008-10-22 16:08:47,838 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 43 time(s).
2008-10-22 16:09:08,843 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 44 time(s).
2008-10-22 16:09:28,847 ERROR org.apache.hadoop.mapred.TaskTracker: Can not
start task tracker because java.io.IOException: Call failed on local
exception
    at org.apache.hadoop.ipc.Client.call(Client.java:718)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:216)
    at org.apache.hadoop.mapred.$Proxy4.getProtocolVersion(Unknown Source)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:319)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:306)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:343)
    at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:288)
    at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:447)
    at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:836)
    at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:2354)
Caused by: java.net.SocketTimeoutException
    at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:109)
    at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:300)
    at org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:177)
    at org.apache.hadoop.ipc.Client.getConnection(Client.java:789)
    at org.apache.hadoop.ipc.Client.call(Client.java:704)
    ... 9 more

2008-10-22 16:09:28,848 INFO org.apache.hadoop.mapred.TaskTracker:
SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at slave/192.168.3.200
************************************************************/
2008-10-22 16:53:42,342 INFO org.apache.hadoop.mapred.TaskTracker:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = slave/192.168.3.200
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 16:53:52,596 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-10-22 16:53:52,728 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-10-22 16:53:52,730 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-10-22 16:53:52,730 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-10-22 16:53:53,148 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@9ced8e
2008-10-22 16:53:53,200 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-10-22 16:53:53,204 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50060
2008-10-22 16:53:53,204 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@7a84e4
2008-10-22 16:53:53,212 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=TaskTracker, sessionId=
2008-10-22 16:53:53,248 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=TaskTracker, port=55329
2008-10-22 16:53:53,322 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2008-10-22 16:53:53,325 INFO org.apache.hadoop.mapred.TaskTracker:
TaskTracker up at: localhost/127.0.0.1:55329
2008-10-22 16:53:53,325 INFO org.apache.hadoop.mapred.TaskTracker: Starting
tracker tracker_slave:localhost/127.0.0.1:55329
2008-10-22 16:53:53,324 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 55329: starting
2008-10-22 16:53:53,370 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 55329: starting
2008-10-22 16:53:53,371 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 55329: starting
2008-10-22 16:54:14,374 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 0 time(s).
2008-10-22 16:54:35,379 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 1 time(s).
2008-10-22 16:54:56,384 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 2 time(s).
2008-10-22 16:55:17,389 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 3 time(s).
2008-10-22 16:55:38,394 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 4 time(s).
2008-10-22 16:55:59,400 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 5 time(s).
2008-10-22 16:56:13,869 INFO org.apache.hadoop.mapred.TaskTracker:
SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at slave/192.168.3.200
************************************************************/
2008-10-22 16:57:13,067 INFO org.apache.hadoop.mapred.TaskTracker:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = slave/192.168.3.200
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 16:57:23,324 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-10-22 16:57:23,458 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-10-22 16:57:23,460 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-10-22 16:57:23,460 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-10-22 16:57:23,876 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@9ced8e
2008-10-22 16:57:23,951 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-10-22 16:57:23,955 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50060
2008-10-22 16:57:23,955 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@7a84e4
2008-10-22 16:57:23,963 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=TaskTracker, sessionId=
2008-10-22 16:57:23,999 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=TaskTracker, port=40049
2008-10-22 16:57:24,072 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2008-10-22 16:57:24,075 INFO org.apache.hadoop.mapred.TaskTracker:
TaskTracker up at: localhost/127.0.0.1:40049
2008-10-22 16:57:24,075 INFO org.apache.hadoop.mapred.TaskTracker: Starting
tracker tracker_slave:localhost/127.0.0.1:40049
2008-10-22 16:57:24,074 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 40049: starting
2008-10-22 16:57:24,098 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 40049: starting
2008-10-22 16:57:24,098 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 40049: starting
2008-10-22 16:57:45,126 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 0 time(s).
2008-10-22 16:58:06,131 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 1 time(s).
2008-10-22 16:58:27,136 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 2 time(s).
2008-10-22 16:58:48,141 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 3 time(s).
2008-10-22 16:59:09,146 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 4 time(s).
2008-10-22 16:59:30,152 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 5 time(s).
2008-10-22 16:59:51,157 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 6 time(s).
2008-10-22 17:00:12,162 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 7 time(s).
2008-10-22 17:00:33,167 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 8 time(s).
2008-10-22 17:00:54,172 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 9 time(s).
2008-10-22 17:01:15,178 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 10 time(s).
2008-10-22 17:01:36,183 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 11 time(s).
2008-10-22 17:01:57,188 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 12 time(s).
2008-10-22 17:02:18,193 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 13 time(s).
2008-10-22 17:02:39,198 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 14 time(s).
2008-10-22 17:03:00,204 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 15 time(s).
2008-10-22 17:03:21,209 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 16 time(s).
2008-10-22 17:03:42,214 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 17 time(s).
2008-10-22 17:04:03,219 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 18 time(s).
2008-10-22 17:04:24,224 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 19 time(s).
2008-10-22 17:04:45,230 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 20 time(s).
2008-10-22 17:05:06,235 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 21 time(s).
2008-10-22 17:05:27,240 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 22 time(s).
2008-10-22 17:05:48,245 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 23 time(s).
2008-10-22 17:06:09,250 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 24 time(s).
2008-10-22 17:06:30,256 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 25 time(s).
2008-10-22 17:06:51,261 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 26 time(s).
2008-10-22 17:07:12,266 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 27 time(s).
2008-10-22 17:07:33,271 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 28 time(s).
2008-10-22 17:07:54,276 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 29 time(s).
2008-10-22 17:08:15,282 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 30 time(s).
2008-10-22 17:08:36,287 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 31 time(s).
2008-10-22 17:08:57,292 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 32 time(s).
2008-10-22 17:09:18,297 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 33 time(s).
2008-10-22 17:09:39,302 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 34 time(s).
2008-10-22 17:10:00,308 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 35 time(s).
2008-10-22 17:10:21,313 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 36 time(s).
2008-10-22 17:10:42,318 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 37 time(s).
2008-10-22 17:11:03,323 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 38 time(s).
2008-10-22 17:11:24,328 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 39 time(s).
2008-10-22 17:11:45,334 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 40 time(s).
2008-10-22 17:12:06,339 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 41 time(s).
2008-10-22 17:12:27,344 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 42 time(s).
2008-10-22 17:12:48,349 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 43 time(s).
2008-10-22 17:13:09,354 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.4.104:54311. Already tried 44 time(s).
2008-10-22 17:13:29,358 ERROR org.apache.hadoop.mapred.TaskTracker: Can not
start task tracker because java.io.IOException: Call failed on local
exception
    at org.apache.hadoop.ipc.Client.call(Client.java:718)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:216)
    at org.apache.hadoop.mapred.$Proxy4.getProtocolVersion(Unknown Source)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:319)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:306)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:343)
    at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:288)
    at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:447)
    at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:836)
    at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:2354)
Caused by: java.net.SocketTimeoutException
    at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:109)
    at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:300)
    at org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:177)
    at org.apache.hadoop.ipc.Client.getConnection(Client.java:789)
    at org.apache.hadoop.ipc.Client.call(Client.java:704)
    ... 9 more

2008-10-22 17:13:29,359 INFO org.apache.hadoop.mapred.TaskTracker:
SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at slave/192.168.3.200
************************************************************/
2008-10-22 17:32:18,230 INFO org.apache.hadoop.mapred.TaskTracker:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = slave/192.168.3.200
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r 686010;
compiled by 'hadoopqa' on Thu Aug 14 19:48:33 UTC 2008
************************************************************/
2008-10-22 17:32:18,492 INFO org.mortbay.util.Credential: Checking Resource
aliases
2008-10-22 17:32:18,631 INFO org.mortbay.http.HttpServer: Version
Jetty/5.1.4
2008-10-22 17:32:18,634 INFO org.mortbay.util.Container: Started
HttpContext[/static,/static]
2008-10-22 17:32:18,634 INFO org.mortbay.util.Container: Started
HttpContext[/logs,/logs]
2008-10-22 17:32:19,047 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.servlet.WebApplicationHandler@1506dc4
2008-10-22 17:32:19,121 INFO org.mortbay.util.Container: Started
WebApplicationContext[/,/]
2008-10-22 17:32:19,125 INFO org.mortbay.http.SocketListener: Started
SocketListener on 0.0.0.0:50060
2008-10-22 17:32:19,125 INFO org.mortbay.util.Container: Started
org.mortbay.jetty.Server@1ded0fd
2008-10-22 17:32:19,133 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=TaskTracker, sessionId=
2008-10-22 17:32:19,171 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=TaskTracker, port=56071
2008-10-22 17:32:19,246 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2008-10-22 17:32:19,248 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 56071: starting
2008-10-22 17:32:19,249 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 56071: starting
2008-10-22 17:32:19,249 INFO org.apache.hadoop.mapred.TaskTracker:
TaskTracker up at: localhost/127.0.0.1:56071
2008-10-22 17:32:19,250 INFO org.apache.hadoop.mapred.TaskTracker: Starting
tracker tracker_slave:localhost/127.0.0.1:56071
2008-10-22 17:32:19,285 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 56071: starting
2008-10-22 17:32:20,304 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54311. Already tried 0 time(s).
2008-10-22 17:32:21,308 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54311. Already tried 1 time(s).
2008-10-22 17:32:22,312 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54311. Already tried 2 time(s).
2008-10-22 17:32:23,316 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54311. Already tried 3 time(s).
2008-10-22 17:32:24,320 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54311. Already tried 4 time(s).
2008-10-22 17:32:25,324 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54311. Already tried 5 time(s).
2008-10-22 17:32:26,328 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54311. Already tried 6 time(s).
2008-10-22 17:32:27,332 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54311. Already tried 7 time(s).
2008-10-22 17:32:28,336 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54311. Already tried 8 time(s).
2008-10-22 17:32:29,340 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: master/192.168.3.171:54311. Already tried 9 time(s).
2008-10-22 17:32:29,343 ERROR org.apache.hadoop.mapred.TaskTracker: Can not
start task tracker because java.io.IOException: Call failed on local
exception
    at org.apache.hadoop.ipc.Client.call(Client.java:718)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:216)
    at org.apache.hadoop.mapred.$Proxy4.getProtocolVersion(Unknown Source)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:319)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:306)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:343)
    at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:288)
    at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:447)
    at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:836)
    at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:2354)
Caused by: java.net.NoRouteToHostException: No route to host
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
    at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:100)
    at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:300)
    at org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:177)
    at org.apache.hadoop.ipc.Client.getConnection(Client.java:789)
    at org.apache.hadoop.ipc.Client.call(Client.java:704)
    ... 9 more

2008-10-22 17:32:29,344 INFO org.apache.hadoop.mapred.TaskTracker:
SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at slave/192.168.3.200
************************************************************/
*ping-to-master-from-slave:// This is tried with master's ip:192.168.4.104
*[hadoop@slave conf]$ ping master
PING master (192.168.4.104) 56(84) bytes of data.
64 bytes from master (192.168.4.104): icmp_seq=1 ttl=64 time=0.141 ms
64 bytes from master (192.168.4.104): icmp_seq=2 ttl=64 time=0.134 ms
64 bytes from master (192.168.4.104): icmp_seq=3 ttl=64 time=0.158 ms
64 bytes from master (192.168.4.104): icmp_seq=4 ttl=64 time=0.168 ms
64 bytes from master (192.168.4.104): icmp_seq=5 ttl=64 time=0.159 ms
64 bytes from master (192.168.4.104): icmp_seq=6 ttl=64 time=0.127 ms

--- master ping statistics ---
6 packets transmitted, 6 received, 0% packet loss, time 5000ms
rtt min/avg/max/mdev = 0.127/0.147/0.168/0.021 ms

*ping-to-master-from-slave:// I have changed master's ip to 192.168.3.171
because i thought problem with 4.* series ip address,but i can able to pint
to master irrespective of IP
*[hadoop@slave conf]$ ping master
PING master (192.168.4.104) 56(84) bytes of data.
64 bytes from master (192.168.4.104): icmp_seq=1 ttl=64 time=0.141 ms
64 bytes from master (192.168.4.104): icmp_seq=2 ttl=64 time=0.134 ms
64 bytes from master (192.168.4.104): icmp_seq=3 ttl=64 time=0.158 ms
64 bytes from master (192.168.4.104): icmp_seq=4 ttl=64 time=0.168 ms
64 bytes from master (192.168.4.104): icmp_seq=5 ttl=64 time=0.159 ms
64 bytes from master (192.168.4.104): icmp_seq=6 ttl=64 time=0.127 ms
*conf/hadoop-site.xml:
*<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
    <name>hadoop.tmp.dir</name>
    <value>/home/hadoop/Hadoop/hadoop-0.18.0/Temp/</value>
</property>
<property>
    <name>fs.default.name</name>
    <value>hdfs://master:54310</value>
</property>
<property>
    <name>mapred.job.tracker</name>
    <value>master:54311</value>
</property>
<property>
    <name>dfs.replication</name>
    <value>2</value>
</property>
</configuration>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message