hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shawna Qian <shaw...@yahoo-inc.com>
Subject MiniYarnCluster multiple nodemanager support
Date Fri, 02 Sep 2011 21:47:17 GMT
Hello:

I am trying to extend the MiniYarnCluster to support Multiple NodeManager.  but I am getting
this address already in use for ContainerManger registration.  Seems like container manager
is using a fixed address 0.0.0.0:4344.  Should this be made configurable?


Also, I am not sure if this makes it is impossible to support multiple nodemanager in the
miniyarncluster for a single machine?

Thx
Shawna


Exception in thread "Thread-94" org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager
	at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:80)
	at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:146)
	at org.apache.hadoop.yarn.server.MyMiniYARNCluster$NewThread.run(MyMiniYARNCluster.java:170)
Caused by: org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
	at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:80)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.start(ContainerManagerImpl.java:219)
	at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
	... 2 more
Caused by: org.apache.hadoop.yarn.YarnException: java.net.BindException: Problem binding to
/0.0.0.0:4344 : Address already in use
	at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:125)
	at org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getServer(HadoopYhttps://sp1-webmail.corp.yahoo.com/owa/?ae=Item&t=IPM.Note&s=Draft&a=Open#arnProtoRPC.java:68)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.createServer(ResourceLocalizationService.java:245)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.start(ResourceLocalizationService.java:228)
	at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
	... 4 more
Caused by: java.net.BindException: Problem binding to /0.0.0.0:4344 : Address already in use
	at org.apache.hadoop.ipc.Server.bind(Server.java:231)
	at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:320)
	at org.apache.hadoop.ipc.Server.<init>(Server.java:1597)
	at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:576)
	at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Server.<init>(ProtoOverHadoopRpcEngine.java:314)
	at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine.getServer(ProtoOverHadoopRpcEngine.java:383)
	at org.apache.hadoop.ipc.RPC.getServer(RPC.java:550)
	at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.createServer(RpcServerFactoryPBImpl.java:155)
	at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:118)
	... 8 more
Caused by: java.net.BindException: Address already in use
	at sun.nio.ch.Net.bind(Native Method)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:119)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
	at org.apache.hadoop.ipc.Server.bind(Server.java:229)
	... 16 more
Exception in thread "Thread-87" java.lang.NullPointerException
	at org.apache.hadoop.yarn.event.AsyncDispatcher.stop(AsyncDispatcher.java:93)
	at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89)
	at org.apache.hadoop.yarn.server.nodemanager.NodeManager.stop(NodeManager.java:151)
	at org.apache.hadoop.yarn.server.nodemanager.NodeManager$1.run(NodeManager.java:129)
Mime
View raw message