incubator-giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Avery Ching <ach...@apache.org>
Subject Re: Exceptions when establishing RPC
Date Tue, 03 Apr 2012 21:01:45 GMT
If you're using one master and one slave, you need to do -w 1.  Did you 
see any error about the RPC server starting up?

Avery

On 4/3/12 1:37 PM, Robert Davis wrote:
> Hello,
>
> I was trying to run Giraph on two machines (one master and one slave) 
> but kept getting exceptions when establishing RPC to the slave 
> machine. Does anybody has any ideas what's going wrong here? I am 
> running the test with following parameters.
>
> hadoop jar target/giraph-0.2-SNAPSHOT-jar-with-dependencies.jar 
> org.apache.giraph.benchmark.PageRankBenchmark -e 10 -s 2 -v -V 2000 -w 2
>
> Thanks,
> Robert
>
> 12/04/03 01:35:01 DEBUG comm.BasicRPCCommunications: 
> startPeerConnectionThread: hostname 
> ec2-107-20-19-131.compute-1.amazonaws.com 
> <http://ec2-107-20-19-131.compute-1.amazonaws.com>, port 30001
> 12/04/03 01:35:01 DEBUG comm.BasicRPCCommunications: 
> startPeerConnectionThread: Connecting to 
> Worker(hostname=ec2-107-20-19-131.compute-1.amazonaws.com 
> <http://ec2-107-20-19-131.compute-1.amazonaws.com>, MRpartition=1, 
> port=30001), addr = ec2-107-20-19-131.compute-1.amazonaws.com:30001 
> <http://ec2-107-20-19-131.compute-1.amazonaws.com:30001> if outMsgMap 
> (null) == null
> 12/04/03 01:35:11 WARN comm.BasicRPCCommunications: 
> connectAllRPCProxys: Failed on attempt 1 of 5 to connect to 
> (id=0,cur=Worker(hostname=ec2-107-20-19-131.compute-1.amazonaws.com 
> <http://ec2-107-20-19-131.compute-1.amazonaws.com>, MRpartition=1, 
> port=30001),prev=null,ckpt_file=null)
> java.net.ConnectException: Call to 
> ec2-107-20-19-131.compute-1.amazonaws.com:30001 
> <http://ec2-107-20-19-131.compute-1.amazonaws.com:30001> failed on 
> connection exception: java.net.ConnectException: Connection refused
> at org.apache.hadoop.ipc.Client.wrapException(Client.java:1095)
> at org.apache.hadoop.ipc.Client.call(Client.java:1071)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
> at $Proxy3.getProtocolVersion(Unknown Source)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:370)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:420)
> at 
> org.apache.giraph.comm.RPCCommunications$1.run(RPCCommunications.java:194)
> at 
> org.apache.giraph.comm.RPCCommunications$1.run(RPCCommunications.java:190)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
> at 
> org.apache.giraph.comm.RPCCommunications.getRPCProxy(RPCCommunications.java:188)
> at 
> org.apache.giraph.comm.RPCCommunications.getRPCProxy(RPCCommunications.java:58)
> at 
> org.apache.giraph.comm.BasicRPCCommunications.startPeerConnectionThread(BasicRPCCommunications.java:678)
> at 
> org.apache.giraph.comm.BasicRPCCommunications.connectAllRPCProxys(BasicRPCCommunications.java:622)
> at 
> org.apache.giraph.comm.BasicRPCCommunications.setup(BasicRPCCommunications.java:583)
> at 
> org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:555)
> at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:474)
> at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:646)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
> Caused by: java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
> at 
> org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
> at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:656)
> at 
> org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:434)
> at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:560)
> at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:184)
> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1202)
> at org.apache.hadoop.ipc.Client.call(Client.java:1046)
> ... 25 more
>


Mime
View raw message