Return-Path: X-Original-To: apmail-incubator-giraph-user-archive@minotaur.apache.org Delivered-To: apmail-incubator-giraph-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 441C39B9E for ; Tue, 3 Apr 2012 20:38:12 +0000 (UTC) Received: (qmail 47553 invoked by uid 500); 3 Apr 2012 20:38:12 -0000 Delivered-To: apmail-incubator-giraph-user-archive@incubator.apache.org Received: (qmail 47509 invoked by uid 500); 3 Apr 2012 20:38:11 -0000 Mailing-List: contact giraph-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: giraph-user@incubator.apache.org Delivered-To: mailing list giraph-user@incubator.apache.org Received: (qmail 47498 invoked by uid 99); 3 Apr 2012 20:38:11 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Apr 2012 20:38:11 +0000 X-ASF-Spam-Status: No, hits=1.8 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of dwb2812877@gmail.com designates 209.85.160.175 as permitted sender) Received: from [209.85.160.175] (HELO mail-gy0-f175.google.com) (209.85.160.175) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Apr 2012 20:38:06 +0000 Received: by ghbz2 with SMTP id z2so88402ghb.6 for ; Tue, 03 Apr 2012 13:37:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=TkKMZki639/XK6v6gIeQjun5O5UUXFe0CBebW3RMRTQ=; b=KDI/byd+d8q6oOInKgpoBDBwiD21+72LHuYNocyeaLBJbDB9++ZbivzlSarEiSnYi7 aQbiV9PVND4oEAxzAhvssf8CuSc+AFExkfGI4N9IBX4tUGqKnueZIXFZydW3DfbKtBpm T74pVpxkJr5Tldzn9e+MCVPfsHyNoaBGlI42wWcB2+t4YjhKolVyLcRTOkemGdHnkkmB YjbhJf8/RnQTo2lBZ/DawCVEHBoGasqeLC1vuoECkWI/+QK9cXm1DJJXjYozVq096+Q3 WsVL5u8FZGKGxNAdt5KjvPQC7SDqeS51ogQjhmZN/iVZJ0kgBM52GbYiyNTcxHiR7jbz 2FXA== Received: by 10.60.18.198 with SMTP id y6mr7466841oed.38.1333485465827; Tue, 03 Apr 2012 13:37:45 -0700 (PDT) MIME-Version: 1.0 Received: by 10.76.125.42 with HTTP; Tue, 3 Apr 2012 13:37:25 -0700 (PDT) From: Robert Davis Date: Tue, 3 Apr 2012 13:37:25 -0700 Message-ID: Subject: Exceptions when establishing RPC To: giraph-user@incubator.apache.org Content-Type: multipart/alternative; boundary=e89a8fb2027a80f9ef04bccc47d3 X-Virus-Checked: Checked by ClamAV on apache.org --e89a8fb2027a80f9ef04bccc47d3 Content-Type: text/plain; charset=ISO-8859-1 Hello, I was trying to run Giraph on two machines (one master and one slave) but kept getting exceptions when establishing RPC to the slave machine. Does anybody has any ideas what's going wrong here? I am running the test with following parameters. hadoop jar target/giraph-0.2-SNAPSHOT-jar-with-dependencies.jar org.apache.giraph.benchmark.PageRankBenchmark -e 10 -s 2 -v -V 2000 -w 2 Thanks, Robert 12/04/03 01:35:01 DEBUG comm.BasicRPCCommunications: startPeerConnectionThread: hostname ec2-107-20-19-131.compute-1.amazonaws.com, port 30001 12/04/03 01:35:01 DEBUG comm.BasicRPCCommunications: startPeerConnectionThread: Connecting to Worker(hostname= ec2-107-20-19-131.compute-1.amazonaws.com, MRpartition=1, port=30001), addr = ec2-107-20-19-131.compute-1.amazonaws.com:30001 if outMsgMap (null) == null 12/04/03 01:35:11 WARN comm.BasicRPCCommunications: connectAllRPCProxys: Failed on attempt 1 of 5 to connect to (id=0,cur=Worker(hostname= ec2-107-20-19-131.compute-1.amazonaws.com, MRpartition=1, port=30001),prev=null,ckpt_file=null) java.net.ConnectException: Call to ec2-107-20-19-131.compute-1.amazonaws.com:30001 failed on connection exception: java.net.ConnectException: Connection refused at org.apache.hadoop.ipc.Client.wrapException(Client.java:1095) at org.apache.hadoop.ipc.Client.call(Client.java:1071) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225) at $Proxy3.getProtocolVersion(Unknown Source) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:370) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:420) at org.apache.giraph.comm.RPCCommunications$1.run(RPCCommunications.java:194) at org.apache.giraph.comm.RPCCommunications$1.run(RPCCommunications.java:190) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083) at org.apache.giraph.comm.RPCCommunications.getRPCProxy(RPCCommunications.java:188) at org.apache.giraph.comm.RPCCommunications.getRPCProxy(RPCCommunications.java:58) at org.apache.giraph.comm.BasicRPCCommunications.startPeerConnectionThread(BasicRPCCommunications.java:678) at org.apache.giraph.comm.BasicRPCCommunications.connectAllRPCProxys(BasicRPCCommunications.java:622) at org.apache.giraph.comm.BasicRPCCommunications.setup(BasicRPCCommunications.java:583) at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:555) at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:474) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:646) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:656) at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:434) at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:560) at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:184) at org.apache.hadoop.ipc.Client.getConnection(Client.java:1202) at org.apache.hadoop.ipc.Client.call(Client.java:1046) ... 25 more --e89a8fb2027a80f9ef04bccc47d3 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello,

I was trying to run Giraph on two machines (one m= aster and one slave) but kept getting exceptions when establishing RPC to t= he slave machine. Does anybody has any ideas what's going wrong here? I= am running the test with following parameters.

hadoop jar target/giraph-0.2-SNAPSHOT-jar-with-dependen= cies.jar org.apache.giraph.benchmark.PageRankBenchmark -e 10 -s 2 -v -V 200= 0 -w 2

Thanks,
Robert

12/04/03 01:35:01 DEBUG comm.BasicRPCCommunications: s= tartPeerConnectionThread: hostname ec2-107-20-19-131.compute-1.amazonaws.com, port 30= 001
12/04/03 01:35:01 DEBUG comm.BasicRPCCommunications: startPeerConnecti= onThread: Connecting to Worker(hostname=3Dec2-107-20-19-131.compute-1.amazonaws.com, = MRpartition=3D1, port=3D30001), addr =3D ec2-107-20-19-131.compute-1.amazonaws.com:= 30001 if outMsgMap (null) =3D=3D null=A0
12/04/03 01:35:11 WARN comm.BasicRPCCommunications: connectAllRPCProxy= s: Failed on attempt 1 of 5 to connect to (id=3D0,cur=3DWorker(hostname=3D<= a href=3D"http://ec2-107-20-19-131.compute-1.amazonaws.com">ec2-107-20-19-1= 31.compute-1.amazonaws.com, MRpartition=3D1, port=3D30001),prev=3Dnull,= ckpt_file=3Dnull)
java.net.ConnectException: Call to ec2-107-20-19-131.compute-1.amazonaws.com:3= 0001 failed on connection exception: java.net.ConnectException: Connect= ion refused
at or= g.apache.hadoop.ipc.Client.wrapException(Client.java:1095)
at org.apache.ha= doop.ipc.Client.call(Client.java:1071)
at or= g.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
at $Proxy3.getProtoco= lVersion(Unknown Source)
at or= g.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
at org.apache.hadoop.ipc.RPC= .getProxy(RPC.java:370)
at or= g.apache.hadoop.ipc.RPC.getProxy(RPC.java:420)
at org.apache.giraph.comm.RP= CCommunications$1.run(RPCCommunications.java:194)
at or= g.apache.giraph.comm.RPCCommunications$1.run(RPCCommunications.java:190)
at= java.security.AccessController.doPrivileged(Native Method)
at ja= vax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.secur= ity.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at or= g.apache.giraph.comm.RPCCommunications.getRPCProxy(RPCCommunications.java:1= 88)
at org.apache.giraph.comm.RPCCommunications.getRPCProxy(RPCCommunicatio= ns.java:58)
at or= g.apache.giraph.comm.BasicRPCCommunications.startPeerConnectionThread(Basic= RPCCommunications.java:678)
at org.apache.giraph.comm.BasicRPCCommunicatio= ns.connectAllRPCProxys(BasicRPCCommunications.java:622)
at or= g.apache.giraph.comm.BasicRPCCommunications.setup(BasicRPCCommunications.ja= va:583)
= at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.= java:555)
at or= g.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:474)
at org.apache= .giraph.graph.GraphMapper.run(GraphMapper.java:646)
at or= g.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache= .hadoop.mapred.MapTask.run(MapTask.java:370)
at or= g.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessC= ontroller.doPrivileged(Native Method)
at ja= vax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.secur= ity.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at or= g.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java= .net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.c= heckConnect(Native Method)
at su= n.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
<= div> at org= .apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206= )
at or= g.apache.hadoop.net.NetUtils.connect(NetUtils.java:656)
at org.apache.hadoo= p.ipc.Client$Connection.setupConnection(Client.java:434)
at or= g.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:560)
=
at or= g.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:184)
at or= g.apache.hadoop.ipc.Client.getConnection(Client.java:1202)
at org.apache.ha= doop.ipc.Client.call(Client.java:1046)
... 2= 5 more

--e89a8fb2027a80f9ef04bccc47d3--