Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3B46911A90 for ; Wed, 16 Apr 2014 16:55:19 +0000 (UTC) Received: (qmail 60045 invoked by uid 500); 16 Apr 2014 16:55:17 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 59945 invoked by uid 500); 16 Apr 2014 16:55:16 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 59905 invoked by uid 99); 16 Apr 2014 16:55:15 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Apr 2014 16:55:15 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of thomascirca@gmail.com designates 209.85.219.45 as permitted sender) Received: from [209.85.219.45] (HELO mail-oa0-f45.google.com) (209.85.219.45) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Apr 2014 16:54:59 +0000 Received: by mail-oa0-f45.google.com with SMTP id eb12so12819911oac.32 for ; Wed, 16 Apr 2014 09:54:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=incuRxfWSmMm42jjcW7gAh/r+jHFKv/ewFXRC0dX5vY=; b=LVbo8283qqj603RuHNeqtIVedy544Bcvp/0Eqe7O3J/T1nf/GHe4AO2qbpVcVZprdy Y/MTJvgwTjPiixKjoBIfzCQLJTAQDAg8m7D0/ceumYmrkvnQiyTluXTMMSMqoKhQs8gs X5Hr1Tjj5kp1teZ4o+PC9DRAUyyIndu1IHj6/wCz7yc2a11FRa7gfNQw/6T6rGnih59Y THz3QydSOBlvWk+ffTJovQuKYoTroFAEmcX3+671g8slAaFv+XoQXY9eG/VPrNOL9TBu PeaZBy1LpHZFE0V7YV5FQY1BNzeJ3DG3xyPqg456y+f+RfOjHxlNu+6HVx44GIszJmPI Nugg== MIME-Version: 1.0 X-Received: by 10.182.153.33 with SMTP id vd1mr1141742obb.86.1397667276485; Wed, 16 Apr 2014 09:54:36 -0700 (PDT) Received: by 10.60.159.106 with HTTP; Wed, 16 Apr 2014 09:54:36 -0700 (PDT) In-Reply-To: <1485238796.2271278.1397614417262.JavaMail.zimbra@stanford.edu> References: <534DE59E.1030208@gmail.com> <1485238796.2271278.1397614417262.JavaMail.zimbra@stanford.edu> Date: Wed, 16 Apr 2014 12:54:36 -0400 Message-ID: Subject: Re: Zookeeper / Netty (Connection refused) issue for 2 node cluster From: Tyler Jones To: user@giraph.apache.org Content-Type: multipart/alternative; boundary=089e013a2378877b1d04f72bc575 X-Virus-Checked: Checked by ClamAV on apache.org --089e013a2378877b1d04f72bc575 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I tried the following suggestion and it would appear that both clients are now using the correct Zookeeper node. This is evidenced in the logs with the following (I'm setting the node named "Slave" to be the Zookeeper- I apologize for the confusion name reversal for this): Slave (Zookeeper master) 2014-04-16 09:23:01,519 INFO org.apache.giraph.master.BspServiceMaster: becomeMaster: I am now the master! Slave (Worker 1) 2014-04-16 09:23:07,447 INFO org.apache.giraph.worker.BspServiceWorker: startSuperstep: Master(hostname=3Dslave, MRtaskID=3D0, port=3D30000) Master (Worker 2) 2014-04-16 03:31:42,136 INFO org.apache.giraph.worker.BspServiceWorker: startSuperstep: Master(hostname=3Dslave, MRtaskID=3D0, port=3D30000) However, the problem still persists. I've included the full logs below. Could it be a DNS issue? Using nestat, I see the following: Master (Worker 2) tcp 0 0 192.168.1.102:30001 0.0.0.0:* LISTEN 1003 7060 6162/java Slave (Master and Worker 1) tcp 0 0 127.0.0.1:30000 0.0.0.0:* LISTEN 1001 17828 3354/java tcp 0 0 127.0.0.1:30002 0.0.0.0:* LISTEN 1001 17875 3394/java So it would appear that the Netty instances that are spun up are only listening on localhost, and not its desginated IP. Would this be a correct diagnosis? Full Logs: Slave: 2014-04-16 09:23:00,918 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2014-04-16 09:23:01,042 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists! 2014-04-16 09:23:01,179 INFO org.apache.giraph.graph.GraphTaskManager: setup: Log level remains at info 2014-04-16 09:23:01,217 INFO org.apache.giraph.graph.GraphTaskManager: setup: Starting up BspServiceMaster (master thread)... 2014-04-16 09:23:01,230 INFO org.apache.giraph.bsp.BspService: BspService: Path to create to halt is /_hadoopBsp/job_201404160259_0004/_haltComputation 2014-04-16 09:23:01,230 INFO org.apache.giraph.bsp.BspService: BspService: Connecting to ZooKeeper with job job_201404160259_0004, 0 on 192.168.1.152:2181 2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3D3.4.5-1392090, built on 09/30/2012 17:52 GMT 2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=3Dslave 2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=3D1.8.0 2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=3DOracle Corporation 2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=3D/opt/oracle-jdk-bin-1.8.0.0/jre 2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=3D/app/hadoop/tmp/mapred/local/taskTracker/hdus= er/jobcache/job_201404160259_0004/jars/classes:/app/hadoop/tmp/mapred/local= /taskTracker/hduser/jobcache/job_201404160259_0004/jars:/app/hadoop/tmp/map= red/local/taskTracker/hduser/jobcache/job_201404160259_0004/attempt_2014041= 60259_0004_m_000000_0/work:/usr/local/hadoop/bin/../conf:/usr/lib64/jvm/ora= cle-jdk-bin-1.8/lib/tools.jar:/usr/local/hadoop/bin/..:/usr/local/hadoop/bi= n/../hadoop-core-0.20.203.0.jar:/usr/local/hadoop/bin/../lib/aspectjrt-1.6.= 5.jar:/usr/local/hadoop/bin/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop= /bin/../lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/bin/../lib/common= s-beanutils-core-1.8.0.jar:/usr/local/hadoop/bin/../lib/commons-cli-1.2.jar= :/usr/local/hadoop/bin/../lib/commons-codec-1.4.jar:/usr/local/hadoop/bin/.= ./lib/commons-collections-3.2.1.jar:/usr/local/hadoop/bin/../lib/commons-co= nfiguration-1.6.jar:/usr/local/hadoop/bin/../lib/commons-daemon-1.0.1.jar:/= usr/local/hadoop/bin/../lib/commons-digester-1.8.jar:/usr/local/hadoop/bin/= ../lib/commons-el-1.0.jar:/usr/local/hadoop/bin/../lib/commons-httpclient-3= .0.1.jar:/usr/local/hadoop/bin/../lib/commons-lang-2.4.jar:/usr/local/hadoo= p/bin/../lib/commons-logging-1.1.1.jar:/usr/local/hadoop/bin/../lib/commons= -logging-api-1.0.4.jar:/usr/local/hadoop/bin/../lib/commons-math-2.1.jar:/u= sr/local/hadoop/bin/../lib/commons-net-1.4.1.jar:/usr/local/hadoop/bin/../l= ib/core-3.1.1.jar:/usr/local/hadoop/bin/../lib/hsqldb-1.8.0.10.jar:/usr/loc= al/hadoop/bin/../lib/jackson-core-asl-1.0.1.jar:/usr/local/hadoop/bin/../li= b/jackson-mapper-asl-1.0.1.jar:/usr/local/hadoop/bin/../lib/jasper-compiler= -5.5.12.jar:/usr/local/hadoop/bin/../lib/jasper-runtime-5.5.12.jar:/usr/loc= al/hadoop/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop/bin/../lib/jetty-6.= 1.26.jar:/usr/local/hadoop/bin/../lib/jetty-util-6.1.26.jar:/usr/local/hado= op/bin/../lib/jsch-0.1.42.jar:/usr/local/hadoop/bin/../lib/junit-4.5.jar:/u= sr/local/hadoop/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop/bin/../lib/log4j= -1.2.15.jar:/usr/local/hadoop/bin/../lib/mockito-all-1.8.5.jar:/usr/local/h= adoop/bin/../lib/oro-2.0.8.jar:/usr/local/hadoop/bin/../lib/servlet-api-2.5= -20081211.jar:/usr/local/hadoop/bin/../lib/slf4j-api-1.4.3.jar:/usr/local/h= adoop/bin/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/bin/../lib/xmlen= c-0.52.jar:/usr/local/hadoop/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hado= op/bin/../lib/jsp-2.1/jsp-api-2.1.jar 2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=3D/usr/local/hadoop/bin/../lib/native/Linux-a= md64-64:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201404= 160259_0004/attempt_201404160259_0004_m_000000_0/work 2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=3D/app/hadoop/tmp/mapred/local/taskTracker/hduse= r/jobcache/job_201404160259_0004/attempt_201404160259_0004_m_000000_0/work/= tmp 2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=3D 2014-04-16 09:23:01,237 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=3DLinux 2014-04-16 09:23:01,237 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=3Damd64 2014-04-16 09:23:01,237 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=3D3.2.12-gentoo 2014-04-16 09:23:01,237 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=3Dhduser 2014-04-16 09:23:01,241 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=3D/home/hduser 2014-04-16 09:23:01,242 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobc= ache/job_201404160259_0004/attempt_201404160259_0004_m_000000_0/work 2014-04-16 09:23:01,242 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=3D192.168.1.152:2181 sessionTimeout=3D60000 watcher=3Dorg.apache.giraph.master.BspServiceMaster@79be0360 2014-04-16 09:23:01,260 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server 192.168.1.152/192.168.1.152:2181. Will not attempt to authenticate using SASL (unknown error) 2014-04-16 09:23:01,261 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to 192.168.1.152/192.168.1.152:2181, initiating session 2014-04-16 09:23:01,339 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server 192.168.1.152/192.168.1.152:2181, sessionid =3D 0x1456ab3381d0000, negotiated timeout =3D 40000 2014-04-16 09:23:01,340 INFO org.apache.giraph.bsp.BspService: process: Asynchronous connection complete. 2014-04-16 09:23:01,346 INFO org.apache.giraph.graph.GraphTaskManager: map: No need to do anything when not a worker 2014-04-16 09:23:01,346 INFO org.apache.giraph.graph.GraphTaskManager: cleanup: Starting for MASTER_ONLY 2014-04-16 09:23:01,421 INFO org.apache.giraph.master.BspServiceMaster: becomeMaster: First child is '/_hadoopBsp/job_201404160259_0004/_masterElectionDir/slave_00000000000' and my bid is '/_hadoopBsp/job_201404160259_0004/_masterElectionDir/slave_0= 0000000000' 2014-04-16 09:23:01,464 INFO org.apache.giraph.comm.netty.NettyServer: NettyServer: Using execution group with 8 threads for requestFrameDecoder. 2014-04-16 09:23:01,512 INFO org.apache.giraph.comm.netty.NettyServer: start: Started server communication server: slave/127.0.0.1:30000 with up to 16 threads on bind attempt 0 with sendBufferSize =3D 32768 receiveBufferSize =3D 524288 2014-04-16 09:23:01,517 INFO org.apache.giraph.comm.netty.NettyClient: NettyClient: Using execution handler with 8 threads after request-encoder. 2014-04-16 09:23:01,519 INFO org.apache.giraph.master.BspServiceMaster: becomeMaster: I am now the master! 2014-04-16 09:23:01,560 INFO org.apache.giraph.bsp.BspService: process: applicationAttemptChanged signaled 2014-04-16 09:23:01,625 WARN org.apache.giraph.bsp.BspService: process: Unknown and unprocessed event (path=3D/_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir/0/_supers= tepDir, type=3DNodeChildrenChanged, state=3DSyncConnected) 2014-04-16 09:23:07,289 INFO org.apache.giraph.io.formats.GiraphFileInputFormat: Total input paths to process : 1 2014-04-16 09:23:07,297 INFO org.apache.giraph.master.BspServiceMaster: generateVertexInputSplits: Got 1 input splits for 2 input threads 2014-04-16 09:23:07,297 WARN org.apache.giraph.master.BspServiceMaster: createVertexInputSplits: Number of inputSplits=3D1 < 2=3Dtotal number of input threads, some threads will be not used 2014-04-16 09:23:07,297 INFO org.apache.giraph.master.BspServiceMaster: createVertexInputSplits: Starting to write input split data to zookeeper with 1 threads 2014-04-16 09:23:07,391 INFO org.apache.giraph.master.BspServiceMaster: createVertexInputSplits: Done writing input split data to zookeeper 2014-04-16 09:23:07,422 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-16 09:23:07,423 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-16 09:23:07,429 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 2 connections, (2 total connected) 0 failed, 0 failures total. 2014-04-16 09:23:07,430 INFO org.apache.giraph.partition.PartitionUtils: computePartitionCount: Creating 4, default would have been 4 partitions. 2014-04-16 09:23:07,460 INFO org.apache.giraph.master.BspServiceMaster: barrierOnWorkerList: 0 out of 2 workers finished on superstep -1 on path /_hadoopBsp/job_201404160259_0004/_vertexInputSplitDoneDir 2014-04-16 09:23:07,462 INFO org.apache.giraph.master.BspServiceMaster: barrierOnWorkerList: Waiting on [master_1, slave_2] 2014-04-16 09:23:07,468 INFO org.apache.giraph.comm.netty.NettyServer: start: Using Netty without authentication. Master: 2014-04-16 03:31:38,681 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2014-04-16 03:31:38,826 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists! 2014-04-16 03:31:39,013 INFO org.apache.giraph.graph.GraphTaskManager: setup: Log level remains at info 2014-04-16 03:31:39,057 INFO org.apache.giraph.graph.GraphTaskManager: setup: Starting up BspServiceWorker... 2014-04-16 03:31:39,071 INFO org.apache.giraph.bsp.BspService: BspService: Path to create to halt is /_hadoopBsp/job_201404160259_0004/_haltComputation 2014-04-16 03:31:39,071 INFO org.apache.giraph.bsp.BspService: BspService: Connecting to ZooKeeper with job job_201404160259_0004, 1 on 192.168.1.152:2181 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3D3.4.5-1392090, built on 09/30/2012 17:52 GMT 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=3Dmaster 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=3D1.7.0_17 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=3DOracle Corporation 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=3D/opt/oracle-jdk-bin-1.7.0.17/jre 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=3D/app/hadoop/tmp/mapred/local/taskTracker/hdus= er/jobcache/job_201404160259_0004/jars/classes:/app/hadoop/tmp/mapred/local= /taskTracker/hduser/jobcache/job_201404160259_0004/jars:/app/hadoop/tmp/map= red/local/taskTracker/hduser/jobcache/job_201404160259_0004/attempt_2014041= 60259_0004_m_000001_0/work:/usr/local/hadoop/bin/../conf:/usr/lib/jvm/oracl= e-jdk-bin-1.7/lib/tools.jar:/usr/local/hadoop/bin/..:/usr/local/hadoop/bin/= ../hadoop-core-0.20.203.0.jar:/usr/local/hadoop/bin/../lib/aspectjrt-1.6.5.= jar:/usr/local/hadoop/bin/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop/b= in/../lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/bin/../lib/commons-= beanutils-core-1.8.0.jar:/usr/local/hadoop/bin/../lib/commons-cli-1.2.jar:/= usr/local/hadoop/bin/../lib/commons-codec-1.4.jar:/usr/local/hadoop/bin/../= lib/commons-collections-3.2.1.jar:/usr/local/hadoop/bin/../lib/commons-conf= iguration-1.6.jar:/usr/local/hadoop/bin/../lib/commons-daemon-1.0.1.jar:/us= r/local/hadoop/bin/../lib/commons-digester-1.8.jar:/usr/local/hadoop/bin/..= /lib/commons-el-1.0.jar:/usr/local/hadoop/bin/../lib/commons-httpclient-3.0= .1.jar:/usr/local/hadoop/bin/../lib/commons-lang-2.4.jar:/usr/local/hadoop/= bin/../lib/commons-logging-1.1.1.jar:/usr/local/hadoop/bin/../lib/commons-l= ogging-api-1.0.4.jar:/usr/local/hadoop/bin/../lib/commons-math-2.1.jar:/usr= /local/hadoop/bin/../lib/commons-net-1.4.1.jar:/usr/local/hadoop/bin/../lib= /core-3.1.1.jar:/usr/local/hadoop/bin/../lib/hsqldb-1.8.0.10.jar:/usr/local= /hadoop/bin/../lib/jackson-core-asl-1.0.1.jar:/usr/local/hadoop/bin/../lib/= jackson-mapper-asl-1.0.1.jar:/usr/local/hadoop/bin/../lib/jasper-compiler-5= .5.12.jar:/usr/local/hadoop/bin/../lib/jasper-runtime-5.5.12.jar:/usr/local= /hadoop/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop/bin/../lib/jetty-6.1.= 26.jar:/usr/local/hadoop/bin/../lib/jetty-util-6.1.26.jar:/usr/local/hadoop= /bin/../lib/jsch-0.1.42.jar:/usr/local/hadoop/bin/../lib/junit-4.5.jar:/usr= /local/hadoop/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop/bin/../lib/log4j-1= .2.15.jar:/usr/local/hadoop/bin/../lib/mockito-all-1.8.5.jar:/usr/local/had= oop/bin/../lib/oro-2.0.8.jar:/usr/local/hadoop/bin/../lib/servlet-api-2.5-2= 0081211.jar:/usr/local/hadoop/bin/../lib/slf4j-api-1.4.3.jar:/usr/local/had= oop/bin/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/bin/../lib/xmlenc-= 0.52.jar:/usr/local/hadoop/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hadoop= /bin/../lib/jsp-2.1/jsp-api-2.1.jar 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=3D/usr/local/hadoop/bin/../lib/native/Linux-a= md64-64:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201404= 160259_0004/attempt_201404160259_0004_m_000001_0/work 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=3D/app/hadoop/tmp/mapred/local/taskTracker/hduse= r/jobcache/job_201404160259_0004/attempt_201404160259_0004_m_000001_0/work/= tmp 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=3D 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=3DLinux 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=3Damd64 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=3D3.4.0-gentoo 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=3Dhduser 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=3D/home/hduser 2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobc= ache/job_201404160259_0004/attempt_201404160259_0004_m_000001_0/work 2014-04-16 03:31:39,079 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=3D192.168.1.152:2181 sessionTimeout=3D60000 watcher=3Dorg.apache.giraph.worker.BspServiceWorker@12082570 2014-04-16 03:31:39,093 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server slave/192.168.1.152:2181. Will not attempt to authenticate using SASL (unknown error) 2014-04-16 03:31:39,093 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to slave/192.168.1.152:2181, initiating session 2014-04-16 03:31:39,470 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server slave/192.168.1.152:2181, sessionid =3D 0x1456ab3381d0002, negotiated timeout =3D 40000 2014-04-16 03:31:40,151 INFO org.apache.giraph.bsp.BspService: process: Asynchronous connection complete. 2014-04-16 03:31:40,212 INFO org.apache.giraph.comm.netty.NettyServer: NettyServer: Using execution group with 8 threads for requestFrameDecoder. 2014-04-16 03:31:40,266 INFO org.apache.giraph.comm.netty.NettyServer: start: Started server communication server: master/192.168.1.102:30001 with up to 16 threads on bind attempt 0 with sendBufferSize =3D 32768 receiveBufferSize =3D 524288 2014-04-16 03:31:40,270 INFO org.apache.giraph.comm.netty.NettyClient: NettyClient: Using execution handler with 8 threads after request-encoder. 2014-04-16 03:31:40,278 INFO org.apache.giraph.graph.GraphTaskManager: setup: Registering health of this worker... 2014-04-16 03:31:40,529 INFO org.apache.giraph.bsp.BspService: getJobState: Job state already exists (/_hadoopBsp/job_201404160259_0004/_masterJobState) 2014-04-16 03:31:40,674 INFO org.apache.giraph.bsp.BspService: getApplicationAttempt: Node /_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir already exists! 2014-04-16 03:31:40,890 INFO org.apache.giraph.bsp.BspService: getApplicationAttempt: Node /_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir already exists! 2014-04-16 03:31:41,407 INFO org.apache.giraph.worker.BspServiceWorker: registerHealth: Created my health node for attempt=3D0, superstep=3D-1 with /_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir/0/_superstepDir/-= 1/_workerHealthyDir/master_1 and workerInfo=3D Worker(hostname=3Dmaster, MRtaskID=3D1, port=3D30001) 2014-04-16 03:31:42,118 INFO org.apache.giraph.comm.netty.NettyServer: start: Using Netty without authentication. 2014-04-16 03:31:42,131 INFO org.apache.giraph.bsp.BspService: process: partitionAssignmentsReadyChanged (partitions are assigned) 2014-04-16 03:31:42,136 INFO org.apache.giraph.worker.BspServiceWorker: startSuperstep: Master(hostname=3Dslave, MRtaskID=3D0, port=3D30000) 2014-04-16 03:31:42,136 INFO org.apache.giraph.worker.BspServiceWorker: startSuperstep: Ready for computation on superstep -1 since worker selection and vertex range assignments are done in /_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir/0/_superstepDir/-= 1/_addressesAndPartitions 2014-04-16 03:31:42,138 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-16 03:31:42,139 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-16 03:31:42,142 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30002 with 0 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30002 2014-04-16 03:31:42,142 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30000 with 1 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30000 2014-04-16 03:31:42,143 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-16 03:31:42,143 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 2 failed, 2 failures total. 2014-04-16 03:31:42,143 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. [continues like this for a while until I kill the job] Slave: 2014-04-16 09:23:03,936 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2014-04-16 09:23:04,064 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists! 2014-04-16 09:23:04,202 INFO org.apache.giraph.graph.GraphTaskManager: setup: Log level remains at info 2014-04-16 09:23:04,241 INFO org.apache.giraph.graph.GraphTaskManager: setup: Starting up BspServiceWorker... 2014-04-16 09:23:04,258 INFO org.apache.giraph.bsp.BspService: BspService: Path to create to halt is /_hadoopBsp/job_201404160259_0004/_haltComputation 2014-04-16 09:23:04,258 INFO org.apache.giraph.bsp.BspService: BspService: Connecting to ZooKeeper with job job_201404160259_0004, 2 on 192.168.1.152:2181 2014-04-16 09:23:04,264 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3D3.4.5-1392090, built on 09/30/2012 17:52 GMT 2014-04-16 09:23:04,264 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=3Dslave 2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=3D1.8.0 2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=3DOracle Corporation 2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=3D/opt/oracle-jdk-bin-1.8.0.0/jre 2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=3D/app/hadoop/tmp/mapred/local/taskTracker/hdus= er/jobcache/job_201404160259_0004/jars/classes:/app/hadoop/tmp/mapred/local= /taskTracker/hduser/jobcache/job_201404160259_0004/jars:/app/hadoop/tmp/map= red/local/taskTracker/hduser/jobcache/job_201404160259_0004/attempt_2014041= 60259_0004_m_000002_0/work:/usr/local/hadoop/bin/../conf:/usr/lib64/jvm/ora= cle-jdk-bin-1.8/lib/tools.jar:/usr/local/hadoop/bin/..:/usr/local/hadoop/bi= n/../hadoop-core-0.20.203.0.jar:/usr/local/hadoop/bin/../lib/aspectjrt-1.6.= 5.jar:/usr/local/hadoop/bin/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop= /bin/../lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/bin/../lib/common= s-beanutils-core-1.8.0.jar:/usr/local/hadoop/bin/../lib/commons-cli-1.2.jar= :/usr/local/hadoop/bin/../lib/commons-codec-1.4.jar:/usr/local/hadoop/bin/.= ./lib/commons-collections-3.2.1.jar:/usr/local/hadoop/bin/../lib/commons-co= nfiguration-1.6.jar:/usr/local/hadoop/bin/../lib/commons-daemon-1.0.1.jar:/= usr/local/hadoop/bin/../lib/commons-digester-1.8.jar:/usr/local/hadoop/bin/= ../lib/commons-el-1.0.jar:/usr/local/hadoop/bin/../lib/commons-httpclient-3= .0.1.jar:/usr/local/hadoop/bin/../lib/commons-lang-2.4.jar:/usr/local/hadoo= p/bin/../lib/commons-logging-1.1.1.jar:/usr/local/hadoop/bin/../lib/commons= -logging-api-1.0.4.jar:/usr/local/hadoop/bin/../lib/commons-math-2.1.jar:/u= sr/local/hadoop/bin/../lib/commons-net-1.4.1.jar:/usr/local/hadoop/bin/../l= ib/core-3.1.1.jar:/usr/local/hadoop/bin/../lib/hsqldb-1.8.0.10.jar:/usr/loc= al/hadoop/bin/../lib/jackson-core-asl-1.0.1.jar:/usr/local/hadoop/bin/../li= b/jackson-mapper-asl-1.0.1.jar:/usr/local/hadoop/bin/../lib/jasper-compiler= -5.5.12.jar:/usr/local/hadoop/bin/../lib/jasper-runtime-5.5.12.jar:/usr/loc= al/hadoop/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop/bin/../lib/jetty-6.= 1.26.jar:/usr/local/hadoop/bin/../lib/jetty-util-6.1.26.jar:/usr/local/hado= op/bin/../lib/jsch-0.1.42.jar:/usr/local/hadoop/bin/../lib/junit-4.5.jar:/u= sr/local/hadoop/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop/bin/../lib/log4j= -1.2.15.jar:/usr/local/hadoop/bin/../lib/mockito-all-1.8.5.jar:/usr/local/h= adoop/bin/../lib/oro-2.0.8.jar:/usr/local/hadoop/bin/../lib/servlet-api-2.5= -20081211.jar:/usr/local/hadoop/bin/../lib/slf4j-api-1.4.3.jar:/usr/local/h= adoop/bin/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/bin/../lib/xmlen= c-0.52.jar:/usr/local/hadoop/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hado= op/bin/../lib/jsp-2.1/jsp-api-2.1.jar 2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=3D/usr/local/hadoop/bin/../lib/native/Linux-a= md64-64:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201404= 160259_0004/attempt_201404160259_0004_m_000002_0/work 2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=3D/app/hadoop/tmp/mapred/local/taskTracker/hduse= r/jobcache/job_201404160259_0004/attempt_201404160259_0004_m_000002_0/work/= tmp 2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=3D 2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=3DLinux 2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=3Damd64 2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=3D3.2.12-gentoo 2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=3Dhduser 2014-04-16 09:23:04,271 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=3D/home/hduser 2014-04-16 09:23:04,271 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobc= ache/job_201404160259_0004/attempt_201404160259_0004_m_000002_0/work 2014-04-16 09:23:04,271 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=3D192.168.1.152:2181 sessionTimeout=3D60000 watcher=3Dorg.apache.giraph.worker.BspServiceWorker@79be0360 2014-04-16 09:23:04,282 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server 192.168.1.152/192.168.1.152:2181. Will not attempt to authenticate using SASL (unknown error) 2014-04-16 09:23:04,283 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to 192.168.1.152/192.168.1.152:2181, initiating session 2014-04-16 09:23:04,697 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server 192.168.1.152/192.168.1.152:2181, sessionid =3D 0x1456ab3381d0001, negotiated timeout =3D 40000 2014-04-16 09:23:04,698 INFO org.apache.giraph.bsp.BspService: process: Asynchronous connection complete. 2014-04-16 09:23:04,742 INFO org.apache.giraph.comm.netty.NettyServer: NettyServer: Using execution group with 8 threads for requestFrameDecoder. 2014-04-16 09:23:04,785 INFO org.apache.giraph.comm.netty.NettyServer: start: Started server communication server: slave/127.0.0.1:30002 with up to 16 threads on bind attempt 0 with sendBufferSize =3D 32768 receiveBufferSize =3D 524288 2014-04-16 09:23:04,789 INFO org.apache.giraph.comm.netty.NettyClient: NettyClient: Using execution handler with 8 threads after request-encoder. 2014-04-16 09:23:04,795 INFO org.apache.giraph.graph.GraphTaskManager: setup: Registering health of this worker... 2014-04-16 09:23:04,883 INFO org.apache.giraph.bsp.BspService: getJobState: Job state already exists (/_hadoopBsp/job_201404160259_0004/_masterJobState) 2014-04-16 09:23:05,344 INFO org.apache.giraph.bsp.BspService: getApplicationAttempt: Node /_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir already exists! 2014-04-16 09:23:05,835 INFO org.apache.giraph.bsp.BspService: getApplicationAttempt: Node /_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir already exists! 2014-04-16 09:23:06,077 INFO org.apache.giraph.worker.BspServiceWorker: registerHealth: Created my health node for attempt=3D0, superstep=3D-1 with /_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir/0/_superstepDir/-= 1/_workerHealthyDir/slave_2 and workerInfo=3D Worker(hostname=3Dslave, MRtaskID=3D2, port=3D30002) 2014-04-16 09:23:07,429 INFO org.apache.giraph.comm.netty.NettyServer: start: Using Netty without authentication. 2014-04-16 09:23:07,442 INFO org.apache.giraph.bsp.BspService: process: partitionAssignmentsReadyChanged (partitions are assigned) 2014-04-16 09:23:07,447 INFO org.apache.giraph.worker.BspServiceWorker: startSuperstep: Master(hostname=3Dslave, MRtaskID=3D0, port=3D30000) 2014-04-16 09:23:07,447 INFO org.apache.giraph.worker.BspServiceWorker: startSuperstep: Ready for computation on superstep -1 since worker selection and vertex range assignments are done in /_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir/0/_superstepDir/-= 1/_addressesAndPartitions 2014-04-16 09:23:07,453 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-16 09:23:07,462 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-16 09:23:07,468 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 2 connections, (2 total connected) 0 failed, 0 failures total. 2014-04-16 09:23:07,474 INFO org.apache.giraph.comm.netty.handler.RequestDecoder: decode: Server window metrics MBytes/sec received =3D 0, MBytesReceived =3D 0.0002, ave received req MBytes =3D 0.0002, secs waited =3D 1.39765453E9 2014-04-16 09:23:17,488 INFO org.apache.giraph.utils.TaskIdsPermitsBarrier: waitForRequiredPermits: Waiting for 1 more tasks to send their aggregator data, task ids: [1] On 4/15/14, 10:13 PM, Vikesh Khanna wrote: Hi Tyler, To fix "unrecognized -D option", use the following command (just changing the position of the argument) - $HADOOP_HOME/bin/hadoop jar $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hado= =3D op-1.2.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner -Dgiraph.zkList=3D3Dmaster:2181 org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/hduser/input/tiny_graph.txt -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/hduser/output/shortestpaths -w 2 Thanks, Vikesh Khanna, Masters, Computer Science (Class of 2015) Stanford University ------------------------------ *From: *"Tyler Jones" *To: *user@giraph.apache.org *Sent: *Tuesday, April 15, 2014 7:06:22 PM *Subject: *Zookeeper / Netty (Connection refused) issue for 2 node cluster I've set up a two node cluster for Giraph. Currently, I have a master and = a slave node. The /etc/hosts for master looks like: 192.168.1.102 master 192.168.1.152 slave and for slave, it looks like so: 127.0.0.1 slave 172.0.0.1 slave 192.168.1.102 master 192.168.1.152 slave I have the following in my core-site.xml on both master and slave. giraph.zkList master:2181 I currently have Zookeeper running on the master node, on port 2181. I'm trying to run a simple Giraph job like so: $HADOOP_HOME/bin/hadoop jar $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hado= =3D op-1.2.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/hduser/input/tiny_graph.txt -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/hduser/output/shortestpaths -w 2 However, I get the errors as shown below. I'm not sure if its a Zookeeper or Netty issue. If I do: telnet master 2181 >From slave and send the ruok string, I get "imok", so I'm not having issues connecting there. Any thoughts? Originally I thought it was an iptables issue so I dumped all the rules and the like (iptables was only on slave). I've also tried removing the first two entries in /etc/hosts on slave, but that leads to other errors. Also, if I change the above to: $HADOOP_HOME/bin/hadoop jar $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hado= =3D op-1.2.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -Dgiraph.zkList=3D3Dmaster:2181 -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/hduser/input/tiny_graph.txt -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/hduser/output/shortestpaths -w 2 It just says "Unrecognized Option: -D" Slave 2014-04-15 18:24:07,774 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2014-04-15 18:24:07,901 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists! 2014-04-15 18:24:08,039 INFO org.apache.giraph.graph.GraphTaskManager: setup: Log level remains at info 2014-04-15 18:24:08,078 INFO org.apache.giraph.graph.GraphTaskManager: setup: Starting up BspServiceMaster (master thread)... 2014-04-15 18:24:08,096 INFO org.apache.giraph.bsp.BspService: BspService: Path to create to halt is /_hadoopBsp/job_201404151217_0002/_haltComputation 2014-04-15 18:24:08,096 INFO org.apache.giraph.bsp.BspService: BspService: Connecting to ZooKeeper with job job_201404151217_0002, 0 on master:2181 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3D3D3.4.5-1392090, built on 09/30/2012 17:52 GMT 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=3D3Dslave 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=3D3D1.8.0 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=3D3DOracle Corporation 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=3D3D/opt/oracle-jdk-bin-1.8.0.0/jre 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hd= us=3D er/jobcache/job_201404151217_0002/jars/classes:/app/hadoop/tmp/mapred/local= =3D /taskTracker/hduser/jobcache/job_201404151217_0002/jars:/app/hadoop/tmp/map= =3D red/local/taskTracker/hduser/jobcache/job_201404151217_0002/attempt_2014041= =3D 51217_0002_m_000000_0/work:*/usr/local/hadoop/bin/*../conf:/usr/lib64/jvm/o= ra=3D cle-jdk-bin-1.8/lib/tools.jar:*/usr/local/hadoop/bin/*..:/usr/local/hadoop/= bi=3D n/..*/hadoop-core-0.20.203.0.jar:/usr/local/hadoop/bin/*../lib/aspectjrt-1.= 6.=3D 5.jar:*/usr/local/hadoop/bin/*../lib/aspectjtools-1.6.5.jar:/usr/local/hado= op=3D*/bin/*..*/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/bin/*../l= ib/common=3D s-beanutils-core-1.8.0.jar:*/usr/local/hadoop/bin/*../lib/commons-cli-1.2.j= ar=3D :*/usr/local/hadoop/bin/*..*/lib/commons-codec-1.4.jar:/usr/local/hadoop/bi= n/*.=3D .*/lib/commons-collections-3.2.1.jar:/usr/local/hadoop/bin/*../lib/commons-= co=3D nfiguration-1.6.jar:*/usr/local/hadoop/bin/*../lib/commons-daemon-1.0.1.jar= :/=3D usr/local/hadoop/bin/..*/lib/commons-digester-1.8.jar:/usr/local/hadoop/bin= /*=3D ..*/lib/commons-el-1.0.jar:/usr/local/hadoop/bin/*../lib/commons-httpclient= -3=3D .0.1.jar:*/usr/local/hadoop/bin/*../lib/commons-lang-2.4.jar:/usr/local/had= oo=3D p/bin/..*/lib/commons-logging-1.1.1.jar:/usr/local/hadoop/bin/*../lib/commo= ns=3D -logging-api-1.0.4.jar:*/usr/local/hadoop/bin/*../lib/commons-math-2.1.jar:= /u=3D sr/local/hadoop/bin/..*/lib/commons-net-1.4.1.jar:/usr/local/hadoop/bin/*..= /l=3D ib/core-3.1.1.jar:*/usr/local/hadoop/bin/*../lib/hsqldb-1.8.0.10.jar:/usr/l= oc=3D al/hadoop/bin/..*/lib/jackson-core-asl-1.0.1.jar:/usr/local/hadoop/bin/*../= li=3D b/jackson-mapper-asl-1.0.1.jar:*/usr/local/hadoop/bin/*../lib/jasper-compil= er=3D -5.5.12.jar:*/usr/local/hadoop/bin/*../lib/jasper-runtime-5.5.12.jar:/usr/l= oc=3D al/hadoop/bin/..*/lib/jets3t-0.6.1.jar:/usr/local/hadoop/bin/*../lib/jetty-= 6.=3D 1.26.jar:*/usr/local/hadoop/bin/*../lib/jetty-util-6.1.26.jar:/usr/local/ha= do=3D op/bin/..*/lib/jsch-0.1.42.jar:/usr/local/hadoop/bin/*../lib/junit-4.5.jar:= /u=3D sr/local/hadoop/bin/..*/lib/kfs-0.2.2.jar:/usr/local/hadoop/bin/*../lib/log= 4j=3D -1.2.15.jar:*/usr/local/hadoop/bin/*../lib/mockito-all-1.8.5.jar:/usr/local= /h=3D adoop/bin/..*/lib/oro-2.0.8.jar:/usr/local/hadoop/bin/*../lib/servlet-api-2= .5=3D -20081211.jar:*/usr/local/hadoop/bin/*../lib/slf4j-api-1.4.3.jar:/usr/local= /h=3D adoop/bin/..*/lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/bin/*../lib/xml= en=3D c-0.52.jar:*/usr/local/hadoop/bin/*../lib/jsp-2.1/jsp-2.1.jar:/usr/local/ha= do=3D op/bin/../lib/jsp-2.1/jsp-api-2.1.jar 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=3D3D/usr/local/hadoop/bin/../lib/native/Linux= -a=3D md64-64:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201404= =3D 151217_0002/attempt_201404151217_0002_m_000000_0/work 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hdu= se=3D r/jobcache/job_201404151217_0002/attempt_201404151217_0002_m_000000_0/work/= =3D tmp 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=3D3D 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=3D3DLinux 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=3D3Damd64 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=3D3D3.2.12-gentoo 2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=3D3Dhduser 2014-04-15 18:24:08,105 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=3D3D/home/hduser 2014-04-15 18:24:08,105 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jo= bc=3D ache/job_201404151217_0002/attempt_201404151217_0002_m_000000_0/work 2014-04-15 18:24:08,106 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=3D3Dmaster:2181 sessionTimeout=3D3D60000 watcher=3D3Dorg.apache.giraph.master.BspServiceMaster@3224f60b 2014-04-15 18:24:08,117 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server master/192.168.1.102:2181. Will not attempt to authenticate using SASL (unknown error) 2014-04-15 18:24:08,118 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to master/192.168.1.102:2181, initiating session 2014-04-15 18:24:08,141 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server master/192.168.1.102:2181, sessionid =3D3D 0x14566270ed7001b, negotiated timeout =3D3D 40000 2014-04-15 18:24:08,142 INFO org.apache.giraph.bsp.BspService: process: Asynchronous connection complete. 2014-04-15 18:24:08,147 INFO org.apache.giraph.graph.GraphTaskManager: map: No need to do anything when not a worker 2014-04-15 18:24:08,148 INFO org.apache.giraph.graph.GraphTaskManager: cleanup: Starting for MASTER_ONLY 2014-04-15 18:24:08,201 INFO org.apache.giraph.master.BspServiceMaster: becomeMaster: First child is '/_hadoopBsp/job_201404151217_0002/_masterElectionDir/slave_00000000000' and my bid is '/_hadoopBsp/job_201404151217_0002/_masterElectionDir/slave_0= =3D 0000000000' 2014-04-15 18:24:08,246 INFO org.apache.giraph.comm.netty.NettyServer: NettyServer: Using execution group with 8 threads for requestFrameDecoder. 2014-04-15 18:24:08,289 INFO org.apache.giraph.comm.netty.NettyServer: start: Started server communication server: slave/127.0.0.1:30000 with up to 16 threads on bind attempt 0 with sendBufferSize =3D3D 32768 receiveBufferSize =3D3D 524288 2014-04-15 18:24:08,294 INFO org.apache.giraph.comm.netty.NettyClient: NettyClient: Using execution handler with 8 threads after request-encoder. 2014-04-15 18:24:08,296 INFO org.apache.giraph.master.BspServiceMaster: becomeMaster: I am now the master! 2014-04-15 18:24:08,714 INFO org.apache.giraph.bsp.BspService: process: applicationAttemptChanged signaled 2014-04-15 18:24:08,790 WARN org.apache.giraph.bsp.BspService: process: Unknown and unprocessed event (path=3D3D/_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir/0/_supe= rs=3D tepDir, type=3D3DNodeChildrenChanged, state=3D3DSyncConnected) 2014-04-15 18:24:11,321 INFO org.apache.giraph.io.formats.GiraphFileInputFormat: Total input paths to process : 1 2014-04-15 18:24:11,328 INFO org.apache.giraph.master.BspServiceMaster: generateVertexInputSplits: Got 1 input splits for 2 input threads 2014-04-15 18:24:11,328 WARN org.apache.giraph.master.BspServiceMaster: createVertexInputSplits: Number of inputSplits=3D3D1 < 2=3D3Dtotal number of input threads, some threads will be not used 2014-04-15 18:24:11,328 INFO org.apache.giraph.master.BspServiceMaster: createVertexInputSplits: Starting to write input split data to zookeeper with 1 threads 2014-04-15 18:24:11,373 INFO org.apache.giraph.master.BspServiceMaster: createVertexInputSplits: Done writing input split data to zookeeper 2014-04-15 18:24:11,405 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 18:24:11,409 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 18:24:11,414 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 2 connections, (2 total connected) 0 failed, 0 failures total. 2014-04-15 18:24:11,415 INFO org.apache.giraph.partition.PartitionUtils: computePartitionCount: Creating 4, default would have been 4 partitions. 2014-04-15 18:24:11,835 INFO org.apache.giraph.comm.netty.NettyServer: start: Using Netty without authentication. 2014-04-15 18:24:11,849 INFO org.apache.giraph.master.BspServiceMaster: barrierOnWorkerList: 0 out of 2 workers finished on superstep -1 on path /_hadoopBsp/job_201404151217_0002/_vertexInputSplitDoneDir 2014-04-15 18:24:11,856 INFO org.apache.giraph.master.BspServiceMaster: barrierOnWorkerList: Waiting on [master_1, slave_2] Master: 2014-04-15 12:32:44,937 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2014-04-15 12:32:45,082 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists! 2014-04-15 12:32:45,267 INFO org.apache.giraph.graph.GraphTaskManager: setup: Log level remains at info 2014-04-15 12:32:45,311 INFO org.apache.giraph.graph.GraphTaskManager: setup: Starting up BspServiceWorker... 2014-04-15 12:32:45,327 INFO org.apache.giraph.bsp.BspService: BspService: Path to create to halt is /_hadoopBsp/job_201404151217_0002/_haltComputation 2014-04-15 12:32:45,327 INFO org.apache.giraph.bsp.BspService: BspService: Connecting to ZooKeeper with job job_201404151217_0002, 1 on master:2181 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3D3D3.4.5-1392090, built on 09/30/2012 17:52 GMT 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=3D3Dmaster 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=3D3D1.7.0_17 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=3D3DOracle Corporation 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=3D3D/opt/oracle-jdk-bin-1.7.0.17/jre 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hd= us=3D er/jobcache/job_201404151217_0002/jars/classes:/app/hadoop/tmp/mapred/local= =3D /taskTracker/hduser/jobcache/job_201404151217_0002/jars:/app/hadoop/tmp/map= =3D red/local/taskTracker/hduser/jobcache/job_201404151217_0002/attempt_2014041= =3D 51217_0002_m_000001_0/work:*/usr/local/hadoop/bin/*../conf:/usr/lib/jvm/ora= cl=3D e-jdk-bin-1.7/lib/tools.jar:*/usr/local/hadoop/bin/*..:*/usr/local/hadoop/b= in/*=3D ..*/hadoop-core-0.20.203.0.jar:/usr/local/hadoop/bin/*../lib/aspectjrt-1.6.= 5.=3D jar:*/usr/local/hadoop/bin/*../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop= /b=3D in/..*/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/bin/*../lib/common= s-=3D beanutils-core-1.8.0.jar:*/usr/local/hadoop/bin/*../lib/commons-cli-1.2.jar= :/=3D usr/local/hadoop/bin/..*/lib/commons-codec-1.4.jar:/usr/local/hadoop/bin/*.= ./=3D lib/commons-collections-3.2.1.jar:*/usr/local/hadoop/bin/*../lib/commons-co= nf=3D iguration-1.6.jar:*/usr/local/hadoop/bin/*../lib/commons-daemon-1.0.1.jar:/= us=3D r/local/hadoop/bin/..*/lib/commons-digester-1.8.jar:/usr/local/hadoop/bin/*= ..=3D*/lib/commons-el-1.0.jar:/usr/local/hadoop/bin/*../lib/commons-httpcli= ent-3.0=3D .1.jar:*/usr/local/hadoop/bin/*..*/lib/commons-lang-2.4.jar:/usr/local/hado= op/*=3D bin/..*/lib/commons-logging-1.1.1.jar:/usr/local/hadoop/bin/*../lib/commons= -l=3D ogging-api-1.0.4.jar:*/usr/local/hadoop/bin/*../lib/commons-math-2.1.jar:/u= sr=3D*/local/hadoop/bin/*..*/lib/commons-net-1.4.1.jar:/usr/local/hadoop/bi= n/*../lib=3D*/core-3.1.1.jar:/usr/local/hadoop/bin/*../lib/hsqldb-1.8.0.10.= jar:/usr/local=3D*/hadoop/bin/*..*/lib/jackson-core-asl-1.0.1.jar:/usr/loca= l/hadoop/bin/../lib/*=3D jackson-mapper-asl-1.0.1.jar:*/usr/local/hadoop/bin/*../lib/jasper-compiler= -5=3D .5.12.jar:*/usr/local/hadoop/bin/*../lib/jasper-runtime-5.5.12.jar:/usr/loc= al=3D*/hadoop/bin/*..*/lib/jets3t-0.6.1.jar:/usr/local/hadoop/bin/*../lib/j= etty-6.1.=3D 26.jar:*/usr/local/hadoop/bin/*../lib/jetty-util-6.1.26.jar:/usr/local/hado= op=3D*/bin/*..*/lib/jsch-0.1.42.jar:/usr/local/hadoop/bin/*../lib/junit-4.5= .jar:/usr=3D*/local/hadoop/bin/*..*/lib/kfs-0.2.2.jar:/usr/local/hadoop/bin= /*../lib/log4j-1=3D .2.15.jar:*/usr/local/hadoop/bin/*../lib/mockito-all-1.8.5.jar:/usr/local/h= ad=3D oop/bin/..*/lib/oro-2.0.8.jar:/usr/local/hadoop/bin/*../lib/servlet-api-2.5= -2=3D 0081211.jar:*/usr/local/hadoop/bin/*../lib/slf4j-api-1.4.3.jar:/usr/local/h= ad=3D oop/bin/..*/lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/bin/*../lib/xmlen= c-=3D 0.52.jar:*/usr/local/hadoop/bin/*../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hado= op=3D*/bin/*../lib/jsp-2.1/jsp-api-2.1.jar 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=3D3D/usr/local/hadoop/bin/../lib/native/Linux= -a=3D md64-64:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201404= =3D 151217_0002/attempt_201404151217_0002_m_000001_0/work 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hdu= se=3D r/jobcache/job_201404151217_0002/attempt_201404151217_0002_m_000001_0/work/= =3D tmp 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=3D3D 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=3D3DLinux 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=3D3Damd64 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=3D3D3.4.0-gentoo 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=3D3Dhduser 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=3D3D/home/hduser 2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jo= bc=3D ache/job_201404151217_0002/attempt_201404151217_0002_m_000001_0/work 2014-04-15 12:32:45,335 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=3D3Dmaster:2181 sessionTimeout=3D3D60000 watcher=3D3Dorg.apache.giraph.worker.BspServiceWorker@238cfdf 2014-04-15 12:32:45,349 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server master/192.168.1.102:2181. Will not attempt to authenticate using SASL (unknown error) 2014-04-15 12:32:45,349 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to master/192.168.1.102:2181, initiating session 2014-04-15 12:32:45,359 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server master/192.168.1.102:2181, sessionid =3D3D 0x14566270ed7001c, negotiated timeout =3D3D 40000 2014-04-15 12:32:45,361 INFO org.apache.giraph.bsp.BspService: process: Asynchronous connection complete. 2014-04-15 12:32:45,424 INFO org.apache.giraph.comm.netty.NettyServer: NettyServer: Using execution group with 8 threads for requestFrameDecoder. 2014-04-15 12:32:45,477 INFO org.apache.giraph.comm.netty.NettyServer: start: Started server communication server: master/192.168.1.102:30001 with up to 16 threads on bind attempt 0 with sendBufferSize =3D3D 32768 receiveBufferSize =3D3D 524288 2014-04-15 12:32:45,481 INFO org.apache.giraph.comm.netty.NettyClient: NettyClient: Using execution handler with 8 threads after request-encoder. 2014-04-15 12:32:45,489 INFO org.apache.giraph.graph.GraphTaskManager: setup: Registering health of this worker... 2014-04-15 12:32:45,504 INFO org.apache.giraph.bsp.BspService: getJobState: Job state already exists (/_hadoopBsp/job_201404151217_0002/_masterJobState) 2014-04-15 12:32:45,524 INFO org.apache.giraph.bsp.BspService: getApplicationAttempt: Node /_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir already exists! 2014-04-15 12:32:45,549 INFO org.apache.giraph.bsp.BspService: getApplicationAttempt: Node /_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir already exists! 2014-04-15 12:32:45,566 INFO org.apache.giraph.worker.BspServiceWorker: registerHealth: Created my health node for attempt=3D3D0, superstep=3D3D-1 with /_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir/0/_superstepDir/-= =3D 1/_workerHealthyDir/master_1 and workerInfo=3D3D Worker(hostname=3D3Dmaster, MRtaskID=3D3D1, port=3D3D30= 001) 2014-04-15 12:32:45,983 INFO org.apache.giraph.comm.netty.NettyServer: start: Using Netty without authentication. 2014-04-15 12:32:46,389 INFO org.apache.giraph.bsp.BspService: process: partitionAssignmentsReadyChanged (partitions are assigned) 2014-04-15 12:32:46,393 INFO org.apache.giraph.worker.BspServiceWorker: startSuperstep: Master(hostname=3D3Dslave, MRtaskID=3D3D0, port=3D3D30000) 2014-04-15 12:32:46,393 INFO org.apache.giraph.worker.BspServiceWorker: startSuperstep: Ready for computation on superstep -1 since worker selection and vertex range assignments are done in /_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir/0/_superstepDir/-= =3D 1/_addressesAndPartitions 2014-04-15 12:32:46,395 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,396 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,398 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30002 with 0 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30002 2014-04-15 12:32:46,398 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30000 with 1 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30000 2014-04-15 12:32:46,398 INFO org.apache.giraph.comm.netty.NettyServer: start: Using Netty without authentication. 2014-04-15 12:32:46,398 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,399 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 2 failed, 2 failures total. 2014-04-15 12:32:46,399 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,399 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30002 with 2 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30002 2014-04-15 12:32:46,399 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30000 with 3 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30000 2014-04-15 12:32:46,400 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 2 failed, 4 failures total. 2014-04-15 12:32:46,402 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,402 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,403 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30002 with 4 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30002 2014-04-15 12:32:46,403 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30000 with 5 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30000 2014-04-15 12:32:46,403 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,403 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 2 failed, 6 failures total. 2014-04-15 12:32:46,404 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,404 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30002 with 6 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30002 2014-04-15 12:32:46,404 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30000 with 7 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30000 2014-04-15 12:32:46,404 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,404 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 2 failed, 8 failures total. 2014-04-15 12:32:46,404 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,404 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30002 with 8 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30002 2014-04-15 12:32:46,405 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,405 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30000 with 9 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30000 2014-04-15 12:32:46,405 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 2 failed, 10 failures total. 2014-04-15 12:32:46,405 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,405 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30002 with 10 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30002 2014-04-15 12:32:46,405 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30000 with 11 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30000 2014-04-15 12:32:46,405 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,406 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 2 failed, 12 failures total. 2014-04-15 12:32:46,406 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,406 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30002 with 12 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30002 2014-04-15 12:32:46,406 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,406 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30000 with 13 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30000 2014-04-15 12:32:46,407 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 2 failed, 14 failures total. 2014-04-15 12:32:46,407 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,407 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30002 with 14 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30002 2014-04-15 12:32:46,407 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 12:32:46,408 WARN org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Future failed to connect with slave/192.168.1.152:30000 with 15 failures because of java.net.ConnectException: Connection refused: slave/192.168.1.152:30000 2014-04-15 12:32:46,408 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 2 failed, 16 failures total. 2014-04-15 12:32:46,408 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. Slave: 2014-04-15 18:24:10,782 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2014-04-15 18:24:10,907 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists! 2014-04-15 18:24:11,047 INFO org.apache.giraph.graph.GraphTaskManager: setup: Log level remains at info 2014-04-15 18:24:11,085 INFO org.apache.giraph.graph.GraphTaskManager: setup: Starting up BspServiceWorker... 2014-04-15 18:24:11,103 INFO org.apache.giraph.bsp.BspService: BspService: Path to create to halt is /_hadoopBsp/job_201404151217_0002/_haltComputation 2014-04-15 18:24:11,103 INFO org.apache.giraph.bsp.BspService: BspService: Connecting to ZooKeeper with job job_201404151217_0002, 2 on master:2181 2014-04-15 18:24:11,109 INFO org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3D3D3.4.5-1392090, built on 09/30/2012 17:52 GMT 2014-04-15 18:24:11,109 INFO org.apache.zookeeper.ZooKeeper: Client environment:host.name=3D3Dslave 2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.version=3D3D1.8.0 2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=3D3DOracle Corporation 2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.home=3D3D/opt/oracle-jdk-bin-1.8.0.0/jre 2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.class.path=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hd= us=3D er/jobcache/job_201404151217_0002/jars/classes:/app/hadoop/tmp/mapred/local= =3D /taskTracker/hduser/jobcache/job_201404151217_0002/jars:/app/hadoop/tmp/map= =3D red/local/taskTracker/hduser/jobcache/job_201404151217_0002/attempt_2014041= =3D 51217_0002_m_000002_0/work:*/usr/local/hadoop/bin/*../conf:/usr/lib64/jvm/o= ra=3D cle-jdk-bin-1.8/lib/tools.jar:*/usr/local/hadoop/bin/*..:/usr/local/hadoop/= bi=3D n/..*/hadoop-core-0.20.203.0.jar:/usr/local/hadoop/bin/*../lib/aspectjrt-1.= 6.=3D 5.jar:*/usr/local/hadoop/bin/*../lib/aspectjtools-1.6.5.jar:/usr/local/hado= op=3D*/bin/*..*/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/bin/*../l= ib/common=3D s-beanutils-core-1.8.0.jar:*/usr/local/hadoop/bin/*../lib/commons-cli-1.2.j= ar=3D :*/usr/local/hadoop/bin/*..*/lib/commons-codec-1.4.jar:/usr/local/hadoop/bi= n/*.=3D .*/lib/commons-collections-3.2.1.jar:/usr/local/hadoop/bin/*../lib/commons-= co=3D nfiguration-1.6.jar:*/usr/local/hadoop/bin/*../lib/commons-daemon-1.0.1.jar= :/=3D usr/local/hadoop/bin/..*/lib/commons-digester-1.8.jar:/usr/local/hadoop/bin= /*=3D ..*/lib/commons-el-1.0.jar:/usr/local/hadoop/bin/*../lib/commons-httpclient= -3=3D .0.1.jar:*/usr/local/hadoop/bin/*../lib/commons-lang-2.4.jar:/usr/local/had= oo=3D p/bin/..*/lib/commons-logging-1.1.1.jar:/usr/local/hadoop/bin/*../lib/commo= ns=3D -logging-api-1.0.4.jar:*/usr/local/hadoop/bin/*../lib/commons-math-2.1.jar:= /u=3D sr/local/hadoop/bin/..*/lib/commons-net-1.4.1.jar:/usr/local/hadoop/bin/*..= /l=3D ib/core-3.1.1.jar:*/usr/local/hadoop/bin/*../lib/hsqldb-1.8.0.10.jar:/usr/l= oc=3D al/hadoop/bin/..*/lib/jackson-core-asl-1.0.1.jar:/usr/local/hadoop/bin/*../= li=3D b/jackson-mapper-asl-1.0.1.jar:*/usr/local/hadoop/bin/*../lib/jasper-compil= er=3D -5.5.12.jar:*/usr/local/hadoop/bin/*../lib/jasper-runtime-5.5.12.jar:/usr/l= oc=3D al/hadoop/bin/..*/lib/jets3t-0.6.1.jar:/usr/local/hadoop/bin/*../lib/jetty-= 6.=3D 1.26.jar:*/usr/local/hadoop/bin/*../lib/jetty-util-6.1.26.jar:/usr/local/ha= do=3D op/bin/..*/lib/jsch-0.1.42.jar:/usr/local/hadoop/bin/*../lib/junit-4.5.jar:= /u=3D sr/local/hadoop/bin/..*/lib/kfs-0.2.2.jar:/usr/local/hadoop/bin/*../lib/log= 4j=3D -1.2.15.jar:*/usr/local/hadoop/bin/*../lib/mockito-all-1.8.5.jar:/usr/local= /h=3D adoop/bin/..*/lib/oro-2.0.8.jar:/usr/local/hadoop/bin/*../lib/servlet-api-2= .5=3D -20081211.jar:*/usr/local/hadoop/bin/*../lib/slf4j-api-1.4.3.jar:/usr/local= /h=3D adoop/bin/..*/lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/bin/*../lib/xml= en=3D c-0.52.jar:*/usr/local/hadoop/bin/*../lib/jsp-2.1/jsp-2.1.jar:/usr/local/ha= do=3D op/bin/../lib/jsp-2.1/jsp-api-2.1.jar 2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=3D3D/usr/local/hadoop/bin/../lib/native/Linux= -a=3D md64-64:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201404= =3D 151217_0002/attempt_201404151217_0002_m_000002_0/work 2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hdu= se=3D r/jobcache/job_201404151217_0002/attempt_201404151217_0002_m_000002_0/work/= =3D tmp 2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=3D3D 2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=3D3DLinux 2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=3D3Damd64 2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=3D3D3.2.12-gentoo 2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=3D3Dhduser 2014-04-15 18:24:11,116 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=3D3D/home/hduser 2014-04-15 18:24:11,116 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jo= bc=3D ache/job_201404151217_0002/attempt_201404151217_0002_m_000002_0/work 2014-04-15 18:24:11,117 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=3D3Dmaster:2181 sessionTimeout=3D3D60000 watcher=3D3Dorg.apache.giraph.worker.BspServiceWorker@3224f60b 2014-04-15 18:24:11,128 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server master/192.168.1.102:2181. Will not attempt to authenticate using SASL (unknown error) 2014-04-15 18:24:11,129 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to master/192.168.1.102:2181, initiating session 2014-04-15 18:24:11,141 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server master/192.168.1.102:2181, sessionid =3D3D 0x14566270ed7001d, negotiated timeout =3D3D 40000 2014-04-15 18:24:11,142 INFO org.apache.giraph.bsp.BspService: process: Asynchronous connection complete. 2014-04-15 18:24:11,185 INFO org.apache.giraph.comm.netty.NettyServer: NettyServer: Using execution group with 8 threads for requestFrameDecoder. 2014-04-15 18:24:11,229 INFO org.apache.giraph.comm.netty.NettyServer: start: Started server communication server: slave/127.0.0.1:30002 with up to 16 threads on bind attempt 0 with sendBufferSize =3D3D 32768 receiveBufferSize =3D3D 524288 2014-04-15 18:24:11,233 INFO org.apache.giraph.comm.netty.NettyClient: NettyClient: Using execution handler with 8 threads after request-encoder. 2014-04-15 18:24:11,240 INFO org.apache.giraph.graph.GraphTaskManager: setup: Registering health of this worker... 2014-04-15 18:24:11,252 INFO org.apache.giraph.bsp.BspService: getJobState: Job state already exists (/_hadoopBsp/job_201404151217_0002/_masterJobState) 2014-04-15 18:24:11,264 INFO org.apache.giraph.bsp.BspService: getApplicationAttempt: Node /_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir already exists! 2014-04-15 18:24:11,273 INFO org.apache.giraph.bsp.BspService: getApplicationAttempt: Node /_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir already exists! 2014-04-15 18:24:11,282 INFO org.apache.giraph.worker.BspServiceWorker: registerHealth: Created my health node for attempt=3D3D0, superstep=3D3D-1 with /_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir/0/_superstepDir/-= =3D 1/_workerHealthyDir/slave_2 and workerInfo=3D3D Worker(hostname=3D3Dslave, MRtaskID=3D3D2, port=3D3D300= 02) 2014-04-15 18:24:11,415 INFO org.apache.giraph.comm.netty.NettyServer: start: Using Netty without authentication. 2014-04-15 18:24:11,821 INFO org.apache.giraph.bsp.BspService: process: partitionAssignmentsReadyChanged (partitions are assigned) 2014-04-15 18:24:11,826 INFO org.apache.giraph.worker.BspServiceWorker: startSuperstep: Master(hostname=3D3Dslave, MRtaskID=3D3D0, port=3D3D30000) 2014-04-15 18:24:11,826 INFO org.apache.giraph.worker.BspServiceWorker: startSuperstep: Ready for computation on superstep -1 since worker selection and vertex range assignments are done in /_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir/0/_superstepDir/-= =3D 1/_addressesAndPartitions 2014-04-15 18:24:11,828 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 18:24:11,829 INFO org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication. 2014-04-15 18:24:11,834 INFO org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully added 2 connections, (2 total connected) 0 failed, 0 failures total. 2014-04-15 18:24:11,848 INFO org.apache.giraph.comm.netty.handler.RequestDecoder: decode: Server window metrics MBytes/sec received =3D3D 0, MBytesReceived =3D3D 0.0001, av= e received req MBytes =3D3D 0.0001, secs waited =3D3D 1.39760064E9 2014-04-15 18:24:21,859 INFO org.apache.giraph.utils.TaskIdsPermitsBarrier: waitForRequiredPermits: Waiting for 1 more tasks to send their aggregator data, task ids: [1] 2014-04-15 18:24:41,860 INFO org.apache.giraph.utils.TaskIdsPermitsBarrier: waitForRequiredPermits: Waiting for 1 more tasks to send their aggregator data, task ids: [1] 2014-04-15 18:25:01,860 INFO org.apache.giraph.utils.TaskIdsPermitsBarrier: waitForRequiredPermits: Waiting for 1 more tasks to send their aggregator data, task ids: [1] 2014-04-15 18:25:21,860 INFO org.apache.giraph.utils.TaskIdsPermitsBarrier: waitForRequiredPermits: Waiting for 1 more tasks to send their aggregator data, task ids: [1] 2014-04-15 18:25:31,861 INFO org.apache.giraph.utils.TaskIdsPermitsBarrier: waitForRequiredPermits: Waiting for 1 more tasks to send their aggregator data, task ids: [1] --089e013a2378877b1d04f72bc575 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
=20 =20 =20
I tried the following suggestion and it would appear that both clients are now using the correct Zookeeper node. This is evidenced in = the logs with the following (I'm setting the node named "Slave&quo= t; to be the Zookeeper- I apologize for the confusion name reversal for thi= s):

Slave (Zookeeper master)

2014-04-16 09:23:01,519 INFO org.apache.giraph.ma= ster.BspServiceMaster: becomeMaster: I am now the master!
=
Slave (Work= er 1)

2014-04-16 = 09:23:07,447 INFO org.apache.giraph.worker.BspServiceWorker: startSuperstep= : Master(hostname=3Dslave, MRtaskID=3D0, port=3D30000)

Master (Worker 2)

2014=
-04-16 03:31:42,136 INFO org.apache.giraph.worker.BspServiceWorker: startSu=
perstep: Master(hostname=3Dslave, MRtaskID=3D0, port=3D30000)

=
=C2=A0However, the prob= lem still persists. I've included the full logs below. Could it be a DN= S issue? Using nestat, I see the following:

Master (Worker 2)
tcp =C2=A0 =C2=A0 =C2=A0= =C2=A00 =C2=A0 =C2=A0 =C2=A00 192.1= 68.1.102:30001 =C2=A0 =C2=A0 0.0.0.0:* =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 LISTEN =C2=A0 =C2=A0 =C2=A01003 =C2=A0 =C2=A0 =C2=A0 7060= =C2=A0 =C2=A0 =C2=A0 6162/java =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0

Slave (Master and Worker 1)

<= div bgcolor=3D"#FFFFFF" text=3D"#000000">
tcp =C2=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A00 127.0.0.1:30000 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0.0.= 0.0:* =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 LISTEN =C2=A0 =C2=A0= =C2=A01001 =C2=A0 =C2=A0 =C2=A0 17828 =C2=A0 =C2=A0 =C2=A03354/java =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0
2014-04-16 09:23:00,918 INFO org.apache.hadoop.util.NativeCodeLoad=
er: Loaded the native-hadoop library
2014-04-16 09:23:01,042 WARN org.apache.hadoop.metrics2.impl.MetricsSystemI=
mpl: Source name ugi already exists!
2014-04-16 09:23:01,179 INFO org.apache.giraph.graph.GraphTaskManager: setu=
p: Log level remains at info
2014-04-16 09:23:01,217 INFO org.apache.giraph.graph.GraphTaskManager: setu=
p: Starting up BspServiceMaster (master thread)...
2014-04-16 09:23:01,230 INFO org.apache.giraph.bsp.BspService: BspService: =
Path to create to halt is /_hadoopBsp/job_201404160259_0004/_haltComputatio=
n
2014-04-16 09:23:01,230 INFO org.apache.giraph.bsp.BspService: BspService: =
Connecting to ZooKeeper with job job_201404160259_0004, 0 on 192.168.1.152:2181
2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:zookeeper.version=3D3.4.5-1392090, built on 09/30/2012 17:52 GMT
2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:host.name=3Dslave
2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.version=3D1.8.0
2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.vendor=3DOracle Corporation
2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.home=3D/opt/oracle-jdk-bin-1.8.0.0/jre
2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.class.path=3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobc=
ache/job_201404160259_0004/jars/classes:/app/hadoop/tmp/mapred/local/taskTr=
acker/hduser/jobcache/job_201404160259_0004/jars:/app/hadoop/tmp/mapred/loc=
al/taskTracker/hduser/jobcache/job_201404160259_0004/attempt_201404160259_0=
004_m_000000_0/work:/usr/local/hadoop/bin/../conf:/usr/lib64/jvm/oracle-jdk=
-bin-1.8/lib/tools.jar:/usr/local/hadoop/bin/..:/usr/local/hadoop/bin/../ha=
doop-core-0.20.203.0.jar:/usr/local/hadoop/bin/../lib/aspectjrt-1.6.5.jar:/=
usr/local/hadoop/bin/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop/bin/..=
/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/bin/../lib/commons-beanu=
tils-core-1.8.0.jar:/usr/local/hadoop/bin/../lib/commons-cli-1.2.jar:/usr/l=
ocal/hadoop/bin/../lib/commons-codec-1.4.jar:/usr/local/hadoop/bin/../lib/c=
ommons-collections-3.2.1.jar:/usr/local/hadoop/bin/../lib/commons-configura=
tion-1.6.jar:/usr/local/hadoop/bin/../lib/commons-daemon-1.0.1.jar:/usr/loc=
al/hadoop/bin/../lib/commons-digester-1.8.jar:/usr/local/hadoop/bin/../lib/=
commons-el-1.0.jar:/usr/local/hadoop/bin/../lib/commons-httpclient-3.0.1.ja=
r:/usr/local/hadoop/bin/../lib/commons-lang-2.4.jar:/usr/local/hadoop/bin/.=
./lib/commons-logging-1.1.1.jar:/usr/local/hadoop/bin/../lib/commons-loggin=
g-api-1.0.4.jar:/usr/local/hadoop/bin/../lib/commons-math-2.1.jar:/usr/loca=
l/hadoop/bin/../lib/commons-net-1.4.1.jar:/usr/local/hadoop/bin/../lib/core=
-3.1.1.jar:/usr/local/hadoop/bin/../lib/hsqldb-1.8.0.10.jar:/usr/local/hado=
op/bin/../lib/jackson-core-asl-1.0.1.jar:/usr/local/hadoop/bin/../lib/jacks=
on-mapper-asl-1.0.1.jar:/usr/local/hadoop/bin/../lib/jasper-compiler-5.5.12=
.jar:/usr/local/hadoop/bin/../lib/jasper-runtime-5.5.12.jar:/usr/local/hado=
op/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop/bin/../lib/jetty-6.1.26.ja=
r:/usr/local/hadoop/bin/../lib/jetty-util-6.1.26.jar:/usr/local/hadoop/bin/=
../lib/jsch-0.1.42.jar:/usr/local/hadoop/bin/../lib/junit-4.5.jar:/usr/loca=
l/hadoop/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop/bin/../lib/log4j-1.2.15=
.jar:/usr/local/hadoop/bin/../lib/mockito-all-1.8.5.jar:/usr/local/hadoop/b=
in/../lib/oro-2.0.8.jar:/usr/local/hadoop/bin/../lib/servlet-api-2.5-200812=
11.jar:/usr/local/hadoop/bin/../lib/slf4j-api-1.4.3.jar:/usr/local/hadoop/b=
in/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/bin/../lib/xmlenc-0.52.=
jar:/usr/local/hadoop/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hadoop/bin/=
../lib/jsp-2.1/jsp-api-2.1.jar
2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.library.path=3D/usr/local/hadoop/bin/../lib/native/Linux-amd64-64=
:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201404160259_=
0004/attempt_201404160259_0004_m_000000_0/work
2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.io.tmpdir=3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobca=
che/job_201404160259_0004/attempt_201404160259_0004_m_000000_0/work/tmp
2014-04-16 09:23:01,236 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.compiler=3D<NA>
2014-04-16 09:23:01,237 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:os.name=3DLinux
2014-04-16 09:23:01,237 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:os.arch=3Damd64
2014-04-16 09:23:01,237 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:os.version=3D3.2.12-gentoo
2014-04-16 09:23:01,237 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:user.name=3Dhduser
2014-04-16 09:23:01,241 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:user.home=3D/home/hduser
2014-04-16 09:23:01,242 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:user.dir=3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/jo=
b_201404160259_0004/attempt_201404160259_0004_m_000000_0/work
2014-04-16 09:23:01,242 INFO org.apache.zookeeper.ZooKeeper: Initiating cli=
ent connection, connectString=3D192.1=
68.1.152:2181 sessionTimeout=3D60000 watcher=3Dorg.apache.giraph.master=
.BspServiceMaster@79be0360
2014-04-16 09:23:01,260 INFO org.apache.zookeeper.ClientCnxn: Opening socke=
t connection to server =
192.168.1.152/192.168.1.152:2181. Will not attempt to authenticate usin=
g SASL (unknown error)
2014-04-16 09:23:01,261 INFO org.apache.zookeeper.ClientCnxn: Socket connec=
tion established to 192=
.168.1.152/192.168.1.152:2181, initiating session
2014-04-16 09:23:01,339 INFO org.apache.zookeeper.ClientCnxn: Session estab=
lishment complete on server 192.168.1.152/192.168.1.152:2181, sessionid =3D 0x1456ab3381d0000,=
 negotiated timeout =3D 40000
2014-04-16 09:23:01,340 INFO org.apache.giraph.bsp.BspService: process: Asy=
nchronous connection complete.
2014-04-16 09:23:01,346 INFO org.apache.giraph.graph.GraphTaskManager: map:=
 No need to do anything when not a worker
2014-04-16 09:23:01,346 INFO org.apache.giraph.graph.GraphTaskManager: clea=
nup: Starting for MASTER_ONLY
2014-04-16 09:23:01,421 INFO org.apache.giraph.master.BspServiceMaster: bec=
omeMaster: First child is '/_hadoopBsp/job_201404160259_0004/_masterEle=
ctionDir/slave_00000000000' and my bid is '/_hadoopBsp/job_20140416=
0259_0004/_masterElectionDir/slave_00000000000'
2014-04-16 09:23:01,464 INFO org.apache.giraph.comm.netty.NettyServer: Nett=
yServer: Using execution group with 8 threads for requestFrameDecoder.
2014-04-16 09:23:01,512 INFO org.apache.giraph.comm.netty.NettyServer: star=
t: Started server communication server: slave/127.0.0.1:30000 with up to 16 threads on bind attempt 0 with send=
BufferSize =3D 32768 receiveBufferSize =3D 524288
2014-04-16 09:23:01,517 INFO org.apache.giraph.comm.netty.NettyClient: Nett=
yClient: Using execution handler with 8 threads after request-encoder.
2014-04-16 09:23:01,519 INFO org.apache.giraph.master.BspServiceMaster: bec=
omeMaster: I am now the master!
2014-04-16 09:23:01,560 INFO org.apache.giraph.bsp.BspService: process: app=
licationAttemptChanged signaled
2014-04-16 09:23:01,625 WARN org.apache.giraph.bsp.BspService: process: Unk=
nown and unprocessed event (path=3D/_hadoopBsp/job_201404160259_0004/_appli=
cationAttemptsDir/0/_superstepDir, type=3DNodeChildrenChanged, state=3DSync=
Connected)
2014-04-16 09:23:07,289 INFO org.apache.giraph.io.formats.GiraphFileInputFo=
rmat: Total input paths to process : 1
2014-04-16 09:23:07,297 INFO org.apache.giraph.master.BspServiceMaster: gen=
erateVertexInputSplits: Got 1 input splits for 2 input threads
2014-04-16 09:23:07,297 WARN org.apache.giraph.master.BspServiceMaster: cre=
ateVertexInputSplits: Number of inputSplits=3D1 < 2=3Dtotal number of in=
put threads, some threads will be not used
2014-04-16 09:23:07,297 INFO org.apache.giraph.master.BspServiceMaster: cre=
ateVertexInputSplits: Starting to write input split data to zookeeper with =
1 threads
2014-04-16 09:23:07,391 INFO org.apache.giraph.master.BspServiceMaster: cre=
ateVertexInputSplits: Done writing input split data to zookeeper
2014-04-16 09:23:07,422 INFO org.apache.giraph.comm.netty.NettyClient: Usin=
g Netty without authentication.
2014-04-16 09:23:07,423 INFO org.apache.giraph.comm.netty.NettyClient: Usin=
g Netty without authentication.
2014-04-16 09:23:07,429 INFO org.apache.giraph.comm.netty.NettyClient: conn=
ectAllAddresses: Successfully added 2 connections, (2 total connected) 0 fa=
iled, 0 failures total.
2014-04-16 09:23:07,430 INFO org.apache.giraph.partition.PartitionUtils: co=
mputePartitionCount: Creating 4, default would have been 4 partitions.
2014-04-16 09:23:07,460 INFO org.apache.giraph.master.BspServiceMaster: bar=
rierOnWorkerList: 0 out of 2 workers finished on superstep -1 on path /_had=
oopBsp/job_201404160259_0004/_vertexInputSplitDoneDir
2014-04-16 09:23:07,462 INFO org.apache.giraph.master.BspServiceMaster: bar=
rierOnWorkerList: Waiting on [master_1, slave_2]
2014-04-16 09:23:07,468 INFO org.apache.giraph.comm.netty.NettyServer: star=
t: Using Netty without authentication.
Master:
2=
014-04-16 03:31:38,681 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded=
 the native-hadoop library
2014-04-16 03:31:38,826 WARN org.apache.hadoop.metrics2.impl.MetricsSystemI=
mpl: Source name ugi already exists!
2014-04-16 03:31:39,013 INFO org.apache.giraph.graph.GraphTaskManager: setu=
p: Log level remains at info
2014-04-16 03:31:39,057 INFO org.apache.giraph.graph.GraphTaskManager: setu=
p: Starting up BspServiceWorker...
2014-04-16 03:31:39,071 INFO org.apache.giraph.bsp.BspService: BspService: =
Path to create to halt is /_hadoopBsp/job_201404160259_0004/_haltComputatio=
n
2014-04-16 03:31:39,071 INFO org.apache.giraph.bsp.BspService: BspService: =
Connecting to ZooKeeper with job job_201404160259_0004, 1 on 192.168.1.152:2181
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:zookeeper.version=3D3.4.5-1392090, built on 09/30/2012 17:52 GMT
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:host.name=3Dmaster
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.version=3D1.7.0_17
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.vendor=3DOracle Corporation
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.home=3D/opt/oracle-jdk-bin-1.7.0.17/jre
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.class.path=3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobc=
ache/job_201404160259_0004/jars/classes:/app/hadoop/tmp/mapred/local/taskTr=
acker/hduser/jobcache/job_201404160259_0004/jars:/app/hadoop/tmp/mapred/loc=
al/taskTracker/hduser/jobcache/job_201404160259_0004/attempt_201404160259_0=
004_m_000001_0/work:/usr/local/hadoop/bin/../conf:/usr/lib/jvm/oracle-jdk-b=
in-1.7/lib/tools.jar:/usr/local/hadoop/bin/..:/usr/local/hadoop/bin/../hado=
op-core-0.20.203.0.jar:/usr/local/hadoop/bin/../lib/aspectjrt-1.6.5.jar:/us=
r/local/hadoop/bin/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop/bin/../l=
ib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/bin/../lib/commons-beanuti=
ls-core-1.8.0.jar:/usr/local/hadoop/bin/../lib/commons-cli-1.2.jar:/usr/loc=
al/hadoop/bin/../lib/commons-codec-1.4.jar:/usr/local/hadoop/bin/../lib/com=
mons-collections-3.2.1.jar:/usr/local/hadoop/bin/../lib/commons-configurati=
on-1.6.jar:/usr/local/hadoop/bin/../lib/commons-daemon-1.0.1.jar:/usr/local=
/hadoop/bin/../lib/commons-digester-1.8.jar:/usr/local/hadoop/bin/../lib/co=
mmons-el-1.0.jar:/usr/local/hadoop/bin/../lib/commons-httpclient-3.0.1.jar:=
/usr/local/hadoop/bin/../lib/commons-lang-2.4.jar:/usr/local/hadoop/bin/../=
lib/commons-logging-1.1.1.jar:/usr/local/hadoop/bin/../lib/commons-logging-=
api-1.0.4.jar:/usr/local/hadoop/bin/../lib/commons-math-2.1.jar:/usr/local/=
hadoop/bin/../lib/commons-net-1.4.1.jar:/usr/local/hadoop/bin/../lib/core-3=
.1.1.jar:/usr/local/hadoop/bin/../lib/hsqldb-1.8.0.10.jar:/usr/local/hadoop=
/bin/../lib/jackson-core-asl-1.0.1.jar:/usr/local/hadoop/bin/../lib/jackson=
-mapper-asl-1.0.1.jar:/usr/local/hadoop/bin/../lib/jasper-compiler-5.5.12.j=
ar:/usr/local/hadoop/bin/../lib/jasper-runtime-5.5.12.jar:/usr/local/hadoop=
/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop/bin/../lib/jetty-6.1.26.jar:=
/usr/local/hadoop/bin/../lib/jetty-util-6.1.26.jar:/usr/local/hadoop/bin/..=
/lib/jsch-0.1.42.jar:/usr/local/hadoop/bin/../lib/junit-4.5.jar:/usr/local/=
hadoop/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop/bin/../lib/log4j-1.2.15.j=
ar:/usr/local/hadoop/bin/../lib/mockito-all-1.8.5.jar:/usr/local/hadoop/bin=
/../lib/oro-2.0.8.jar:/usr/local/hadoop/bin/../lib/servlet-api-2.5-20081211=
.jar:/usr/local/hadoop/bin/../lib/slf4j-api-1.4.3.jar:/usr/local/hadoop/bin=
/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/bin/../lib/xmlenc-0.52.ja=
r:/usr/local/hadoop/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hadoop/bin/..=
/lib/jsp-2.1/jsp-api-2.1.jar
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.library.path=3D/usr/local/hadoop/bin/../lib/native/Linux-amd64-64=
:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201404160259_=
0004/attempt_201404160259_0004_m_000001_0/work
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.io.tmpdir=3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobca=
che/job_201404160259_0004/attempt_201404160259_0004_m_000001_0/work/tmp
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.compiler=3D<NA>
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:os.name=3DLinux
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:os.arch=3Damd64
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:os.version=3D3.4.0-gentoo
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:user.name=3Dhduser
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:user.home=3D/home/hduser
2014-04-16 03:31:39,078 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:user.dir=3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/jo=
b_201404160259_0004/attempt_201404160259_0004_m_000001_0/work
2014-04-16 03:31:39,079 INFO org.apache.zookeeper.ZooKeeper: Initiating cli=
ent connection, connectString=3D192.1=
68.1.152:2181 sessionTimeout=3D60000 watcher=3Dorg.apache.giraph.worker=
.BspServiceWorker@12082570
2014-04-16 03:31:39,093 INFO org.apache.zookeeper.ClientCnxn: Opening socke=
t connection to server slave/192.168.=
1.152:2181. Will not attempt to authenticate using SASL (unknown error)
2014-04-16 03:31:39,093 INFO org.apache.zookeeper.ClientCnxn: Socket connec=
tion established to slave/192.168.1.1=
52:2181, initiating session
2014-04-16 03:31:39,470 INFO org.apache.zookeeper.ClientCnxn: Session estab=
lishment complete on server slave/192=
.168.1.152:2181, sessionid =3D 0x1456ab3381d0002, negotiated timeout =
=3D 40000
2014-04-16 03:31:40,151 INFO org.apache.giraph.bsp.BspService: process: Asy=
nchronous connection complete.
2014-04-16 03:31:40,212 INFO org.apache.giraph.comm.netty.NettyServer: Nett=
yServer: Using execution group with 8 threads for requestFrameDecoder.
2014-04-16 03:31:40,266 INFO org.apache.giraph.comm.netty.NettyServer: star=
t: Started server communication server: master/192.168.1.102:30001 with up to 16 threads on bind attempt 0 =
with sendBufferSize =3D 32768 receiveBufferSize =3D 524288
2014-04-16 03:31:40,270 INFO org.apache.giraph.comm.netty.NettyClient: Nett=
yClient: Using execution handler with 8 threads after request-encoder.
2014-04-16 03:31:40,278 INFO org.apache.giraph.graph.GraphTaskManager: setu=
p: Registering health of this worker...
2014-04-16 03:31:40,529 INFO org.apache.giraph.bsp.BspService: getJobState:=
 Job state already exists (/_hadoopBsp/job_201404160259_0004/_masterJobStat=
e)
2014-04-16 03:31:40,674 INFO org.apache.giraph.bsp.BspService: getApplicati=
onAttempt: Node /_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir a=
lready exists!
2014-04-16 03:31:40,890 INFO org.apache.giraph.bsp.BspService: getApplicati=
onAttempt: Node /_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir a=
lready exists!
2014-04-16 03:31:41,407 INFO org.apache.giraph.worker.BspServiceWorker: reg=
isterHealth: Created my health node for attempt=3D0, superstep=3D-1 with /_=
hadoopBsp/job_201404160259_0004/_applicationAttemptsDir/0/_superstepDir/-1/=
_workerHealthyDir/master_1 and workerInfo=3D Worker(hostname=3Dmaster, MRta=
skID=3D1, port=3D30001)
2014-04-16 03:31:42,118 INFO org.apache.giraph.comm.netty.NettyServer: star=
t: Using Netty without authentication.
2014-04-16 03:31:42,131 INFO org.apache.giraph.bsp.BspService: process: par=
titionAssignmentsReadyChanged (partitions are assigned)
2014-04-16 03:31:42,136 INFO org.apache.giraph.worker.BspServiceWorker: sta=
rtSuperstep: Master(hostname=3Dslave, MRtaskID=3D0, port=3D30000)
2014-04-16 03:31:42,136 INFO org.apache.giraph.worker.BspServiceWorker: sta=
rtSuperstep: Ready for computation on superstep -1 since worker selection a=
nd vertex range assignments are done in /_hadoopBsp/job_201404160259_0004/_=
applicationAttemptsDir/0/_superstepDir/-1/_addressesAndPartitions
2014-04-16 03:31:42,138 INFO org.apache.giraph.comm.netty.NettyClient: Usin=
g Netty without authentication.
2014-04-16 03:31:42,139 INFO org.apache.giraph.comm.netty.NettyClient: Usin=
g Netty without authentication.
2014-04-16 03:31:42,142 WARN org.apache.giraph.comm.netty.NettyClient: conn=
ectAllAddresses: Future failed to connect with slave/192.168.1.152:30002 with 0 failures because of java.ne=
t.ConnectException: Connection refused: slave/192.168.1.152:30002
2014-04-16 03:31:42,142 WARN org.apache.giraph.comm.netty.NettyClient: conn=
ectAllAddresses: Future failed to connect with slave/192.168.1.152:30000 with 1 failures because of java.ne=
t.ConnectException: Connection refused: slave/192.168.1.152:30000
2014-04-16 03:31:42,143 INFO org.apache.giraph.comm.netty.NettyClient: Usin=
g Netty without authentication.
2014-04-16 03:31:42,143 INFO org.apache.giraph.comm.netty.NettyClient: conn=
ectAllAddresses: Successfully added 0 connections, (0 total connected) 2 fa=
iled, 2 failures total.
2014-04-16 03:31:42,143 INFO org.apache.giraph.comm.netty.NettyClient: Usin=
g Netty without authentication.
[conti=
nues like this for a while until I kill the job]

Slave:

2014-04-16 09:23:=
03,936 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hado=
op library
2014-04-16 09:23:04,064 WARN org.apache.hadoop.metrics2.impl.MetricsSystemI=
mpl: Source name ugi already exists!
2014-04-16 09:23:04,202 INFO org.apache.giraph.graph.GraphTaskManager: setu=
p: Log level remains at info
2014-04-16 09:23:04,241 INFO org.apache.giraph.graph.GraphTaskManager: setu=
p: Starting up BspServiceWorker...
2014-04-16 09:23:04,258 INFO org.apache.giraph.bsp.BspService: BspService: =
Path to create to halt is /_hadoopBsp/job_201404160259_0004/_haltComputatio=
n
2014-04-16 09:23:04,258 INFO org.apache.giraph.bsp.BspService: BspService: =
Connecting to ZooKeeper with job job_201404160259_0004, 2 on 192.168.1.152:2181
2014-04-16 09:23:04,264 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:zookeeper.version=3D3.4.5-1392090, built on 09/30/2012 17:52 GMT
2014-04-16 09:23:04,264 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:host.name=3Dslave
2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.version=3D1.8.0
2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.vendor=3DOracle Corporation
2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.home=3D/opt/oracle-jdk-bin-1.8.0.0/jre
2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.class.path=3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobc=
ache/job_201404160259_0004/jars/classes:/app/hadoop/tmp/mapred/local/taskTr=
acker/hduser/jobcache/job_201404160259_0004/jars:/app/hadoop/tmp/mapred/loc=
al/taskTracker/hduser/jobcache/job_201404160259_0004/attempt_201404160259_0=
004_m_000002_0/work:/usr/local/hadoop/bin/../conf:/usr/lib64/jvm/oracle-jdk=
-bin-1.8/lib/tools.jar:/usr/local/hadoop/bin/..:/usr/local/hadoop/bin/../ha=
doop-core-0.20.203.0.jar:/usr/local/hadoop/bin/../lib/aspectjrt-1.6.5.jar:/=
usr/local/hadoop/bin/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop/bin/..=
/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/bin/../lib/commons-beanu=
tils-core-1.8.0.jar:/usr/local/hadoop/bin/../lib/commons-cli-1.2.jar:/usr/l=
ocal/hadoop/bin/../lib/commons-codec-1.4.jar:/usr/local/hadoop/bin/../lib/c=
ommons-collections-3.2.1.jar:/usr/local/hadoop/bin/../lib/commons-configura=
tion-1.6.jar:/usr/local/hadoop/bin/../lib/commons-daemon-1.0.1.jar:/usr/loc=
al/hadoop/bin/../lib/commons-digester-1.8.jar:/usr/local/hadoop/bin/../lib/=
commons-el-1.0.jar:/usr/local/hadoop/bin/../lib/commons-httpclient-3.0.1.ja=
r:/usr/local/hadoop/bin/../lib/commons-lang-2.4.jar:/usr/local/hadoop/bin/.=
./lib/commons-logging-1.1.1.jar:/usr/local/hadoop/bin/../lib/commons-loggin=
g-api-1.0.4.jar:/usr/local/hadoop/bin/../lib/commons-math-2.1.jar:/usr/loca=
l/hadoop/bin/../lib/commons-net-1.4.1.jar:/usr/local/hadoop/bin/../lib/core=
-3.1.1.jar:/usr/local/hadoop/bin/../lib/hsqldb-1.8.0.10.jar:/usr/local/hado=
op/bin/../lib/jackson-core-asl-1.0.1.jar:/usr/local/hadoop/bin/../lib/jacks=
on-mapper-asl-1.0.1.jar:/usr/local/hadoop/bin/../lib/jasper-compiler-5.5.12=
.jar:/usr/local/hadoop/bin/../lib/jasper-runtime-5.5.12.jar:/usr/local/hado=
op/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop/bin/../lib/jetty-6.1.26.ja=
r:/usr/local/hadoop/bin/../lib/jetty-util-6.1.26.jar:/usr/local/hadoop/bin/=
../lib/jsch-0.1.42.jar:/usr/local/hadoop/bin/../lib/junit-4.5.jar:/usr/loca=
l/hadoop/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop/bin/../lib/log4j-1.2.15=
.jar:/usr/local/hadoop/bin/../lib/mockito-all-1.8.5.jar:/usr/local/hadoop/b=
in/../lib/oro-2.0.8.jar:/usr/local/hadoop/bin/../lib/servlet-api-2.5-200812=
11.jar:/usr/local/hadoop/bin/../lib/slf4j-api-1.4.3.jar:/usr/local/hadoop/b=
in/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/bin/../lib/xmlenc-0.52.=
jar:/usr/local/hadoop/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hadoop/bin/=
../lib/jsp-2.1/jsp-api-2.1.jar
2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.library.path=3D/usr/local/hadoop/bin/../lib/native/Linux-amd64-64=
:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201404160259_=
0004/attempt_201404160259_0004_m_000002_0/work
2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.io.tmpdir=3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobca=
che/job_201404160259_0004/attempt_201404160259_0004_m_000002_0/work/tmp
2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:java.compiler=3D<NA>
2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:os.name=3DLinux
2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:os.arch=3Damd64
2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:os.version=3D3.2.12-gentoo
2014-04-16 09:23:04,265 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:user.name=3Dhduser
2014-04-16 09:23:04,271 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:user.home=3D/home/hduser
2014-04-16 09:23:04,271 INFO org.apache.zookeeper.ZooKeeper: Client environ=
ment:user.dir=3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/jo=
b_201404160259_0004/attempt_201404160259_0004_m_000002_0/work
2014-04-16 09:23:04,271 INFO org.apache.zookeeper.ZooKeeper: Initiating cli=
ent connection, connectString=3D192.1=
68.1.152:2181 sessionTimeout=3D60000 watcher=3Dorg.apache.giraph.worker=
.BspServiceWorker@79be0360
2014-04-16 09:23:04,282 INFO org.apache.zookeeper.ClientCnxn: Opening socke=
t connection to server =
192.168.1.152/192.168.1.152:2181. Will not attempt to authenticate usin=
g SASL (unknown error)
2014-04-16 09:23:04,283 INFO org.apache.zookeeper.ClientCnxn: Socket connec=
tion established to 192=
.168.1.152/192.168.1.152:2181, initiating session
2014-04-16 09:23:04,697 INFO org.apache.zookeeper.ClientCnxn: Session estab=
lishment complete on server 192.168.1.152/192.168.1.152:2181, sessionid =3D 0x1456ab3381d0001,=
 negotiated timeout =3D 40000
2014-04-16 09:23:04,698 INFO org.apache.giraph.bsp.BspService: process: Asy=
nchronous connection complete.
2014-04-16 09:23:04,742 INFO org.apache.giraph.comm.netty.NettyServer: Nett=
yServer: Using execution group with 8 threads for requestFrameDecoder.
2014-04-16 09:23:04,785 INFO org.apache.giraph.comm.netty.NettyServer: star=
t: Started server communication server: slave/127.0.0.1:30002 with up to 16 threads on bind attempt 0 with send=
BufferSize =3D 32768 receiveBufferSize =3D 524288
2014-04-16 09:23:04,789 INFO org.apache.giraph.comm.netty.NettyClient: Nett=
yClient: Using execution handler with 8 threads after request-encoder.
2014-04-16 09:23:04,795 INFO org.apache.giraph.graph.GraphTaskManager: setu=
p: Registering health of this worker...
2014-04-16 09:23:04,883 INFO org.apache.giraph.bsp.BspService: getJobState:=
 Job state already exists (/_hadoopBsp/job_201404160259_0004/_masterJobStat=
e)
2014-04-16 09:23:05,344 INFO org.apache.giraph.bsp.BspService: getApplicati=
onAttempt: Node /_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir a=
lready exists!
2014-04-16 09:23:05,835 INFO org.apache.giraph.bsp.BspService: getApplicati=
onAttempt: Node /_hadoopBsp/job_201404160259_0004/_applicationAttemptsDir a=
lready exists!
2014-04-16 09:23:06,077 INFO org.apache.giraph.worker.BspServiceWorker: reg=
isterHealth: Created my health node for attempt=3D0, superstep=3D-1 with /_=
hadoopBsp/job_201404160259_0004/_applicationAttemptsDir/0/_superstepDir/-1/=
_workerHealthyDir/slave_2 and workerInfo=3D Worker(hostname=3Dslave, MRtask=
ID=3D2, port=3D30002)
2014-04-16 09:23:07,429 INFO org.apache.giraph.comm.netty.NettyServer: star=
t: Using Netty without authentication.
2014-04-16 09:23:07,442 INFO org.apache.giraph.bsp.BspService: process: par=
titionAssignmentsReadyChanged (partitions are assigned)
2014-04-16 09:23:07,447 INFO org.apache.giraph.worker.BspServiceWorker: sta=
rtSuperstep: Master(hostname=3Dslave, MRtaskID=3D0, port=3D30000)
2014-04-16 09:23:07,447 INFO org.apache.giraph.worker.BspServiceWorker: sta=
rtSuperstep: Ready for computation on superstep -1 since worker selection a=
nd vertex range assignments are done in /_hadoopBsp/job_201404160259_0004/_=
applicationAttemptsDir/0/_superstepDir/-1/_addressesAndPartitions
2014-04-16 09:23:07,453 INFO org.apache.giraph.comm.netty.NettyClient: Usin=
g Netty without authentication.
2014-04-16 09:23:07,462 INFO org.apache.giraph.comm.netty.NettyClient: Usin=
g Netty without authentication.
2014-04-16 09:23:07,468 INFO org.apache.giraph.comm.netty.NettyClient: conn=
ectAllAddresses: Successfully added 2 connections, (2 total connected) 0 fa=
iled, 0 failures total.
2014-04-16 09:23:07,474 INFO org.apache.giraph.comm.netty.handler.RequestDe=
coder: decode: Server window metrics MBytes/sec received =3D 0, MBytesRecei=
ved =3D 0.0002, ave received req MBytes =3D 0.0002, secs waited =3D 1.39765=
453E9
2014-04-16 09:23:17,488 INFO org.apache.giraph.utils.TaskIdsPermitsBarrier:=
 waitForRequiredPermits: Waiting for 1 more tasks to send their aggregator =
data, task ids: [1]


On 4/15/14, 10:13 PM, Vikesh Khanna wrote:
=20
Hi Tyler,

To fix "unrecognized -D option", use the following c= ommand (just changing the position of the argument) -=C2=A0
$HADOOP_HOME/bin/hadoop jar $GIRAPH_HOME/giraph-examples/tar=
get/giraph-examples-1.1.0-SNAPSHOT-for-hado=3D op-1.2.1-jar-with-dependenci=
es.jar org.apache.giraph.GiraphRunner=C2=A0-Dgiraph.zkList=3D3D=
master:2181=C2=A0=C2=A0org.apache.giraph.examples.Simpl=
eShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleF=
loatDoubleVertexInputFormat -vip /user/hduser/input/tiny_graph.txt -vof org=
.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/hduser/outp=
ut/shortestpaths -w 2
Thanks,
Vikesh Khanna,
Masters, Computer Science (Class of 2015)
Stanford University


From: "Tyler Jones" = <thomascirca@gmail.com>
To: user@giraph.apache.org<= br> Sent: Tuesday, April 15, 2014 7:06:22 PM
Subject: Zookeeper / Netty (Connection refused) issue for 2 node cluster

I've set up a two node cluster for Giraph. Currently, I =
have a master and a
slave node. The /etc/hosts for master looks like:

192.168.1.102 master
192.168.1.152 slave

and for slave, it looks like so:

127.0.0.1       slave
172.0.0.1 slave
192.168.1.102 master
192.168.1.152 slave

I have the following in my core-site.xml on both master and slave.

<property>
<name>giraph.zkList</name>
<value>master:2181</value>
</property>

I currently have Zookeeper running on the master node, on port 2181. I'=
m
trying to run a simple Giraph job like so:

$HADOOP_HOME/bin/hadoop jar
$GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hado=
=3D
op-1.2.1-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimpleShortestPathsComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/hduser/input/tiny_graph.txt -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/hduser/output/shortestpaths -w 2

However, I get the errors as shown below. I'm not sure if its a Zookeep=
er
or Netty issue. If I do:

telnet master 2181

>From slave and send the ruok string, I get "imok", so I'm not=
 having issues
connecting there. Any thoughts? Originally I thought it was an iptables
issue so I dumped all the rules and the like (iptables was only on slave). =
I've also tried removing the
first two entries in /etc/hosts on slave, but that leads to other errors.
Also, if I change the above to:

$HADOOP_HOME/bin/hadoop jar
$GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hado=
=3D
op-1.2.1-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimpleShortestPathsComputation
-Dgiraph.zkList=3D3Dmaster:2181 -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/hduser/input/tiny_graph.txt -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/hduser/output/shortestpaths -w 2

It just says "Unrecognized Option: -D"

Slave

2014-04-15 18:24:07,774 INFO org.apache.hadoop.util.NativeCodeLoader:
Loaded the native-hadoop library
2014-04-15 18:24:07,901 WARN
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi
already exists!
2014-04-15 18:24:08,039 INFO org.apache.giraph.graph.GraphTaskManager:
setup: Log level remains at info
2014-04-15 18:24:08,078 INFO org.apache.giraph.graph.GraphTaskManager:
setup: Starting up BspServiceMaster (master thread)...
2014-04-15 18:24:08,096 INFO org.apache.giraph.bsp.BspService:
BspService: Path to create to halt is
/_hadoopBsp/job_201404151217_0002/_haltComputation
2014-04-15 18:24:08,096 INFO org.apache.giraph.bsp.BspService:
BspService: Connecting to ZooKeeper with job job_201404151217_0002, 0
on master:2181
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:zookeeper.version=3D3D3.4.5-1392090, built on 09/30/2012 17:52
GMT
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:host.name=3D=
3Dslave
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.version=3D3D1.8.0
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.vendor=3D3DOracle Corporation
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.home=3D3D/opt/oracle-jdk-bin-1.8.0.0/jre
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.class.path=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hd=
us=3D
er/jobcache/job_201404151217_0002/jars/classes:/app/hadoop/tmp/mapred/local=
=3D
/taskTracker/hduser/jobcache/job_201404151217_0002/jars:/app/hadoop/tmp/map=
=3D
red/local/taskTracker/hduser/jobcache/job_201404151217_0002/attempt_2014041=
=3D
51217_0002_m_000000_0/work:/usr/local/hadoop/bin/../conf:/usr/lib64/jvm/ora=3D
cle-jdk-bin-1.8/lib/tools.jar:/usr/local/hadoop/bin/<=
/span>..:/usr/local/hadoop/bi=3D
n/../hadoop-core-0.20.203.0.jar:/usr/local/hadoop/bin=
/../lib/aspectjrt-1.6.=3D
5.jar:/usr/local/hadoop/bin/../lib/aspectj=
tools-1.6.5.jar:/usr/local/hadoop=3D
/bin/../lib/commons-beanut=
ils-1.7.0.jar:/usr/local/hadoop/bin/../lib/common=3D
s-beanutils-core-1.8.0.jar:/usr/local/hadoop/bin/../lib/commons-cli-1.2.jar=3D
:/usr/local/hadoop/bin/../=
lib/commons-codec-1.4.jar:/usr/local/hadoop/bin/.=3D
./lib/commons-collections-3.2.1.jar:/usr/local/hadoop/bin/../lib/commons-co=3D
nfiguration-1.6.jar:/usr/local/hadoop/bin/=
../lib/commons-daemon-1.0.1.jar:/=3D
usr/local/hadoop/bin/../lib/commons-digester-1.8.jar:/usr/l=
ocal/hadoop/bin/=3D
../lib/commons-el-1.0.jar:/usr/local/hadoop/bin/../lib/commons-httpclient-3=3D
.0.1.jar:/usr/local/hadoop/bin/../lib/comm=
ons-lang-2.4.jar:/usr/local/hadoo=3D
p/bin/../lib/commons-logging-1.1.1.jar:/usr/local/hadoop/bi=
n/../lib/commons=3D
-logging-api-1.0.4.jar:/usr/local/hadoop/bin/<=
/i>../lib/commons-math-2.1.jar:/u=3D
sr/local/hadoop/bin/../lib/commons-net-1.4.1.jar:/usr/local=
/hadoop/bin/../l=3D
ib/core-3.1.1.jar:/usr/local/hadoop/bin/..=
/lib/hsqldb-1.8.0.10.jar:/usr/loc=3D
al/hadoop/bin/../lib/jackson-core-asl-1.0.1.jar:/usr/local/=
hadoop/bin/../li=3D
b/jackson-mapper-asl-1.0.1.jar:/usr/local/hadoop/bin/=
../lib/jasper-compiler=3D
-5.5.12.jar:/usr/local/hadoop/bin/../lib/j=
asper-runtime-5.5.12.jar:/usr/loc=3D
al/hadoop/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop/bin=
/../lib/jetty-6.=3D
1.26.jar:/usr/local/hadoop/bin/../lib/jett=
y-util-6.1.26.jar:/usr/local/hado=3D
op/bin/../lib/jsch-0.1.42.jar:/usr/local/hadoop/bin/<=
/span>../lib/junit-4.5.jar:/u=3D
sr/local/hadoop/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop/=
bin/../lib/log4j=3D
-1.2.15.jar:/usr/local/hadoop/bin/../lib/m=
ockito-all-1.8.5.jar:/usr/local/h=3D
adoop/bin/../lib/oro-2.0.8.jar:/usr/local/hadoop/bin/=
../lib/servlet-api-2.5=3D
-20081211.jar:/usr/local/hadoop/bin/../lib=
/slf4j-api-1.4.3.jar:/usr/local/h=3D
adoop/bin/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/=
bin/../lib/xmlen=3D
c-0.52.jar:/usr/local/hadoop/bin/../lib/js=
p-2.1/jsp-2.1.jar:/usr/local/hado=3D
op/bin/../lib/jsp-2.1/jsp-api-2.1.jar
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.library.path=3D3D/usr/local/hadoop/bin/../lib/native/Linux=
-a=3D
md64-64:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201404=
=3D
151217_0002/attempt_201404151217_0002_m_000000_0/work
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hdu=
se=3D
r/jobcache/job_201404151217_0002/attempt_201404151217_0002_m_000000_0/work/=
=3D
tmp
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.compiler=3D3D<NA>
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.name=3D3DLi=
nux
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.arch=3D3Damd64
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.version=3D3D3.2.12-gentoo
2014-04-15 18:24:08,102 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.name=3D=
3Dhduser
2014-04-15 18:24:08,105 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.home=3D3D/home/hduser
2014-04-15 18:24:08,105 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.dir=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jo=
bc=3D
ache/job_201404151217_0002/attempt_201404151217_0002_m_000000_0/work
2014-04-15 18:24:08,106 INFO org.apache.zookeeper.ZooKeeper:
Initiating client connection, connectString=3D3Dmaster:2181
sessionTimeout=3D3D60000
watcher=3D3Dorg.apache.giraph.master.BspServiceMaster@3224f60b
2014-04-15 18:24:08,117 INFO org.apache.zookeeper.ClientCnxn: Opening
socket connection to server master/192.168.1.102:2181. Will not
attempt to authenticate using SASL (unknown error)
2014-04-15 18:24:08,118 INFO org.apache.zookeeper.ClientCnxn: Socket
connection established to master/192.168.1.102:2181, initiating
session
2014-04-15 18:24:08,141 INFO org.apache.zookeeper.ClientCnxn: Session
establishment complete on server master/192.168.1.102:2181, sessionid
=3D3D 0x14566270ed7001b, negotiated timeout =3D3D 40000
2014-04-15 18:24:08,142 INFO org.apache.giraph.bsp.BspService:
process: Asynchronous connection complete.
2014-04-15 18:24:08,147 INFO org.apache.giraph.graph.GraphTaskManager:
map: No need to do anything when not a worker
2014-04-15 18:24:08,148 INFO org.apache.giraph.graph.GraphTaskManager:
cleanup: Starting for MASTER_ONLY
2014-04-15 18:24:08,201 INFO
org.apache.giraph.master.BspServiceMaster: becomeMaster: First child
is '/_hadoopBsp/job_201404151217_0002/_masterElectionDir/slave_00000000=
000'
and my bid is '/_hadoopBsp/job_201404151217_0002/_masterElectionDir/sla=
ve_0=3D
0000000000'
2014-04-15 18:24:08,246 INFO org.apache.giraph.comm.netty.NettyServer:
NettyServer: Using execution group with 8 threads for
requestFrameDecoder.
2014-04-15 18:24:08,289 INFO org.apache.giraph.comm.netty.NettyServer:
start: Started server communication server: slave/127.0.0.1:30000 with
up to 16 threads on bind attempt 0 with sendBufferSize =3D3D 32768
receiveBufferSize =3D3D 524288
2014-04-15 18:24:08,294 INFO org.apache.giraph.comm.netty.NettyClient:
NettyClient: Using execution handler with 8 threads after
request-encoder.
2014-04-15 18:24:08,296 INFO
org.apache.giraph.master.BspServiceMaster: becomeMaster: I am now the
master!
2014-04-15 18:24:08,714 INFO org.apache.giraph.bsp.BspService:
process: applicationAttemptChanged signaled
2014-04-15 18:24:08,790 WARN org.apache.giraph.bsp.BspService:
process: Unknown and unprocessed event
(path=3D3D/_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir/0/_supe=
rs=3D
tepDir,
type=3D3DNodeChildrenChanged, state=3D3DSyncConnected)
2014-04-15 18:24:11,321 INFO
org.apache.giraph.io.formats.GiraphFileInputFormat: Total input paths
to process : 1
2014-04-15 18:24:11,328 INFO
org.apache.giraph.master.BspServiceMaster: generateVertexInputSplits:
Got 1 input splits for 2 input threads
2014-04-15 18:24:11,328 WARN
org.apache.giraph.master.BspServiceMaster: createVertexInputSplits:
Number of inputSplits=3D3D1 < 2=3D3Dtotal number of input threads, some
threads will be not used
2014-04-15 18:24:11,328 INFO
org.apache.giraph.master.BspServiceMaster: createVertexInputSplits:
Starting to write input split data to zookeeper with 1 threads
2014-04-15 18:24:11,373 INFO
org.apache.giraph.master.BspServiceMaster: createVertexInputSplits:
Done writing input split data to zookeeper
2014-04-15 18:24:11,405 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 18:24:11,409 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 18:24:11,414 INFO org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Successfully added 2 connections, (2 total
connected) 0 failed, 0 failures total.
2014-04-15 18:24:11,415 INFO
org.apache.giraph.partition.PartitionUtils: computePartitionCount:
Creating 4, default would have been 4 partitions.
2014-04-15 18:24:11,835 INFO org.apache.giraph.comm.netty.NettyServer:
start: Using Netty without authentication.
2014-04-15 18:24:11,849 INFO
org.apache.giraph.master.BspServiceMaster: barrierOnWorkerList: 0 out
of 2 workers finished on superstep -1 on path
/_hadoopBsp/job_201404151217_0002/_vertexInputSplitDoneDir
2014-04-15 18:24:11,856 INFO
org.apache.giraph.master.BspServiceMaster: barrierOnWorkerList:
Waiting on [master_1, slave_2]


Master:

2014-04-15 12:32:44,937 INFO org.apache.hadoop.util.NativeCodeLoader:
Loaded the native-hadoop library

2014-04-15 12:32:45,082 WARN
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi
already exists!
2014-04-15 12:32:45,267 INFO org.apache.giraph.graph.GraphTaskManager:
setup: Log level remains at info
2014-04-15 12:32:45,311 INFO org.apache.giraph.graph.GraphTaskManager:
setup: Starting up BspServiceWorker...
2014-04-15 12:32:45,327 INFO org.apache.giraph.bsp.BspService:
BspService: Path to create to halt is
/_hadoopBsp/job_201404151217_0002/_haltComputation
2014-04-15 12:32:45,327 INFO org.apache.giraph.bsp.BspService:
BspService: Connecting to ZooKeeper with job job_201404151217_0002, 1
on master:2181
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:zookeeper.version=3D3D3.4.5-1392090, built on 09/30/2012 17:52
GMT
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:host.name=3D=
3Dmaster
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.version=3D3D1.7.0_17
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.vendor=3D3DOracle Corporation
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.home=3D3D/opt/oracle-jdk-bin-1.7.0.17/jre
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.class.path=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hd=
us=3D
er/jobcache/job_201404151217_0002/jars/classes:/app/hadoop/tmp/mapred/local=
=3D
/taskTracker/hduser/jobcache/job_201404151217_0002/jars:/app/hadoop/tmp/map=
=3D
red/local/taskTracker/hduser/jobcache/job_201404151217_0002/attempt_2014041=
=3D
51217_0002_m_000001_0/work:/usr/local/hadoop/bin/../conf:/usr/lib/jvm/oracl=3D
e-jdk-bin-1.7/lib/tools.jar:/usr/local/hadoop/bin/..:/usr/local/hadoop/bin/=3D
../hadoop-core-0.20.203.0.jar:/usr/local/hadoop/bin/<=
/span>../lib/aspectjrt-1.6.5.=3D
jar:/usr/local/hadoop/bin/../lib/aspectjto=
ols-1.6.5.jar:/usr/local/hadoop/b=3D
in/../lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/bin=
/../lib/commons-=3D
beanutils-core-1.8.0.jar:/usr/local/hadoop/bin/../lib/commons-cli-1.2.jar:/=3D
usr/local/hadoop/bin/../lib/commons-codec-1.4.jar:/usr/loca=
l/hadoop/bin/../=3D
lib/commons-collections-3.2.1.jar:/usr/local/hadoop/bin/../lib/commons-conf=3D
iguration-1.6.jar:/usr/local/hadoop/bin/..=
/lib/commons-daemon-1.0.1.jar:/us=3D
r/local/hadoop/bin/../lib/commons-digester-1.8.jar:/usr/loc=
al/hadoop/bin/..=3D
/lib/commons-el-1.0.jar:/usr/local/hadoop/bin/=
../lib/commons-httpclient-3.0=3D
.1.jar:/usr/local/hadoop/bin/../<=
/span>lib/commons-lang-2.4.jar:/usr/local/hadoop/=3D
bin/../lib/commons-logging-1.1.1.jar:/usr/local/hadoop/bin<=
span>/../lib/commons-l=3D
ogging-api-1.0.4.jar:/usr/local/hadoop/bin/../lib/commons-math-2.1.jar:/usr=3D
/local/hadoop/bin/../lib/c=
ommons-net-1.4.1.jar:/usr/local/hadoop/bin/../lib=3D
/core-3.1.1.jar:/usr/local/hadoop/bin/../l=
ib/hsqldb-1.8.0.10.jar:/usr/local=3D
/hadoop/bin/../lib/jackson=
-core-asl-1.0.1.jar:/usr/local/hadoop/bin/=
../lib/=3D
jackson-mapper-asl-1.0.1.jar:/usr/local/hadoop/bin/../lib/jasper-compiler-5=3D
.5.12.jar:/usr/local/hadoop/bin/../lib/jas=
per-runtime-5.5.12.jar:/usr/local=3D
/hadoop/bin/../lib/jets3t-=
0.6.1.jar:/usr/local/hadoop/bin/../lib/jetty-6.1.=3D
26.jar:/usr/local/hadoop/bin/../lib/jetty-=
util-6.1.26.jar:/usr/local/hadoop=3D
/bin/../lib/jsch-0.1.42.ja=
r:/usr/local/hadoop/bin/../lib/junit-4.5.jar:/usr=3D
/local/hadoop/bin/../lib/k=
fs-0.2.2.jar:/usr/local/hadoop/bin/../lib/log4j-1=3D
.2.15.jar:/usr/local/hadoop/bin/../lib/moc=
kito-all-1.8.5.jar:/usr/local/had=3D
oop/bin/../lib/oro-2.0.8.jar:/usr/local/hadoop/bin/../lib/servlet-api-2.5-2=3D
0081211.jar:/usr/local/hadoop/bin/../lib/s=
lf4j-api-1.4.3.jar:/usr/local/had=3D
oop/bin/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/bi=
n/../lib/xmlenc-=3D
0.52.jar:/usr/local/hadoop/bin/../lib/jsp-=
2.1/jsp-2.1.jar:/usr/local/hadoop=3D
/bin/../lib/jsp-2.1/jsp-api-2.1.jar
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.library.path=3D3D/usr/local/hadoop/bin/../lib/native/Linux=
-a=3D
md64-64:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201404=
=3D
151217_0002/attempt_201404151217_0002_m_000001_0/work
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hdu=
se=3D
r/jobcache/job_201404151217_0002/attempt_201404151217_0002_m_000001_0/work/=
=3D
tmp
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.compiler=3D3D<NA>
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.name=3D3DLi=
nux
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.arch=3D3Damd64
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.version=3D3D3.4.0-gentoo
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.name=3D=
3Dhduser
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.home=3D3D/home/hduser
2014-04-15 12:32:45,334 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.dir=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jo=
bc=3D
ache/job_201404151217_0002/attempt_201404151217_0002_m_000001_0/work
2014-04-15 12:32:45,335 INFO org.apache.zookeeper.ZooKeeper:
Initiating client connection, connectString=3D3Dmaster:2181
sessionTimeout=3D3D60000
watcher=3D3Dorg.apache.giraph.worker.BspServiceWorker@238cfdf
2014-04-15 12:32:45,349 INFO org.apache.zookeeper.ClientCnxn: Opening
socket connection to server master/192.168.1.102:2181. Will not
attempt to authenticate using SASL (unknown error)
2014-04-15 12:32:45,349 INFO org.apache.zookeeper.ClientCnxn: Socket
connection established to master/192.168.1.102:2181, initiating
session
2014-04-15 12:32:45,359 INFO org.apache.zookeeper.ClientCnxn: Session
establishment complete on server master/192.168.1.102:2181, sessionid
=3D3D 0x14566270ed7001c, negotiated timeout =3D3D 40000
2014-04-15 12:32:45,361 INFO org.apache.giraph.bsp.BspService:
process: Asynchronous connection complete.
2014-04-15 12:32:45,424 INFO org.apache.giraph.comm.netty.NettyServer:
NettyServer: Using execution group with 8 threads for
requestFrameDecoder.
2014-04-15 12:32:45,477 INFO org.apache.giraph.comm.netty.NettyServer:
start: Started server communication server: master/192.168.1.102:30001
with up to 16 threads on bind attempt 0 with sendBufferSize =3D3D 32768
receiveBufferSize =3D3D 524288
2014-04-15 12:32:45,481 INFO org.apache.giraph.comm.netty.NettyClient:
NettyClient: Using execution handler with 8 threads after
request-encoder.
2014-04-15 12:32:45,489 INFO org.apache.giraph.graph.GraphTaskManager:
setup: Registering health of this worker...
2014-04-15 12:32:45,504 INFO org.apache.giraph.bsp.BspService:
getJobState: Job state already exists
(/_hadoopBsp/job_201404151217_0002/_masterJobState)
2014-04-15 12:32:45,524 INFO org.apache.giraph.bsp.BspService:
getApplicationAttempt: Node
/_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir already
exists!
2014-04-15 12:32:45,549 INFO org.apache.giraph.bsp.BspService:
getApplicationAttempt: Node
/_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir already
exists!
2014-04-15 12:32:45,566 INFO
org.apache.giraph.worker.BspServiceWorker: registerHealth: Created my
health node for attempt=3D3D0, superstep=3D3D-1 with
/_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir/0/_superstepDir/-=
=3D
1/_workerHealthyDir/master_1
and workerInfo=3D3D Worker(hostname=3D3Dmaster, MRtaskID=3D3D1, port=3D3D30=
001)
2014-04-15 12:32:45,983 INFO org.apache.giraph.comm.netty.NettyServer:
start: Using Netty without authentication.
2014-04-15 12:32:46,389 INFO org.apache.giraph.bsp.BspService:
process: partitionAssignmentsReadyChanged (partitions are assigned)
2014-04-15 12:32:46,393 INFO
org.apache.giraph.worker.BspServiceWorker: startSuperstep:
Master(hostname=3D3Dslave, MRtaskID=3D3D0, port=3D3D30000)
2014-04-15 12:32:46,393 INFO
org.apache.giraph.worker.BspServiceWorker: startSuperstep: Ready for
computation on superstep -1 since worker selection and vertex range
assignments are done in
/_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir/0/_superstepDir/-=
=3D
1/_addressesAndPartitions
2014-04-15 12:32:46,395 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,396 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,398 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30002 with 0 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30002
2014-04-15 12:32:46,398 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30000 with 1 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30000
2014-04-15 12:32:46,398 INFO org.apache.giraph.comm.netty.NettyServer:
start: Using Netty without authentication.
2014-04-15 12:32:46,398 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,399 INFO org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Successfully added 0 connections, (0 total
connected) 2 failed, 2 failures total.
2014-04-15 12:32:46,399 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,399 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30002 with 2 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30002
2014-04-15 12:32:46,399 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30000 with 3 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30000
2014-04-15 12:32:46,400 INFO org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Successfully added 0 connections, (0 total
connected) 2 failed, 4 failures total.
2014-04-15 12:32:46,402 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,402 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,403 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30002 with 4 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30002
2014-04-15 12:32:46,403 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30000 with 5 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30000
2014-04-15 12:32:46,403 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,403 INFO org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Successfully added 0 connections, (0 total
connected) 2 failed, 6 failures total.
2014-04-15 12:32:46,404 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,404 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30002 with 6 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30002
2014-04-15 12:32:46,404 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30000 with 7 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30000
2014-04-15 12:32:46,404 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,404 INFO org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Successfully added 0 connections, (0 total
connected) 2 failed, 8 failures total.
2014-04-15 12:32:46,404 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,404 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30002 with 8 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30002
2014-04-15 12:32:46,405 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,405 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30000 with 9 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30000
2014-04-15 12:32:46,405 INFO org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Successfully added 0 connections, (0 total
connected) 2 failed, 10 failures total.
2014-04-15 12:32:46,405 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,405 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30002 with 10 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30002
2014-04-15 12:32:46,405 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30000 with 11 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30000
2014-04-15 12:32:46,405 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,406 INFO org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Successfully added 0 connections, (0 total
connected) 2 failed, 12 failures total.
2014-04-15 12:32:46,406 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,406 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30002 with 12 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30002
2014-04-15 12:32:46,406 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,406 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30000 with 13 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30000
2014-04-15 12:32:46,407 INFO org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Successfully added 0 connections, (0 total
connected) 2 failed, 14 failures total.
2014-04-15 12:32:46,407 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,407 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30002 with 14 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30002
2014-04-15 12:32:46,407 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 12:32:46,408 WARN org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Future failed to connect with
slave/192.168.1.15=
2:30000 with 15 failures because of
java.net.ConnectException: Connection refused:
slave/192.168.1.15=
2:30000
2014-04-15 12:32:46,408 INFO org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Successfully added 0 connections, (0 total
connected) 2 failed, 16 failures total.
2014-04-15 12:32:46,408 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.


Slave:

2014-04-15 18:24:10,782 INFO org.apache.hadoop.util.NativeCodeLoader:
Loaded the native-hadoop library
2014-04-15 18:24:10,907 WARN
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi
already exists!
2014-04-15 18:24:11,047 INFO org.apache.giraph.graph.GraphTaskManager:
setup: Log level remains at info
2014-04-15 18:24:11,085 INFO org.apache.giraph.graph.GraphTaskManager:
setup: Starting up BspServiceWorker...
2014-04-15 18:24:11,103 INFO org.apache.giraph.bsp.BspService:
BspService: Path to create to halt is
/_hadoopBsp/job_201404151217_0002/_haltComputation
2014-04-15 18:24:11,103 INFO org.apache.giraph.bsp.BspService:
BspService: Connecting to ZooKeeper with job job_201404151217_0002, 2
on master:2181
2014-04-15 18:24:11,109 INFO org.apache.zookeeper.ZooKeeper: Client
environment:zookeeper.version=3D3D3.4.5-1392090, built on 09/30/2012 17:52
GMT
2014-04-15 18:24:11,109 INFO org.apache.zookeeper.ZooKeeper: Client
environment:host.name=3D=
3Dslave
2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.version=3D3D1.8.0
2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.vendor=3D3DOracle Corporation
2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.home=3D3D/opt/oracle-jdk-bin-1.8.0.0/jre
2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.class.path=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hd=
us=3D
er/jobcache/job_201404151217_0002/jars/classes:/app/hadoop/tmp/mapred/local=
=3D
/taskTracker/hduser/jobcache/job_201404151217_0002/jars:/app/hadoop/tmp/map=
=3D
red/local/taskTracker/hduser/jobcache/job_201404151217_0002/attempt_2014041=
=3D
51217_0002_m_000002_0/work:/usr/local/hadoop/bin/../conf:/usr/lib64/jvm/ora=3D
cle-jdk-bin-1.8/lib/tools.jar:/usr/local/hadoop/bin/<=
/span>..:/usr/local/hadoop/bi=3D
n/../hadoop-core-0.20.203.0.jar:/usr/local/hadoop/bin=
/../lib/aspectjrt-1.6.=3D
5.jar:/usr/local/hadoop/bin/../lib/aspectj=
tools-1.6.5.jar:/usr/local/hadoop=3D
/bin/../lib/commons-beanut=
ils-1.7.0.jar:/usr/local/hadoop/bin/../lib/common=3D
s-beanutils-core-1.8.0.jar:/usr/local/hadoop/bin/../lib/commons-cli-1.2.jar=3D
:/usr/local/hadoop/bin/../=
lib/commons-codec-1.4.jar:/usr/local/hadoop/bin/.=3D
./lib/commons-collections-3.2.1.jar:/usr/local/hadoop/bin/../lib/commons-co=3D
nfiguration-1.6.jar:/usr/local/hadoop/bin/=
../lib/commons-daemon-1.0.1.jar:/=3D
usr/local/hadoop/bin/../lib/commons-digester-1.8.jar:/usr/l=
ocal/hadoop/bin/=3D
../lib/commons-el-1.0.jar:/usr/local/hadoop/bin/../lib/commons-httpclient-3=3D
.0.1.jar:/usr/local/hadoop/bin/../lib/comm=
ons-lang-2.4.jar:/usr/local/hadoo=3D
p/bin/../lib/commons-logging-1.1.1.jar:/usr/local/hadoop/bi=
n/../lib/commons=3D
-logging-api-1.0.4.jar:/usr/local/hadoop/bin/<=
/i>../lib/commons-math-2.1.jar:/u=3D
sr/local/hadoop/bin/../lib/commons-net-1.4.1.jar:/usr/local=
/hadoop/bin/../l=3D
ib/core-3.1.1.jar:/usr/local/hadoop/bin/..=
/lib/hsqldb-1.8.0.10.jar:/usr/loc=3D
al/hadoop/bin/../lib/jackson-core-asl-1.0.1.jar:/usr/local/=
hadoop/bin/../li=3D
b/jackson-mapper-asl-1.0.1.jar:/usr/local/hadoop/bin/=
../lib/jasper-compiler=3D
-5.5.12.jar:/usr/local/hadoop/bin/../lib/j=
asper-runtime-5.5.12.jar:/usr/loc=3D
al/hadoop/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop/bin=
/../lib/jetty-6.=3D
1.26.jar:/usr/local/hadoop/bin/../lib/jett=
y-util-6.1.26.jar:/usr/local/hado=3D
op/bin/../lib/jsch-0.1.42.jar:/usr/local/hadoop/bin/<=
/span>../lib/junit-4.5.jar:/u=3D
sr/local/hadoop/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop/=
bin/../lib/log4j=3D
-1.2.15.jar:/usr/local/hadoop/bin/../lib/m=
ockito-all-1.8.5.jar:/usr/local/h=3D
adoop/bin/../lib/oro-2.0.8.jar:/usr/local/hadoop/bin/=
../lib/servlet-api-2.5=3D
-20081211.jar:/usr/local/hadoop/bin/../lib=
/slf4j-api-1.4.3.jar:/usr/local/h=3D
adoop/bin/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/=
bin/../lib/xmlen=3D
c-0.52.jar:/usr/local/hadoop/bin/../lib/js=
p-2.1/jsp-2.1.jar:/usr/local/hado=3D
op/bin/../lib/jsp-2.1/jsp-api-2.1.jar
2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.library.path=3D3D/usr/local/hadoop/bin/../lib/native/Linux=
-a=3D
md64-64:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201404=
=3D
151217_0002/attempt_201404151217_0002_m_000002_0/work
2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hdu=
se=3D
r/jobcache/job_201404151217_0002/attempt_201404151217_0002_m_000002_0/work/=
=3D
tmp
2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.compiler=3D3D<NA>
2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.name=3D3DLi=
nux
2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.arch=3D3Damd64
2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.version=3D3D3.2.12-gentoo
2014-04-15 18:24:11,110 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.name=3D=
3Dhduser
2014-04-15 18:24:11,116 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.home=3D3D/home/hduser
2014-04-15 18:24:11,116 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.dir=3D3D/app/hadoop/tmp/mapred/local/taskTracker/hduser/jo=
bc=3D
ache/job_201404151217_0002/attempt_201404151217_0002_m_000002_0/work
2014-04-15 18:24:11,117 INFO org.apache.zookeeper.ZooKeeper:
Initiating client connection, connectString=3D3Dmaster:2181
sessionTimeout=3D3D60000
watcher=3D3Dorg.apache.giraph.worker.BspServiceWorker@3224f60b
2014-04-15 18:24:11,128 INFO org.apache.zookeeper.ClientCnxn: Opening
socket connection to server master/192.168.1.102:2181. Will not
attempt to authenticate using SASL (unknown error)
2014-04-15 18:24:11,129 INFO org.apache.zookeeper.ClientCnxn: Socket
connection established to master/192.168.1.102:2181, initiating
session
2014-04-15 18:24:11,141 INFO org.apache.zookeeper.ClientCnxn: Session
establishment complete on server master/192.168.1.102:2181, sessionid
=3D3D 0x14566270ed7001d, negotiated timeout =3D3D 40000
2014-04-15 18:24:11,142 INFO org.apache.giraph.bsp.BspService:
process: Asynchronous connection complete.
2014-04-15 18:24:11,185 INFO org.apache.giraph.comm.netty.NettyServer:
NettyServer: Using execution group with 8 threads for
requestFrameDecoder.
2014-04-15 18:24:11,229 INFO org.apache.giraph.comm.netty.NettyServer:
start: Started server communication server: slave/127.0.0.1:30002 with
up to 16 threads on bind attempt 0 with sendBufferSize =3D3D 32768
receiveBufferSize =3D3D 524288
2014-04-15 18:24:11,233 INFO org.apache.giraph.comm.netty.NettyClient:
NettyClient: Using execution handler with 8 threads after
request-encoder.
2014-04-15 18:24:11,240 INFO org.apache.giraph.graph.GraphTaskManager:
setup: Registering health of this worker...
2014-04-15 18:24:11,252 INFO org.apache.giraph.bsp.BspService:
getJobState: Job state already exists
(/_hadoopBsp/job_201404151217_0002/_masterJobState)
2014-04-15 18:24:11,264 INFO org.apache.giraph.bsp.BspService:
getApplicationAttempt: Node
/_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir already
exists!
2014-04-15 18:24:11,273 INFO org.apache.giraph.bsp.BspService:
getApplicationAttempt: Node
/_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir already
exists!
2014-04-15 18:24:11,282 INFO
org.apache.giraph.worker.BspServiceWorker: registerHealth: Created my
health node for attempt=3D3D0, superstep=3D3D-1 with
/_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir/0/_superstepDir/-=
=3D
1/_workerHealthyDir/slave_2
and workerInfo=3D3D Worker(hostname=3D3Dslave, MRtaskID=3D3D2, port=3D3D300=
02)
2014-04-15 18:24:11,415 INFO org.apache.giraph.comm.netty.NettyServer:
start: Using Netty without authentication.
2014-04-15 18:24:11,821 INFO org.apache.giraph.bsp.BspService:
process: partitionAssignmentsReadyChanged (partitions are assigned)
2014-04-15 18:24:11,826 INFO
org.apache.giraph.worker.BspServiceWorker: startSuperstep:
Master(hostname=3D3Dslave, MRtaskID=3D3D0, port=3D3D30000)
2014-04-15 18:24:11,826 INFO
org.apache.giraph.worker.BspServiceWorker: startSuperstep: Ready for
computation on superstep -1 since worker selection and vertex range
assignments are done in
/_hadoopBsp/job_201404151217_0002/_applicationAttemptsDir/0/_superstepDir/-=
=3D
1/_addressesAndPartitions
2014-04-15 18:24:11,828 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 18:24:11,829 INFO org.apache.giraph.comm.netty.NettyClient:
Using Netty without authentication.
2014-04-15 18:24:11,834 INFO org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Successfully added 2 connections, (2 total
connected) 0 failed, 0 failures total.
2014-04-15 18:24:11,848 INFO
org.apache.giraph.comm.netty.handler.RequestDecoder: decode: Server
window metrics MBytes/sec received =3D3D 0, MBytesReceived =3D3D 0.0001, av=
e
received req MBytes =3D3D 0.0001, secs waited =3D3D 1.39760064E9
2014-04-15 18:24:21,859 INFO
org.apache.giraph.utils.TaskIdsPermitsBarrier: waitForRequiredPermits:
Waiting for 1 more tasks to send their aggregator data, task ids: [1]
2014-04-15 18:24:41,860 INFO
org.apache.giraph.utils.TaskIdsPermitsBarrier: waitForRequiredPermits:
Waiting for 1 more tasks to send their aggregator data, task ids: [1]
2014-04-15 18:25:01,860 INFO
org.apache.giraph.utils.TaskIdsPermitsBarrier: waitForRequiredPermits:
Waiting for 1 more tasks to send their aggregator data, task ids: [1]
2014-04-15 18:25:21,860 INFO
org.apache.giraph.utils.TaskIdsPermitsBarrier: waitForRequiredPermits:
Waiting for 1 more tasks to send their aggregator data, task ids: [1]
2014-04-15 18:25:31,861 INFO
org.apache.giraph.utils.TaskIdsPermitsBarrier: waitForRequiredPermits:
Waiting for 1 more tasks to send their aggregator data, task ids: [1]


--089e013a2378877b1d04f72bc575--