Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CC82AC2E8 for ; Tue, 25 Jun 2013 05:17:18 +0000 (UTC) Received: (qmail 81033 invoked by uid 500); 25 Jun 2013 05:17:18 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 80881 invoked by uid 500); 25 Jun 2013 05:17:13 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 80867 invoked by uid 99); 25 Jun 2013 05:17:11 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Jun 2013 05:17:11 +0000 Received: from localhost (HELO aching-mbp2.local) (127.0.0.1) (smtp-auth username aching, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Jun 2013 05:17:11 +0000 Message-ID: <51C927D2.3060802@apache.org> Date: Mon, 24 Jun 2013 22:17:06 -0700 From: Avery Ching User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:17.0) Gecko/20130509 Thunderbird/17.0.6 MIME-Version: 1.0 To: user@giraph.apache.org, Eli Reisman Subject: Re: Is Zookeeper a must for Giraph? References: In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Zookeeper is required. That being said, you can have an external Zookeeper or Giraph can start one for you. It's your choice. Eli is the one to contact regarding Giraph on Hadoop 2.0.5. Any thoughts Eli? Avery On 6/24/13 5:22 PM, Chuan Lei wrote: > It is not clear to me that whether Zookeeper is required or optional > to Giraph. I wonder if it is possible to run Giraph without Zookeeper. > If not the case, would the default Zookeeper work with Giraph? Is > there anything has to be changed on Zookeeper. > > Another question is that I have the following error message when I ran > Giraph on Hadoop-2.0.5 when I ran the PageRankBenchmark program. I saw > similar posts on the mailing list, but it seems no clear answer to it > yet. I would be grateful if someone can answer my question and resolve > the issue. > > Error: java.lang.IllegalStateException: run: Caught an unrecoverable > exception java.io.FileNotFoundException: File > _bsp/_defaultZkManagerDir/job_1372108933881_0002/_zkServer does not > exist. at > org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:102) at > org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:757) at > org.apache.hadoop.mapred.MapTask.run(MapTask.java:339) at > org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:158) at > java.security.AccessController.doPrivileged(Native Method) at > javax.security.auth.Subject.doAs(Subject.java:396) at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1478) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:153) Caused > by: java.lang.RuntimeException: java.io.FileNotFoundException: File > _bsp/_defaultZkManagerDir/job_1372108933881_0002/_zkServer does not > exist. at > org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:790) > at > org.apache.giraph.graph.GraphTaskManager.startZooKeeperManager(GraphTaskManager.java:357) > at > org.apache.giraph.graph.GraphTaskManager.setup(GraphTaskManager.java:188) > at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:60) at > org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:90) ... 7 > more Caused by: java.io.FileNotFoundException: File > _bsp/_defaultZkManagerDir/job_1372108933881_0002/_zkServer does not > exist. at > org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:405) > at > org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:749) > ... 11 more > > Regards, > Chuan