giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Avery Ching <ach...@apache.org>
Subject Re: Is Zookeeper a must for Giraph?
Date Tue, 25 Jun 2013 05:17:06 GMT
Zookeeper is required.  That being said, you can have an external 
Zookeeper or Giraph can start one for you.  It's your choice.

Eli is the one to contact regarding Giraph on Hadoop 2.0.5.  Any 
thoughts Eli?

Avery

On 6/24/13 5:22 PM, Chuan Lei wrote:
> It is not clear to me that whether Zookeeper is required or optional 
> to Giraph. I wonder if it is possible to run Giraph without Zookeeper. 
> If not the case, would the default Zookeeper work with Giraph? Is 
> there anything has to be changed on Zookeeper.
>
> Another question is that I have the following error message when I ran 
> Giraph on Hadoop-2.0.5 when I ran the PageRankBenchmark program. I saw 
> similar posts on the mailing list, but it seems no clear answer to it 
> yet. I would be grateful if someone can answer my question and resolve 
> the issue.
>
> Error: java.lang.IllegalStateException: run: Caught an unrecoverable 
> exception java.io.FileNotFoundException: File 
> _bsp/_defaultZkManagerDir/job_1372108933881_0002/_zkServer does not 
> exist. at 
> org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:102) at 
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:757) at 
> org.apache.hadoop.mapred.MapTask.run(MapTask.java:339) at 
> org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:158) at 
> java.security.AccessController.doPrivileged(Native Method) at 
> javax.security.auth.Subject.doAs(Subject.java:396) at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1478)

> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:153) Caused 
> by: java.lang.RuntimeException: java.io.FileNotFoundException: File 
> _bsp/_defaultZkManagerDir/job_1372108933881_0002/_zkServer does not 
> exist. at 
> org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:790)

> at 
> org.apache.giraph.graph.GraphTaskManager.startZooKeeperManager(GraphTaskManager.java:357)

> at 
> org.apache.giraph.graph.GraphTaskManager.setup(GraphTaskManager.java:188) 
> at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:60) at 
> org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:90) ... 7 
> more Caused by: java.io.FileNotFoundException: File 
> _bsp/_defaultZkManagerDir/job_1372108933881_0002/_zkServer does not 
> exist. at 
> org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:405)

> at 
> org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:749)

> ... 11 more
>
> Regards,
> Chuan


Mime
View raw message