giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Roman Shaposhnik <ro...@shaposhnik.org>
Subject Giraph on Hadoop 2.0.0-alpha
Date Fri, 25 May 2012 16:24:00 GMT
Hi!

I'm trying to run Giraph trunk on top of Hadoop 2.0.0 and I'm getting
the following error while submitting an example job:
 $ hadoop jar /usr/lib/giraph/giraph-jar-with-dependencies.jar
org.apache.giraph.benchmark.PageRankBenchmark -e 1 -s 3 -V 100000 -w 3

Now, if I look at the state of HDFS right after the job fails I see that
the job has created file structure all the way up to
  _bsp/_defaultZkManagerDir/job_1337959594450_0002/
I even see
  _bsp/_defaultZkManagerDir/job_1337959594450_0002/zkServerList_ahmed-laptop 0
so it is unlikely to be file permission problems or anything like that.

Could you, please, suggest a way to debug it from here?

Oh, and here's the exception I'm getting:

2012-05-25 08:31:34,335 INFO [IPC Server handler 16 on 33249]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report
from attempt_1337959594450_0002_m_000001_3: Error:
java.lang.RuntimeException: java.io.FileNotFoundException: File
_bsp/_defaultZkManagerDir/job_1337959594450_0002/_zkServer does not
exist.
      at org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:748)
      at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:424)
      at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:645)
      at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
      at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:152)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
      at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
Caused by: java.io.FileNotFoundException: File
_bsp/_defaultZkManagerDir/job_1337959594450_0002/_zkServer does not
exist.
      at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:365)
      at org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:707)
      ... 9 more

Thanks,
Roman.

Mime
View raw message