giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tripti Singh <tri...@yahoo-inc.com>
Subject Re: _zkServer does not Exist
Date Mon, 22 Oct 2012 11:49:21 GMT
Hi,
I am trying to build Giraph with Hadoop_0.23 profile.
When I try to run the PageRankBenchmark, I get the following error:

Cmd> hadoop jar giraph-0.71-SNAPSHOT-for-hadoop-0.23.4.1210022201-jar-with-dependencies.jar
org.apache.giraph.benchmark.PageRankBenchmark
 -Dmapred.job.tracker=<host:port> -Dgiraph.zkManagerDirectory='/tmp/giraph/cc/_bsp/_defaultZkManagerDir'
-c 1 -e 2 -s 2 -V 10 -w 1

2012-10-22 10:53:33,446 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt
to override final parameter: yarn.app.mapreduce.am.job.client.port-range;  Ignoring.
2012-10-22 10:53:33,446 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt
to override final parameter: mapreduce.admin.reduce.child.java.opts;  Ignoring.
2012-10-22 10:53:33,447 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt
to override final parameter: hadoop.tmp.dir;  Ignoring.
2012-10-22 10:53:33,561 INFO [main] org.apache.giraph.graph.GraphMapper: setup: Set log level
to info
2012-10-22 10:53:33,561 INFO [main] org.apache.giraph.graph.GraphMapper: Distributed cache
is empty. Assuming fatjar.
2012-10-22 10:53:33,561 INFO [main] org.apache.giraph.graph.GraphMapper: setup: classpath
@ {path}/job.jar for job org.apache.giraph.benchmark.PageRankBenchmark
2012-10-22 10:53:33,564 WARN [main] org.apache.hadoop.conf.Configuration: mapred.task.partition
is deprecated. Instead, use mapreduce.task.partition
2012-10-22 10:53:33,564 WARN [main] org.apache.hadoop.conf.Configuration: mapred.job.id is
deprecated. Instead, use mapreduce.job.id
2012-10-22 10:53:33,564 WARN [main] org.apache.hadoop.conf.Configuration: job.local.dir is
deprecated. Instead, use mapreduce.job.local.dir
2012-10-22 10:53:33,565 INFO [main] org.apache.giraph.zk.ZooKeeperManager: createCandidateStamp:
Made the directory /tmp/giraph/cc/_bsp/_defaultZkManagerDir
2012-10-22 10:53:33,568 INFO [main] org.apache.giraph.zk.ZooKeeperManager: createCandidateStamp:
Creating my filestamp /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_task/gsrd215n08.red.ygrid.yahoo.com
1
2012-10-22 10:53:33,601 INFO [main] org.apache.giraph.zk.ZooKeeperManager: getZooKeeperServerList:
For task 1, got file 'zkServerList_gsrd208n08.red.ygrid.yahoo.com 0 ' (polling period is 3000)
2012-10-22 10:53:33,601 INFO [main] org.apache.giraph.zk.ZooKeeperManager: getZooKeeperServerList:
Found [gsrd208n08.red.ygrid.yahoo.com, 0] 2 hosts in filename 'zkServerList_gsrd208n08.red.ygrid.yahoo.com
0 '
2012-10-22 10:53:33,603 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running
child : java.lang.IllegalStateException: run: Caught an unrecoverable exception java.io.FileNotFoundException:
File /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer does not exist.
        at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:595)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:157)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1212)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:152)
Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: File /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer
does not exist.
        at org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:796)
        at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:328)
        at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:573)
        ... 7 more
Caused by: java.io.FileNotFoundException: File /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer
does not exist.
        at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:362)
        at org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:755)
        ... 9 more

2012-10-22 10:53:33,607 INFO [main] org.apache.hadoop.mapred.Task: Runnning cleanup for the
task
2012-10-22 10:53:33,609 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping
MapTask metrics system...
2012-10-22 10:53:33,610 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask
metrics system stopped.
2012-10-22 10:53:33,610 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask
metrics system shutdown complete.

How can I resolve this.

Thanks,
Tripti.


Mime
View raw message