giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ken Williams <zoo9...@hotmail.com>
Subject RE: FileNotFoundException: File _bsp/_defaultZkManagerDir/job_201308291126_0029/_zkServer does not exist.
Date Mon, 02 Sep 2013 16:27:04 GMT
Hi,
      I am trying to one of the example programs included with Giraph 1.0.0but whatever I
do I always get this same error:
FileNotFoundException: File _bsp/_defaultZkManagerDir/<job_number>/_zkServer does not
exist.
   I am running Giraph 1.0.0, on hadoop-2.0.0-cdh4.1.1    I successfully ran 'mvn clean install
-Phadoop_2.0.0' with no problems.
This is my input file,
[root@localhost giraph]# hadoop fs -cat /user/root/input/tiny_graph.txt[0,0,[[1,1],[3,3]]][1,0,[[0,1],[2,2],[3,1]]][2,0,[[1,2],[4,4]]][3,0,[[0,3],[1,1],[4,4]]][4,0,[[3,4],[2,4]]]
   When I try to run an example program this is the output,
[root@localhost giraph]#  hadoop jar /usr/local/giraph/giraph-examples/target/giraph-examples-1.0.0-for-hadoop-2.0.0-alpha-jar-with-dependencies.jar
  org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsVertex  -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/root/input/tiny_graph.txt
-of org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/root/output/shortestpaths
-w 1 13/09/02 17:06:36 INFO utils.ConfigurationUtils: No edge input format specified. Ensure
your InputFormat does not require one.13/09/02 17:06:36 WARN job.GiraphConfigurationValidator:
Output format vertex index type is not known13/09/02 17:06:36 WARN job.GiraphConfigurationValidator:
Output format vertex value type is not known13/09/02 17:06:36 WARN job.GiraphConfigurationValidator:
Output format edge value type is not known13/09/02 17:06:36 INFO job.GiraphJob: run: Since
checkpointing is disabled (default), do not allow any task retries (setting mapred.map.max.attempts
= 0, old value = 4)13/09/02 17:06:37 WARN mapred.JobClient: Use GenericOptionsParser for parsing
the arguments. Applications should implement Tool for the same.13/09/02 17:06:40 INFO mapred.JobClient:
Running job: job_201308291126_002913/09/02 17:06:41 INFO mapred.JobClient:  map 0% reduce
0%13/09/02 17:06:51 INFO mapred.JobClient: Job complete: job_201308291126_002913/09/02 17:06:51
INFO mapred.JobClient: Counters: 613/09/02 17:06:51 INFO mapred.JobClient:   Job Counters
13/09/02 17:06:51 INFO mapred.JobClient:     Failed map tasks=113/09/02 17:06:51 INFO mapred.JobClient:
    Launched map tasks=213/09/02 17:06:51 INFO mapred.JobClient:     Total time spent by all
maps in occupied slots (ms)=1651513/09/02 17:06:51 INFO mapred.JobClient:     Total time spent
by all reduces in occupied slots (ms)=013/09/02 17:06:51 INFO mapred.JobClient:     Total
time spent by all maps waiting after reserving slots (ms)=013/09/02 17:06:51 INFO mapred.JobClient:
    Total time spent by all reduces waiting after reserving slots (ms)=0[root@localhost giraph]#


There are no errors but no output is produced, and in the Web UI I can see the 2 map tasks
have both failed.When I look in the log files this is the exception I see thrown,
java.lang.IllegalStateException: run: Caught an unrecoverable exception java.io.FileNotFoundException:
File _bsp/_defaultZkManagerDir/job_201308291126_0029/_zkServer does not exist.	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:102)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645)	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)	at java.security.AccessController.doPrivileged(Native
Method)	at javax.security.auth.Subject.doAs(Subject.java:396)	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
at org.apache.hadoop.mapred.Child.main(Child.java:262)Caused by: java.lang.RuntimeException:
java.io.FileNotFoundException: File _bsp/_defaultZkManagerDir/job_201308291126_0029/_zkServer
does not exist.	at org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:790)
at org.apache.giraph.graph.GraphTaskManager.startZooKeeperManager(GraphTaskManager.java
Every time I run a new job, it throws this same error. 
I have a copy of Zookeeper installed here,
[root@localhost giraph]# /usr/lib/zookeeper/bin/zkServer.sh  statusJMX enabled by defaultUsing
config: /usr/lib/zookeeper/bin/../conf/zoo.cfgMode: standalone[root@localhost giraph]# 
          Any help would be greatly appreciated.
          Thank you,
Ken

 		 	   		   		 	   		  
Mime
View raw message