Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8F1EE1076B for ; Mon, 2 Sep 2013 17:18:59 +0000 (UTC) Received: (qmail 29007 invoked by uid 500); 2 Sep 2013 17:18:58 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 28812 invoked by uid 500); 2 Sep 2013 17:18:57 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 28801 invoked by uid 99); 2 Sep 2013 17:18:56 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Sep 2013 17:18:56 +0000 X-ASF-Spam-Status: No, hits=-0.5 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of pradeep0802@gmail.com designates 209.85.215.45 as permitted sender) Received: from [209.85.215.45] (HELO mail-la0-f45.google.com) (209.85.215.45) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Sep 2013 17:18:51 +0000 Received: by mail-la0-f45.google.com with SMTP id eh20so3769761lab.18 for ; Mon, 02 Sep 2013 10:18:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=awluZ4olxY+2EDKt9RdkMC2qDE4u42zc1OosYwjltuM=; b=I8WUxBd/xJAkfy3hCFkqB6iuwVG7SGZXDPKyzOUornIVPHOrzCc2t87J78OEtImmT8 qG3af01pXCYREsTGS7gJuipO86usDFfqvwSACP/m84EMsWtDTp2ttDU1zmrEOKUO7ZrV XT+zrFJADkgmX4EtmMVX+ccSPO3dtvFaWk4nQDJgTtDghXQcxDaKaUUWp3MXJSVJo70d gE12Pl0NyKddHyxCXk2MKgzLgWjcfoa1SWEuijvFBBBGmXLuyB6BZlKV6VcsjOkHLa6p 74ZnE+lw25D17A2iF2A+l3xFPDPgpl5ZwvVknsn6pzRJR7vt0rL32XTs8gHQ3ArRwToc 2JVg== MIME-Version: 1.0 X-Received: by 10.152.37.103 with SMTP id x7mr2890209laj.28.1378142309784; Mon, 02 Sep 2013 10:18:29 -0700 (PDT) Received: by 10.112.160.10 with HTTP; Mon, 2 Sep 2013 10:18:29 -0700 (PDT) In-Reply-To: References: Date: Mon, 2 Sep 2013 22:48:29 +0530 Message-ID: Subject: Re: FileNotFoundException: File _bsp/_defaultZkManagerDir/job_201308291126_0029/_zkServer does not exist. From: pradeep kumar To: user@giraph.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org Can you check if zookeeper running properly. On 9/2/13, Ken Williams wrote: > Hi, > I am trying to one of the example programs included with Giraph > 1.0.0but whatever I do I always get this same error: > FileNotFoundException: File _bsp/_defaultZkManagerDir//_zkServer > does not exist. > I am running Giraph 1.0.0, on hadoop-2.0.0-cdh4.1.1 I successfully ran > 'mvn clean install -Phadoop_2.0.0' with no problems. > This is my input file, > [root@localhost giraph]# hadoop fs -cat > /user/root/input/tiny_graph.txt[0,0,[[1,1],[3,3]]][1,0,[[0,1],[2,2],[3,1]]][2,0,[[1,2],[4,4]]][3,0,[[0,3],[1,1],[4,4]]][4,0,[[3,4],[2,4]]] > When I try to run an example program this is the output, > [root@localhost giraph]# hadoop jar > /usr/local/giraph/giraph-examples/target/giraph-examples-1.0.0-for-hadoop-2.0.0-alpha-jar-with-dependencies.jar > org.apache.giraph.GiraphRunner > org.apache.giraph.examples.SimpleShortestPathsVertex -vif > org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip > /user/root/input/tiny_graph.txt -of > org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op > /user/root/output/shortestpaths -w 1 13/09/02 17:06:36 INFO > utils.ConfigurationUtils: No edge input format specified. Ensure your > InputFormat does not require one.13/09/02 17:06:36 WARN > job.GiraphConfigurationValidator: Output format vertex index type is not > known13/09/02 17:06:36 WARN job.GiraphConfigurationValidator: Output format > vertex value type is not known13/09/02 17:06:36 WARN > job.GiraphConfigurationValidator: Output format edge value type is not > known13/09/02 17:06:36 INFO job.GiraphJob: run: Since checkpointing is > disabled (default), do not allow any task retries (setting > mapred.map.max.attempts = 0, old value = 4)13/09/02 17:06:37 WARN > mapred.JobClient: Use GenericOptionsParser for parsing the arguments. > Applications should implement Tool for the same.13/09/02 17:06:40 INFO > mapred.JobClient: Running job: job_201308291126_002913/09/02 17:06:41 INFO > mapred.JobClient: map 0% reduce 0%13/09/02 17:06:51 INFO mapred.JobClient: > Job complete: job_201308291126_002913/09/02 17:06:51 INFO mapred.JobClient: > Counters: 613/09/02 17:06:51 INFO mapred.JobClient: Job Counters 13/09/02 > 17:06:51 INFO mapred.JobClient: Failed map tasks=113/09/02 17:06:51 INFO > mapred.JobClient: Launched map tasks=213/09/02 17:06:51 INFO > mapred.JobClient: Total time spent by all maps in occupied slots > (ms)=1651513/09/02 17:06:51 INFO mapred.JobClient: Total time spent by > all reduces in occupied slots (ms)=013/09/02 17:06:51 INFO mapred.JobClient: > Total time spent by all maps waiting after reserving slots > (ms)=013/09/02 17:06:51 INFO mapred.JobClient: Total time spent by all > reduces waiting after reserving slots (ms)=0[root@localhost giraph]# > > There are no errors but no output is produced, and in the Web UI I can see > the 2 map tasks have both failed.When I look in the log files this is the > exception I see thrown, > java.lang.IllegalStateException: run: Caught an unrecoverable exception > java.io.FileNotFoundException: File > _bsp/_defaultZkManagerDir/job_201308291126_0029/_zkServer does not exist. at > org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:102) at > org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645) at > org.apache.hadoop.mapred.MapTask.run(MapTask.java:325) at > org.apache.hadoop.mapred.Child$4.run(Child.java:268) at > java.security.AccessController.doPrivileged(Native Method) at > javax.security.auth.Subject.doAs(Subject.java:396) at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332) at > org.apache.hadoop.mapred.Child.main(Child.java:262)Caused by: > java.lang.RuntimeException: java.io.FileNotFoundException: File > _bsp/_defaultZkManagerDir/job_201308291126_0029/_zkServer does not exist. at > org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:790) at > org.apache.giraph.graph.GraphTaskManager.startZooKeeperManager(GraphTaskManager.java > Every time I run a new job, it throws this same error. > I have a copy of Zookeeper installed here, > [root@localhost giraph]# /usr/lib/zookeeper/bin/zkServer.sh statusJMX > enabled by defaultUsing config: /usr/lib/zookeeper/bin/../conf/zoo.cfgMode: > standalone[root@localhost giraph]# > Any help would be greatly appreciated. > Thank you, > Ken > > -- Pradeep Kumar