Return-Path: X-Original-To: apmail-incubator-giraph-user-archive@minotaur.apache.org Delivered-To: apmail-incubator-giraph-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D642690C5 for ; Wed, 1 Feb 2012 19:18:07 +0000 (UTC) Received: (qmail 50898 invoked by uid 500); 1 Feb 2012 19:18:07 -0000 Delivered-To: apmail-incubator-giraph-user-archive@incubator.apache.org Received: (qmail 50803 invoked by uid 500); 1 Feb 2012 19:18:07 -0000 Mailing-List: contact giraph-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: giraph-user@incubator.apache.org Delivered-To: mailing list giraph-user@incubator.apache.org Received: (qmail 50795 invoked by uid 99); 1 Feb 2012 19:18:07 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 19:18:07 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jghoman@gmail.com designates 209.85.212.175 as permitted sender) Received: from [209.85.212.175] (HELO mail-wi0-f175.google.com) (209.85.212.175) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 19:18:00 +0000 Received: by wibhq7 with SMTP id hq7so1278475wib.6 for ; Wed, 01 Feb 2012 11:17:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding; bh=ahv4YjjntQC5n1H2/DYhnrt8grKbvvSu5xtTFBUY0Q4=; b=L4FJdqL3kaPi877Zl//1Ea6pIfLWRgHIcwVjuhrhsEDZXGatgaV6VtnBbeJstp9i9+ z/z/Lnm89jbXoC6cABIT+V96QnCJMTlXLABcgSpyrwLXuyEDftlAupexCJexlaF92iqp vC5orRbnADzyT2CgG6ooCrTVyJFj0C5HQDIFg= Received: by 10.180.107.68 with SMTP id ha4mr18157487wib.9.1328123860302; Wed, 01 Feb 2012 11:17:40 -0800 (PST) MIME-Version: 1.0 Received: by 10.180.107.166 with HTTP; Wed, 1 Feb 2012 11:17:10 -0800 (PST) In-Reply-To: References: <4EE7F6D6.1060801@apache.org>

From: Jakob Homan Date: Wed, 1 Feb 2012 11:17:10 -0800 Message-ID: Subject: Re: Getting started To: giraph-user@incubator.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org We need to update the wiki; it's out of date. Now we have bin/giraph to run user jars. Once you have the regular Giraph .tar.gz unpacked on your machine and your vertex jar somewhere: bin/giraph On Wed, Feb 1, 2012 at 11:09 AM, Shaunak Kashyap wr= ote: > Hi, > > I was able to run the shortest paths example as described > here:=A0https://cwiki.apache.org/confluence/display/GIRAPH/Shortest+Paths= +Example. > > After this I tried to create my own JAR containing a class similar > to=A0SimpleShortestPathsVertex=A0and a "lib" directory containing the > giraph-*.jar (obtained from the target/ directory after building from > source) and other dependent JARs. When I tried to run my JAR as a hadoop > job, I get the following errors: > > $ hadoop jar giraph-example-shortest-path-with-libs.jar > com.skyboximaging.janus.giraph.example.SkyboxShortestPathsVertex > shortestPathsInputGraph shortestPathsOutputGraph 0 3 > > 12/02/01 11:05:01 INFO mapred.JobClient: Running job: job_201111161517_14= 71 > 12/02/01 11:05:02 INFO mapred.JobClient: =A0map 0% reduce 0% > 12/02/01 11:05:07 INFO mapred.JobClient: Task Id : > attempt_201111161517_1471_m_000001_0, Status : FAILED > java.lang.IllegalStateException: run: Caught an unrecoverable exception > java.lang.RuntimeException: java.lang.ClassNotFoundException: > com.skyboximaging.janus.giraph.example.SkyboxShortestPathsVertex > =A0 =A0 =A0 =A0 at org.apache.giraph.graph.GraphMapper.run(GraphMapper.ja= va:650) > =A0 =A0 =A0 =A0 at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.= java:647) > =A0 =A0 =A0 =A0 at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323) > =A0 =A0 =A0 =A0 at org.apache.hadoop.mapred.Child$4.run(Child.java:270) > =A0 =A0 =A0 =A0 at java.security.AccessController.doPrivileged(Native Met= hod) > =A0 =A0 =A0 =A0 at javax.security.auth.Subject.doAs(Subject.java:396) > =A0 =A0 =A0 =A0 at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation= .java:1127) > =A0 =A0 =A0 =A0 at org.apache.hadoop.mapred.Child.main(Child.java:264) > Caused by: java.lang.RuntimeException: java.lang.RuntimeException: > java.lang.ClassNotFoundException: > com.skyboximaging.janus.giraph.example.SkyboxShortestPathsVertex > =A0 =A0 =A0 =A0 at > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1028) > =A0 =A0 =A0 =A0 at > org.apache.giraph.graph.BspUtils.getVertexClass(BspUtils.java:299) > > When I checked, the class does exist in my JAR, in the right path: > > $ jar tvf giraph-example-shortest-path-with-libs.jar | grep > SkyboxShortestPathsVertex > =A0 6029 Tue Jan 31 13:22:50 PST 2012 > com/skyboximaging/janus/giraph/example/SkyboxShortestPathsVertex.class > > Maybe this is yet another Hadoop issue (i.e. not specific to Giraph) but = I'd > appreciate any help with it. > > Thank you, > > Shaunak > > On Wed, Dec 14, 2011 at 6:57 AM, Shaunak Kashyap > wrote: >> >> Hi Avery, >> >> You're right; my error turned out to be a Hadoop issue which I have >> worked around now. Thanks for the official documentation link. >> >> Shaunak >> >> On Tue, Dec 13, 2011 at 5:07 PM, Avery Ching wrote: >> > Hi Shaunak, >> > >> > The official GIRAPH documentation is located at >> > https://cwiki.apache.org/confluence/display/GIRAPH/Index . =A0That bei= ng >> > said, >> > your error looks like a Hadoop issue. =A0Are you able to run normal Ha= doop >> > example jobs? >> > >> > Thanks, >> > >> > Avery >> > >> > >> > On 12/13/11 9:27 AM, Shaunak Kashyap wrote: >> >> >> >> Hi, >> >> >> >> Maybe this page - >> >> https://github.com/aching/Giraph/wiki/Quick-Start-Guide - is outdated >> >> but I tried following the instructions there and am getting the >> >> following error: >> >> >> >> shaunak@hadoop-1:~/Giraph$ hadoop jar >> >> target/giraph-0.70-jar-with-dependencies.jar >> >> org.apache.giraph.benchmark.PageRankBenchmark -h >> >> 11/12/13 09:25:08 FATAL conf.Configuration: error parsing conf file: >> >> javax.xml.parsers.ParserConfigurationException: Feature >> >> 'http://apache.org/xml/features/xinclude' is not recognized. >> >> Exception in thread "main" java.lang.RuntimeException: >> >> javax.xml.parsers.ParserConfigurationException: Feature >> >> 'http://apache.org/xml/features/xinclude' is not recognized. >> >> =A0 =A0 =A0 =A0 at >> >> >> >> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:= 1396) >> >> =A0 =A0 =A0 =A0 at >> >> >> >> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java= :1251) >> >> =A0 =A0 =A0 =A0 at >> >> org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1192= ) >> >> =A0 =A0 =A0 =A0 at >> >> org.apache.hadoop.conf.Configuration.get(Configuration.java:415) >> >> =A0 =A0 =A0 =A0 at org.apache.hadoop.util.RunJar.main(RunJar.java:143= ) >> >> Caused by: javax.xml.parsers.ParserConfigurationException: Feature >> >> 'http://apache.org/xml/features/xinclude' is not recognized. >> >> =A0 =A0 =A0 =A0 at >> >> >> >> org.apache.xerces.jaxp.DocumentBuilderFactoryImpl.newDocumentBuilder(= Unknown >> >> Source) >> >> =A0 =A0 =A0 =A0 at >> >> >> >> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:= 1282) >> >> =A0 =A0 =A0 =A0 ... 4 more >> >> >> >> What am I missing? >> >> >> >> Thank you, >> >> >> >> Shaunak >> >> >> > >> >> >> >> -- >> "Now the hardness of this world slowly grinds your dreams away / >> Makin' a fool's joke out of the promises we make" --- Bruce >> Springsteen, "Blood Brothers" > > > > > -- > "Now the hardness of this world slowly grinds your dreams away / Makin' a > fool's joke out of the promises we make" --- Bruce Springsteen, "Blood > Brothers"