giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexandre Fonseca <alexandrejorgefons...@gmail.com>
Subject Re: Issue while executing SimpleShortestPathsComputation
Date Tue, 10 Dec 2013 10:00:14 GMT
GIRAPH-814 fixes the exception:

(GiraphApplicationMaster.java:main(442)) - GiraphApplicationMaster caught a t$
java.lang.NoClassDefFoundError: 
org/apache/hadoop/mapreduce/lib/output/TextOutputFormat

which you'd supposedly get after you solved your current problem with the 
GiraphApplicationMaster.

I see that you've already confirmed in a different mail that 
GiraphApplicationMaster is indeed inside your giraph-example.jar so the only 
thing that I can think of is that something might be wrong with your -yj 
parameter (can you put the entire command you use here please?) or something 
else is preventing Giraph from loading it.

Looking at the log that appears directly in your terminal when you run the 
hadoop jar command, do you see something like the following?

13/12/10 10:56:01 INFO yarn.GiraphYarnClient: LIB JARS :giraph-examples-1.1.0-
SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
13/12/10 10:56:01 INFO yarn.YarnUtils: Class path name .
13/12/10 10:56:01 INFO yarn.YarnUtils: base path checking .
13/12/10 10:56:01 INFO yarn.GiraphYarnClient: Made local resource for 
:/home/alex/Projects/giraph/example-runner/giraph-examples-1.1.0-SNAPSHOT-for-
hadoop-2.2.0-jar-with-dependencies.jar to 
hdfs://localhost/user/alex/giraph_yarn_jar_cache/application_1386669300464_0001/giraph-
examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
13/12/10 10:56:02 INFO yarn.YarnUtils: Registered file in LocalResources :: 
hdfs://localhost/user/alex/giraph_yarn_jar_cache/application_1386669300464_0001/giraph-
examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar


On Tuesday 10 December 2013 09:39:34 Rob Vesse wrote:
> Applying the GIRAPH-814 patch did not help for me
> 
> Even with the -yj argument (which fwiw I've been using all along) I still
> get GiraphApplicationMaster not found error
> 
> Rob
> 
> On 09/12/2013 21:45, "Alexandre Fonseca" <alexandrejorgefonseca@gmail.com>
> 
> wrote:
> >I have confirmed a bug in Giraph's YARN code related to the default
> >MapReduce
> >configuration. Either provide your own mapreduce.application.classpath in
> >mapred-site.xml or apply the patch described here:
> >https://issues.apache.org/jira/browse/GIRAPH-814
> >
> >Application runs successfully if using custom
> >mapreduce.application.classpath
> >or no default mapreduce.application.classpath + patch. Application fails
> >if
> >using default mapreduce.application.classpath and no patch.
> >
> >Cheers,
> >Alex
> >
> >On Monday 09 December 2013 22:05:20 Alexandre Fonseca wrote:
> >> mapreduce.application.classpath

Mime
View raw message