hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel Quach <danqu...@cs.ucla.edu>
Subject Re: Adding mahout math jar to hadoop mapreduce execution
Date Tue, 31 Jan 2012 07:10:34 GMT
I compiled using javac:

javac -classpath :/usr/local/hadoop/hadoop-core-0.20.203.0.jar:/usr/local/hadoop/lib/commons-cli-1.2.jar:/usr/local/mahout/math/target/mahout-math-0.6-SNAPSHOT.jar
-d makevector_classes/ MakeVector.java;

If I don't include the mahout-math jar, it gives me a compile error because of DenseVector.


On Jan 30, 2012, at 10:42 PM, Prashant Kommireddi wrote:

> How are you building the mapreduce jar? Try not to include the Mahout dist
> while building MR jar, and include it only on "-libjars" option.
> 
> On Mon, Jan 30, 2012 at 10:33 PM, Daniel Quach <danquach@cs.ucla.edu> wrote:
> 
>> I have been compiling my mapreduce with the jars in the classpath, and I
>> believe I need to also add the jars as an option to -libjars to hadoop.
>> However, even when I do this, I still get an error complaining about
>> missing classes at runtime. (Compilation works fine).
>> 
>> Here is my command:
>> hadoop jar makevector.jar org.myorg.MakeVector -libjars
>> /usr/local/mahout/math/target/mahout-math-0.6-SNAPSHOT.jar input/ output/
>> 
>> This is the error I receive:
>> Exception in thread "main" java.lang.NoClassDefFoundError:
>> org/apache/mahout/math/DenseVector
>> 
>> I wonder if I am using the GenericOptionsParser incorrectly? I'm not sure
>> if there is a deeper problem here.
>> 


Mime
View raw message