mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phan, Truong Q" <Troung.P...@team.telstra.com>
Subject RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Date Mon, 31 Mar 2014 06:09:09 GMT
Yes, I did rebuild it.

oracle@bpdevdmsdbs01: ---- /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9
-----
$ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1 -DskipTests=true
[INFO] Scanning for projects...
....
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Mahout Build Tools ................................ SUCCESS [  8.215 s]
[INFO] Apache Mahout ..................................... SUCCESS [  1.158 s]
[INFO] Mahout Math ....................................... SUCCESS [16:21 min]
[INFO] Mahout Core ....................................... SUCCESS [26:21 min]
[INFO] Mahout Integration ................................ SUCCESS [03:55 min]
[INFO] Mahout Examples ................................... SUCCESS [02:54 min]
[INFO] Mahout Release Package ............................ SUCCESS [  0.084 s]
[INFO] Mahout Math/Scala wrappers ........................ SUCCESS [01:16 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 50:59 min
[INFO] Finished at: 2014-03-31T14:25:27+10:00
[INFO] Final Memory: 47M/250M
[INFO] ------------------------------------------------------------------------


Thanks and Regards,
Truong Phan


P    + 61 2 8576 5771
M   + 61 4 1463 7424
E    troung.phan@team.telstra.com
W  www.telstra.com


-----Original Message-----
From: Andrew Musselman [mailto:andrew.musselman@gmail.com] 
Sent: Monday, 31 March 2014 2:44 PM
To: user@mahout.apache.org
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1

Have you rebuilt Mahout for your version?  We're not supporting Hadoop version two yet.

See here for some direction:  http://mail-archives.us.apache.org/mod_mbox/mahout-user/201403.mbox/%3CCANg8BGD8Cm_=ESecQQ5mDL+6ybbNrR1Ce7i=PkuiMXMcktWgMg@mail.gmail.com%3E

> On Mar 30, 2014, at 7:28 PM, "Phan, Truong Q" <Troung.Phan@team.telstra.com> wrote:
> 
> Hi
>  
> Does Mahout v0.9 supports Cloudera Hadoop v5 (2.2.0-cdh5.0.0-beta-1)?
> I have managed to installed and run all test cases under the Mahout v0.9 without any
issue.
> Please see below for the evident of the test cases.
> However I have no success to run the example from http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.html
and got the following errors.
> Note: I have set the CLASSPATH to point to all of Mahout’s jar files.
>  
> <snip>
> $ env | grep CLASS
> CLASSPATH=:/usr/lib/hadoop-0.20-mapreduce/lib:/usr/lib/hadoop-0.20-map
> reduce/lib:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mah
> out-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg001
> /BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/ta
> rget/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/
> devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-sou
> rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahou
> t-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/st
> g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/mat
> h/target/mahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/
> devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-sou
> rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahou
> t-distribution-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002/st
> g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/int
> egration/target/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1D/h
> adoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/targe
> t/mahout-integration-0.9-sources.jar
>  
> $ export 
> MAHOUT_HOME=/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/ma
> hout-distribution-0.9
> $ export PATH=$MAHOUT_HOME/bin:$PATH
>  
> oracle@bpdevdmsdbs01:BDMSSI1D1 ---- 
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> ution-0.9/nem-dms ----- $ mahout recommenditembased --input mydata.dat 
> --usersFile user.dat --numRecommendations 2 --output output/ 
> --similarityClassname SIMILARITY_PEARSON_CORRELATION Running on 
> hadoop, using /usr/lib/hadoop-0.20-mapreduce/bin/hadoop and 
> HADOOP_CONF_DIR=
> MAHOUT-JOB: 
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> ution-0.9/examples/target/mahout-examples-0.9-job.jar
> Exception in thread "main" java.lang.NoClassDefFoundError: 
> org/apache/hadoop/util/PlatformName
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: org.apache.hadoop.util.PlatformName.  Program will exit.
> Exception in thread "main" java.lang.NoClassDefFoundError: 
> org/apache/hadoop/util/RunJar Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.RunJar
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: org.apache.hadoop.util.RunJar.  Program will exit.
> </snip>
>  
> <snip>
> [INFO] --- maven-install-plugin:2.5.1:install (default-install) @ 
> mahout-math-scala --- [INFO] Installing 
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> ution-0.9/math-scala/target/mahout-math-scala-0.9.jar to 
> /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/ma
> hout-math-scala-0.9.jar [INFO] Installing 
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> ution-0.9/math-scala/pom.xml to 
> /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/ma
> hout-math-scala-0.9.pom [INFO] Installing 
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> ution-0.9/math-scala/target/mahout-math-scala-0.9-tests.jar to 
> /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/ma
> hout-math-scala-0.9-tests.jar [INFO] Installing 
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> ution-0.9/math-scala/target/mahout-math-scala-0.9-sources.jar to 
> /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/ma
> hout-math-scala-0.9-sources.jar [INFO] 
> ----------------------------------------------------------------------
> --
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Mahout Build Tools ................................ SUCCESS 
> [01:21 min] [INFO] Apache Mahout ..................................... 
> SUCCESS [  6.898 s] [INFO] Mahout Math 
> ....................................... SUCCESS [17:39 min] [INFO] 
> Mahout Core ....................................... SUCCESS [  01:01 
> h] [INFO] Mahout Integration ................................ SUCCESS 
> [06:59 min] [INFO] Mahout Examples ................................... 
> SUCCESS [03:15 min] [INFO] Mahout Release Package 
> ............................ SUCCESS [  0.026 s] [INFO] Mahout 
> Math/Scala wrappers ........................ SUCCESS [03:39 min] 
> [INFO] 
> ----------------------------------------------------------------------
> --
> [INFO] BUILD SUCCESS
> [INFO] 
> ----------------------------------------------------------------------
> --
> [INFO] Total time: 01:34 h
> [INFO] Finished at: 2014-03-28T13:10:48+10:00 [INFO] Final Memory: 
> 49M/276M [INFO] 
> ----------------------------------------------------------------------
> --
> </snip>
>  
> Thanks and Regards,
> Truong Phan
> Senior Technology Specialist
> Database Engineering
> Transport & Routing Engineering | Networks | Telstra Operations
> 
> P    + 61 2 8576 5771
> M   + 61 4 1463 7424
> E    troung.phan@team.telstra.com
> W  www.telstra.com
> Love the movies? Telstra takes you there with $10 movie tickets, just 
> to say thanks. Available now at telstra.com/movies This communication may contain confidential
or copyright information of Telstra Corporation Limited (ABN 33 051 775 556). If you are not
an intended recipient, you must not keep, forward, copy, use, save or rely on this communication,
and any such action is unauthorised and prohibited. If you have received this communication
in error, please reply to this email to notify the sender of its incorrect delivery, and then
delete both it and your reply.
>  
>  
Mime
View raw message