mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <sro...@gmail.com>
Subject RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Date Mon, 31 Mar 2014 08:05:09 GMT
But you have a bunch of Hadoop 0.20 jars on your classpath! Definitely a
problem. Those should not be there.
On Mar 31, 2014 7:09 AM, "Phan, Truong Q" <Troung.Phan@team.telstra.com>
wrote:

> Yes, I did rebuild it.
>
> oracle@bpdevdmsdbs01: ----
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9
> -----
> $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
> -DskipTests=true
> [INFO] Scanning for projects...
> ....
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Mahout Build Tools ................................ SUCCESS [
>  8.215 s]
> [INFO] Apache Mahout ..................................... SUCCESS [
>  1.158 s]
> [INFO] Mahout Math ....................................... SUCCESS [16:21
> min]
> [INFO] Mahout Core ....................................... SUCCESS [26:21
> min]
> [INFO] Mahout Integration ................................ SUCCESS [03:55
> min]
> [INFO] Mahout Examples ................................... SUCCESS [02:54
> min]
> [INFO] Mahout Release Package ............................ SUCCESS [
>  0.084 s]
> [INFO] Mahout Math/Scala wrappers ........................ SUCCESS [01:16
> min]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 50:59 min
> [INFO] Finished at: 2014-03-31T14:25:27+10:00
> [INFO] Final Memory: 47M/250M
> [INFO]
> ------------------------------------------------------------------------
>
>
> Thanks and Regards,
> Truong Phan
>
>
> P    + 61 2 8576 5771
> M   + 61 4 1463 7424
> E    troung.phan@team.telstra.com
> W  www.telstra.com
>
>
> -----Original Message-----
> From: Andrew Musselman [mailto:andrew.musselman@gmail.com]
> Sent: Monday, 31 March 2014 2:44 PM
> To: user@mahout.apache.org
> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> Have you rebuilt Mahout for your version?  We're not supporting Hadoop
> version two yet.
>
> See here for some direction:
> http://mail-archives.us.apache.org/mod_mbox/mahout-user/201403.mbox/%3CCANg8BGD8Cm_=ESecQQ5mDL+6ybbNrR1Ce7i=PkuiMXMcktWgMg@mail.gmail.com%3E
>
> > On Mar 30, 2014, at 7:28 PM, "Phan, Truong Q" <
> Troung.Phan@team.telstra.com> wrote:
> >
> > Hi
> >
> > Does Mahout v0.9 supports Cloudera Hadoop v5 (2.2.0-cdh5.0.0-beta-1)?
> > I have managed to installed and run all test cases under the Mahout v0.9
> without any issue.
> > Please see below for the evident of the test cases.
> > However I have no success to run the example from
> http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.htmland got the following
errors.
> > Note: I have set the CLASSPATH to point to all of Mahout’s jar files.
> >
> > <snip>
> > $ env | grep CLASS
> > CLASSPATH=:/usr/lib/hadoop-0.20-mapreduce/lib:/usr/lib/hadoop-0.20-map
> > reduce/lib:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mah
> > out-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg001
> > /BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/ta
> > rget/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/
> > devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-sou
> > rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahou
> > t-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/st
> > g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/mat
> > h/target/mahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/
> > devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-sou
> > rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahou
> > t-distribution-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002/st
> > g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/int
> > egration/target/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1D/h
> > adoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/targe
> > t/mahout-integration-0.9-sources.jar
> >
> > $ export
> > MAHOUT_HOME=/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/ma
> > hout-distribution-0.9
> > $ export PATH=$MAHOUT_HOME/bin:$PATH
> >
> > oracle@bpdevdmsdbs01:BDMSSI1D1 ----
> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> > ution-0.9/nem-dms ----- $ mahout recommenditembased --input mydata.dat
> > --usersFile user.dat --numRecommendations 2 --output output/
> > --similarityClassname SIMILARITY_PEARSON_CORRELATION Running on
> > hadoop, using /usr/lib/hadoop-0.20-mapreduce/bin/hadoop and
> > HADOOP_CONF_DIR=
> > MAHOUT-JOB:
> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> > ution-0.9/examples/target/mahout-examples-0.9-job.jar
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/hadoop/util/PlatformName
> > Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.util.PlatformName
> >         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> >         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> >         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> > Could not find the main class: org.apache.hadoop.util.PlatformName.
>  Program will exit.
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/hadoop/util/RunJar Caused by:
> java.lang.ClassNotFoundException: org.apache.hadoop.util.RunJar
> >         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> >         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> >         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> > Could not find the main class: org.apache.hadoop.util.RunJar.  Program
> will exit.
> > </snip>
> >
> > <snip>
> > [INFO] --- maven-install-plugin:2.5.1:install (default-install) @
> > mahout-math-scala --- [INFO] Installing
> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> > ution-0.9/math-scala/target/mahout-math-scala-0.9.jar to
> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/ma
> > hout-math-scala-0.9.jar [INFO] Installing
> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> > ution-0.9/math-scala/pom.xml to
> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/ma
> > hout-math-scala-0.9.pom [INFO] Installing
> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> > ution-0.9/math-scala/target/mahout-math-scala-0.9-tests.jar to
> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/ma
> > hout-math-scala-0.9-tests.jar [INFO] Installing
> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> > ution-0.9/math-scala/target/mahout-math-scala-0.9-sources.jar to
> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/ma
> > hout-math-scala-0.9-sources.jar [INFO]
> > ----------------------------------------------------------------------
> > --
> > [INFO] Reactor Summary:
> > [INFO]
> > [INFO] Mahout Build Tools ................................ SUCCESS
> > [01:21 min] [INFO] Apache Mahout .....................................
> > SUCCESS [  6.898 s] [INFO] Mahout Math
> > ....................................... SUCCESS [17:39 min] [INFO]
> > Mahout Core ....................................... SUCCESS [  01:01
> > h] [INFO] Mahout Integration ................................ SUCCESS
> > [06:59 min] [INFO] Mahout Examples ...................................
> > SUCCESS [03:15 min] [INFO] Mahout Release Package
> > ............................ SUCCESS [  0.026 s] [INFO] Mahout
> > Math/Scala wrappers ........................ SUCCESS [03:39 min]
> > [INFO]
> > ----------------------------------------------------------------------
> > --
> > [INFO] BUILD SUCCESS
> > [INFO]
> > ----------------------------------------------------------------------
> > --
> > [INFO] Total time: 01:34 h
> > [INFO] Finished at: 2014-03-28T13:10:48+10:00 [INFO] Final Memory:
> > 49M/276M [INFO]
> > ----------------------------------------------------------------------
> > --
> > </snip>
> >
> > Thanks and Regards,
> > Truong Phan
> > Senior Technology Specialist
> > Database Engineering
> > Transport & Routing Engineering | Networks | Telstra Operations
> >
> > P    + 61 2 8576 5771
> > M   + 61 4 1463 7424
> > E    troung.phan@team.telstra.com
> > W  www.telstra.com
> > Love the movies? Telstra takes you there with $10 movie tickets, just
> > to say thanks. Available now at telstra.com/movies This communication
> may contain confidential or copyright information of Telstra Corporation
> Limited (ABN 33 051 775 556). If you are not an intended recipient, you
> must not keep, forward, copy, use, save or rely on this communication, and
> any such action is unauthorised and prohibited. If you have received this
> communication in error, please reply to this email to notify the sender of
> its incorrect delivery, and then delete both it and your reply.
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message