mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Suneel Marthi <suneel_mar...@yahoo.com>
Subject Re: MAHOUT 0.9 Release - New URL
Date Mon, 20 Jan 2014 13:06:35 GMT
Hmmm... that's an issue. Since both Dirichlet and Meanshift clustering have been removed from
0.9, cluster-syntheticcontrol.sh options 4,5 are not gonna work and should have been removed
for 0.9.

To PMC,

 -> rollback the release, fix this issue (and other patches that were submitted in the
last few days) and put out another release ?







On Monday, January 20, 2014 12:33 AM, Andrew Palumbo <ap.dev@outlook.com> wrote:
 
I ran through the tests with on a CentOS VM AMD64 2 cores 4 GB RAM.  Had a bit of trouble
getting the Hadoop natives to compile and therefore may have run into some problems because
of the hadoop setup.  Ran into some problems in the example scripts.  Particularly with
./cluster-syntheticcontrol.sh ->4,5.  I will run through the rest of the examples when
im sure I've got hadoop setup right.


Apache Maven 3.1.2-SNAPSHOT 
Java version: 1.6.0_45, vendor: Sun Microsystems Inc.
Java home: /usr/java/jdk1.6.0_45/jre
OS name: "linux", version: "2.6.32-358.23.2.el6.x86_64", arch: "amd64", family: "unix"
$MAHOUT_LOCAL=true
Hadoop 2.2.0


a) Verify that u can unpack the release (tar or zip) ...passed (tar) [passed ]

b) Verify u r able to compile the distro

    mvn compile- [passed with warnings]

    [WARNING]  Expected all dependencies to require Scala version: 2.9.3
    [WARNING]  org.apache.mahout:mahout-math-scala:0.9 requires scala version: 2.9.3
    [WARNING]  org.scalatest:scalatest_2.9.2:1.9.1 requires scala version: 2.9.2
    [WARNING] Multiple versions of scala libraries detected!

c)  Run through the unit tests: mvn clean test
    mvn clean test [passed]

d) Run the example scripts under $MAHOUT_HOME/examples/bin. 
Please run through all the different options in each script

    Running example scripts with $MAHOUT_LOCAL=true

    ./cluster-syntheticcontrol.sh ->1 [works]
    ./cluster-syntheticcontrol.sh ->2 [works]
    ./cluster-syntheticcontrol.sh ->3 [works]


    ./cluster-syntheticcontrol.sh ->4 [exits, throws exception]
    [...]
    WARNING: Unable to add class: org.apache.mahout.clustering.syntheticcontrol.dirichlet.Job
    java.lang.ClassNotFoundException: org.apache.mahout.clustering.syntheticcontrol.dirichlet.Job
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:171)
        at org.apache.mahout.driver.MahoutDriver.addClass(MahoutDriver.java:237)
        at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:128)
    Jan 19, 2014 7:55:31 PM org.slf4j.impl.JCLLoggerAdapter warn


    ./cluster-syntheticcontrol.sh ->5 [exits, throws exception]

    WARNING: Unable to add class: org.apache.mahout.clustering.syntheticcontrol.meanshift.Job
    java.lang.ClassNotFoundException: org.apache.mahout.clustering.syntheticcontrol.meanshift.Job
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:171)
        at org.apache.mahout.driver.MahoutDriver.addClass(MahoutDriver.java:237)
        at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:128)
    Jan 19, 2014 7:59:51 PM org.slf4j.impl.JCLLoggerAdapter warn
    WARNING: No org.apache.mahout.clustering.syntheticcontrol.meanshift.Job.props found
on classpath, will use command-line arguments only
    Unknown program 'org.apache.mahout.clustering.syntheticcontrol.meanshift.Job' chosen.


    ./classify-20newsgroups.sh ->1 [works]
    ./classify-20newsgroups.sh ->2 [works]


    cluster-reuters.sh ->1 [works]
    cluster-reuters.sh ->2 [works]
    cluster-reuters.sh ->3 [works]
    
    Same error as noted previosly in the thread:

    cluster-reuters.sh ->4 [0 clusters]

    [...]

    WARNING: No qualcluster.props found on classpath, will use command-line arguments only
    Num clusters: 0; maxDistance: 0.000000
    [Dunn Index] First: Infinity
    [Davies-Bouldin Index] First: NaN
    Jan 19, 2014 7:13:57 PM org.slf4j.impl.JCLLoggerAdapter info
    INFO: Program took 669 ms (Minutes: 0.01115)
    cluster,distance.mean,distance.sd,distance.q0,distance.q1,distance.q2,distance.q3,distance.q4,count,is.train






> Date: Thu, 16 Jan 2014 06:41:09 -0800
> From: suneel_marthi@yahoo.com
> Subject: MAHOUT 0.9 Release - New URL 
> To: user@mahout.apache.org; dev@mahout.apache.org
> 
> Third time's a Charm!!!
> 
> 
> Here's the new URL for Mahout 0.9 Release:
> https://repository.apache.org/content/repositories/orgapachemahout-1002/org/apache/mahout/mahout-distribution/0.9/
> 
> For those volunteering to test this, some of the things to be verified:
> 
> a) Verify that u can unpack the release (tar or zip)
> b) Verify u r able to compile the distro
> c)  Run through the unit tests: mvn clean test
> d) Run the example scripts under $MAHOUT_HOME/examples/bin. Please run through all the
different options in each script.
>      
> 
> Committers
>  and PMC members:
> ---------------------------------------
> 
> Need 'at least 3 +1 votes' for the Release to pass. 
> 
> 
> Thanks and Regards.
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message