Mailing-List: contact mahout-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mahout-dev@lucene.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.fr;
  h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
  b=nIh4dylpjRUsE3+RNWCtJTxawnt+IGb8YzenF6Uz06JKdWWlW+1mDpx1FLyOWVju9s+gwJ6kWFwHq67kq0hpBgDesiQCLh38Q1oyjLpucNn5BD9+0mlxS3i5toUVmnUpcIL3NN6JXbSjTZvTSzwxm82Gl9ZK7IUPqMT8NxEKUiY=;
Message-ID: <714405.2099.qm@web26304.mail.ukl.yahoo.com>
Date: Tue, 18 Aug 2009 10:28:53 -0700 (PDT)
From: deneche abdelhakim <a_deneche@yahoo.fr>
Subject: Re: class not found bug ?
To: mahout-dev@lucene.apache.org
In-Reply-To: <8BD5DFE4-A577-42F7-B6BB-C521D7EBD9D3@apache.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

> Try 0.20.0.  Also, you may need to flatten the JOB jar=0A> into a single =
jar.=0A=0AMy example and Kmeans example Don't work on 0.20.0 without actual=
ly flattening the JOB jar. But as I wrote in my last post, there may be a s=
impler solution: modifying "maven/build.xml" seems to solve the problem, at=
 least for my examples and kmeans:=0A=0AIndex: maven/build.xml=0A=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A--- maven/build.xml    (revisi=
on 804891)=0A+++ maven/build.xml    (working copy)=0A@@ -45,9 +45,9 @@=0A  =
                 includes=3D"**/*.jar"/>=0A       <zipfileset dir=3D"${core=
-lib}" prefix=3D"lib"=0A                   includes=3D"**/*.jar" excludes=
=3D"hadoop-*.jar"/>=0A-      <zipfileset dir=3D"../core/target/" prefix=3D"=
lib" includes=3D"apache-mahout-core-${version}.jar"/>=0A+      <zipfileset =
dir=3D"../core/target/classes"/>=0A       <zipfileset dir=3D"${dest}/depend=
ency" prefix=3D"lib"=0A-                  includes=3D"**/*.jar"/>=0A+      =
            includes=3D"**/*.jar" excludes=3D"apache-mahout-core-${version}=
..jar"/>=0A       <zipfileset dir=3D"../core/target/dependency" prefix=3D"li=
b"=0A                   includes=3D"**/*.jar"/>=0A     </jar>=0A=0A=0A--- E=
n date de=A0: Lun 17.8.09, Grant Ingersoll <gsingers@apache.org> a =E9crit=
=A0:=0A=0A> De: Grant Ingersoll <gsingers@apache.org>=0A> Objet: Re: class =
not found bug ?=0A> =C0: mahout-dev@lucene.apache.org=0A> Date: Lundi 17 Ao=
=FBt 2009, 14h46=0A> =0A> On Aug 17, 2009, at 7:36 AM, deneche abdelhakim w=
rote:=0A> =0A> > I moved recently some of the "Decision Forest"=0A> example=
s from the core project to the examples project.=0A> While in core they wor=
ked perfectly in hadoop 0..19.1=0A> (pseudo-distributed), but now they don'=
t !!!=0A> =0A> Try 0.20.0.=A0 Also, you may need to flatten the JOB jar=0A>=
 into a single jar.=0A> =0A> =0A> > =0A> > For example, running my=0A> org.=
apache.mahout.df.BuildForest gives the following=0A> exception:=0A> > =0A> =
> ....=0A> > 09/08/17 12:02:36 INFO mapred.JobClient: Running job:=0A> job_=
200908171136_0020=0A> > 09/08/17 12:02:37 INFO mapred.JobClient:=A0 map 0%=
=0A> reduce 0%=0A> > 09/08/17 12:02:43 INFO mapred.JobClient: Task Id :=0A>=
 attempt_200908171136_0020_m_000000_0, Status : FAILED=0A> > java.lang.NoCl=
assDefFoundError:=0A> com/thoughtworks/xstream/XStream=0A> > =A0=A0=A0 at=
=0A> org.apache.mahout.utils.StringUtils.<clinit>(StringUtils.java:28)=0A> =
> =A0=A0=A0 at=0A> org.apache.mahout.df.mapred.Builder.getTreeBuilder(Build=
er.java:117)=0A> > =A0=A0=A0 at=0A> org.apache.mahout.df.mapred.MapredMappe=
r.configure(MapredMapper.java:74)=0A> > =A0=A0=A0 at=0A> org.apache.mahout.=
df.mapred.partial.Step1Mapper.configure(Step1Mapper.java:75)=0A> > =A0=A0=
=A0 at=0A> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.j=
ava:58)=0A> > =A0=A0=A0 at=0A> org.apache.hadoop.util.ReflectionUtils.newIn=
stance(ReflectionUtils.java:83)=0A> > ...=0A> > =0A> > =0A> > So I tried in=
stead to run one of mahout's : following=0A> the wiki, kmeans gives me the =
following error:=0A> > =0A> > ...=0A> > 09/08/17 11:59:27 INFO kmeans.KMean=
sDriver: Iteration=0A> 4=0A> > ...=0A> > 09/08/17 11:59:43 INFO kmeans.KMea=
nsDriver:=0A> Clustering=0A> > 09/08/17 11:59:43 INFO kmeans.KMeansDriver: =
Running=0A> Clustering=0A> > 09/08/17 11:59:43 INFO kmeans.KMeansDriver: In=
put:=0A> output/data Clusters In: output/clusters-4 Out:=0A> output/points =
Distance:=0A> org.apache.mahout.utils.EuclideanDistanceMeasure=0A> > 09/08/=
17 11:59:43 INFO kmeans.KMeansDriver:=0A> convergence: 0.5 Input Vectors:=
=0A> org.apache.mahout.matrix.SparseVector=0A> > 09/08/17 11:59:43 WARN map=
red.JobClient: Use=0A> GenericOptionsParser for parsing the arguments. Appl=
ications=0A> should implement Tool for the same.=0A> > 09/08/17 11:59:43 IN=
FO mapred..FileInputFormat: Total=0A> input paths to process : 2=0A> > 09/0=
8/17 11:59:43 INFO mapred.JobClient: Running job:=0A> job_200908171136_0019=
=0A> > 09/08/17 11:59:44 INFO mapred.JobClient:=A0 map 0%=0A> reduce 0%=0A>=
 > 09/08/17 11:59:54 INFO mapred.JobClient: Task Id :=0A> attempt_200908171=
136_0019_m_000000_0, Status : FAILED=0A> > java.lang.NoClassDefFoundError:=
=0A> com/google/gson/reflect/TypeToken=0A> > =A0=A0=A0 at=0A> java.lang.Cla=
ssLoader.defineClass1(Native Method)=0A> > =A0=A0=A0 at=0A> java.lang.Class=
Loader.defineClass(ClassLoader.java:637)=0A> > =A0=A0=A0 at=0A> java.securi=
ty.SecureClassLoader.defineClass(SecureClassLoader.java:142)=0A> > =A0=A0=
=A0 at=0A> java.net.URLClassLoader.defineClass(URLClassLoader.java:277)=0A>=
 > =A0=A0=A0 at=0A> java.net.URLClassLoader.access$000(URLClassLoader.java:=
73)=0A> > =A0=A0=A0 at=0A> java.net.URLClassLoader$1.run(URLClassLoader.jav=
a:212)=0A> > =A0=A0=A0 at=0A> java.security.AccessController.doPrivileged(N=
ative Method)=0A> > ...=0A> > =0A> > The problem seems related to the fact =
that=0A> mahout-core.jar is being packed inside examples.jar. So I=0A> modi=
fied maven/build.xml to pack the core classes instead=0A> (because they are=
 available):=0A> > =0A> > Index: maven/build.xml=0A> >=0A> =3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A> > --- maven/build.xml=A0=A0=A0 (re=
vision=0A> 804891)=0A> > +++ maven/build.xml=A0=A0=A0 (working copy)=0A> > =
@@ -45,9 +45,9 @@=0A> >=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=0A> =A0=A0=A0include=
s=3D"**/*.jar"/>=0A> >=A0 =A0 =A0=A0=A0<zipfileset=0A> dir=3D"${core-lib}" =
prefix=3D"lib"=0A> >=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=0A> =A0=A0=A0includes=
=3D"**/*.jar"=0A> excludes=3D"hadoop-*.jar"/>=0A> > -=A0 =A0 =A0 <zipfilese=
t=0A> dir=3D"../core/target/" prefix=3D"lib"=0A> includes=3D"apache-mahout-=
core-${version}.jar"/>=0A> > +=A0 =A0 =A0 <zipfileset=0A> dir=3D"../core/ta=
rget/classes"/>=0A> >=A0 =A0 =A0=A0=A0<zipfileset=0A> dir=3D"${dest}/depend=
ency" prefix=3D"lib"=0A> > -=A0 =A0 =A0 =A0 =A0 =A0 =A0=0A> =A0 =A0 include=
s=3D"**/*.jar"/>=0A> > +=A0 =A0 =A0 =A0 =A0 =A0 =A0=0A> =A0 =A0 includes=3D=
"**/*.jar"=0A> excludes=3D"apache-mahout-core-${version}.jar"/>=0A> >=A0 =
=A0 =A0=A0=A0<zipfileset=0A> dir=3D"../core/target/dependency" prefix=3D"li=
b"=0A> >=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=0A> =A0=A0=A0includes=3D"**/*.jar"/=
>=0A> >=A0 =A0=A0=A0</jar>=0A> > =0A> > This seems to solve the problem, bu=
t I didn't try it=0A> on all examples=0A> > =0A> > ________________________=
__________________________=0A> > Do You Yahoo!?=0A> > En finir avec le spam=
? Yahoo! Mail vous offre la=0A> meilleure protection possible contre les me=
ssages non=0A> sollicit=E9s=0A> > http://mail.yahoo.fr Yahoo! Mail=0A> > =
=0A> =0A> --------------------------=0A> Grant Ingersoll=0A> http://www.luc=
idimagination.com/=0A> =0A> Search the Lucene ecosystem=0A> (Lucene/Solr/Nu=
tch/Mahout/Tika/Droids) using Solr/Lucene:=0A> http://www.lucidimagination.=
com/search=0A> =0A> =0A=0A_________________________________________________=
_=0ADo You Yahoo!?=0AEn finir avec le spam? Yahoo! Mail vous offre la meill=
eure protection possible contre les messages non sollicit=E9s =0Ahttp://mai=
l.yahoo.fr Yahoo! Mail