mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fernando Fernández <fernando.fernandez.gonza...@gmail.com>
Subject Re: Lanczos Algorithm
Date Thu, 25 Nov 2010 23:04:57 GMT
Yes, I'm using maven, so I don't understand it either. Here's the last
exception I got:

10/11/25 20:29:28 INFO lanczos.LanczosSolver: Finding 10 singular vectors of
matrix with 6 rows, via Lanczos

10/11/25 20:29:28 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable

10/11/25 20:29:28 INFO compress.CodecPool: Got brand-new decompressor

ERROR CAUSE: java.io.IOException: wrong key class:
org.apache.hadoop.io.IntWritable is not class
org.apache.hadoop.io.LongWritable

java.lang.IllegalStateException: java.io.IOException: wrong key class:
org.apache.hadoop.io.IntWritable is not class
org.apache.hadoop.io.LongWritable

        at
org.apache.mahout.math.hadoop.DistributedRowMatrix$DistributedMatrixIterator.hasNext(DistributedRowMatrix.java:230)

        at
org.apache.mahout.math.decomposer.lanczos.LanczosSolver.getInitialVector(LanczosSolver.java:194)

        at
org.apache.mahout.math.decomposer.lanczos.LanczosSolver.solve(LanczosSolver.java:107)

        at #########################################################

Caused by: java.io.IOException: wrong key class:
org.apache.hadoop.io.IntWritable is not class
org.apache.hadoop.io.LongWritable

        at
org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1824)

        at
org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1876)

        at
org.apache.mahout.math.hadoop.DistributedRowMatrix$DistributedMatrixIterator.hasNext(DistributedRowMatrix.java:221)

        ... 3 more


The ###... line is just the name of my project.

2010/11/25 Ted Dunning <ted.dunning@gmail.com>

> Mahout-math is a separate dependency.  If you are using maven, the second
> order dependency should be picked up automagically.  If you are using
> maven,
> I don't understand why the build wouldn't pick it up automatically.
>
> 2010/11/25 Fernando Fernández <fernando.fernandez.gonzalez@gmail.com>
>
> > Hi again Jake,
> >
> > I'm having a lot of problems trying to use the DistributedLanczosSolver
> > class directly. I get ClassNotFound exceptions for
> > org.apache.mahout.math.vector, but svd seems to execute perfectly when I
> > use
> > it on the command line (The only problem is that I only get printed
> > eigenvalues and I need them to do the extra multiplications you mentioned
> > before). Can you tell which .java file or source code generates the job
> > under "mahout svd" command so I can compare it to my code and see if i'm
> > missing something that causes the exception? If I have this code, I just
> > need to add the lines needed to persist eigenvalues.
> >
> > Best,
> > Fernando.
> >
> > 2010/11/24 Jake Mannix <jake.mannix@gmail.com>
> >
> > > 2010/11/24 Fernando Fernández <fernando.fernandez.gonzalez@gmail.com>
> > >
> > > > Sorry jake,
> > > >
> > > > What do you mean by "length", do you mean the norm of the vector?
> > > >
> > >
> > > yes.
> > >
> > >  -jake
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message