mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Suneel Marthi <suneel_mar...@yahoo.com>
Subject Re: ArrayIndexOutOfBoundsException with mahout vectordump and cvb ?
Date Fri, 10 Jan 2014 00:12:42 GMT
The issue seems to be with ur dictionary. What is the length of dictionary?





On Thursday, January 9, 2014 6:49 PM, Yang <teddyyyy123@gmail.com> wrote:
 
I am trying to run the lda (now called cvb) function, I followed the steps
listed in many online sources. the final step after getting the lda result,
to show the result in a human-readable form is doing this vectordump, but
it gave me the following exception:

I also listed the first few bytes of my cvb output file, looks to be at
least not empty.

Thanks!
yang

sh-3.2$   bin/mahout vectordump -i MAHOUT/cvb/part-m-00000 --dictionary
sparse/dictionary.file-0 --dictionaryType sequencefile --vectorSize 10 -o
cvbout
Running on hadoop, using /apache/hadoop/bin/hadoop and HADOOP_CONF_DIR=
MAHOUT-JOB:
/home/yyang15/mahout/mahout-distribution-0.8/mahout-examples-0.8-job.jar
14/01/08 16:37:03 INFO common.AbstractJob: Command line arguments:
{--dictionary=[sparse/dictionary.file-0], --dictionaryType=[sequencefile],
--endPhase=[2147483647], --input=[MAHOUT/cvb/part-m-00000],
--output=[cvbout], --startPhase=[0], --tempDir=[temp], --vectorSize=[10]}
14/01/08 16:37:04 INFO vectors.VectorDumper: Sort? false
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 0
        at
org.apache.mahout.utils.vectors.VectorHelper$2.apply(VectorHelper.java:132)
        at
org.apache.mahout.utils.vectors.VectorHelper$2.apply(VectorHelper.java:129)
        at com.google.common.collect.Iterators$8.next(Iterators.java:812)
        at java.util.AbstractCollection.toArray(AbstractCollection.java:124)
        at java.util.ArrayList.<init>(ArrayList.java:131)
        at com.google.common.collect.Lists.newArrayList(Lists.java:119)
        at
org.apache.mahout.utils.vectors.VectorHelper.toWeightedTerms(VectorHelper.java:128)
        at
org.apache.mahout.utils.vectors.VectorHelper.vectorToJson(VectorHelper.java:147)
        at
org.apache.mahout.utils.vectors.VectorDumper.run(VectorDumper.java:240)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at
org.apache.mahout.utils.vectors.VectorDumper.main(VectorDumper.java:260)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
        at
org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
        at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:194)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:160)




SEQ^F
org.apache.hadoop.io.IntWritable%org.apache.mahout.math.VectorWritable^@^@^@^@^@^@%<D3>NX<97><A9><FD><BB>a;H<98>KȪ<82>^@^A!^G^@^@^@^D^@^@^@^@^C<A0>H=<B6>g<9C>O
<EF>^?<D8>=ˍ<8A><F1>-<AC>8=ɪA+<E0><F1>^R=<AC>-^Ck<BE>^Cm=<F4>p-<E0>ul<D3>=<BA><FE>H7T<F6>^B=<D7>E<EC><95>RH<A7>=<BB>U<DE>^B^Y"<F1>=<D9>WV^F"^P^Q=հ`^?8^N<F1>=<D6>b^YJ
<91><A0>$=<BB><94><F1><C6>^S?c=<B1><BA><88>^G<EB>i^P=<9B>^N>R<92><D2>q=<BA>^H,<9E>^_<B3><91>=<CE><ED>
i<C1>^FA=<F4>6<9F><A6><BF>^V[=<9F><E8>IN<A4>L<D5>=<B4><E5><F4>j
<83><A0>I=<F4>p<AB>֣%<80>=<A3>'^A<AB><8B>=<A9>=<A4>^V<DB>3<80>^M<B7>=<B5>A^SV^Eͺ?4
       ^K0^\<9D><BA>=<AA><86>l<8B><F4><E8>m^@^@^@^@^@^@^@^@=<C4>w^NjK<BF>
   =<AB>"^O;!<E0><F7>=<AF><BC>R<DC>-
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message