mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "chungongyu (Issue Comment Edited) (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Edited] (MAHOUT-712) DisplaySpectralKMeans Example Surfaces FileNotFoundException in DistributedRowMatrix.times() Usage/Implementation
Date Fri, 20 Jan 2012 05:27:39 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13189619#comment-13189619
] 

chungongyu edited comment on MAHOUT-712 at 1/20/12 5:26 AM:
------------------------------------------------------------

hi, all
A simple way to solve this is to do as follows:

go to here, 
org.apache.mahout.clustering.spectral.common.VectorMatrixMultiplicationJob(line 84);


change
    return new DistributedRowMatrix(outputPath, new Path(outputPath, "tmp"), 
to
    return new DistributedRowMatrix(outputPath, new Path(outputPath, "_tmp"), 

                
      was (Author: chungongyu):
    hi, all
A simple way to solve this is to do as follows:

org.apache.mahout.clustering.spectral.common.VectorMatrixMultiplicationJob(line 84);


    return new DistributedRowMatrix(outputPath, new Path(outputPath, "tmp"), 

    return new DistributedRowMatrix(outputPath, new Path(outputPath, "_tmp"), 

                  
> DisplaySpectralKMeans Example Surfaces FileNotFoundException in DistributedRowMatrix.times()
Usage/Implementation
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: MAHOUT-712
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-712
>             Project: Mahout
>          Issue Type: Sub-task
>          Components: Clustering
>    Affects Versions: 0.5
>            Reporter: Jeff Eastman
>            Assignee: Shannon Quinn
>
> Not clear if this is due to SpectralKMeansDriver usage or an implementation issue deeper
inside. The error is repeatable:
> Exception in thread "main" java.lang.IllegalStateException: java.io.FileNotFoundException:
File file:/home/dev/workspace/mahout/output/calculations/laplacian-3/tmp/data does not exist.
>         at org.apache.mahout.math.hadoop.DistributedRowMatrix.times(DistributedRowMatrix.java:217)
>         at org.apache.mahout.math.decomposer.lanczos.LanczosSolver.solve(LanczosSolver.java:104)
>         at org.apache.mahout.math.hadoop.decomposer.DistributedLanczosSolver.runJob(DistributedLanczosSolver.java:70)
>         at org.apache.mahout.clustering.spectral.kmeans.SpectralKMeansDriver.run(SpectralKMeansDriver.java:155)
>         at org.apache.mahout.clustering.display.DisplaySpectralKMeans.main(DisplaySpectralKMeans.java:71)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
>         at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
>         at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:187)
> Caused by: java.io.FileNotFoundException: File file:/home/dev/workspace/mahout/output/calculations/laplacian-3/tmp/data
does not exist.
>         at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>         at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:51)
>         at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:201)
>         at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:810)
>         at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:781)
>         at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730)
>         at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1249)
>         at org.apache.mahout.math.hadoop.DistributedRowMatrix.times(DistributedRowMatrix.java:209)
>  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message