mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shannon Quinn (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (MAHOUT-1159) Add SSVD option to SpectralKMeans
Date Mon, 11 Mar 2013 20:37:15 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13599237#comment-13599237
] 

Shannon Quinn edited comment on MAHOUT-1159 at 3/11/13 8:36 PM:
----------------------------------------------------------------

Excellent points, thanks. Here's a new patch with the suggested fixes, let me know if that
works.

The only reason I noticed the discrepancy in the documentation is SSVD in spectral k-means
was originally tested in standalone mode, and obviously the DistributedCache is not available
in that case.

Updated the patch: actually used the new parameters.
                
      was (Author: magsol):
    Excellent points, thanks. Here's a new patch with the suggested fixes, let me know if
that works.

The only reason I noticed the discrepancy in the documentation is SSVD in spectral k-means
was originally tested in standalone mode, and obviously the DistributedCache is not available
in that case.
                  
> Add SSVD option to SpectralKMeans
> ---------------------------------
>
>                 Key: MAHOUT-1159
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1159
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Clustering
>    Affects Versions: 0.8
>            Reporter: Shannon Quinn
>            Assignee: Shannon Quinn
>            Priority: Minor
>             Fix For: 0.8
>
>         Attachments: MAHOUT-1159.patch, MAHOUT-1159-ssvdopts.patch
>
>
> This adds SSVD as an option for eigensolver, in addition to the [default] Lanczos solver.
Testing indicated it yielded similar clustering accuracy with a possible performance boost.
> This patch includes other small fixes, such as using the default "tempDir" for intermediate
calculations.
> The initialization of the SSVD solver is a bit awkward, with specifying the number of
reducers. I hard-coded this at 10; is there a better solution? Perhaps making it an optional
parameter to the SSVD constructor?
> [Thanks to University of Pittsburgh CS undergraduates Andrew King, Pawan Solanki, and
Philip Schinis for working on this.]

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message