mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitriy Lyubimov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAHOUT-792) Add new stochastic decomposition code
Date Mon, 12 Sep 2011 00:16:08 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13102388#comment-13102388
] 

Dmitriy Lyubimov commented on MAHOUT-792:
-----------------------------------------

so, this is not fully committed yet? 

I don't see our version of CholeskyDecomposition class on the trunk (only apache-math's one).
Neighter do i think i can see the SequentialOutOfCoreSVD etc. that seems to be present in
the patch posted?

> Add new stochastic decomposition code
> -------------------------------------
>
>                 Key: MAHOUT-792
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-792
>             Project: Mahout
>          Issue Type: New Feature
>            Reporter: Ted Dunning
>         Attachments: MAHOUT-792.patch, MAHOUT-792.patch, sd-2.pdf
>
>
> I have figured out some simplification for our SSVD algorithms.  This eliminates the
QR decomposition and makes life easier.
> I will produce a patch that contains the following:
>   - a CholeskyDecomposition implementation that does pivoting (and thus rank-revealing)
or not.  This should actually be useful for solution of large out-of-core least squares problems.
>   - an in-memory SSVD implementation that should work for matrices up to about 1/3 of
available memory.
>   - an out-of-core SSVD threaded implementation that should work for very large matrices.
 It should take time about equal to the cost of reading the input matrix 4 times and will
require working disk roughly equal to the size of the input.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message