flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Till Rohrmann (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-1718) Add sparse vector and sparse matrix types to machine learning library
Date Wed, 18 Mar 2015 08:59:38 GMT
Till Rohrmann created FLINK-1718:
------------------------------------

             Summary: Add sparse vector and sparse matrix types to machine learning library
                 Key: FLINK-1718
                 URL: https://issues.apache.org/jira/browse/FLINK-1718
             Project: Flink
          Issue Type: Improvement
            Reporter: Till Rohrmann


Currently, the machine learning library only supports dense matrix and dense vectors. For
future algorithms it would be beneficial to also support sparse vectors and matrices.

I'd propose to use the compressed sparse column (CSC) representation, because it allows rather
efficient operations compared to a map backed sparse matrix/vector implementation. Furthermore,
this is also the format the Breeze library expects for sparse matrices/vectors. Thus, it is
easy to convert to a sparse breeze data structure which provides us with many linear algebra
operations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message