hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Trivial Update of "Matrix" by udanax
Date Tue, 29 Jan 2008 06:32:07 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by udanax:
http://wiki.apache.org/hadoop/Matrix

------------------------------------------------------------------------------
  
  The matrix package will be useful for some of the Large-Scale Numeric Analysis and Data
Mining which need the computation system of the Inverse Matrix for Data Mining related area
(e.g. linear regression, PCA, SVM, ..., etc).
  
- The current shared-memory based parallel matrix solution provides a scalable and high performance
matrix operations, however, matrix resources can't be scalable. But, Using Hbase's Row,Column(Qualifier)
two dimensional space, we are able to store large sparse matrix. Also, The Auto-partitioned
sparsity sub-structure will be efficiently managed and serviced by Hbase. Row or Column operations
can be done in linear time and algorithms such as structured Gaussian elimination or iterative
methods run in O(~-the number of non-zero elements in the matrix-~ / ~-number of mappers (processors/cores)-~)
time on Map/Reduce.
+ Generally, The current shared-memory based parallel matrix solution provides a scalable
and high performance matrix operations, however, matrix resources can't be scalable. But,
Using Hbase's Row,Column(Qualifier) two dimensional space, we are able to store large sparse
matrix. Also, The Auto-partitioned sparsity sub-structure will be efficiently managed and
serviced by Hbase. Row or Column operations can be done in linear time and algorithms such
as structured Gaussian elimination or iterative methods run in O(~-the number of non-zero
elements in the matrix-~ / ~-number of mappers (processors/cores)-~) time on Map/Reduce.
  
  === Initial Contributors ===
  

Mime
View raw message