hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "Matrix" by udanax
Date Tue, 29 Jan 2008 01:37:50 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by udanax:
http://wiki.apache.org/hadoop/Matrix

------------------------------------------------------------------------------
+ == Hbase Matrix Package for Map/Reduce-based Parallel Matrix Computations ==
+ 
+ The current shared-memory based parallel matrix solution provides a scalable and high performance
matrix operations, however, matrix resources can't be scalable. But, Using Hbase's Row,Column(Qualifier)
two dimensional space, we are able to store large sparse matrix. Also, The Auto-partitioned
sparsity sub-structure will be efficiently managed and serviced by Hbase. Row or Column operations
can be done in linear time and algorithms such as structured Gaussian elimination or iterative
methods run in '''O(~-the number of non-zero elements in the matrix-~)''' time.
+ 
+ === Initial Contributors ===
+ 
+  * [:udanax:Edward Yoon] (R&D center, NHN corp.)
+ 
+ === Applications ===
+ 
+ It can be support a broad variety of applications in the domain of Physics, Linear Algebra,

+ [[BR]]Computational Fluid Dynamics, Relational Algebra, Statistics, Graphics Rendering and
others.
+ 
+  * Scientific simulation and modeling 
+   * Matrix-vector/matrix-matrix multiply 
+   * Soving linear systems 
+  * Information retrieval 
+   * Sorting 
+   * Finding eigenvalues and eigenvectors 
+  * Computer graphics and computational geometry 
+   * Matrix multiply 
+   * computing matrix determinate 
+ 
+ === Download ===
+ 
+  * [http://wiki.apache.org/hadoop-data/attachments/Matrix/attachments/matrix-test_v0.0.1.tar
matrix-test_v0.0.1.tar]
+ 
+ Included List
+ 
+  * Matrix Addition/Substraction
+  * Matrix Multiplication
+  * Cholesky Decomposition
+ 
+ === Getting Start ===
  {{{
- bash-3.00# bin/hadoop jar ./build/contrib/hbase/hadoop-0.16.0-dev-hbase.jar org.apache.hadoop.hbase.matrix.ExampleDriver
multiply 4 4 2
+ bash-3.00# bin/hadoop jar ./lib/hadoop-0.16.0-dev-hbase.jar org.apache.hadoop.hbase.matrix.ExampleDriver
multiply 4 4 2
+ 
  Matrix Space initializing on Hbase.... Please wait.
  Create 4 by 4 Random Matrix A
  4.0     1.0     4.0     2.0
@@ -18, +53 @@

  Matrix Space initializing on Hbase.... Please wait.
  A * B multiplication start.
  08/01/29 10:16:51 INFO fs.DFSClient: Allocating new block
+ ...
- 08/01/29 10:16:51 INFO fs.DFSClient: pipeline = 127.0.0.1:50010
- 08/01/29 10:16:51 INFO fs.DFSClient: Connecting to 127.0.0.1:50010
- 08/01/29 10:16:51 INFO fs.DFSClient: Closing old block blk_7909691455912549989
- 08/01/29 10:16:51 INFO fs.DFSClient: Allocating new block
- 08/01/29 10:16:51 INFO fs.DFSClient: pipeline = 127.0.0.1:50010
- 08/01/29 10:16:51 INFO fs.DFSClient: Connecting to 127.0.0.1:50010
- 08/01/29 10:16:51 INFO fs.DFSClient: Closing old block blk_1750225628545418760
- 08/01/29 10:16:51 INFO fs.DFSClient: Allocating new block
- 08/01/29 10:16:51 INFO fs.DFSClient: pipeline = 127.0.0.1:50010
- 08/01/29 10:16:51 INFO fs.DFSClient: Connecting to 127.0.0.1:50010
- 08/01/29 10:16:51 INFO fs.DFSClient: Closing old block blk_-5881704470236878285
- 08/01/29 10:16:51 INFO mapred.JobClient: Running job: job_200801291012_0003
- 08/01/29 10:16:52 INFO mapred.JobClient:  map 0% reduce 0%
- 08/01/29 10:17:01 INFO mapred.JobClient:  map 100% reduce 0%
- 08/01/29 10:17:06 INFO mapred.JobClient:  map 100% reduce 100%
- 08/01/29 10:17:07 INFO mapred.JobClient: Job complete: job_200801291012_0003
- 08/01/29 10:17:07 INFO mapred.JobClient: Counters: 11
- 08/01/29 10:17:07 INFO mapred.JobClient:   Job Counters
- 08/01/29 10:17:07 INFO mapred.JobClient:     Launched map tasks=1
- 08/01/29 10:17:07 INFO mapred.JobClient:     Launched reduce tasks=1
- 08/01/29 10:17:07 INFO mapred.JobClient:   Map-Reduce Framework
- 08/01/29 10:17:07 INFO mapred.JobClient:     Map input records=4
- 08/01/29 10:17:07 INFO mapred.JobClient:     Map output records=16
- 08/01/29 10:17:07 INFO mapred.JobClient:     Map input bytes=0
- 08/01/29 10:17:07 INFO mapred.JobClient:     Map output bytes=2416
- 08/01/29 10:17:07 INFO mapred.JobClient:     Combine input records=0
- 08/01/29 10:17:07 INFO mapred.JobClient:     Combine output records=0
- 08/01/29 10:17:07 INFO mapred.JobClient:     Reduce input groups=4
- 08/01/29 10:17:07 INFO mapred.JobClient:     Reduce input records=16
  08/01/29 10:17:07 INFO mapred.JobClient:     Reduce output records=4
+ 
  Computation Time : (16.67 sec)
  Matrix C result.
  27.0    35.0    43.0    26.0

Mime
View raw message