hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Lucene-hadoop Wiki] Trivial Update of "Hbase/ShellPlans" by udanax
Date Fri, 24 Aug 2007 23:39:32 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by udanax:
http://wiki.apache.org/lucene-hadoop/Hbase/ShellPlans

------------------------------------------------------------------------------
  R ([[-3.16227766, -4.42718872],
      [ 0.        , -0.63245553]])
  }}}
+ 
+ = Example Of Altools Use =
+ 
+ 
+ == Latent Semantic Analysis by SVD ==
+  * ~-'''NOTATION'''-~
+   * ~-''T,,0,,'' : orthogonal, unit-length columns-~
+   * ~-''D,,0,,'' : orthogonal, unit-length columns-~
+   * ~-''S,,0,,'' : eigenvalues of a diagonal matrix-~
+   * ~-''t'' : Row number of matrix X-~
+   * ~-''d'' : Column number of matrix X-~
+   * ~-''m'' : Rank of matrix X ( ≤ min(t,d) )-~
+ 
+ 
+ ||Row Key ||<-6>Column Families ||
+ ||<rowbgcolor="#ececec">term ||<-2> corpus: ||<-2>link: ||<-2>..
||
+ ||t01 ||corpus:c01 ||0 ||link:cnn.com ||1 ||.. ||.. ||
+ || ||corpus:c03 ||0 ||  ||  ||.. ||.. ||
+ ||t02 ||corpus:c01 ||1 || || ||.. ||.. ||
+ || ||corpus:c02 ||0 ||link:google.com  ||0  || || ||
+ ||.. ||.. ||.. ||.. ||.. ||.. ||.. ||
+ 
+ {{{
+ //Set up the matrix X
+ Hbase.altools > X = Matrix('t_table','corpus'); 
+ }}}
+ 
+  * ~-''w,,ij,, = tf,,ij,, '''·''' log( N/df,,j,, )''-~
+ 
+ ||<rowbgcolor="#ececec"> ||c01 ||c02 ||.. ||
+ ||<bgcolor="#ececec">t01 ||0.00 ||0.00 ||.. ||
+ ||<bgcolor="#ececec">t02 ||2.08 ||0.00 ||.. ||
+ ||<bgcolor="#ececec">.. ||.. ||.. ||.. ||
+ 
+ {{{
+ //Diagonal eigenvalue S
+ 
+ Hbase.altools > M = X.SVDecomposition(); 
+ Hbase.altools > S = M.getS();
+ }}}
+ 
+  * ~-''X = T,,0,,S,,0,,D,,0,,''-~
+ 
+ {{{
+ //Othonormal eigenvector T, D
+ 
+ Hbase.altools > T = M.getU();
+ Hbase.altools > D = M.getV();
+ }}}
+ 
+ Dimension reduction (k = 3)
  
  = Papers =
   * [http://www.uib.no/People/nmabh/art/hpj.pdf High performance numerical libraries in Java]

Mime
View raw message