hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Lucene-hadoop Wiki] Trivial Update of "HbaseShell" by udanax
Date Wed, 20 Jun 2007 01:22:16 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by udanax:
http://wiki.apache.org/lucene-hadoop/HbaseShell

------------------------------------------------------------------------------
+ [[TableOfContents(4)]]
+ ----
+ = Hbase Shell Introduction =
+ 
- Hbase Shell is an 'interpreter' (or 'shell)' to provide scalable data processing capabilities
like 
+ Hbase Shell is an 'interpreter' (or 'shell)' to provide scalable data processing capabilities
like  
  [[BR]]aggregation, algebraic calculation on Hadoop + Hbase.
  
  == Hbase Shell Goals ==
+ HBase Shell is developed to achieve the following goals.
  
+  * Generic Query Model Functions
- HBase Shell is developed to achieve the following goals. 
- 
-  * Generic Monitoring Function
-  * A Simplified Import/Export/Migrate Functionality Between different data sources (Hadoop,
HBase) 
+  * A Simplified Import/Export/Migrate Functionality Between different data sources (Hadoop,
HBase)
-  * A Simplified processing of a logical data model 
+  * A Simplified processing of a logical data model
-  * A Simplified algebraic operations 
+  * A Simplified algebraic operations
-   * Parallel Numerical Analysis by abstracting/numericalizing points, lines, or plane data
across multiple maps in HBase. 
+   * Parallel Numerical Analysis by abstracting/numericalizing points, lines, or plane data
across multiple maps in HBase.
  
  == Background ==
- 
- I expect Hadoop + Hbase to handle sparsity and data explosion very well in near future.
- [[BR]]Moreover, i believe the design of the multi-dimensional structure and the 3-dim space
model of the data are [[BR]]optimized for rapid ad-hoc information retrieval in any orientation,
as well as for fast, flexible calculation and transformation of [[BR]]raw data based on formulaic
relationships.
+ I expect Hadoop + Hbase to handle sparsity and data explosion very well in near future.
[[BR]]Moreover, i believe the design of the multi-dimensional structure and the 3-dim space
model of the data are [[BR]]optimized for rapid ad-hoc information retrieval in any orientation,
as well as for fast, flexible calculation and transformation of [[BR]]raw data based on formulaic
relationships.
  
  Then, I thought it would require a more user-friendly interface to enable querying the data
interactive. 
  [[BR]]So, I began building parallel processing shell  [[BR]]to help make general algebraic
and logical data modeling works easier on Hadoop + Hbase
  
    -- ''If you could give me an opinion on the above ideas, it would be great.''
  
- == Syntax Definition ==
+ == Rationale ==
  
- === Basic Commands ===
+ writing...
  
+ {{{
+ ... Bigtable takes care of all the data layout, compression, and access chores associated
with a large
+ data store. It presents the abstraction of a 2-dimensional table of data cells, with different
versions over time making up a third dimension ...
+ 
+ - Failure Trends in a Large Disk Drive Population (Google)
+ }}}
+ 
+ ----
+ = Hbase Shell Syntax Definition =
+ 
+ writing...
+ 
+ == Basic Commands ==
+ 
- ||<#ececec> '''Command''' ||<#ececec> '''Description''' ||
+ ||<#ececec> '''Command''' ||<#ececec> '''Explanation''' ||
- ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW
[TABLES]''-~ ||
+ ||SHOW ||<99%>'''Show''' command provides information about argument.[[BR]][[BR]]~-''SHOW
[TABLES]''-~ ||
- ||CREATE ||Creating a new table.[[BR]][[BR]]~-''CREATE table_name[[BR]]COLUMNFAMILIES('columnfamily_name1'[,
'columnfamily_name2', ...])[[BR]]LIMIT=limitNumber_of_Version;''-~ ||
+ ||CREATE ||'''Create''' will Creating a new table.[[BR]][[BR]]~-''CREATE table_name[[BR]]COLUMNFAMILIES('columnfamily_name1'[,
'columnfamily_name2', ...])[[BR]]LIMIT=limitNumber_of_Version;''-~ ||
- ||DROP ||Removing table or tables.[[BR]][[BR]]~-''DROP table_name1[, table_name2, ...];''-~
||
+ ||DROP ||'''Drop''' will droping column in a table or tables.[[BR]][[BR]]~-''DROP table_name1[,
table_name2, ...];''-~ ||
- ||SET ||Inserting or add a row of data into the table.[[BR]][[BR]]~-''SET table_name[[BR]]
VALUES('columnfamily_name:column_key','entry')[[BR]]WHERE row="row_key";''-~ ||
+ ||SET ||'''Set''' Inserting or add a row of data into the table.[[BR]][[BR]]~-''SET table_name[[BR]]
VALUES('columnfamily_name:column_key','entry')[[BR]]WHERE row="row_key";''-~ ||
- ||SELECT ||Query the Hbase and retrieve selected data.[[BR]][[BR]]~-''SELECT table_name[[BR]][WHERE
row="row_key"][[BR]][AND column="columnfamily_name:column_key"];[[BR]][AND time="Specified_Timestamp"];[[BR]][LIMIT=Number_of_Version];''-~
||
+ ||SELECT ||'''Select''' Query the Hbase and retrieve selected data.[[BR]][[BR]]~-''SELECT
table_name[[BR]][WHERE row="row_key"][[BR]][AND column="columnfamily_name:column_key"];[[BR]][AND
time="Specified_Timestamp"];[[BR]][LIMIT=Number_of_Version];''-~ ||
  
  === Basic Functions ===
  
+ ||<#ececec> '''Function''' ||<#ececec> '''Explanation''' ||
+ ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW
[TABLES]''-~ ||
+ ||... ||... ||
+ 
+ The Matrix commands are used to handle a 2D array of numerical data values.
+ [[BR]]A number of routines are provided to manipulate the matrix object directly, illustrated
below by simple examples.
+ 
+ '''Note''' that vectors should be defined as two-dimensional matrices to distinguish between
row and column vectors 
+ [[BR]]in order to be able to perform matrix operations consistently. 
+ 
- === Matrix Commands ===
+ == Matrix Commands ==
+ 
+ ||<#ececec> '''Command''' ||<#ececec> '''Explanation''' ||
+ ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW
[TABLES]''-~ ||
+ ||... ||... ||
  
  === Matrix Construction Functions ===
  
- === Matrix Operation Functions ===
+ ||<#ececec> '''Function''' ||<#ececec> '''Explanation''' ||
+ ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW
[TABLES]''-~ ||
+ ||... ||... ||
  
- === Analysis Functions ===
+ === Matrix Algebra Functions ===
  
- ==== Architecture ====
+ ||MULTIPLY ||'''Multiply''' will determine the product of two matrices. The number of columns
in the left matrix must match the number of rows in the right matrix.  ||
+ ||SUBTRACT ||'''Subtract''' will determine the difference of two matrices. The matrix may
be subtracted from itself, and the result matrix may be either of the two input matrices.
The right matrix is subtracted from the left matrix.  ||
+ ||SYMMETRIZE ||'''Symmetrize''' will symmetrize a real square matrix. If the result matrix
does not exist at the time of the command, it is created. If the result matrix does exist,
all previous information is lost. The result matrix may be the same as the input matrix. 
||
+ ||TRANSPOSE ||'''Transpose''' a matrix. If the result matrix does not exist at the time
of the command, it is created. If the result matrix does exist, all previous information is
lost. The result matrix may be the same as the input matrix, but results in a matrix filled
with zero-valued elements. ||
+ ||... ||... ||
+ 
+ ----
+ = Example Of Hbase Shell Use =
+ ..
+ == Basic Usage ==
+ ..
+ == Basic Matrix Operations ==
+ 
+ '''Not Good.... It Just writing =_=;'''
+ {{{
+ Hbase > A = Matrix(table_m,columnfamily_a);
+ Hbase > B = Matrix(table_m,columnfamily_b);
+ Hbase > A.random(2,2);
+ Hbase > B.random(2,2);
+ 
+ table_m
+ 
+        columnfamily_a             columnfamily_b         columnfamily_b
+       column_1 column_2          column_1 column_2      column_1 column_2
+ row_1    1       0	   row_1    0       2        row_1    3       3
+ row_2    0       0	   row_2    1       0        row_2    3       3
+ }}}
  
  
- == Involved ==
+ ----
+ = Matrix Extension Example On Hbase Shell =
+ ..
+ == Latent Semantic Analysis By Singular Value Decomposition ==
+ ..
+ == Scalable  Collaborative Filtering With A Large User-By-Item Matrix ==
+ ..
+ == Consistency Assessment Of Topological Relationship By Matrix-Union ==
+ .. 
  
+ ----
+ 
+ = People Involved =
+ 
-  * [wiki:udanax Edward Yoon] udanax@nhncorp.com
+  * [:udanax:Edward Yoon] udanax@nhncorp.com
   * Sewon Kim ebow31@gmail.com
   * Wonhyung Cha codeguru@hotmail.com
  

Mime
View raw message