hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Lucene-hadoop Wiki] Trivial Update of "HbaseShell" by udanax
Date Wed, 20 Jun 2007 10:12:40 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by udanax:
http://wiki.apache.org/lucene-hadoop/HbaseShell

------------------------------------------------------------------------------
+ '''work in progress'''
+ 
  [[TableOfContents(4)]]
  ----
  = Hbase Shell Introduction =
@@ -8, +10 @@

  [[BR]]aggregation, algebraic calculation on Hadoop + Hbase.
  
  == Hbase Shell Goals ==
+ 
  HBase Shell is developed to achieve the following goals.
  
   * Generic Query Model Functions
   * A Simplified Import/Export/Migrate Functionality Between different data sources (Hadoop,
HBase)
   * A Simplified processing of a logical data model
   * A Simplified algebraic operations
-   * Parallel Numerical Analysis by abstracting/numericalizing points, lines, or plane data
across multiple maps in HBase.
+  * Parallel Numerical Analysis by abstracting/numericalizing points, lines, or plane data
across multiple maps in HBase.
  
  == Background ==
  I expect Hadoop + Hbase to handle sparsity and data explosion very well in near future.
[[BR]]Moreover, i believe the design of the multi-dimensional structure and the 3-dim space
model of the data are [[BR]]optimized for rapid ad-hoc information retrieval in any orientation,
as well as for fast, flexible calculation and transformation of [[BR]]raw data based on formulaic
relationships.
@@ -22, +25 @@

  Then, I thought it would require a more user-friendly interface to enable querying the data
interactive. 
  [[BR]]So, I began building parallel processing shell  [[BR]]to help make general algebraic
and logical data modeling works easier on Hadoop + Hbase
  
-   -- ''If you could give me an opinion on the above ideas, it would be great.''
- 
  == Rationale ==
+ ...
- 
- writing...
- 
- {{{
- ... Bigtable takes care of all the data layout, compression, and access chores associated
with a large
- data store. It presents the abstraction of a 2-dimensional table of data cells, with different
versions over time making up a third dimension ...
- 
- - Failure Trends in a Large Disk Drive Population (Google)
- }}}
  
  ----
  = Hbase Shell Syntax Definition =
  
- writing...
+ '''Note''' that Data should be located by their row, column, and timestamp.
  
  == Basic Commands ==
  
  ||<#ececec> '''Command''' ||<#ececec> '''Explanation''' ||
- ||SHOW ||<99%>'''Show''' command provides information about argument.[[BR]][[BR]]~-''SHOW
[TABLES]''-~ ||
+ ||SHOW ||<99%>'''Show''' command will list the tables.[[BR]][[BR]]~-''SHOW tables''-~
||
+ ||DESC ||'''Desc''' command will provides information about the columnfamilies in a table.[[BR]][[BR]]~-''DESC
table_name''-~ ||
- ||CREATE ||'''Create''' will Creating a new table.[[BR]][[BR]]~-''CREATE table_name[[BR]]COLUMNFAMILIES('columnfamily_name1'[,
'columnfamily_name2', ...])[[BR]]LIMIT=limitNumber_of_Version;''-~ ||
+ ||CREATE ||'''Create''' command will create a new table.[[BR]][[BR]]~-''CREATE table_name[[BR]]COLUMNFAMILIES('columnfamily_name1'[,
'columnfamily_name2', ...])[[BR]]LIMIT=limitNumber_of_Version;''-~ ||
- ||DROP ||'''Drop''' will droping column in a table or tables.[[BR]][[BR]]~-''DROP table_name1[,
table_name2, ...];''-~ ||
+ ||DROP ||'''Drop''' command will droping column in a table or tables.[[BR]][[BR]]~-''DROP
table_name1[, table_name2, ...];''-~ ||
- ||SET ||'''Set''' Inserting or add a row of data into the table.[[BR]][[BR]]~-''SET table_name[[BR]]
VALUES('columnfamily_name:column_key','entry')[[BR]]WHERE row="row_key";''-~ ||
- ||SELECT ||'''Select''' Query the Hbase and retrieve selected data.[[BR]][[BR]]~-''SELECT
table_name[[BR]][WHERE row="row_key"][[BR]][AND column="columnfamily_name:column_key"];[[BR]][AND
time="Specified_Timestamp"];[[BR]][LIMIT=Number_of_Version];''-~ ||
+ ||PRINT ||'''Print''' command will print a results to the console output. [[BR]][[BR]]~-''A
= array([1, 2, 3]);[[BR]]PRINT A;[[BR]]B = SELECT table_name WHERE row="rowKey";[[BR]]PRINT
B;''-~||
+ ||STORE ||'''STORE''' command will store results to specified table. [[BR]][[BR]]~-''M =
matrix('table_name','columnfamily_name');[[BR]]A = array([[1, 2],[3, 4]]);[[BR]]STORE A TO
M run_style;[[BR]]B = SELECT table_name WHERE row="row_key";[[BR]]STORE B TO ('table_name','columnfamily_name1'[,
'columnfamily_name2']) run_style;''-~||
  
+ And, Commands to manually manipulate data on more detailed parts.
+ 
+ 
+ ||<#ececec> '''Command''' ||<#ececec> '''Explanation''' ||
+ ||INSERT ||<99%>'''Insert''' command will insert one row into the table with a value
for specified column in the table.[[BR]][[BR]]~-''INSERT table_name[[BR]] VALUES('columnfamily_name:column_key','entry')[[BR]]WHERE
row="row_key";''-~ ||
+ ||SET ||'''SET''' command will change the values. [[BR]][[BR]]~-''SET table_name[[BR]] VALUES('columnfamily_name:column_key','entry')[[BR]]WHERE
row="row_key";''-~||
+ ||DELETE ||'''Delete''' command will delete specified rows in table. [[BR]][[BR]]~-''DELETE
table_name[[BR]]WHERE row="row_key"[[BR]][AND column="columnfamily_name:column_key"];''-~||
+ 
- === Basic Functions ===
+ === Aggregation Functions ===
+ 
+ ||<#ececec> '''Command''' ||<#ececec> '''Explanation''' ||
+ ||SELECT ||<99%>'''Select''' command will retrieves rows from a table.[[BR]][[BR]]~-''SELECT
table_name[[BR]][WHERE row="row_key"][[BR]][AND column="columnfamily_name:column_key"];[[BR]][AND
time="Specified_Timestamp"];[[BR]][LIMIT=Number_of_Version];''-~ ||
+ 
+ ...
  
  ||<#ececec> '''Function''' ||<#ececec> '''Explanation''' ||
- ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW
[TABLES]''-~ ||
- ||... ||... ||
+ ||... ||<99%>... ||
  
- The Matrix commands are used to handle a 2D array of numerical data values.
+ The Matrix commands are used to store a 2D array of numerical data values.
  [[BR]]A number of routines are provided to manipulate the matrix object directly, illustrated
below by simple examples.
  
  '''Note''' that vectors should be defined as two-dimensional matrices to distinguish between
row and column vectors 
  [[BR]]in order to be able to perform matrix operations consistently. 
  
- == Matrix Commands ==
- 
- ||<#ececec> '''Command''' ||<#ececec> '''Explanation''' ||
- ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW
[TABLES]''-~ ||
- ||... ||... ||
- 
  === Matrix Construction Functions ===
+ ..
- 
- ||<#ececec> '''Function''' ||<#ececec> '''Explanation''' ||
- ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW
[TABLES]''-~ ||
- ||... ||... ||
- 
  === Matrix Algebra Functions ===
+ ..
+ === Special functions ===
+ ..
- 
- ||<#ececec> '''Function''' ||<#ececec> '''Explanation''' ||
- ||SHOW ||<99%>Show command provides information about argument.[[BR]][[BR]]~-''SHOW
[TABLES]''-~ ||
- ||... ||... ||
  
  ----
  = Example Of Hbase Shell Use =
  ..
  == Basic Usage ==
  ..
- == Basic Matrix Operations ==
+ == Matrix Operations ==
  ..
+ 
  ----
  = Matrix Extension Example On Hbase Shell =
  ..
@@ -97, +93 @@

  .. 
  
  ----
- 
  = People Involved =
  
   * [:udanax:Edward Yoon] udanax@nhncorp.com

Mime
View raw message