hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Lucene-hadoop Wiki] Update of "Hbase/HbaseArchitecture" by JimKellerman
Date Tue, 06 Feb 2007 06:56:34 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by JimKellerman:
http://wiki.apache.org/lucene-hadoop/Hbase/HbaseArchitecture

The comment on the change is:
Add table of contents

------------------------------------------------------------------------------
  This effort is still a "work in progress". Please feel free to add comments, but please
make them stand out by bolding or underlining them. Thanks!
  
+ = Table of Contents =
+ 
+  * [#masternode Master Node]
+  * [#chubby Distributed Lock Server]
+  * [#tabletserver Tablet Server]
+  * [#sstable SSTable]
+  * [#metadata METADATA Table]
+  * [#clientlib Client Library]
+  * [#schema Configuration / Schema Definition]
+  * [#api API]
+  * [#other Other]
+  * [#comments Comments]
+ 
+ [[Anchor(masternode)]]
  = Master Node =
  
   * Handles table creation and deletion
@@ -24, +38 @@

    * Scans METADATA table to find all tablets and adds those that have not been assigned
to the set of unassigned tablets
  
  
+ [[Anchor(chubby)]]
  = Distributed Lock Server - a ''Chubby'' clone =
  
   * [:DistributedLockServer:see also Hadoop Distributed Lock Server]
@@ -35, +50 @@

    1. To store access control lists
  
  
+ [[Anchor(tabletserver)]]
  = Tablet Server =
  
   * Manages and serves a set of Tablets (between 10 and 1000). A tablet is a row range of
the table sorted in lexographical order. Tablets comprise two types of data structures: One
or more on-disk structure called an SSTable, and one or more in-memory data structures called
memtable. Initially, a table consists of a single tablet.
@@ -111, +127 @@

     LoadTablet()
  }}}
  
+ [[Anchor(sstable)]]
  = SSTable =
  
   * Immutable (write-once)
@@ -143, +160 @@

  
  ''The consensus to date has been that !MapFile is a good enough approximation to start with
and optimization at this point is premature.''
  
+ [[Anchor(metadata)]]
  = METADATA Table =
  
   * Three-level heirarchy
@@ -177, +195 @@

   * ["Schema"]
  
  
+ [[Anchor(clientlib)]]
  = Client Library =
  
   * Caches tablet locations
@@ -185, +204 @@

   * Client library pre-fetches tablet locations by reading metadata for more than one tablet
whenever it reads the METADATA table.
  
  
+ [[Anchor(schema)]]
  = Configuration / Schema Definition =
  
   * Tablet Size
@@ -196, +216 @@

    * In Memory tuning parameter
    * Use Bloom Filter
  
+ [[Anchor(api)]]
  = API =
  
  {{{
@@ -219, +240 @@

    Increment IntegerCounter?
  }}}
  
+ [[Anchor(other)]]
  = Other =
  
   * Map/Reduce connector
   * Client Sawzall script execution in Tablet server space
  
+ [[Anchor(comments)]]
  = Comments =
  
  Please add comments about the architecture below. In the future, as this page grows too
big, it will be split into multiple sub-pages based on the architectural component. Applicable
comments will then be moved to that page. At that point, comments on this page should be related
to an overall architectural issue or one that spans multiple components. Thank you.

Mime
View raw message