hbase-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From st...@apache.org
Subject git commit: HBASE-11735 Document Configurable Bucket Sizes in bucketCache (Misty Stanley-Jones)
Date Tue, 19 Aug 2014 21:48:00 GMT
Repository: hbase
Updated Branches:
  refs/heads/master 8a52d58a7 -> 50f17935f

HBASE-11735 Document Configurable Bucket Sizes in bucketCache (Misty Stanley-Jones)

Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/50f17935
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/50f17935
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/50f17935

Branch: refs/heads/master
Commit: 50f17935fdd14bfe869f1267de754a80bb6ad1ef
Parents: 8a52d58
Author: stack <stack@apache.org>
Authored: Tue Aug 19 14:47:50 2014 -0700
Committer: stack <stack@apache.org>
Committed: Tue Aug 19 14:47:50 2014 -0700

 .../src/main/resources/hbase-default.xml        | 27 ++++++++++++++++++++
 src/main/docbkx/book.xml                        | 14 ++++++++++
 2 files changed, 41 insertions(+)

diff --git a/hbase-common/src/main/resources/hbase-default.xml b/hbase-common/src/main/resources/hbase-default.xml
index 0b46ee3..959c4e1 100644
--- a/hbase-common/src/main/resources/hbase-default.xml
+++ b/hbase-common/src/main/resources/hbase-default.xml
@@ -826,6 +826,33 @@ possible configurations would overwhelm and obscure the important.
           index block in a multi-level block index grows to this size, the
           block is written out and a new block is started.</description>
+    <property>
+    <name>hbase.bucketcache.ioengine</name>
+    <value></value>
+    <description>Where to store the contents of the bucketcache. One of: onheap, 
+      offheap, or file. If a file, set it to file:PATH_TO_FILE. See https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/io/hfile/CacheConfig.html
for more information.
+    </description>
+  </property>
+  <property>
+    <name>hbase.bucketcache.combinedcache.enabled</name>
+    <value>true</value>
+    <description>Whether or not the bucketcache is used in league with the LRU 
+      on-heap block cache. In this mode, indices and blooms are kept in the LRU 
+      blockcache and the data blocks are kept in the bucketcache.</description>
+  </property>
+  <property>
+    <name>hbase.bucketcache.size</name>
+    <value>65536</value>
+    <description>The size of the buckets for the bucketcache if you only use a single
+      Defaults to the default blocksize, which is 64 * 1024.</description>
+  </property>
+  <property>
+    <name>hbase.bucketcache.sizes</name>
+    <value></value>
+    <description>A comma-separated list of sizes for buckets for the bucketcache 
+      if you use multiple sizes. Should be a list of block sizes in order from smallest 
+      to largest. The sizes you use will depend on your data access patterns.</description>
+  </property>

diff --git a/src/main/docbkx/book.xml b/src/main/docbkx/book.xml
index dbf9029..3a4ff60 100644
--- a/src/main/docbkx/book.xml
+++ b/src/main/docbkx/book.xml
@@ -2384,6 +2384,20 @@ rs.close();
                 In other words, you configure the L1 LruBlockCache as you would normally,
                 as you would when there is no L2 BucketCache present.
+            <para><link xlink:href="https://issues.apache.org/jira/browse/HBASE-10641"
+                >HBASE-10641</link> introduced the ability to configure multiple
sizes for the
+              buckets of the bucketcache, in HBase 0.98 and newer. To configurable multiple
+              sizes, configure the new property <option>hfile.block.cache.sizes</option>
(instead of
+                <option>hfile.block.cache.size</option>) to a comma-separated
list of block sizes,
+              ordered from smallest to largest, with no spaces. The goal is to optimize the
+              sizes based on your data access patterns. The following example configures
buckets of
+              size 4096 and 8192.</para>
+            <screen language="xml"><![CDATA[
+  <name>hfile.block.cache.sizes</name>
+  <value>4096,8192</value>
+              ]]></screen>
             <note xml:id="direct.memory">
                 <title>Direct Memory Usage In HBase</title>
                 <para>The default maximum direct memory varies by JVM.  Traditionally
it is 64M

View raw message