hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-953) Enable BLOCKCACHE by default [WAS -> Reevaluate HBASE-288 block caching work....?]
Date Sat, 25 Oct 2008 21:38:44 GMT

     [ https://issues.apache.org/jira/browse/HBASE-953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

stack updated HBASE-953:
------------------------

    Attachment: blockcache.patch

Commit comment below
{code}
HBASE-953 Enable BLOCKCACHE by default [WAS -> Reevaluate HBASE-288 block caching work....?]
Change that makes BLOCKCACHE on by default but caching blocks of 16k rather than 64k.
Means that upgrading, users must update their hbase-default.xml to pick up the smaller
value else OOME issues.  This patch may introduce OOME issues anyways.  Need to watch
out for it (Was find on 1.6.0_10 but on an early 1.7.0 was easy to OOME).  

This patch removes commons-collections.jar.  Was only added for its ReferenceMap which
is replaced in this patch by a version of what used to be called SoftSortedMap (renamed
as SoftValueSortedMap); the ReferenceMap replacement is SoftValueMap.  Use our own
because I want to be able to watch evictions if issues with OOMEs and RM is all private
when it runs the ReferenceQueue clean up (RM also had features we don't need).

M conf/hbase-default.xml
  Update hbase.hstore.blockCache.blockSize; make 16k instaed of 64k.
D  lib/commons-collections-3.2.jar
  Removed. Not used.
A  src/test/org/apache/hadoop/hbase/util/SoftValueSortedMapTest.java
  Rename of SoftSortedMapTest.
D src/test/org/apache/hadoop/hbase/util/SoftSortedMapTest.java
  Removed
M  src/java/org/apache/hadoop/hbase/HColumnDescriptor.java
  Enable blockcaching as default.
M  src/java/org/apache/hadoop/hbase/io/BlockFSInputStream.java
  Use SoftValueMap instead of ReferenceMap.
A  src/java/org/apache/hadoop/hbase/util/ReferenceQueueUtil.java
  ReferenceQueue utility class.
A src/java/org/apache/hadoop/hbase/util/SoftValueMap.java
  Like SoftValueSortedMap but not sorted (based on it).
A src/java/org/apache/hadoop/hbase/util/SoftValue.java
  Added.  Was internal class of SoftSortedMap.
A src/java/org/apache/hadoop/hbase/util/SoftValueSortedMap.java
  Rename of SoftSortedMap.
A src/java/org/apache/hadoop/hbase/util/SoftSortedMap.java
  Like SoftValueSortedMap but a plain Map.
M  src/java/org/apache/hadoop/hbase/client/HConnectionManager.java
  SoftSortedMap was renamed SoftValueSortedMap.
{code}

> Enable BLOCKCACHE by default [WAS -> Reevaluate HBASE-288 block caching work....?]
> ----------------------------------------------------------------------------------
>
>                 Key: HBASE-953
>                 URL: https://issues.apache.org/jira/browse/HBASE-953
>             Project: Hadoop HBase
>          Issue Type: Task
>            Reporter: stack
>            Priority: Critical
>             Fix For: 0.19.0
>
>         Attachments: blockcache.patch
>
>
> Go back and take another look at the Tom White work.  We've gotten boost in writing and
scanning because of J-D work.  HBASE-288 looks like it boosts sequential reads and perhaps
random read a little.  Take another look.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message