Return-Path: 
 <user-return-49749-apmail-hbase-user-archive=hbase.apache.org@hbase.apache.org>
X-Original-To: apmail-hbase-user-archive@www.apache.org
Delivered-To: apmail-hbase-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 7DA4517567
	for <apmail-hbase-user-archive@www.apache.org>;
 Tue,  6 Oct 2015 20:03:29 +0000 (UTC)
Received: (qmail 44574 invoked by uid 500); 6 Oct 2015 20:03:27 -0000
Delivered-To: apmail-hbase-user-archive@hbase.apache.org
Received: (qmail 44509 invoked by uid 500); 6 Oct 2015 20:03:27 -0000
Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hbase.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hbase.apache.org>
List-Post: <mailto:user@hbase.apache.org>
List-Id: <user.hbase.apache.org>
Reply-To: user@hbase.apache.org
Delivered-To: mailing list user@hbase.apache.org
Received: (qmail 44498 invoked by uid 99); 6 Oct 2015 20:03:27 -0000
Received: from mail-relay.apache.org (HELO mail-relay.apache.org)
 (140.211.11.15)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Oct 2015 20:03:27 +0000
Received: from mail-wi0-f176.google.com (mail-wi0-f176.google.com
 [209.85.212.176])
	by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with
 ESMTPSA id 4EAD81A0163
	for <user@hbase.apache.org>; Tue,  6 Oct 2015 20:03:27 +0000 (UTC)
Received: by wicfx3 with SMTP id fx3so174587941wic.0
        for <user@hbase.apache.org>; Tue, 06 Oct 2015 13:03:26 -0700 (PDT)
X-Received: by 10.180.86.100 with SMTP id o4mr6221970wiz.59.1444161806154;
 Tue, 06 Oct 2015 13:03:26 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.28.151.77 with HTTP; Tue, 6 Oct 2015 13:03:06 -0700 (PDT)
In-Reply-To: 
 <CAFFn_SvWrxUw-QpB8bqf=AkpkFzZ0d4qF1uGjt5U2QR7DWYVCA@mail.gmail.com>
References: 
 <CAFFn_SvWrxUw-QpB8bqf=AkpkFzZ0d4qF1uGjt5U2QR7DWYVCA@mail.gmail.com>
From: Nick Dimiduk <ndimiduk@apache.org>
Date: Tue, 6 Oct 2015 13:03:06 -0700
Message-ID: 
 <CANZa=GssYbRz_8LiYjQLoWjem6-nhxqvPwDbnqsZ1iEkccsPhA@mail.gmail.com>
Subject: Re: hbase.bucketcache.percentage.in.combinedcache with ioengine=<FILE
 ON SSD> on HBase 0.98
To: hbase-user <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=f46d04428e247445770521751f87

--f46d04428e247445770521751f87
Content-Type: text/plain; charset=UTF-8

Configuring offheap cache in 0.98 is a huge PITA. There are some example
configs [0] linked from my old blog post [1], maybe that's a starting
point? I also worked with our docs team to get this explained [2] in a
somewhat useful way, using an algorithm/formula as the basis of the
explanation. That algorithm was eventually implemented into Ambari's Stack
Advisor script [3], so if you're really feeling brave you can try to
extract it from there.

But really, you should upgrade to 1.x and enjoy Stack's nice work on making
it simpler to configure.

Good luck,
-n

[0]: https://github.com/ndimiduk/perf_blockcache
[1]: http://www.n10k.com/blog/blockcache-showdown/
[2]:
http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Sys_Admin_Guides/content/ref-db219cd6-c586-49c1-bc56-c9c1c5475276.1.html
[3]:
https://github.com/apache/ambari/blob/trunk/ambari-server/src/main/resources/stacks/HDP/2.2/services/stack_advisor.py#L552-L579

On Tue, Oct 6, 2015 at 11:36 AM, Anthony Nguyen <anthony.an.nguyen@gmail.com
> wrote:

> Hi all,
>
> I'm running HBase 0.98, with the complicated percentage.in.combinedcache
> setting. What's the best way to set the percentage.in.combinedcache setting
> when using a file on SSD storage as the location for ioengine? The SSD
> drive is dedicated for the cache. I don't want to modify the LruBlockCache
> settings at all, keeping it available for index + bloom and just add the L2
> SSD cache for storage for the data blocks (not the raw L1+L2 method).
>
> My confusion is in how I should best modify the percentage.in.combinedcache
> setting. HBASE-11520 makes things much clearer, but unfortunately it isn't
> in 0.98. To me, it doesn't make much sense to have L1 be set to
> hbase.bucketcache.size (100G) * (1.0 -
> hbase.bucketcache.percentage.in.combinedcache (default=0.9) = 1G when I
> want the L1 to be the same as it was prior to bucketcache
> (hfile.block.cache.size * heap).
>
> Also, I don't want to have any direct addressing of memory since my offheap
> is completely on SSD. Does this mean I shouldn't change
> XX:MaxDirectMemorySize?
>
> Could someone sanity check these settings for me? Thanks!
>
> 30 GB RAM
> ~120 GB SSD
> HBASE_REGIONSERVER_OPTS -Xms17G -Xmx17G
> XX:MaxDirectMemorySize <- Don't touch since we're not using direct byte
> buffers, right?
>
> <property>
>   <name>hbase.bucketcache.ioengine</name>
>   <value>file:/mnt/foo/bar</value>
> </property>
> <property>
>   <name>hbase.bucketcache.percentage.in.combinedcache</name>
>   <value>0.9</value>
> </property>
>
> <property>
>   <name>hfile.block.cache.size</name>
>   <value>0.6</value>
> </property>
>
> <property>
>   <name>hbase.bucketcache.size</name>
>   <value>102400</value>
> </property>
>

--f46d04428e247445770521751f87--