Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id AD5B4200D09 for ; Tue, 12 Sep 2017 18:52:59 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id AC1231609C7; Tue, 12 Sep 2017 16:52:59 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id F15C81609B4 for ; Tue, 12 Sep 2017 18:52:58 +0200 (CEST) Received: (qmail 57622 invoked by uid 500); 12 Sep 2017 16:52:57 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 57610 invoked by uid 99); 12 Sep 2017 16:52:56 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Sep 2017 16:52:56 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 55920D36FE for ; Tue, 12 Sep 2017 16:52:56 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.879 X-Spam-Level: ** X-Spam-Status: No, score=2.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id HZOIyrfvrLaF for ; Tue, 12 Sep 2017 16:52:55 +0000 (UTC) Received: from mail-ua0-f181.google.com (mail-ua0-f181.google.com [209.85.217.181]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id E808260F06 for ; Tue, 12 Sep 2017 16:52:54 +0000 (UTC) Received: by mail-ua0-f181.google.com with SMTP id s15so15742577uag.1 for ; Tue, 12 Sep 2017 09:52:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=hLoc+EC1wFCI7rasH88mkSLpv/zgtZbnDw7Jwhkz7uU=; b=UPGr4s+JbY9tEu9V+q6C/0tv2TeMyS0Z8p1CvSJ1m8sPLYCRnxKHXGXc63f1/OePbk MD/M7VHP/sXDB+KcnLf6tTrv9OTV2um1l013OEjlGqb4jMz9+N+/+t3DerEjKb/lGAy6 IbWQSGkeD5SMxWdEPRzd9f0IbjrokxN40fS2FfJ3bFeT7pVNZs3ufuUIkjNddtpCpxkS 23FnljdAYc3lHCaadH1QdVNmxuNuKBr+L5iPwMf3liOreYAa6KYeEnacucqtWhWZy8/K OrdEmtpteJsLxdViUFjocgOtf0k70g4Iu9Xp0KG0w7cwXvtS+Yo1dl5vYYfK3VsbvBGP KJXA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=hLoc+EC1wFCI7rasH88mkSLpv/zgtZbnDw7Jwhkz7uU=; b=o4cUIU+9+zELJqR4X3UTZ0kFX2YZi8/98uZHSn2Pg5VImdIB1nmtD+jXzR83rc6Rs0 uY5vqAx42HBmv43KXizAhazyIiKzMgAbUc7Yy4q9QCyyF913EkxKCGjaxCWv9yz08Oxy 2MKrjg4Yec8QGbENsHqujgTC9EBlunuUSryxbis9T7pdmb/GatasSNGfBfxXwI803fdz nD8XKShjfy2eZ+nOWyyicf42wSoBjQAZV56U5fSh1gEL3xYnf6tCBPrQPRq9jvuySlKF aE1M8ajiLJrvHyL7rw9bArrmItOKVCZXsaUagXcta7GIrG+gzuujAvMEGBac90J29TlR GGaw== X-Gm-Message-State: AHPjjUjpJ++3XDzRoC/LTuDfmGl0Sbq+MWrTkIy7lFXLfKjVPogeHQY4 /y76yWDjMN9wInGwj95ErqoKDaKsKvdX X-Google-Smtp-Source: ADKCNb7AiZ7mXf/XWwzph444eeAfWKT42ADY7gLGXYmmGs++00+l61RZr+H4yUuaPH5PwLSQ5rTGO4Q8BX3QWS0pAQw= X-Received: by 10.176.69.243 with SMTP id u106mr12312853uau.22.1505235171912; Tue, 12 Sep 2017 09:52:51 -0700 (PDT) MIME-Version: 1.0 Received: by 10.176.27.84 with HTTP; Tue, 12 Sep 2017 09:52:51 -0700 (PDT) In-Reply-To: References: From: Arul Ramachandran Date: Tue, 12 Sep 2017 09:52:51 -0700 Message-ID: Subject: Re: Offheap config question for Hbase 1.1.2 To: user@hbase.apache.org Content-Type: multipart/alternative; boundary="94eb2c11be74b9b9aa055900dfdf" archived-at: Tue, 12 Sep 2017 16:52:59 -0000 --94eb2c11be74b9b9aa055900dfdf Content-Type: text/plain; charset="UTF-8" Thank you, Ram. >> So are you trying to use bucket cache feature in offheap mode with 1.1.2? Yes. >> So even in 0.98 you were using bucket cache in offheap mode? Yes, but it is a different hbase cluster and it run 0.98. The one I am trying to setup offheap cache is hbase 1.1.2 -arul On Tue, Sep 12, 2017 at 9:34 AM, ramkrishna vasudevan < ramkrishna.s.vasudevan@gmail.com> wrote: > Hi > > So are you trying to use bucket cache feature in offheap mode with 1.1.2? > If so then it is needed that the MaxDirectMemory is greater than the > offheap bucket cache size. > > If you are not using in offheap mode then probably there is no need for > MaxDirectMemory to be greater than bucket cache size. > > >>in Hbase 0.98, I had to set -XX:MaxDirectMemorySize less than > hbase.bucket.cache.size > So even in 0.98 you were using bucket cache in offheap mode? > > Regards > Ram > > On Tue, Sep 12, 2017 at 9:40 PM, Ted Yu wrote: > > > Looks like the config you meant should be hbase.bucketcache.size > > > > As the refguide says: > > > > A float that EITHER represents a percentage of total heap memory size to > > give to the cache (if < 1.0) OR, it is the total capacity in megabytes of > > BucketCache. Default: 0.0 > > > > If you specify the size as capacity, -XX:MaxDirectMemorySize should be > > bigger than the capacity. > > > > For #2, did you encounter some error ? > > > > Cheers > > > > On Tue, Sep 12, 2017 at 8:52 AM, Arul Ramachandran > > wrote: > > > > > In HBase 1.1.2, I am setting up bucket cache. I set MaxDirectMemory > size > > > greater than hbase.bucket.cache.size - only then it would work. > > > > > > 1) Does HBASE_REGIONSERVER_OPTS -XX:MaxDirectMemorySize needs to be > > greater > > > than hbase.bucket.cache.size? > > > 2) It seems with hbase 1.1.2, HBASE_MASTER_OPTS also needs the > > > -XX:MaxDirectMemorySize setting? > > > > > > IIRC, in Hbase 0.98, I had to set -XX:MaxDirectMemorySize less than > > > hbase.bucket.cache.size --and-- I did not have to set > > > -XX:MaxDirectMemorySize for HBASE_MASTER_OPTS. > > > > > > > > > Thanks, > > > Arul > > > > > > --94eb2c11be74b9b9aa055900dfdf--