Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B3A07200C63 for ; Wed, 26 Apr 2017 13:49:10 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id B222F160B95; Wed, 26 Apr 2017 11:49:10 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 0820D160BA8 for ; Wed, 26 Apr 2017 13:49:09 +0200 (CEST) Received: (qmail 83343 invoked by uid 500); 26 Apr 2017 11:49:07 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 83331 invoked by uid 99); 26 Apr 2017 11:49:07 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Apr 2017 11:49:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 15B76C0C98 for ; Wed, 26 Apr 2017 11:49:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id HM3UXBZXmHYd for ; Wed, 26 Apr 2017 11:49:06 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id D06125F3FF for ; Wed, 26 Apr 2017 11:49:05 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 137A5E0185 for ; Wed, 26 Apr 2017 11:49:05 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 4B22B21DE8 for ; Wed, 26 Apr 2017 11:49:04 +0000 (UTC) Date: Wed, 26 Apr 2017 11:49:04 +0000 (UTC) From: "Anoop Sam John (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-17343) Make Compacting Memstore default in 2.0 with BASIC as the default type MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 26 Apr 2017 11:49:10 -0000 [ https://issues.apache.org/jira/browse/HBASE-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984635#comment-15984635 ] Anoop Sam John commented on HBASE-17343: ---------------------------------------- What I think is as below.. (Did not test and investigated thoroughly though. I have to do that.. Just as a test way did) We have a global memstore size above which we dont allow sum of all memstore's size to grow.. Once we reach we block the writes and make forced flushes. Even at a lower barrier breach, we take action. Here while we change the CSLM to CellArray, we have a size increase (temp) and we dont account that any where.. We were already nearing to the global memstore limit but and this change would have breached it , blocking further writes and making forced flushes. (If we accounted that).. The IHOP is so adjusted considering the global memstore size been 60%. May be like the heap usage by memstores grow (this is memory which we can not release) above 60% .. The change might be giving a breathing space as we do some forced flushes. Again just theory.. Need to do further investigation. Again this is an issue when we deal with low cell size and higher memstore size (MSLAB and it is pool). > Make Compacting Memstore default in 2.0 with BASIC as the default type > ---------------------------------------------------------------------- > > Key: HBASE-17343 > URL: https://issues.apache.org/jira/browse/HBASE-17343 > Project: HBase > Issue Type: Bug > Affects Versions: 2.0.0 > Reporter: ramkrishna.s.vasudevan > Priority: Blocker > Fix For: 2.0.0 > > Attachments: HBASE-17343-V01.patch, HBASE-17343-V02.patch, HBASE-17343-V04.patch, HBASE-17343-V05.patch > > > FYI [~anastas], [~eshcar] and [~ebortnik]. -- This message was sent by Atlassian JIRA (v6.3.15#6346)