Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 86BFF200BEC for ; Wed, 14 Dec 2016 09:05:00 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 857A4160B19; Wed, 14 Dec 2016 08:05:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id CDC3A160B13 for ; Wed, 14 Dec 2016 09:04:59 +0100 (CET) Received: (qmail 97567 invoked by uid 500); 14 Dec 2016 08:04:58 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 97543 invoked by uid 99); 14 Dec 2016 08:04:58 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 14 Dec 2016 08:04:58 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 8573A2C03E4 for ; Wed, 14 Dec 2016 08:04:58 +0000 (UTC) Date: Wed, 14 Dec 2016 08:04:58 +0000 (UTC) From: "Eshcar Hillel (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-17294) External Configuration for Memory Compaction MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 14 Dec 2016 08:05:00 -0000 [ https://issues.apache.org/jira/browse/HBASE-17294?page=3Dcom.atlassi= an.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17294: ---------------------------------- Release Note:=20 This patch provides a single external knob to control memstore compaction. Possible memstore compaction policies are: (1) None - no memory compaction, when size threshold is exceeded data is fl= ushed to disk (2) Basic policy applies optimizations which modify the index to a more com= pacted representation. This is beneficial in all access patterns. The small= er the cells are the greater the benefit of this policy. This is the defaul= t policy. (3) Eager - in addition to compacting the index representation as the basic= policy, eager policy eliminates duplication while the data is still in mem= ory (much like the on-disk compaction does after the data is flushed to dis= k). This policy is most useful for applications with high data churn or sma= ll working sets. Memory compaction policeman be set at the column family level at table crea= tion time: {code} create =E2=80=98=E2=80=99, {NAME =3D> =E2=80=98=E2=80=99,=20 IN_MEMORY_COMPACTION =3D> =E2=80=98=E2=80=99} {code} or as a property at the global configuration level by setting the property = in hbase-site.xml, with BASIC being the default value: {code} =09hbase.hregion.compacting.memstore.type =09 {code} The values used in this property can change as memstore compaction policies= evolve over time. > External Configuration for Memory Compaction=20 > --------------------------------------------- > > Key: HBASE-17294 > URL: https://issues.apache.org/jira/browse/HBASE-17294 > Project: HBase > Issue Type: Sub-task > Reporter: Eshcar Hillel > Assignee: Eshcar Hillel > Fix For: 2.0.0 > > Attachments: HBASE-17294-V01.patch, HBASE-17294-V02.patch, HBASE-= 17294-V03.patch > > > We would like to have a single external knob to control memstore compacti= on. > Possible memstore compaction policies are none, basic, and eager. > This sub-task allows to set this property at the column family level at t= able creation time: > {code} > create =E2=80=98=E2=80=99, > {NAME =3D> =E2=80=98=E2=80=99,=20 > IN_MEMORY_COMPACTION =3D> =E2=80=98=E2=80=99} > {code} > or to set this at the global configuration level by setting the property = in hbase-site.xml, with BASIC being the default value: > {code} > > =09hbase.hregion.compacting.memstore.type > =09 > > {code} > The values used in this property can change as memstore compaction polici= es evolve over time. -- This message was sent by Atlassian JIRA (v6.3.4#6332)