Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 72A1C200D23 for ; Thu, 19 Oct 2017 10:40:07 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 710F91609ED; Thu, 19 Oct 2017 08:40:07 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id B8B3E1609E2 for ; Thu, 19 Oct 2017 10:40:06 +0200 (CEST) Received: (qmail 98840 invoked by uid 500); 19 Oct 2017 08:40:05 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 98829 invoked by uid 99); 19 Oct 2017 08:40:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Oct 2017 08:40:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id E51E7180705 for ; Thu, 19 Oct 2017 08:40:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id oJ9HklIDnxMj for ; Thu, 19 Oct 2017 08:40:04 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id E266E5F3DE for ; Thu, 19 Oct 2017 08:40:03 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id C9F8FE0D60 for ; Thu, 19 Oct 2017 08:40:02 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 6A833243AB for ; Thu, 19 Oct 2017 08:40:01 +0000 (UTC) Date: Thu, 19 Oct 2017 08:40:01 +0000 (UTC) From: "Eshcar Hillel (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 19 Oct 2017 08:40:07 -0000 [ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: ---------------------------------- Attachment: HBASE-16417.09.patch > In-Memory MemStore Policy for Flattening and Compactions > -------------------------------------------------------- > > Key: HBASE-16417 > URL: https://issues.apache.org/jira/browse/HBASE-16417 > Project: HBase > Issue Type: Sub-task > Reporter: Anastasia Braginsky > Assignee: Eshcar Hillel > Fix For: 3.0.0 > > Attachments: HBASE-16417 - Adaptive Compaction Policy - 20171001.pdf, HBASE-16417 - parameter tuning - 20171001.pdf, HBASE-16417-V01.patch, HBASE-16417-benchmarkresults-20161101.pdf, HBASE-16417-benchmarkresults-20161110.pdf, HBASE-16417-benchmarkresults-20161123.pdf, HBASE-16417-benchmarkresults-20161205.pdf, HBASE-16417-benchmarkresults-20170309.pdf, HBASE-16417-benchmarkresults-20170317.pdf, HBASE-16417.01.patch, HBASE-16417.02.patch, HBASE-16417.03.patch, HBASE-16417.04.patch, HBASE-16417.05.patch, HBASE-16417.06.patch, HBASE-16417.07.patch, HBASE-16417.07.patch, HBASE-16417.08.patch, HBASE-16417.09.patch > > > This Jira explores the performance of different memstore compaction policies. > It presents the result of write-only workload evaluation as well as read performance in read-write workloads. > We investigate several settings of hardware (SSD, HDD), key distribution (Zipf, uniform), with multiple settings of the system, and compare measures like write throughput, read latency, write volume, total gc time, etc. > The submitted patch sets some system properties at the values yielding optimal performance. In addition we suggest a new Adaptive memstore compaction policy that shows good tradeoffs between write throughput and write volume. -- This message was sent by Atlassian JIRA (v6.4.14#64029)