Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 059E7200D2E for ; Tue, 31 Oct 2017 18:02:08 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 042861609EF; Tue, 31 Oct 2017 17:02:08 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 473B31609E6 for ; Tue, 31 Oct 2017 18:02:07 +0100 (CET) Received: (qmail 2520 invoked by uid 500); 31 Oct 2017 17:02:06 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 2509 invoked by uid 99); 31 Oct 2017 17:02:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 31 Oct 2017 17:02:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 70B5818340E for ; Tue, 31 Oct 2017 17:02:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id a_tK4mWx28Qp for ; Tue, 31 Oct 2017 17:02:03 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 586F560F19 for ; Tue, 31 Oct 2017 17:02:03 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 87BE2E0594 for ; Tue, 31 Oct 2017 17:02:02 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 59A08212F9 for ; Tue, 31 Oct 2017 17:02:01 +0000 (UTC) Date: Tue, 31 Oct 2017 17:02:01 +0000 (UTC) From: "Eshcar Hillel (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 31 Oct 2017 17:02:08 -0000 [ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: ---------------------------------- Attachment: HBASE-16417.18.patch > In-Memory MemStore Policy for Flattening and Compactions > -------------------------------------------------------- > > Key: HBASE-16417 > URL: https://issues.apache.org/jira/browse/HBASE-16417 > Project: HBase > Issue Type: Sub-task > Reporter: Anastasia Braginsky > Assignee: Eshcar Hillel > Fix For: 3.0.0 > > Attachments: HBASE-16417 - Adaptive Compaction Policy - 20171001.pdf, HBASE-16417 - parameter tuning - 20171001.pdf, HBASE-16417-V01.patch, HBASE-16417-benchmarkresults-20161101.pdf, HBASE-16417-benchmarkresults-20161110.pdf, HBASE-16417-benchmarkresults-20161123.pdf, HBASE-16417-benchmarkresults-20161205.pdf, HBASE-16417-benchmarkresults-20170309.pdf, HBASE-16417-benchmarkresults-20170317.pdf, HBASE-16417.01.patch, HBASE-16417.02.patch, HBASE-16417.03.patch, HBASE-16417.04.patch, HBASE-16417.05.patch, HBASE-16417.06.patch, HBASE-16417.07.patch, HBASE-16417.07.patch, HBASE-16417.08.patch, HBASE-16417.09.patch, HBASE-16417.10.patch, HBASE-16417.11.patch, HBASE-16417.12.patch, HBASE-16417.13.patch, HBASE-16417.14.patch, HBASE-16417.15.patch, HBASE-16417.16.patch, HBASE-16417.17.patch, HBASE-16417.17.patch, HBASE-16417.17.patch, HBASE-16417.17.patch, HBASE-16417.17.patch, HBASE-16417.18.patch > > > This Jira explores the performance of different memstore compaction policies. > It presents the result of write-only workload evaluation as well as read performance in read-write workloads. > We investigate several settings of hardware (SSD, HDD), key distribution (Zipf, uniform), with multiple settings of the system, and compare measures like write throughput, read latency, write volume, total gc time, etc. > The submitted patch sets some system properties at the values yielding optimal performance. In addition we suggest a new Adaptive memstore compaction policy that shows good tradeoffs between write throughput and write volume. -- This message was sent by Atlassian JIRA (v6.4.14#64029)