Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id BA127200BB1 for ; Wed, 19 Oct 2016 14:12:00 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id B8DC8160ADE; Wed, 19 Oct 2016 12:12:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 32606160AFC for ; Wed, 19 Oct 2016 14:12:00 +0200 (CEST) Received: (qmail 44041 invoked by uid 500); 19 Oct 2016 12:11:59 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 43932 invoked by uid 99); 19 Oct 2016 12:11:59 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Oct 2016 12:11:59 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id AA7632C4C81 for ; Wed, 19 Oct 2016 12:11:58 +0000 (UTC) Date: Wed, 19 Oct 2016 12:11:58 +0000 (UTC) From: "Edward Bortnikov (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-16608) Introducing the ability to merge ImmutableSegments without copy-compaction or SQM usage MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 19 Oct 2016 12:12:00 -0000 [ https://issues.apache.org/jira/browse/HBASE-16608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15588588#comment-15588588 ] Edward Bortnikov commented on HBASE-16608: ------------------------------------------ Thanks again, [~anoop.hbase] and [~ram_krish] for helping us debug the GC issue. Agree that the current merge policy is naive. The number of ref copies and waste memory grows as arithmetic progression with the number of flushes. Let's try to find middle ground between the need to keep the number of segments small and the need to reduce the copy. Looking forward to that conversation. > Introducing the ability to merge ImmutableSegments without copy-compaction or SQM usage > --------------------------------------------------------------------------------------- > > Key: HBASE-16608 > URL: https://issues.apache.org/jira/browse/HBASE-16608 > Project: HBase > Issue Type: Sub-task > Reporter: Anastasia Braginsky > Assignee: Anastasia Braginsky > Attachments: HBASE-16417-V02.patch, HBASE-16417-V04.patch, HBASE-16417-V06.patch, HBASE-16417-V07.patch, HBASE-16417-V08.patch, HBASE-16417-V10.patch, HBASE-16608-V01.patch, HBASE-16608-V03.patch, HBASE-16608-V04.patch, HBASE-16608-V08.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)