Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CF7B496F6 for ; Thu, 11 Dec 2014 07:35:12 +0000 (UTC) Received: (qmail 1776 invoked by uid 500); 11 Dec 2014 07:35:12 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 1726 invoked by uid 500); 11 Dec 2014 07:35:12 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 1712 invoked by uid 99); 11 Dec 2014 07:35:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Dec 2014 07:35:12 +0000 Date: Thu, 11 Dec 2014 07:35:12 +0000 (UTC) From: "Jingcheng Du (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-11861) Native MOB Compaction mechanisms. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242278#comment-14242278 ] Jingcheng Du commented on HBASE-11861: -------------------------------------- bq. We create a del mob file per region compaction (major, and potentially minor due to ttl age offs). There're deleted cells in the minor compaction where only delete markers are retained, all the earlier cells will be deleted. I think we could leave the expired(live longer than TTL) cells out of the del files. Let the ExpiredMobFileCleaner to handle those mob files directly. Please advise. [~jmhsieh]. Thanks! > Native MOB Compaction mechanisms. > --------------------------------- > > Key: HBASE-11861 > URL: https://issues.apache.org/jira/browse/HBASE-11861 > Project: HBase > Issue Type: Sub-task > Components: regionserver, Scanners > Affects Versions: 2.0.0 > Reporter: Jonathan Hsieh > Attachments: 141030-mob-compaction.pdf, mob compaction.pdf > > > Currently, the first cut of mob will have external processes to age off old mob data (the ttl cleaner), and to compact away deleted or over written data (the sweep tool). > From an operational point of view, having two external tools, especially one that relies on MapReduce is undesirable. In this issue we'll tackle integrating these into hbase without requiring external processes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)