Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 110A41127F for ; Wed, 17 Sep 2014 23:34:35 +0000 (UTC) Received: (qmail 90159 invoked by uid 500); 17 Sep 2014 23:34:34 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 90053 invoked by uid 500); 17 Sep 2014 23:34:34 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 90040 invoked by uid 99); 17 Sep 2014 23:34:34 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Sep 2014 23:34:34 +0000 Date: Wed, 17 Sep 2014 23:34:34 +0000 (UTC) From: "Jonathan Hsieh (JIRA)" To: dev@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Reopened] (HBASE-11646) Handle the MOB in compaction MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hsieh reopened HBASE-11646: ------------------------------------ I cannot seem to commit currently. will try again later and close issue then. > Handle the MOB in compaction > ---------------------------- > > Key: HBASE-11646 > URL: https://issues.apache.org/jira/browse/HBASE-11646 > Project: HBase > Issue Type: Sub-task > Components: Compaction > Affects Versions: hbase-11339 > Reporter: Jingcheng Du > Assignee: Jingcheng Du > Fix For: hbase-11339 > > Attachments: HBASE-11646-V2.diff, HBASE-11646-V3.diff, HBASE-11646-V4.diff, HBASE-11646-V5.diff, HBASE-11646-V6.diff, HBASE-11646-V7.diff, HBASE-11646.diff > > > In the updated MOB design however, admins can set CF level thresholds that would force cell values > the threshold to use the MOB write path instead of the traditional path. There are two cases where mobs need to interact with this threshold > 1) How do we handle the case when the threshold size is changed? > 2) Today, you can bulkload hfiles that contain MOBs. These cells will work as normal inside hbase. Unfortunately the cells with MOBs in them will never benefit form the MOB write path. > The proposal here is to modify compaction in mob enabled cf's such that the threshold value is honored with compactions. This handles case #1 -- elements that should be moved out of the normal hfiles get 'compacted' into refs and mob hfiles, and values that should be pulled into the cf get derefed and written out wholy in the compaction. For case #2, we can maintain the same behavior and compaction would move data into the mob writepath/lifecycle. -- This message was sent by Atlassian JIRA (v6.3.4#6332)