Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E782811676 for ; Wed, 16 Jul 2014 23:15:08 +0000 (UTC) Received: (qmail 21290 invoked by uid 500); 16 Jul 2014 23:15:07 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 21231 invoked by uid 500); 16 Jul 2014 23:15:07 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 20996 invoked by uid 99); 16 Jul 2014 23:15:07 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Jul 2014 23:15:07 +0000 Date: Wed, 16 Jul 2014 23:15:07 +0000 (UTC) From: "Andrew Purtell (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (HBASE-3144) Freeze and thaw for regions and/or regionservers MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-3144. ----------------------------------- Resolution: Not a Problem > Freeze and thaw for regions and/or regionservers > ------------------------------------------------ > > Key: HBASE-3144 > URL: https://issues.apache.org/jira/browse/HBASE-3144 > Project: HBase > Issue Type: New Feature > Components: regionserver > Reporter: Karthik Ranganathan > > When frozen, a region would not flush new files or delete old files. > Context: > Was talking to Dhruba about the possibility of a fast intra-cluster copy, and he says it is totally do-able. The idea is this: if there is a HBase table that is very large (multiple terabytes) then distcp takes a long time. The major bottleneck is the cross rack network transfer time. We can easily avoid this by going to each of the block replicas and replicating them on the same machine from one disk to another. For our infrastructure setup, this could make hours of copy time seconds. > If we are able to implement the above, then copying an entire HBase table will only take seconds. Now we just have to ensure that the region files do not "change" during this period - so we need to disable compactions and flushes. Hence the need for the freeze and thaw of regions in a region server. > The way this would work is to flush a region, freeze it, snapshot it, then thaw it and let normal operations proceed. The snapshot would proceed at disk read/write speed so it should take only seconds per region. -- This message was sent by Atlassian JIRA (v6.2#6252)