Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 37C6B11597 for ; Thu, 9 May 2013 08:55:57 +0000 (UTC) Received: (qmail 87607 invoked by uid 500); 9 May 2013 08:55:54 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 87463 invoked by uid 500); 9 May 2013 08:55:54 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 87440 invoked by uid 99); 9 May 2013 08:55:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 May 2013 08:55:53 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of theo.bertozzi@gmail.com designates 209.85.212.171 as permitted sender) Received: from [209.85.212.171] (HELO mail-wi0-f171.google.com) (209.85.212.171) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 May 2013 08:55:48 +0000 Received: by mail-wi0-f171.google.com with SMTP id l13so5949307wie.4 for ; Thu, 09 May 2013 01:55:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type; bh=vURJ9h4VsH0xaqTXeTryOlpYOnuzOdo9Uq3k1E0W5H8=; b=Qrgp7liUqsQzJxb146P4EAKsLXtqeWta2yjDlE/k+2/ubIT2mTV5WmTWT1J0WmasGt s/rkOUyoiHLBWOBd++deBb9pqu7Hh81CNKk1sr4e/IW70dcy6QRkTmbH6xnuYoa02aMx rpGVyrgQ/YKXQxDZGUYhFuUltu4iOX8iPtN63JxEehgCOHaeVUTfXmxJ2nB5C8Ea9YM/ Jj+f+vMD2IoLlv5IGsurkcJm39rWMOfIVL51zjmNhN2I3NadNRdQw6dMM05bOR5AVA0s NoQObPlvAHPnDdpFPP1MkZ0Y3IUZ9CbL2svplTiWH5ArcITYXKDjkOgZYyIXobwlOZn+ CCYA== X-Received: by 10.180.183.133 with SMTP id em5mr15707940wic.26.1368089727813; Thu, 09 May 2013 01:55:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.194.120.98 with HTTP; Thu, 9 May 2013 01:55:07 -0700 (PDT) In-Reply-To: References: From: Matteo Bertozzi Date: Thu, 9 May 2013 09:55:07 +0100 Message-ID: Subject: Re: HBase Snapshots as backup solution To: user@hbase.apache.org, ahmic.samir@gmail.com Content-Type: multipart/alternative; boundary=001a11c222c83f59d904dc4536c6 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c222c83f59d904dc4536c6 Content-Type: text/plain; charset=ISO-8859-1 Hi, Could you describe a bit more what do you need by a backup, what do you expect by it and what is your data flow? A snapshot at the moment can guarantee just row level consistency. This means that if you have in-flight writes some can be present in the snapshot some not. so, The best type of workload is the one that import data from somewhere. In this case after a restore you can check which keys are present and reimport the ones missing. The other case is the one where you don't care if some rows are missing. Snapshots doesn't create a copy of the data, so if you want to properly save your data somewhere else you have to use ExportSnapshot, to copy the data to another cluster. The main difference with CopyTable is that you don't impact the RS during the export, since the operation is just a filesystem level. I think that snapshots are really good for testing stuff, you can take a snapshot of a table.. clone a table from the snapshot and try to change compression, schema or just play with the data, without impacting the main table, and without have to copy petabyte of data. Here there's a snapshot related blog post that tries to explain how the feature work and what are some of the use cases https://blog.cloudera.com/blog/2013/03/introduction-to-apache-hbase-snapshots/ Matteo On Thu, May 9, 2013 at 9:11 AM, Samir Ahmic wrote: > Hi all, > > We are using hbase-0.94.6.1 and at moment i'm evaluation Snapshots as > backup solution for moving data between clusters. I'm wondering if someone > have similar experience and what are pros and cons ? Also is Snapshot > future stable enough for this sort of operation ? > > Thanks, > Samir > --001a11c222c83f59d904dc4536c6--