Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9F28D1083A for ; Tue, 10 Sep 2013 00:45:15 +0000 (UTC) Received: (qmail 5103 invoked by uid 500); 10 Sep 2013 00:45:13 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 5018 invoked by uid 500); 10 Sep 2013 00:45:13 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 5010 invoked by uid 99); 10 Sep 2013 00:45:13 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Sep 2013 00:45:13 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW X-Spam-Check-By: apache.org Received-SPF: error (athena.apache.org: local policy) Received: from [209.85.215.46] (HELO mail-la0-f46.google.com) (209.85.215.46) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Sep 2013 00:45:09 +0000 Received: by mail-la0-f46.google.com with SMTP id eh20so5486122lab.19 for ; Mon, 09 Sep 2013 17:44:28 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=Ebzx1f7OBwwYEiCFh6iIo8HgJY6s9kk/SZIGHRBnkAs=; b=Uotm5JeS0wTBS1TQvBwWtRJqhRC/Z6kVxaLO31MZwmGtBcKZd64ZlQrITF/ta3sJfL N3QnT9twKfIkTx9RNCLENh1wQJukqA6dncGrWvNEkb85XBoyOhQAQLHsztqLATthXQIj 2y2feoaTWSfHk3drHa7QohOxlgkXePGkZsn/f5pTu1AIceI+LQBN1rWX1zajMNq22OTU 7rYQjVujc1fOjAAjnenHQGOyC1X9C9D9W99x/V/MAUqpuSWMfhrysudoGXuLeE2Ul2x6 Tzu/qm9iRrs28ngRldH+mBDPR1tk/WPY48SJvw+ywDAdYiwzX/qfd5EY+wNsT12tSHlJ /vFg== X-Gm-Message-State: ALoCoQmmcly+3XKBVT46BEknSF3S88XHRfpD04LEHxfdk+N/Z8Zdz3L3NH1vbDsDkt+wodhZCMA3 MIME-Version: 1.0 X-Received: by 10.152.37.103 with SMTP id x7mr4177583laj.28.1378773867725; Mon, 09 Sep 2013 17:44:27 -0700 (PDT) Received: by 10.112.73.103 with HTTP; Mon, 9 Sep 2013 17:44:27 -0700 (PDT) In-Reply-To: References: Date: Mon, 9 Sep 2013 17:44:27 -0700 Message-ID: Subject: Re: Hbase ExportSnapshot with AWS From: Carlos Espinoza To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=089e0160b5e49c975804e5fcce7f X-Virus-Checked: Checked by ClamAV on apache.org --089e0160b5e49c975804e5fcce7f Content-Type: text/plain; charset=ISO-8859-1 That'd be a great enhancement. On Mon, Sep 9, 2013 at 4:42 PM, Vladimir Rodionov wrote: > Great, thanks. One possible enhancement: support for arbitrary file > system (not only s3). > > Best regards, > Vladimir Rodionov > Principal Platform Engineer > Carrier IQ, www.carrieriq.com > e-mail: vrodionov@carrieriq.com > > ________________________________________ > From: Carlos Espinoza [carlos@imgur.com] > Sent: Monday, September 09, 2013 2:57 PM > To: user@hbase.apache.org > Subject: Re: Hbase ExportSnapshot with AWS > > You might be interested in a tool I recently wrote. It's a wrapper around > the Export Snapshot tool. It's not heavily tested, but it has worked for us > so far. You can use it to create a snapshot and export it to S3. It can > also be used to import a snapshot from S3 into a running HBase cluster. You > need to dedicate a bucket for this. > > https://github.com/lospro7/snapshot-s3-util > > > On Mon, Sep 9, 2013 at 1:13 PM, Vladimir Rodionov > wrote: > > > There is no option to export materialized snapshot to AWS yet - only to > > another HBase cluster. > > You can export snapshot metadata to s3 using S3 FileSystem in Hadoop, > but > > this is not you are looking for. > > You can export snapshots to table(s) in another cluster and then use > > distcp to copy data over to s3. > > One caveat: you have to have spare cluster for that, because you can't > > export table's snapshot to different cluster and > > different table (name). > > > > yea, too many limitations. One major enhancement to snapshots which is > > definitely welcomed is ability to export materialized > > snapshots to a different DFS location (S3 in this case) > > > > > > Best regards, > > Vladimir Rodionov > > Principal Platform Engineer > > Carrier IQ, www.carrieriq.com > > e-mail: vrodionov@carrieriq.com > > > > ________________________________________ > > From: Dhanasekaran Anbalagan [bugcy013@gmail.com] > > Sent: Monday, September 09, 2013 12:51 PM > > To: cdh-user; user@hbase.apache.org > > Subject: Hbase ExportSnapshot with AWS > > > > Hi Guys, > > > > It's possible to Export Snapshot with Amazon S3 or Glacier. Currently we > > have two hbase cluster running on same datacenter. We want > > backup solution for Hbase data. > > > > want redundant backup solution for data store. something like S3 or > > Glacier. > > > > I will use CopyTable and snapshot for Hbase data. But the what is use > > cluster are in same datacenter. > > > > If two cluster are down. I want retrieve data from > > > > Please guide me. what are the possible solution. > > > > -Dhanasekaran. > > > > Did I learn something today? If not, I wasted it. > > > > Confidentiality Notice: The information contained in this message, > > including any attachments hereto, may be confidential and is intended to > be > > read only by the individual or entity to whom this message is addressed. > If > > the reader of this message is not the intended recipient or an agent or > > designee of the intended recipient, please note that any review, use, > > disclosure or distribution of this message or its attachments, in any > form, > > is strictly prohibited. If you have received this message in error, > please > > immediately notify the sender and/or Notifications@carrieriq.com and > > delete or destroy any copy of this message and its attachments. > > > > Confidentiality Notice: The information contained in this message, > including any attachments hereto, may be confidential and is intended to be > read only by the individual or entity to whom this message is addressed. If > the reader of this message is not the intended recipient or an agent or > designee of the intended recipient, please note that any review, use, > disclosure or distribution of this message or its attachments, in any form, > is strictly prohibited. If you have received this message in error, please > immediately notify the sender and/or Notifications@carrieriq.com and > delete or destroy any copy of this message and its attachments. > --089e0160b5e49c975804e5fcce7f--