Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 85662 invoked from network); 24 Nov 2009 19:50:04 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 24 Nov 2009 19:50:04 -0000 Received: (qmail 97212 invoked by uid 500); 24 Nov 2009 19:50:03 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 97152 invoked by uid 500); 24 Nov 2009 19:50:03 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 96827 invoked by uid 99); 24 Nov 2009 19:50:03 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Nov 2009 19:50:03 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Nov 2009 19:50:00 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id B63B1234C045 for ; Tue, 24 Nov 2009 11:49:39 -0800 (PST) Message-ID: <264230368.1259092179732.JavaMail.jira@brutus> Date: Tue, 24 Nov 2009 19:49:39 +0000 (UTC) From: "Andrew Purtell (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Commented: (HBASE-2008) [EC2] Periodic automatic backup to S3 In-Reply-To: <2083101422.1259091939724.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12782124#action_12782124 ] Andrew Purtell commented on HBASE-2008: --------------------------------------- Consider an easy way for the user to back up an elastic HBase cluster to S3. distcp is too naive an approach. Compactions rewrite data into new files. One option is a tool, probably MapReduce in formulation, that incrementally writes new edits (stores and delete markers) into log structured files in S3, and conversely can reply from S3 back into HBase. Another option is to hook replication (HBASE-1295) at least for the backup piece. > [EC2] Periodic automatic backup to S3 > ------------------------------------- > > Key: HBASE-2008 > URL: https://issues.apache.org/jira/browse/HBASE-2008 > Project: Hadoop HBase > Issue Type: Sub-task > Reporter: Andrew Purtell > Assignee: Andrew Purtell > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.