Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 31770 invoked from network); 9 Mar 2011 16:55:21 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 9 Mar 2011 16:55:21 -0000 Received: (qmail 18592 invoked by uid 500); 9 Mar 2011 16:55:17 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 18555 invoked by uid 500); 9 Mar 2011 16:55:17 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 18523 invoked by uid 99); 9 Mar 2011 16:55:17 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Mar 2011 16:55:17 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.214.44] (HELO mail-bw0-f44.google.com) (209.85.214.44) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Mar 2011 16:55:09 +0000 Received: by bwz13 with SMTP id 13so949264bwz.31 for ; Wed, 09 Mar 2011 08:54:48 -0800 (PST) Received: by 10.204.15.130 with SMTP id k2mr5853317bka.95.1299689688239; Wed, 09 Mar 2011 08:54:48 -0800 (PST) MIME-Version: 1.0 Received: by 10.204.71.132 with HTTP; Wed, 9 Mar 2011 08:54:28 -0800 (PST) X-Originating-IP: [24.23.118.38] In-Reply-To: References: From: William Oberman Date: Wed, 9 Mar 2011 11:54:28 -0500 Message-ID: Subject: Re: Aamzon EC2 & Cassandra to ebs or not.. To: Sasha Dolgy Cc: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=000325554c722f8ce5049e0f96c9 X-Virus-Checked: Checked by ClamAV on apache.org --000325554c722f8ce5049e0f96c9 Content-Type: text/plain; charset=ISO-8859-1 I haven't done backups yet, so I don't know where the data is written. Is it where the nodetool is run from? Or local to the instance running cassandra (and there, local to the data directory?). I assumed it was the latter (not finding docs on that yet), and that would require 2x storage allocated on that instance for 1x data (to have room for the snapshot). If its the former, then yes, I'd totally run the command from an ephemeral store, and backup to S3. will On Wed, Mar 9, 2011 at 11:48 AM, Sasha Dolgy wrote: > Hi Will, > > http://wiki.apache.org/cassandra/Operations#Backing_up_data > > If the > snapshot is written to the ephemeral storage ... there isn't a cost. (i need > to confirm that) > > You can then move this to an S3 bucket with RDS if you want or full > 99.999999999% redundancy and have it available to developers > > This is what I had in my head.... > -sd > > > On Wed, Mar 9, 2011 at 5:39 PM, William Oberman wrote: > >> I thought nodetool snapshot writes the snapshot locally, requiring 2x of >> expensive storage allocation 24x7 (vs. cheap storage allocation of a ebs >> snapshot). By that I mean EBS allocation is GB allocated per month costs at >> one rate, and EBS snapshots are delta compressed copies to S3. >> >> Can you point the snapshot to an external filesystem? >> >> will >> >> -- Will Oberman Civic Science, Inc. 3030 Penn Avenue., First Floor Pittsburgh, PA 15201 (M) 412-480-7835 (E) oberman@civicscience.com --000325554c722f8ce5049e0f96c9 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable I haven't done backups yet, so I don't know where the data is writt= en.=A0 Is it where the nodetool is run from?=A0 Or local to the instance ru= nning cassandra (and there, local to the data directory?).=A0 I assumed it = was the latter (not finding docs on that yet), and that would require 2x st= orage allocated on that instance for 1x data (to have room for the snapshot= ).=A0 If its the former, then yes, I'd totally run the command from an = ephemeral store, and backup to S3.

will

On Wed, Mar 9, 2011 at 11:48 AM,= Sasha Dolgy <sdol= gy@gmail.com> wrote:
Hi Will,



You can then move this to an S3 bucket with RDS if you = want or full 99.999999999% redundancy and have it available to developers

This is what I had in my head....
-sd

On Wed, Mar 9, 2011 at 5:39 PM, William Ober= man <oberman@civicscience.com> wrote:
I thought nodetool snapshot writes the snapshot locally, requiring 2x of ex= pensive storage allocation 24x7 (vs. cheap storage allocation of a ebs snap= shot).=A0 By that I mean EBS allocation is GB allocated per month costs at = one rate, and EBS snapshots are delta compressed copies to S3.=A0

Can you point the snapshot to an external filesystem?=A0

will




--
Will Oberman
Civic S= cience, Inc.
3030 Penn Avenue., First Floor
Pittsburgh, PA 15201
(= M) 412-480-7835
(E) oberman@= civicscience.com
--000325554c722f8ce5049e0f96c9--