Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B8BD044E7 for ; Thu, 23 Jun 2011 15:03:47 +0000 (UTC) Received: (qmail 98181 invoked by uid 500); 23 Jun 2011 15:03:45 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 98126 invoked by uid 500); 23 Jun 2011 15:03:45 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 98118 invoked by uid 99); 23 Jun 2011 15:03:44 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Jun 2011 15:03:44 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: 209.85.214.44 is neither permitted nor denied by domain of oberman@civicscience.com) Received: from [209.85.214.44] (HELO mail-bw0-f44.google.com) (209.85.214.44) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Jun 2011 15:03:37 +0000 Received: by bwz13 with SMTP id 13so1890230bwz.31 for ; Thu, 23 Jun 2011 08:03:17 -0700 (PDT) Received: by 10.204.80.215 with SMTP id u23mr937135bkk.201.1308841397226; Thu, 23 Jun 2011 08:03:17 -0700 (PDT) MIME-Version: 1.0 Received: by 10.204.15.66 with HTTP; Thu, 23 Jun 2011 08:02:57 -0700 (PDT) X-Originating-IP: [24.23.118.38] In-Reply-To: References: <5306E6F7-3429-41A9-AEB4-0DBE45F07638@gmail.com> From: William Oberman Date: Thu, 23 Jun 2011 11:02:57 -0400 Message-ID: Subject: Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots? To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=0016e6dbe66a8c8e2404a66262b5 X-Virus-Checked: Checked by ClamAV on apache.org --0016e6dbe66a8c8e2404a66262b5 Content-Type: text/plain; charset=ISO-8859-1 I've been doing EBS snapshots for mysql for some time now, and was using a similar pattern as Josep (XFS with freeze, snap, unfreeze), with the extra complication that I was actually using 8 EBS's in RAID-0 (and the extra extra complication that I had to lock the MyISAM tables... glad to be moving away from that). For cassandra I switched to ephemeral disks, as per recommendations from this forum. One note on EBS snapshots though: the last time I checked (which was some time ago) I noticed degraded IO performance on the box during the snapshotting process even though the take snapshot command returns almost immediately. My theory back then was that amazon does the delta/compress/store "outside" of the VM, but it obviously has an effect on resources on the box the VM runs on. I was doing this on a mysql slave that no one talked to, so I didn't care/bother looking into it further. will On Thu, Jun 23, 2011 at 10:30 AM, Peter Schuller < peter.schuller@infidyne.com> wrote: > >> EBS volume atomicity is good. We've had tons of experience since EBS > came > >> out almost 4 years ago, to back all kinds of things, including large > DBs. > > And thanks a lot for coming forward with production experience. That > is always useful with these things. > > -- > / Peter Schuller > -- Will Oberman Civic Science, Inc. 3030 Penn Avenue., First Floor Pittsburgh, PA 15201 (M) 412-480-7835 (E) oberman@civicscience.com --0016e6dbe66a8c8e2404a66262b5 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable I've been doing EBS snapshots for mysql for some time now, and was usin= g a similar pattern as Josep (XFS with freeze, snap, unfreeze), with the ex= tra complication that I was actually using 8 EBS's in RAID-0 (and the e= xtra extra complication that I had to lock the MyISAM tables... glad to be = moving away from that).=A0 For cassandra I switched to ephemeral disks, as = per recommendations from this forum.

One note on EBS snapshots though: the last time I checked (which was so= me time ago) I noticed degraded IO performance on the box during the snapsh= otting process even though the take snapshot command returns almost immedia= tely.=A0 My theory back then was that amazon does the delta/compress/store = "outside" of the VM, but it obviously has an effect on resources = on the box the VM runs on.=A0 I was doing this on a mysql slave that no one= talked to, so I didn't care/bother looking into it further.

will

On Thu, Jun 23, 2011 at 10:30 AM= , Peter Schuller <peter.schuller@infidyne.com> wrote:
>> EBS volume atomicity is good. We've had tons= of experience since EBS came
>> out almost 4 years ago,=A0 to back all kinds of things, including = large DBs.

And thanks a lot for coming forward with production experience. That<= br> is always useful with these things.

--
/ Peter Schuller



--
Will Oberman
= Civic Science, Inc.
3030 Penn Avenue., First Floor
Pittsburgh, PA 152= 01
(M) 412-480-7835
(E) o= berman@civicscience.com
--0016e6dbe66a8c8e2404a66262b5--