Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 321681854C for ; Tue, 20 Oct 2015 15:52:58 +0000 (UTC) Received: (qmail 59169 invoked by uid 500); 20 Oct 2015 15:52:53 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 59087 invoked by uid 500); 20 Oct 2015 15:52:51 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 59074 invoked by uid 99); 20 Oct 2015 15:52:51 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Oct 2015 15:52:51 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id C6B89C5CF8 for ; Tue, 20 Oct 2015 15:52:50 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.001 X-Spam-Level: *** X-Spam-Status: No, score=3.001 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3, MIME_QP_LONG_LINE=0.001, RP_MATCHES_RCVD=0.001, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id XSIa3UJKDyfz for ; Tue, 20 Oct 2015 15:52:49 +0000 (UTC) Received: from mail.crowdstrike.com (dragos.crowdstrike.com [208.42.226.9]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 6FC182303B for ; Tue, 20 Oct 2015 15:52:49 +0000 (UTC) Received: from casmbox01.crowdstrike.sys (10.100.11.66) by ee01.crowdstrike.sys (10.100.0.12) with Microsoft SMTP Server (TLS) id 15.0.847.32; Tue, 20 Oct 2015 08:52:21 -0700 Received: from casmbox01.crowdstrike.sys (10.100.11.66) by casmbox01.crowdstrike.sys (10.100.11.66) with Microsoft SMTP Server (TLS) id 15.0.847.32; Tue, 20 Oct 2015 08:52:24 -0700 Received: from casmbox01.crowdstrike.sys ([fe80::9509:3711:75cb:b49f]) by casmbox01.crowdstrike.sys ([fe80::9509:3711:75cb:b49f%12]) with mapi id 15.00.0847.030; Tue, 20 Oct 2015 08:52:23 -0700 From: Jeff Jirsa To: "user@cassandra.apache.org" Subject: Re: Hiper-V snapshot and Cassandra Thread-Topic: Hiper-V snapshot and Cassandra Thread-Index: AdELJ35cTyf4JMf2RMmWAlACt0ZVwgAJ9BEA Date: Tue, 20 Oct 2015 15:52:23 +0000 Message-ID: <03B2E7DC-FE45-4239-B096-006D2395D077@crowdstrike.com> References: <16F23EF62E625C4185EB64C3D01C805299DA50A0@UKBMBXW04.prod.quest.corp> In-Reply-To: <16F23EF62E625C4185EB64C3D01C805299DA50A0@UKBMBXW04.prod.quest.corp> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-originating-ip: [10.100.0.9] Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha256; boundary="B_3528175942_713432160" MIME-Version: 1.0 --B_3528175942_713432160 Content-type: multipart/alternative; boundary="B_3528175942_1463895528" --B_3528175942_1463895528 Content-type: text/plain; charset="UTF-8" Content-transfer-encoding: quoted-printable As long as your hyper-v/vss snapshots include both the data directory and t= he commit log directory, then they=E2=80=99re exactly as good as tolerating a sing= le power outage =E2=80=93 you should be able to load the sstables and replay comm= it log and be fine.=20 Assuming you=E2=80=99re moving the hyper-v/vss snapshot to another host (using DP= M or similar), it=E2=80=99s probably going to work the way you expect. You=E2=80=99ll note, however, the cassandra was designed to do the opposite of wh= at you=E2=80=99re doing =E2=80=93 rather than having one monolithic database that=E2=80=99s sc= aled up, the canonical use case for cassandra is to have a number of smaller= databases, so you still get the same capacity and throughput, but you also = get high availability and fault tolerance. It may be worth noting (as Mr. Co= li suggested) that you=E2=80=99re using cassandra in an atypical fashion, and if y= ou add more smaller nodes, then you=E2=80=99ll gain performance, gain HA, gain cap= acity, and that moving snapshots will be faster because there=E2=80=99s less data = per system. From: Raul D'Opazo Reply-To: "user@cassandra.apache.org" Date: Tuesday, October 20, 2015 at 4:22 AM To: "user@cassandra.apache.org" Subject: Hiper-V snapshot and Cassandra Hi, I am really new with Cassandra and i have some questions regarding the back= up of Cassandra with TB of info. So please, forgive me if I ask a noob quest= ion.=20 I only have one node, in one server (Windows 2012), and Cassandra will grow= up to 4TB approx. It is a hiper-v virtual machine, with enough resources. I have done snapshots and it is ok, because we don=E2=80=99t double the size in e= ach snapshot, but I need to have other solution in case of disks problems.=20 Copying these snapshots using other backup systems is crazy, approx.. 500MB= /s it will last days. I am thinking if hiper-v virtual machine snapshots can be used to recover C= assandra in a consistence way. Is it possible? This will avoid me to copy snapshots to other network location or backup sy= stem. Thanks, Raul =20 =20 --B_3528175942_1463895528 Content-type: text/html; charset="UTF-8" Content-transfer-encoding: quoted-printable
As long as your hyper-v/= vss snapshots include both the data directory and the commit log directory, = then they’re exactly as good as tolerating a single power outage ̵= 1; you should be able to load the sstables and replay  commit log and b= e fine. 

Assuming you’re moving the hype= r-v/vss snapshot to another host (using DPM or similar), it’s probably= going to work the way you expect.

You’ll not= e, however, the cassandra was designed to do the opposite of what you’= re doing – rather than having one monolithic database that’s sca= led up, the canonical use case for cassandra is to have a number of smaller = databases, so you still get the same capacity and throughput, but you also g= et high availability and fault tolerance. It may be worth noting (as Mr. Col= i suggested) that you’re using cassandra in an atypical fashion, and i= f you add more smaller nodes, then you’ll gain performance, gain HA, g= ain capacity, and that moving snapshots will be faster because there’s= less data per system.


From: Raul D'Opazo
Reply-To: "user@cassandra.apache.org"
Date: Tuesday, October 20, 2015 at 4:22 AM<= br>To: "user@cassandra.apache.org"
Subject: Hiper-V snapshot and Cassandra

<= div xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-microsoft-c= om:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" xmlns:m=3D"h= ttp://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http://www.w3.org/TR= /REC-html40">

Hi,

I am really new = with Cassandra and i have some questions regarding the backup of Cassandra w= ith TB of info. So please, forgive me if I ask a noob question.

I only have o= ne node, in one server (Windows 2012), and Cassandra will grow up to 4TB app= rox. It is a hiper-v virtual machine, with enough resources.

I have done snapshots and it i= s ok, because we don’t double the size in each snapshot, but I need to= have other solution in case of disks problems.

Copying these= snapshots using other backup systems is crazy, approx.. 500MB/s it will las= t days.

I am th= inking if hiper-v virtual machine snapshots can be used to recover Cassandra= in a consistence way. Is it possible?

This will avoid me to copy snapshots to other networ= k location or backup system.

Thanks,

Raul  

 

 --B_3528175942_1463895528-- --B_3528175942_713432160 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" MIISYAYJKoZIhvcNAQcCoIISUTCCEk0CAQExDzANBglghkgBZQMEAgEFADALBgkqhkiG9w0B BwGggg8wMIIJlTCCB32gAwIBAgIKJGjoIQAAAAACYjANBgkqhkiG9w0BAQsFADBQMRMwEQYK CZImiZPyLGQBGRYDc3lzMRswGQYKCZImiZPyLGQBGRYLY3Jvd2RzdHJpa2UxHDAaBgNVBAMT E2Nyb3dkc3RyaWtlLVJPT1QtQ0EwHhcNMTUwNTE4MTcwNTU4WhcNMjMwNTE2MTcwNTU4WjCB nTETMBEGCgmSJomT8ixkARkWA3N5czEbMBkGCgmSJomT8ixkARkWC2Nyb3dkc3RyaWtlMRAw DgYDVQQLEwdDU1VzZXJzMRQwEgYDVQQLEwtFbmdpbmVlcmluZzEWMBQGA1UEAxMNSmVmZiBS LiBKaXJzYTEpMCcGCSqGSIb3DQEJARYaSmVmZi5KaXJzYUBjcm93ZHN0cmlrZS5jb20wggIi MA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQDz/juPunY45nC7cetdyhafX455PB0ps4zm rZ/jR7NZfNWK11qq4CsWu9Agifcx7KlsmWSjn1EMopttM8axhSpgZOEKaiKSUI7NkihHKcpd ITBmx3XyhU2Dj5wBoftLbp54W+6AC5NYmsrlsqb1sw9CbRQRiALR+amfwzeZZOTKIpl2MYUJ 0qGkikpcl1wGQ1pXZYM4Bi3fa36IACgzgosONucxKMF9uOX8MUYaxdcU2wOpxvh3P4xw/CHO SQJsTaijjLDz+cZ7osYZmBlLdbHN2A55JxzMYlbNEb7xuOp7e3ooV8TV5I7LaD6ewPqu3B9Y nJnXoF+rNuf14D1tZWnT6BUBHIxNk1OTloOihowRaItAsSCUoY+KkRSFPWfwEOUEiynoSCUa gwyqIov+QP/KsGUf1J22yajmH9zexvkqoLohN56qhrAa+v3fZF0UyGk5V+EKeK4zxfu7tFwH Y9KJOPIl9jN5EBRiEpbe+j+6w8FO6+hOf3Pmr2R/IbQl9AP+saDqHGrCJrOUHZnNx+9YZ1pU TvUd/3qgQODgO28z/XqXmqqXefiwiqT9Ubmoiz7T//u069y3zquTD3PKoRnJLJuV4UIfnEdP HBIpClo9OQ2iz3CPGen+eTZprtaOlM926uweNTwDdsrjX3KiV2+bqLoLcAT2lzAFv1pSHp7O kQIDAQABo4IEITCCBB0wDgYDVR0PAQH/BAQDAgWgMD4GCSsGAQQBgjcVBwQxMC8GJysGAQQB gjcVCITk0CKH/Pdpg9mDAoHlqxCG+PJlgW6Gi7JugryReAIBZAIBFTCBlAYJKoZIhvcNAQkP BIGGMIGDMA4GCCqGSIb3DQMCAgIAgDAOBggqhkiG9w0DBAICAIAwBwYFKw4DAgcwCgYIKoZI hvcNAwcwCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBLTALBglghkgBZQMEARYwCwYJYIZIAWUD BAEZMAsGCWCGSAFlAwQBAjALBglghkgBZQMEAQUwHQYDVR0OBBYEFFeyMg1s94zEmeUrFyUT 1gtu/8mqMB8GA1UdIwQYMBaAFAnL7V4xGc1Nowmrlmwbj20X638YMIIBEwYDVR0fBIIBCjCC AQYwggECoIH/oIH8hoG6bGRhcDovLy9DTj1jcm93ZHN0cmlrZS1ST09ULUNBLENOPWRjMSxD Tj1DRFAsQ049UHVibGljJTIwS2V5JTIwU2VydmljZXMsQ049U2VydmljZXMsQ049Q29uZmln dXJhdGlvbixEQz1jcm93ZHN0cmlrZSxEQz1zeXM/Y2VydGlmaWNhdGVSZXZvY2F0aW9uTGlz dD9iYXNlP29iamVjdENsYXNzPWNSTERpc3RyaWJ1dGlvblBvaW50hj1odHRwOi8vZGMxLmNy b3dkc3RyaWtlLnN5cy9DZXJ0RW5yb2xsL2Nyb3dkc3RyaWtlLVJPT1QtQ0EuY3JsMIIBKgYI KwYBBQUHAQEEggEcMIIBGDCBtgYIKwYBBQUHMAKGgalsZGFwOi8vL0NOPWNyb3dkc3RyaWtl LVJPT1QtQ0EsQ049QUlBLENOPVB1YmxpYyUyMEtleSUyMFNlcnZpY2VzLENOPVNlcnZpY2Vz LENOPUNvbmZpZ3VyYXRpb24sREM9Y3Jvd2RzdHJpa2UsREM9c3lzP2NBQ2VydGlmaWNhdGU/ YmFzZT9vYmplY3RDbGFzcz1jZXJ0aWZpY2F0aW9uQXV0aG9yaXR5MF0GCCsGAQUFBzABhlFo dHRwOi8vZGMxLmNyb3dkc3RyaWtlLnN5cy9DZXJ0RW5yb2xsL2RjMS5jcm93ZHN0cmlrZS5z eXNfY3Jvd2RzdHJpa2UtUk9PVC1DQS5jcnQwKQYDVR0lBCIwIAYIKwYBBQUHAwIGCCsGAQUF BwMEBgorBgEEAYI3CgMEMDUGCSsGAQQBgjcVCgQoMCYwCgYIKwYBBQUHAwIwCgYIKwYBBQUH AwQwDAYKKwYBBAGCNwoDBDBNBgNVHREERjBEoCYGCisGAQQBgjcUAgOgGAwWamppcnNhQGNy b3dkc3RyaWtlLnN5c4EaSmVmZi5KaXJzYUBjcm93ZHN0cmlrZS5jb20wDQYJKoZIhvcNAQEL BQADggIBAIso1nTlfRcS3oWoWZ6gtjY0AH91GZpWft+O2kWxDUqzrmfmF+9swJXrk462v/m9 KAUxuch4mLC7j4tQ4FyNV64FZe+tU1fcNlg4wLIOjSoMykjx85sFbzh64YIpbpiX+8dqc/pF h6YcUU4PUgz7CZ0Q79J6bomV0EP94QUTN1AYLAYQ4xaPyLkO2DCtTiQ5Kef8jnNnrEYzZT62 OdljvhdGdV/VDMHAPr4yRPGgRou4Gf0cWsQNCav0RMEHPyJsgpXFCacLCCpvonXQoLMnClYT CVf7fWXdR+UtEpjssNMO2icJXNLarC7ngON7nzsqJKs40eKeAlKHlKXC620fCDbn6Icyodwd w32rkZDann2NAbrf8y2ArrXObRky1h/t8LDhkz/Yvvd5ndsKfQfciyCwIKBIcIgodR4MWobN qJzFIV5P/H/QGM8QLBdOwqEgwfqJjovgosxDXjb/aLbEuyCxgSTjZP6yv+90MFfs8ojV+0o2 Ir3q/H24u42nCD4gpGtb/+X16O1FV65QYlDPQyOomLnxBiuRji9BrazPvU4yIsHpJsZ5iTvG AvddQXQM4P7fNh+3esHBbvEwadPTOpUi/IfjQFsdDDaQw2QX6TjD5qT9vKimX2BpZmJIPvhi 9xXnmae7etpkBJ1Xrc8ysgpBRcZ0aKI4nyYmtGqNoov9MIIFkzCCA3ugAwIBAgIQHHI69IfK ebRHYrS5//qdkTANBgkqhkiG9w0BAQsFADBQMRMwEQYKCZImiZPyLGQBGRYDc3lzMRswGQYK CZImiZPyLGQBGRYLY3Jvd2RzdHJpa2UxHDAaBgNVBAMTE2Nyb3dkc3RyaWtlLVJPT1QtQ0Ew HhcNMTIwMzE4MDA1NjU4WhcNMzIwMzE4MDEwNjU0WjBQMRMwEQYKCZImiZPyLGQBGRYDc3lz MRswGQYKCZImiZPyLGQBGRYLY3Jvd2RzdHJpa2UxHDAaBgNVBAMTE2Nyb3dkc3RyaWtlLVJP T1QtQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQCqrDGWg7do3ZjG04CVNLL6 voCUzmip/CbqyuCBAF3XNHjLsQnIhqQ+4sYkvozZVvR0CG3rvSe4YbSzOcHTsmK5bPiatuXB iUBO8rwHm5tzMUnjGk+XomeOGJzwemYsGIDJupLekvSrcm9dXX4H+GK97J42EkM8UAzsAGwn 7qpWo/bPrn7AM8kdua7DVbZbeJXjoid1NzFG4gjwdmtOtcwBx3DCs7io7C/R5Aep5APq4nmT gA7/whOpkxtThZCqiG8QprBRAktnmS2gMn3Kw1O0amPHtJr/O6FldgoK6Dkb9hKDftVFX9Te D7AlOVaZfltscXksnPxFBP0A6Bjw92hqR6QzRDqcWO+v1kswkd01jRrPPc410scWN7vX2QHv kCku8APiSIOGAvaLS/EtzcmjeJhCgkC6HVt5gjXXJBOMq9C2g82s8UiUnhj7D5/loaZffTyY 5y9mnZaxMbJavjmRV/vj0/Uuy+r1Z7WqIZ/0EhttmE+404YX4lAX/FtFjK0Ns5tpQgSxoIy2 ZUPTWmWsvwSiTud3Ek16IqxbPoQejuVhYnggjonpShvOeXAGcq+PMeQOIDoYl2fjlLTvUUvR LOvDse0F1nzo+6/OF+rr+h5iD2H4IAn0f/dasUIi77rU1mWMWWNTmRGP/7itZ2OhKakvxrtM sdbI4aj8AJPLnQIDAQABo2kwZzATBgkrBgEEAYI3FAIEBh4EAEMAQTAOBgNVHQ8BAf8EBAMC AYYwDwYDVR0TAQH/BAUwAwEB/zAdBgNVHQ4EFgQUCcvtXjEZzU2jCauWbBuPbRfrfxgwEAYJ KwYBBAGCNxUBBAMCAQAwDQYJKoZIhvcNAQELBQADggIBADP4q4k1ZlMnD9FoC9nanmJsEli3 suYxE3VKFMNMF/g+YTv60ETh3k9op70DUPnowyphLgFAoI2ZmqVyaij5gYxUr9OGYHVUJecG oc6dYuQQUb6D6QDOJW+kUC/bSTJI5ICOGCQobSRuFPJKswbcq7QxA008+bq/S93zoH/afBgG VUMqGt/kiwvBra+ClRMu8m5RlpBmkLLy76zcznsWFaJNKnU4N0sWQLrrNh5jiaOT8MVmcoS5 OWfoy3Bp9zHEpT1zVrFvVDdl9+EIFwOAlfcg1jBIp037XxyxN526VUfowmJa86a+VnQVZH92 33y8qMjU2dGhqdXDFT8iHXbnFh3L6uxEjU6w2n90FXtuBaIvMlVKAOLqQrTkUC/FbTRVsCSh MzzpgEybnc4kcG0LdcEp4dh3NIArj5N37Tqh7pl2i7WBOfQ2ya4mz7f+G0bv1jImPgDK2I3F zd5f8uMvuCKbxMuDWdpaVRG8M+pwaVGV+b6nr5uoFno9QWk0VYz5035Yi/S0Bv2xT4jI/DR0 jT/A18fDQPGsp4JEk9/4XL0cndYi1mQSKnoKfNkKJGfv/dwLCNP3yEW9rHBbF5LSOe3apq/X NFH/7ZIkzRBkjngcXffbaClZdad8QALtQAqafYe7PnzNLyjbfpP4u6w2+9YW+yYx90SiSks/ oHPkRSBuMYIC9DCCAvACAQEwXjBQMRMwEQYKCZImiZPyLGQBGRYDc3lzMRswGQYKCZImiZPy LGQBGRYLY3Jvd2RzdHJpa2UxHDAaBgNVBAMTE2Nyb3dkc3RyaWtlLVJPT1QtQ0ECCiRo6CEA AAAAAmIwDQYJYIZIAWUDBAIBBQCgaTAvBgkqhkiG9w0BCQQxIgQgbEXnPXVlT2GSMW0TnSCL 1XShRcvPTreYkfKOD8/1nUkwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0B CQUxDxcNMTUxMDIwMTU1MjIyWjANBgkqhkiG9w0BAQEFAASCAgBjVQVQhMKnepNrcUEd6iF7 Dd1UrqVsQTvQ6nKnFh/7ZojEQbBhavWtyt6moFxTzl22ZqYZ5NiJtjEwAVY98WuhvyL1hS2Q n8LwepVuI10uqKsAA1gliNxSIBsFhglAvIbW4JD4Hhs0kkAaGgGkvMgyz5Kj/qthrjgjk6wv dJQq6h8+QP35P/GIsSAsjN6xgiO0jWapiG1ojJ2hCsjQfZglFNVlw+wJNpdrO4iba5WPahc7 RAnIju2zZk69z+tX0nqgcoLYtMtZd4Ts4VCF/OEQergyRB+oOcwHpSlcvAEM+ZhTqWh4WBM0 TlJ8nZFImFgZNpM5BlmqX7PG4XRQbCqPL4uNIT1h7TDbZlghyhjy92R5hdnpnXUQVi+ThKeo w77ZAYu3jxRIo8SbT0cGDblBUuee7e+yIRt9OwTY9XW5z6S7Kwfx9rh8RNcZagUUmUjD9M9v Ow007aVqRQ7sysU+PLfIv1kK7EyXw85M/WtRzrDa48OcxCk8/WJ2STB6AxCithj61RsnZTMA KrFqf1Y3B2YRneNFSTI+tWcjKtTN5ibzg8l8JfGyL+psPkUhS5bl0vxRrilaW2NBRW4B3ea8 LHp+hKevuTqGvPL3B/SfPZthdpSpCKiryNzVkfx51IFy56dDajiJvXWn0a/r+DFf0mZaITYc 4rZNWONWka7w/w== --B_3528175942_713432160--