Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D726F10C44 for ; Fri, 13 Dec 2013 17:35:26 +0000 (UTC) Received: (qmail 56368 invoked by uid 500); 13 Dec 2013 17:35:13 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 56235 invoked by uid 500); 13 Dec 2013 17:35:10 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 56188 invoked by uid 99); 13 Dec 2013 17:35:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 13 Dec 2013 17:35:08 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ailinykh@gmail.com designates 209.85.215.48 as permitted sender) Received: from [209.85.215.48] (HELO mail-la0-f48.google.com) (209.85.215.48) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 13 Dec 2013 17:35:04 +0000 Received: by mail-la0-f48.google.com with SMTP id n7so1652347lam.21 for ; Fri, 13 Dec 2013 09:34:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=XSZxZshSjX5TvvaFH+UMfCrcoukBnR78BEccD5QM3qY=; b=cFtxC4jMBq3S6/siEMoEJfE6aMtiaPnV0HsvO+trvgcqq6orzD7hC0C2qcqMScyh/z XVmwdlP895E06B/pjm+p6rpy1ys1SmQdGnRjDJb7OpcD5eRhtp9rYWjd2N3PY8KwcQGA dNqVOs7UXah6+g0vXrfVd/LtgRdW7xaUCI/JvIAUvf1r8JS4qqUdebkPjBmxeB4Gsk+Z zRb6jPPaDAo3om7jYryiofYJWYwp8k+4GW4BcGYfrFFkzcd2j9/mJuxFFNZuXpSmevXw ioNhM60WPqqIth69pqt8s24UdsTmZeK7g5W75GYH2maGp7MiTr9cdARn+OlVCb0JSl5K K9ew== MIME-Version: 1.0 X-Received: by 10.152.234.37 with SMTP id ub5mr2198125lac.51.1386956083113; Fri, 13 Dec 2013 09:34:43 -0800 (PST) Received: by 10.114.82.130 with HTTP; Fri, 13 Dec 2013 09:34:43 -0800 (PST) In-Reply-To: References: Date: Fri, 13 Dec 2013 09:34:43 -0800 Message-ID: Subject: Re: Restore with archive commitlog From: Andrey Ilinykh To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=001a1134609ca7371b04ed6de014 X-Virus-Checked: Checked by ClamAV on apache.org --001a1134609ca7371b04ed6de014 Content-Type: text/plain; charset=ISO-8859-1 As someone told you this feature was added by Netflix to work with Priam (cassandra management tool). Priam itself uses it for several months only, so I doubt if anybody uses this feature in production. Any way, you can ping guys working on Priam. This is your best bet. https://github.com/Netflix/Priam Let us know if you can figure out how to use it. Thank you, Andrey On Fri, Dec 13, 2013 at 6:31 AM, Bonnet Jonathan. < jonathan.bonnet@externe.bnpparibas.com> wrote: > Hello, > > As i told you i began to explore restore operations, see my config for > archive commit logs: > > archive_command=/bin/bash /produits/cassandra/scripts/cassandra-archive.sh > %path %name > > restore_command=/bin/bash /produits/cassandra/scripts/cassandra-restore.sh > %from %to > > restore_directories=/produits/cassandra/cassandra_data/archived_commit > > restore_point_in_time=2013:12:11 17:00:00 > > My 2 scripts > > cassandra-archive.sh: > > bzip2 --best -k $1 > mv $1.bz2 /produits/cassandra/cassandra_data/archived_commit/$2.bz2 > > > cassandra-restore.sh: > cp -f $1 $2 > bzip2 -d $2 > > > > For an example, at 2013:12:11 17:30:00 i had truncate a table which belong > to a keyspace with no replication on one node, after that i made a nodetool > flush. So when i restore to 2013:12:11 17:00:00 i expect to have my table > bein fill up again. > > The node restart with this config correctly, i see my archive commit log > come back to my commitlogdirectory, seems bizarre to me that these ones > finish by *.out like CommitLog-3-1386927339271.log.out and not just .log. > Everything is normal ? > > When i query my table now, this one is still empty. Finaly my restore > doesn't work and i wonder why ? > > Do i have to make a restore on all nodes ? my keyspace have no replication > but perhaps restore need same operation on all node. > > I miss something, i don't know. > > Thanks for your help. > > > --001a1134609ca7371b04ed6de014 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
As someone told you this feature was added by Netflix to w= ork with Priam (cassandra management tool). Priam itself uses it for severa= l months only, so I doubt if anybody uses this feature in production. Any w= ay, you can ping guys working on Priam. This is your best bet.

Let us know if you can figure out how to us= e it.

Thank you,
=A0 Andrey=A0


On Fri, Dec 1= 3, 2013 at 6:31 AM, Bonnet Jonathan. <jonathan.bonnet= @externe.bnpparibas.com> wrote:
Hello,

=A0 As i told you i began to explore restore operations, see my config for<= br> archive commit logs:

archive_command=3D/bin/bash /produits/cassandra/scripts/cassandra-archive.s= h
%path %name

restore_command=3D/bin/bash /produits/cassandra/scripts/cassandra-restore.s= h
%from %to

restore_directories=3D/produits/cassandra/cassandra_data/archived_commit
restore_point_in_time=3D2013:12:11 17:00:00

My 2 scripts

cassandra-archive.sh:

bzip2 --best -k $1
mv $1.bz2 /produits/cassandra/cassandra_data/archived_commit/$2.bz2


cassandra-restore.sh:
cp -f $1 $2
bzip2 -d $2



For an example, at 2013:12:11 17:30:00 i had truncate a table which belong<= br> to a keyspace with no replication on one node, after that i made a nodetool=
flush. So when i restore to 2013:12:11 17:00:00 i expect to have my table bein fill up again.

The node restart with this config correctly, i see my archive commit log come back to my commitlogdirectory, seems bizarre to me that these ones
finish by *.out like CommitLog-3-1386927339271.log.out and not just .log. Everything is normal ?

When i query my table now, this one is still empty. Finaly my restore
doesn't work and i wonder why ?

Do i have to make a restore on all nodes ? my keyspace have no replication<= br> but perhaps restore need same operation on all node.

I miss something, i don't know.

Thanks for your help.



--001a1134609ca7371b04ed6de014--