Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 47839 invoked from network); 16 Jun 2010 00:58:15 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 16 Jun 2010 00:58:15 -0000 Received: (qmail 34262 invoked by uid 500); 16 Jun 2010 00:58:14 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 34218 invoked by uid 500); 16 Jun 2010 00:58:13 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 34210 invoked by uid 99); 16 Jun 2010 00:58:13 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Jun 2010 00:58:13 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jshook@gmail.com designates 209.85.212.44 as permitted sender) Received: from [209.85.212.44] (HELO mail-vw0-f44.google.com) (209.85.212.44) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Jun 2010 00:58:06 +0000 Received: by vws9 with SMTP id 9so7431871vws.31 for ; Tue, 15 Jun 2010 17:57:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type; bh=5RMBv7PU0AfbkQHQAxbDi/Fju66mfAxeOq1pJMnsGws=; b=tBo6y5+UwccZ/PHdMfxMwMWJjouEt9OnYJ0336XOLItWffrOv8IONG4t3BGmgkhjn0 1IkX9mQRo1vcd/m6hEMXjdNNXmx6Q0CLBtFvbuKXw/4Vy/oLOIuq7yE/JIMUbKjGjQZd 606X3fEQDTDyAukMhNoa1+60y/vN57lRtTs+8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=vBrl2APAaapxujVGSKKsG0nVttaGLXd63++qcbQbrtlZyjYm6c9HE6TA+4xdtTOvGE GL6kkQ1x5iNVvzUWyEBN6dxM1NYcTBkMPMGgsyx1AgJfOtbpeKuMafmam0iNhZarwu26 lnXmYULthifbO6oGE016+H3rneFQjQ4et6XPc= MIME-Version: 1.0 Received: by 10.224.52.27 with SMTP id f27mr3548707qag.359.1276649864958; Tue, 15 Jun 2010 17:57:44 -0700 (PDT) Received: by 10.229.87.133 with HTTP; Tue, 15 Jun 2010 17:57:44 -0700 (PDT) In-Reply-To: References: <590CDE7A083C4142AF05E96F2FB543BC973BF0@r-exchange.cardlink.local> Date: Tue, 15 Jun 2010 19:57:44 -0500 Message-ID: Subject: Re: Some questions about using Cassandra From: Jonathan Shook To: user@cassandra.apache.org Content-Type: multipart/related; boundary=00c09f89935bb4154c04891b35a3 X-Virus-Checked: Checked by ClamAV on apache.org --00c09f89935bb4154c04891b35a3 Content-Type: multipart/alternative; boundary=00c09f89935bb4154104891b35a2 --00c09f89935bb4154104891b35a2 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Doh! Replace "of" with "if" in the top line. On Tue, Jun 15, 2010 at 7:57 PM, Jonathan Shook wrote: > There is JSON import and export, of you want a form of external backup. > > No, you can't hook event subscribers into the storage engine. You can > modify it to do this, however. It may not be trivial. > > An easier way to do this would be to have a boundary system (or dedicated > thread, for example) consume data in small amounts, using some temporal > criterion, with a checkpoint. If the results of consuming the data are > idempotent, you don't have to use a checkpoint, necessarily, but some cyc= lic > rework may occur. > > If your storage layout includes temporal names, it should be > straightforward. The details how exactly how would depend on your storage > layout, but it is not unusual as far as requirements go. > > > > On Tue, Jun 15, 2010 at 7:49 PM, Anthony Ikeda < > Anthony.Ikeda@cardlink.com.au> wrote: > >> We are currently looking at a distributed database option and so far >> Cassandra ticks all the boxes. However, I still have some questions. >> >> >> >> Is there any need for archiving of Cassandra and what backup options are >> available? As it is a no-data-loss system I=92m guessing archiving is no= t >> exactly relevant. >> >> >> >> Is there any concept of Listeners such that when data is added to >> Cassandra we can fire off another process to do something with that data= ? >> E.g. create a copy in a secondary database for Business Intelligence >> reports? Send the data to an LDAP server? >> >> >> >> >> >> Anthony Ikeda >> >> Java Analyst/Programmer >> >> Cardlink Services Limited >> >> Level 4, 3 Rider Boulevard >> >> Rhodes NSW 2138 >> >> >> >> Web: www.cardlink.com.au | Tel: + 61 2 9646 9221 | Fax: + 61 2 9646 9283 >> >> [image: logo_cardlink1] >> >> >> >> ********************************************************************** >> This e-mail message and any attachments are intended only for the use of >> the addressee(s) named above and may contain information that is privile= ged >> and confidential. If you are not the intended recipient, any display, >> dissemination, distribution, or copying is strictly prohibited. If you >> believe you have received this e-mail message in error, please immediate= ly >> notify the sender by replying to this e-mail message or by telephone to = (02) >> 9646 9222. Please delete the email and any attachments and do not retain= the >> email or any attachments in any form. >> ********************************************************************** >> > > --00c09f89935bb4154104891b35a2 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Doh! Replace "of" with "if" in the top line.

On Tue, Jun 15, 2010 at 7:57 PM, Jonathan Shook <jshook@gmail.com= > wrote:
There is JSON imp= ort and export, of you want a form of external backup.

No, you can&#= 39;t hook event subscribers into the storage engine. You can modify it to d= o this, however. It may not be trivial.

An easier way to do this would be to have a boundary system (or dedicat= ed thread, for example) consume data in small amounts, using some temporal = criterion, with a checkpoint. If the results of consuming the data are idem= potent, you don't have to use a checkpoint, necessarily, but some cycli= c rework may occur.

If your storage layout includes temporal names, it should be straightfo= rward. The details how exactly how would depend on your storage layout, but= it is not unusual as far as requirements go.



On Tue, Jun 15, 2010 at 7:49 PM, Anthony Ikeda <Anthony.Ikeda@= cardlink.com.au> wrote:

We are currently looking at a distributed database o= ption and so far Cassandra ticks all the boxes. However, I still have some questi= ons.

=A0

Is there any need for archiving of Cassandra and wha= t backup options are available? As it is a no-data-loss system I=92m guessing archiving is not exactly relevant.

=A0

Is there any concept of Listeners such that when dat= a is added to Cassandra we can fire off another process to do something with tha= t data? E.g. create a copy in a secondary database for Business Intelligence reports? Send the data to an LDAP server?

=A0

=A0

Anthony Ikeda

Java Analyst/Programmer<= /p>

Cardlink Services Limited

Level 4, 3 Rider Boulevard

Rhodes NSW 2138

=A0

Web: www.cardlink.com.a= u | Tel: + 61 2 9646 9221 | Fax: + 61 2 9646 9283

=3D"logo_cardlink1"

=A0


**********************************************************************
This e-mail message and any attachments are intended only for the use of th= e addressee(s) named above and may contain information that is privileged a= nd confidential. If you are not the intended recipient, any display, dissem= ination, distribution, or copying is strictly prohibited. If you believe = you have received this e-mail message in error, please immediately notify t= he sender by replying to this e-mail message or by telephone to (02) 9646 9= 222. Please delete the email and any attachments and do not retain the emai= l or any attachments in any form.
**********************************************************************


--00c09f89935bb4154104891b35a2-- --00c09f89935bb4154c04891b35a3 Content-Type: image/gif; name="image001.gif" Content-Transfer-Encoding: base64 Content-ID: X-Attachment-Id: 671c18e305b34041_0.1 R0lGODlhmwBsAOYAAHcAAPzezYqIiXRzc8C+v40+JO2KZOHg4NYAGqWkpf////fRu+2rirxrTdOO bt0rJuNaPLwAEttEL359fejn5/707szMzLt8X6+urvGjfuXCrpkAANetlbBDKsWNcZmZmeZsSff3 94EfDeS3n7cAD8tePeh7Vu6XcdjX2O/v76RUONqdfv3p3vDd0dR7WOXLu4QAAN+0nJmZmbi2t8YA FrlgQbcfGtVCLZInE5pEKfjHrfa8nfft58uBX3wcCpgTD8ubgd2VdOG+quBpRtaiiJpPNOy0l/PX x4wAAM4AF+u9pOGDX/fOte/e1tqmi30AAKNcQdNTN5NBJ8+Ud95zUqhMMPnTvd5KMfSwjsMAFN6c c9uwmPC4mpkAAJ9HLOGPavjbytaljHsHAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5 BAQUAP8ALAAAAACbAGwAAAf/gAqCg4SFhoeIiYqLjI2Oj5CRkpOUlZaXmJmam5ydnp+goaKjpKWm p6ipqqusra6vsLGys7S1tre4ubq7vL2+v8DBwsPExcbHyMnKy8zNzs/Q0dLT1NXW19jZ2tvc3d7f 4OHi4+Tl5ufo6err7O3u7/Dx8rNWBvOkFScIIPejBhAIrvQbBQLLg4GhTvCzgvDTDgQBGn7SgeCE RE8BHkiocJFTRgQMO2r6aFFkpo8QOJq89PFBxJWWrDxAgEAHTEsPaWK5WSkDTQT2eEqqYOJnUKGH FijREqRp0yMBrhhFSqgClyVRsmSJwJUECRtKsPwEOmIE1R1UkqilwZYG1xIu/8CAGHvCwYa7NZzw MFkhgwQEatVG+WIEzCCfY3coWNGjw90NPxpokNh35s8bDFgU0iH1p8tCPEY0+IEESRUiAzmPHbLA kJW5Y0GoRBSjAQwYOFDHIxo7JKEdAMc+2NmIxxQcT7wIeSfTM/FBAU5Yjq050hYvAFTsXYeYJoSX Cqyc6Dw2oM1KQnKI8ZCuggHhOzL8Ky88gyYOIqS0MFchOP3/NF2BxWyaXOADB+T0ByCAICgGSgtF QLHdNwouONYVJ1Q3CgcF7OdNhRYWBJ4pPEDxQjcglneFCRn41kgIB8R4gAIsWGHjiJAAgWAhAdho BYHNZADCkBkUaWMlBwyg5P8HCnRnnyEsFFlkIi9MKAhsIA1DAQEffDDABF0SQIEoSS6pAJZPFpIT AhBAMh2OvBzgpZJ01mlBKATQicGZPzlYSHf8PDJWMDPUaSidKeBJJwEKTOfiIPrQdBQjFQz6CwaG TpAAAQRg4GUComCq5J1jPSpIfEY+YsVPbfpSKJ0C3FlIComGMucAB1T6Eyer0hRonHV+EMIiKWAg gJIJzIhCl0zO0CWoFjB7ZwhcLnnnrQf0ShMiCg0ZwA5DghBAX3M9YMJ5TU4lCFHhpinLrQIMq0ie h0Zr5gRLijoqCvgaqu8AIWgr0CFjsfAeTR+VV5KT6/qXEi0U2LkIvYcGq0D/xV+WiTGdCojlKyKD YjldeQwdjMBOID5MC8UCLBIxnRPMQEAChiYQAsYJHKsnAa/Cmu7HhgTgmQL+0cRi0fZg+aN/BgAZ C81K7qkI1APEOwjFAxCgccaCWFDnmIJszaTJ7g6iLT/C+YYlP/7pwDQutzKaSAp1zjjIzYtuDbYC OmddyK1MonkIRR+XSgjh+yhwobq3xK2I10q2/DedB1DMpCB0I1oIxYxi6Sch3Z0gNE0HHf4T2vRN asutM8yrpyHYcj6IxpITIrvhhjh59p8/if7fc43TeTkishfS7wDFLjoICsIbQjUKiv8EpwJF0bQD 4r8KojuA08uCtd2HUNw6/yEvK6kAtoNAPsDwgxx/AAuWGqI0w4RUfzLiEkynsi3lf7n35s0jBNUG cD7Kza5O8ura17SFAESQxwr0G8T8fpIBxFUkFwOcAAESqIAUWEB9A5CVAnq2vovRKYGZi9ryDKUA xLXKECH7CboE8UCG2a8muAjB8YTXpX7xK1gf6JuZ6jQ5WHXpUD9bEPx2pbRCxJAmNqkAeR7gNFlQ 4FYY4xTGjjeD8k2gEFur0/GY1B0AaatN5NGQIJ6YpfDEJhfU2qGhWkdCZDFPSVoLICEsIMcPlI9J N6TPA3YXP0EITAHkAU+kdLKLynkqTBaoVQdntqkxwShGKbjkAf53Nwt4ijIA0FOAjMbUIx+Z8kYV 8FFETFmIVN4oPD6qyimpQsta2vKWuMylLnfJy1768pfANEcgAAA7 --00c09f89935bb4154c04891b35a3--