Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 65219 invoked from network); 16 Jun 2010 01:08:32 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 16 Jun 2010 01:08:32 -0000 Received: (qmail 45758 invoked by uid 500); 16 Jun 2010 01:08:30 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 45728 invoked by uid 500); 16 Jun 2010 01:08:30 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 45720 invoked by uid 99); 16 Jun 2010 01:08:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Jun 2010 01:08:30 +0000 X-ASF-Spam-Status: No, hits=2.9 required=10.0 tests=EXTRA_MPART_TYPE,HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [117.120.16.147] (HELO mail62.messagelabs.com) (117.120.16.147) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Jun 2010 01:08:22 +0000 X-VirusChecked: Checked X-Env-Sender: Anthony.Ikeda@cardlink.com.au X-Msg-Ref: server-8.tower-62.messagelabs.com!1276650475!13060779!1 X-StarScan-Version: 6.2.4; banners=cardlink.com.au,-,- X-Originating-IP: [203.36.58.163] Received: (qmail 1323 invoked from network); 16 Jun 2010 01:07:55 -0000 Received: from unknown (HELO rmail.5f55.cardlink.local) (203.36.58.163) by server-8.tower-62.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 16 Jun 2010 01:07:55 -0000 Received: from r-exchange.cardlink.local (r-exchange.cardlink.local [10.3.3.3]) by rmail.5f55.cardlink.local (8.13.5.20060308/8.13.4) with ESMTP id o5G17mLK024043 for ; Wed, 16 Jun 2010 11:07:48 +1000 (EST) X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: multipart/related; boundary="----_=_NextPart_001_01CB0CF0.55FEB35F"; type="multipart/alternative" Subject: RE: Some questions about using Cassandra Date: Wed, 16 Jun 2010 11:07:47 +1000 Message-ID: <590CDE7A083C4142AF05E96F2FB543BC973BF3@r-exchange.cardlink.local> In-Reply-To: X-MS-Has-Attach: yes X-MS-TNEF-Correlator: Thread-Topic: Some questions about using Cassandra Thread-Index: AcsM7wNuMihh1IXCRPa+dYDmBlg1uQAAI4Vw References: <590CDE7A083C4142AF05E96F2FB543BC973BF0@r-exchange.cardlink.local> From: "Anthony Ikeda" To: X-Virus-Checked: Checked by ClamAV on apache.org This is a multi-part message in MIME format. ------_=_NextPart_001_01CB0CF0.55FEB35F Content-Type: multipart/alternative; boundary="----_=_NextPart_002_01CB0CF0.55FEB35F" ------_=_NextPart_002_01CB0CF0.55FEB35F Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Thanks Jonathan, I was only asking about the event listeners because an alternative we are considering is TIBCO Active Spaces which draws quite a lot of parallels to Cassandra. =20 I guess it would be interesting to find out how other people use Cassandra, i.e., is it your one stop shop for data storage or do you also store to a RDBMs to re-use the data? One factor I need to consider is our Business Intelligence platform that will need to use the data stored for reporting purposes. =20 We are looking at using Cassandra for our real-time layer for Active-Active data centre use and perhaps have Oracle installed alongside for non-real-time use such that data is mediated to the Oracle database for other uses. =20 Anthony =20 =20 =20 =20 From: Jonathan Shook [mailto:jshook@gmail.com]=20 Sent: Wednesday, 16 June 2010 10:58 AM To: user@cassandra.apache.org Subject: Re: Some questions about using Cassandra =20 Doh! Replace "of" with "if" in the top line. On Tue, Jun 15, 2010 at 7:57 PM, Jonathan Shook wrote: There is JSON import and export, of you want a form of external backup. No, you can't hook event subscribers into the storage engine. You can modify it to do this, however. It may not be trivial. An easier way to do this would be to have a boundary system (or dedicated thread, for example) consume data in small amounts, using some temporal criterion, with a checkpoint. If the results of consuming the data are idempotent, you don't have to use a checkpoint, necessarily, but some cyclic rework may occur. If your storage layout includes temporal names, it should be straightforward. The details how exactly how would depend on your storage layout, but it is not unusual as far as requirements go. On Tue, Jun 15, 2010 at 7:49 PM, Anthony Ikeda < Anthony.Ikeda@cardlink.com.au> wrote: We are currently looking at a distributed database option and so far Cassandra ticks all the boxes. However, I still have some questions. =20 Is there any need for archiving of Cassandra and what backup options are available? As it is a no-data-loss system I'm guessing archiving is not exactly relevant. =20 Is there any concept of Listeners such that when data is added to Cassandra we can fire off another process to do something with that data? E.g. create a copy in a secondary database for Business Intelligence reports? Send the data to an LDAP server? =20 =20 Anthony Ikeda Java Analyst/Programmer Cardlink Services Limited Level 4, 3 Rider Boulevard Rhodes NSW 2138 =20 Web: www.cardlink.com.au | Tel: + 61 2 9646 9221 | Fax: + 61 2 9646 9283 =20 =20 ********************************************************************** This e-mail message and any attachments are intended only for the use of the addressee(s) named above and may contain information that is privileged and confidential. If you are not the intended recipient, any display, dissemination, distribution, or copying is strictly prohibited. If you believe you have received this e-mail message in error, please immediately notify the sender by replying to this e-mail message or by telephone to (02) 9646 9222. Please delete the email and any attachments and do not retain the email or any attachments in any form. ********************************************************************** =20 _____________________________________________________________________=20 This e-mail has been scanned for viruses by MCI's Internet Managed=20 Scanning Services - powered by MessageLabs. For further information=20 visit http://www.mci.com ********************************************************************** This e-mail message and any attachments are intended only for the use of t= he addressee(s) named above and may contain information that is privileged= and confidential. If you are not the intended recipient, any display, dis= semination, distribution, or copying is strictly prohibited. If you beli= eve you have received this e-mail message in error, please immediately not= ify the sender by replying to this e-mail message or by telephone to (02) = 9646 9222. Please delete the email and any attachments and do not retain t= he email or any attachments in any form. ********************************************************************** ------_=_NextPart_002_01CB0CF0.55FEB35F Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Thanks Jonathan, I was only asking about the event listener= s because an alternative we are considering is TIBCO Active Spaces which dra= ws quite a lot of parallels to Cassandra.

 

I guess it would be interesting to find out how other peopl= e use Cassandra, i.e., is it your one stop shop for data storage or do you also = store to a RDBMs to re-use the data? One factor I need to consider is our Busine= ss Intelligence platform that will need to use the data stored for reporting purposes.

 

We are looking at using Cassandra for our real-time layer f= or Active-Active data centre use and perhaps have Oracle installed alongside = for non-real-time use such that data is mediated to the Oracle database for ot= her uses.

 

Anthony

 

 

 

 

From: Jonathan Shook [mailto:jshook@gmail.co= m]
Sent: Wednesday, 16 June 2010 10:58 AM
To: user@cassandra.apache.org
Subject: Re: Some questions about using Cassandra=

 

Doh! Replace "of&= quot; with "if" in the top line.

On Tue, Jun 15, 2010 at 7:57 PM, Jonathan Shook <<= a href=3D"mailto:jshook@gmail.com">jshook@gmail.com> wrote:

There is JSON import and export, of you want a form o= f external backup.

No, you can't hook event subscribers into the storage engine. You can modi= fy it to do this, however. It may not be trivial.

An easier way to do this would be to have a boundary system (or dedicated thread, for example) consume data in small amounts, using some temporal criterion, with a checkpoint. If the results of consuming the data are idempotent, you don't have to use a checkpoint, necessarily, but some cycl= ic rework may occur.

If your storage layout includes temporal names, it should be straightforwa= rd. The details how exactly how would depend on your storage layout, but it is= not unusual as far as requirements go.



On Tue, Jun 15, 2010 at 7:49 PM, Anthony Ikeda <Anthony.Ik= eda@cardlink.com.au> wrote:

We are currently looking at a distributed database option and so far Cassandr= a ticks all the boxes. However, I still have some questions.

 

Is there any need for archiving of Cassandra and what backup options are available? As it is a no-data-loss system I’m guessing archiving is = not exactly relevant.

 

Is there any concept of Listeners such that when data is added to Cassandra w= e can fire off another process to do something with that data? E.g. create a cop= y in a secondary database for Business Intelligence reports? Send the data to a= n LDAP server?

 

 

Anthony Ikeda

Java Analyst/Programmer

Cardlink Services Limited

Level 4, 3 Ri= der Boulevard

Rhodes NSW 21= 38

 =

Web:=20www.cardlink.com.au<= /a> | Tel: + 61 2 9646 9221 | Fax: + 61 2 9646 9283

3D"logo_cardlink1"

 


**********************************************************************
= This e-mail message and any attachments are intended only for the use of t= he addressee(s) named above and may contain information that is privileged an= d confidential. If you are not the intended recipient, any display, dissemination, distribution, or copying is strictly prohibited. If you bel= ieve you have received this e-mail message in error, please immediately notify = the sender by replying to this e-mail message or by telephone to (02) 9646 922= 2. Please delete the email and any attachments and do not retain the email or= any attachments in any form.
**********************************************************************

 



_____________________________________________________________________
= This e-mail has been scanned for viruses by MCI's Internet Managed
Scanning Services - powered by MessageLabs. For further information
visit http://www.mci.com


**********************************************************************
= This e-mail message and any attachments are intended only for the use of t= he addressee(s) named above and may contain information that is privileged= and confidential. If you are not the intended recipient, any display, dis= semination, distribution, or copying is strictly prohibited. If you beli= eve you have received this e-mail message in error, please immediately not= ify the sender by replying to this e-mail message or by telephone to (02) = 9646 9222. Please delete the email and any attachments and do not retain t= he email or any attachments in any form.
**********************************************************************
= ------_=_NextPart_002_01CB0CF0.55FEB35F-- ------_=_NextPart_001_01CB0CF0.55FEB35F Content-Type: image/gif; name="image001.gif" Content-Transfer-Encoding: base64 Content-ID: Content-Description: image001.gif Content-Location: image001.gif R0lGODlhmwBsAOYAAHcAAPzezYqIiXRzc8C+v40+JO2KZOHg4NYAGqWkpf////fRu+2rirxrTdOO bt0rJuNaPLwAEttEL359fejn5/707szMzLt8X6+urvGjfuXCrpkAANetlbBDKsWNcZmZmeZsSff3 94EfDeS3n7cAD8tePeh7Vu6XcdjX2O/v76RUONqdfv3p3vDd0dR7WOXLu4QAAN+0nJmZmbi2t8YA FrlgQbcfGtVCLZInE5pEKfjHrfa8nfft58uBX3wcCpgTD8ubgd2VdOG+quBpRtaiiJpPNOy0l/PX x4wAAM4AF+u9pOGDX/fOte/e1tqmi30AAKNcQdNTN5NBJ8+Ud95zUqhMMPnTvd5KMfSwjsMAFN6c c9uwmPC4mpkAAJ9HLOGPavjbytaljHsHAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5 BAQUAP8ALAAAAACbAGwAAAf/gAqCg4SFhoeIiYqLjI2Oj5CRkpOUlZaXmJmam5ydnp+goaKjpKWm p6ipqqusra6vsLGys7S1tre4ubq7vL2+v8DBwsPExcbHyMnKy8zNzs/Q0dLT1NXW19jZ2tvc3d7f 4OHi4+Tl5ufo6err7O3u7/Dx8rNWBvOkFScIIPejBhAIrvQbBQLLg4GhTvCzgvDTDgQBGn7SgeCE RE8BHkiocJFTRgQMO2r6aFFkpo8QOJq89PFBxJWWrDxAgEAHTEsPaWK5WSkDTQT2eEqqYOJnUKGH FijREqRp0yMBrhhFSqgClyVRsmSJwJUECRtKsPwEOmIE1R1UkqilwZYG1xIu/8CAGHvCwYa7NZzw MFkhgwQEatVG+WIEzCCfY3coWNGjw90NPxpokNh35s8bDFgU0iH1p8tCPEY0+IEESRUiAzmPHbLA kJW5Y0GoRBSjAQwYOFDHIxo7JKEdAMc+2NmIxxQcT7wIeSfTM/FBAU5Yjq050hYvAFTsXYeYJoSX Cqyc6Dw2oM1KQnKI8ZCuggHhOzL8Ky88gyYOIqS0MFchOP3/NF2BxWyaXOADB+T0ByCAICgGSgtF QLHdNwouONYVJ1Q3CgcF7OdNhRYWBJ4pPEDxQjcglneFCRn41kgIB8R4gAIsWGHjiJAAgWAhAdho BYHNZADCkBkUaWMlBwyg5P8HCnRnnyEsFFlkIi9MKAhsIA1DAQEffDDABF0SQIEoSS6pAJZPFpIT AhBAMh2OvBzgpZJ01mlBKATQicGZPzlYSHf8PDJWMDPUaSidKeBJJwEKTOfiIPrQdBQjFQz6CwaG TpAAAQRg4GUComCq5J1jPSpIfEY+YsVPbfpSKJ0C3FlIComGMucAB1T6Eyer0hRonHV+EMIiKWAg gJIJzIhCl0zO0CWoFjB7ZwhcLnnnrQf0ShMiCg0ZwA5DghBAX3M9YMJ5TU4lCFHhpinLrQIMq0ie h0Zr5gRLijoqCvgaqu8AIWgr0CFjsfAeTR+VV5KT6/qXEi0U2LkIvYcGq0D/xV+WiTGdCojlKyKD YjldeQwdjMBOID5MC8UCLBIxnRPMQEAChiYQAsYJHKsnAa/Cmu7HhgTgmQL+0cRi0fZg+aN/BgAZ C81K7qkI1APEOwjFAxCgccaCWFDnmIJszaTJ7g6iLT/C+YYlP/7pwDQutzKaSAp1zjjIzYtuDbYC OmddyK1MonkIRR+XSgjh+yhwobq3xK2I10q2/DedB1DMpCB0I1oIxYxi6Sch3Z0gNE0HHf4T2vRN asutM8yrpyHYcj6IxpITIrvhhjh59p8/if7fc43TeTkishfS7wDFLjoICsIbQjUKiv8EpwJF0bQD 4r8KojuA08uCtd2HUNw6/yEvK6kAtoNAPsDwgxx/AAuWGqI0w4RUfzLiEkynsi3lf7n35s0jBNUG cD7Kza5O8ura17SFAESQxwr0G8T8fpIBxFUkFwOcAAESqIAUWEB9A5CVAnq2vovRKYGZi9ryDKUA xLXKECH7CboE8UCG2a8muAjB8YTXpX7xK1gf6JuZ6jQ5WHXpUD9bEPx2pbRCxJAmNqkAeR7gNFlQ 4FYY4xTGjjeD8k2gEFur0/GY1B0AaatN5NGQIJ6YpfDEJhfU2qGhWkdCZDFPSVoLICEsIMcPlI9J N6TPA3YXP0EITAHkAU+kdLKLynkqTBaoVQdntqkxwShGKbjkAf53Nwt4ijIA0FOAjMbUIx+Z8kYV 8FFETFmIVN4oPD6qyimpQsta2vKWuMylLnfJy1768pfANEcgAAA7 ------_=_NextPart_001_01CB0CF0.55FEB35F--