Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4BD494047 for ; Mon, 6 Jun 2011 14:18:04 +0000 (UTC) Received: (qmail 75215 invoked by uid 500); 6 Jun 2011 14:18:02 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 75188 invoked by uid 500); 6 Jun 2011 14:18:02 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 75178 invoked by uid 99); 6 Jun 2011 14:18:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Jun 2011 14:18:02 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of tmarthinussen@gmail.com designates 74.125.82.172 as permitted sender) Received: from [74.125.82.172] (HELO mail-wy0-f172.google.com) (74.125.82.172) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Jun 2011 14:17:56 +0000 Received: by wyb29 with SMTP id 29so3398107wyb.31 for ; Mon, 06 Jun 2011 07:17:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=8/qsEJRsRYhisjGjcOAFkW3un6bGAQR2JH617Adv8tk=; b=vEF6/pk7hnPAUcZludGK9rOoW00XblGUyWWaZ9wZV8tgoCSDHQdkSyHPMflBwyZeZ/ tgHTJuwG1OrLOHHFeKIJU8XmhccTDK2sy/iOAsDdx7cYYh7JyDfzj/6XoJ0YxcqsayNq lBEfuEnnqR7EO8w/PhOFPOevcYw6ZzsBfy/dk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=GaQfBtuasoZaeGxqjJJpbJKRFUamzWDf9ySNo5wm7YnF4oVtjCXAEesxQqzZio50WI sB2haXAhYav8PL2JChR+1BmJZVgbs70r2SrgXdExcgEl/4v8WY7SlJ/UDVszx/NqKYdV S21k3gLnYxZ/yz0aIWTszZZtmY0IajN3OlCmA= MIME-Version: 1.0 Received: by 10.216.52.193 with SMTP id e43mr2564695wec.40.1307369855627; Mon, 06 Jun 2011 07:17:35 -0700 (PDT) Received: by 10.216.3.13 with HTTP; Mon, 6 Jun 2011 07:17:35 -0700 (PDT) In-Reply-To: References: <1307057809.11384.40.camel@erebus.lan> Date: Mon, 6 Jun 2011 23:17:35 +0900 Message-ID: Subject: Re: [RELEASE] 0.8.0 From: Terje Marthinussen To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=0016e6dee70fd5b10f04a50bc30c X-Virus-Checked: Checked by ClamAV on apache.org --0016e6dee70fd5b10f04a50bc30c Content-Type: text/plain; charset=ISO-8859-1 How did that typo happen... "across a committed hints file" should be "across a corrupted hints file" Seems like the last supercolumn in the hints file has 0 subcolumns. This actually seem to be correctly serialized, but my code has a bug and fail to read it. When that is said, I wonder why the hint has 0 subcolumns in the first place? Is that expected behaviour? Regards, Terje On Mon, Jun 6, 2011 at 10:09 PM, Terje Marthinussen wrote: > Of course I talked too soon. > I saw a corrupted commitlog some days back after killing cassandra and I > just came across a committed hints file after a cluster restart for some > config changes :( > Will look into that. > > Otherwise, not defaults, but close. > The dataset is fed from scratch so yes, memtable_total_space is there. > > Some option tuning here and there and a few extra GC options and a > relatively large patch which makes more compact serialization (this may help > a bit...) > > Most of the tuning dates back to cassandra 0.6/0.7. It could be an > interesting experiment to see if things got worse without them on 0.8. > > Hopefully I can submit the serialization patch soon. > > Regards, > Terje > > On Mon, Jun 6, 2011 at 9:12 PM, Jonathan Ellis wrote: > >> Has this been running w/ default settings (i.e. relying on the new >> memtable_total_space_in_mb) or was this an upgrade from 0.7 (or >> otherwise had the per-CF memtable settings applied?) >> >> On Mon, Jun 6, 2011 at 12:00 AM, Terje Marthinussen >> wrote: >> > 0.8 under load may turn out to be more stable and well behaving than any >> > release so far >> > Been doing a few test runs stuffing more than 1 billion records into a >> 12 >> > node cluster and thing looks better than ever. >> > VM's stable and nice at 11GB. No data corruptions, dead nodes, full GC's >> or >> > any of the other trouble that plagued early 0.7 releases. >> > Still have to test more nasty stuff like rebalancing or recovering >> failed >> > nodes, but so far I would recommend anyone to consider 0.8 over 0.7.x >> if >> > setting up a new system >> > Terje >> > >> > On Fri, Jun 3, 2011 at 5:25 PM, Stephen Connolly >> > wrote: >> >> >> >> Great work! >> >> >> >> -Stephen >> >> >> >> P.S. >> >> As the release of artifacts to Maven Central is now part of the >> >> release process, the artifacts are all available from Maven Central >> >> already (for people who use Maven/ANT+Ivy/Gradle/Buildr/etc) >> >> >> >> On 3 June 2011 00:36, Eric Evans wrote: >> >> > >> >> > I am very pleased to announce the official release of Cassandra >> 0.8.0. >> >> > >> >> > If you haven't been paying attention to this release, this is your >> last >> >> > chance, because by this time tomorrow all your friends are going to >> be >> >> > raving, and you don't want to look silly. >> >> > >> >> > So why am I resorting to hyperbole? Well, for one because this is >> the >> >> > release that debuts the Cassandra Query Language (CQL). In one fell >> >> > swoop Cassandra has become more than NoSQL, it's MoSQL. >> >> > >> >> > Cassandra also has distributed counters now. With counters, you can >> >> > count stuff, and counting stuff rocks. >> >> > >> >> > A kickass use-case for Cassandra is spanning data-centers for >> >> > fault-tolerance and locality, but doing so has always meant sending >> data >> >> > in the clear, or tunneling over a VPN. New for 0.8.0, encryption of >> >> > intranode traffic. >> >> > >> >> > If you're not motivated to go upgrade your clusters right now, you're >> >> > either not easily impressed, or you're very lazy. If it's the >> latter, >> >> > would it help knowing that rolling upgrades between releases is now >> >> > supported? Yeah. You can upgrade your 0.7 cluster to 0.8 without >> >> > shutting it down. >> >> > >> >> > You see what I mean? Then go read the release notes[1] to learn >> about >> >> > the full range of awesomeness, then grab a copy[2] and become a >> >> > (fashionably )early adopter. >> >> > >> >> > Drivers for CQL are available in Python[3], Java[3], and Node.js[4]. >> >> > >> >> > As usual, a Debian package is available from the project's APT >> >> > repository[5]. >> >> > >> >> > Enjoy! >> >> > >> >> > >> >> > [1]: http://goo.gl/CrJqJ (NEWS.txt) >> >> > [2]: http://cassandra.debian.org/download >> >> > [3]: http://www.apache.org/dist/cassandra/drivers >> >> > [4]: https://github.com/racker/node-cassandra-client >> >> > [5]: http://wiki.apache.org/cassandra/DebianPackaging >> >> > >> >> > -- >> >> > Eric Evans >> >> > eevans@rackspace.com >> >> > >> >> > >> > >> > >> >> >> >> -- >> Jonathan Ellis >> Project Chair, Apache Cassandra >> co-founder of DataStax, the source for professional Cassandra support >> http://www.datastax.com >> > > --0016e6dee70fd5b10f04a50bc30c Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable How did that typo happen...
"across a committed hints file"
should be=A0
"across a corrupted hints file"

Seems like the last supercolumn in the hints file has 0 subc= olumns.
This actually seem to be correctly serialized, but my cod= e has a bug and fail to read it.

When that is said= , I wonder why the hint has 0 subcolumns in the first place?=A0
Is that expected behaviour?

Regards,
Terje


On Mon, Jun 6, 20= 11 at 10:09 PM, Terje Marthinussen <tmarthinussen@gmail.com> wrote:
Of course I talked too soon.=A0
<= div>I saw a corrupted commitlog some days back after killing cassandra and = I just came across a committed hints file after a cluster restart for some = config changes :(
Will look into that.

Otherwise, not defaults, but close.
The dataset is fed f= rom scratch so yes, memtable_total_space is there.

S= ome option tuning here and there and a few extra GC options and a relativel= y large patch which makes more compact serialization (this may help a bit..= .)

Most of the tuning dates back to cassandra 0.6/0.7. It = could be an interesting experiment to see if things got worse without them = on 0.8.

Hopefully I can submit the serialization p= atch soon.=A0

Regards,=A0
Terje

On Mon, Jun 6, 2011 at 9:12= PM, Jonathan Ellis <jbellis@gmail.com> wrote:
Has this been running w/ default settings (i= .e. relying on the new
memtable_total_space_in_mb) or was this an upgrade from 0.7 (or
otherwise had the per-CF memtable settings applied?)

On Mon, Jun 6, 2011 at 12:00 AM, Terje Marthinussen
<tmarthinus= sen@gmail.com> wrote:
> 0.8 under load may turn out to be more stable and well behaving than a= ny
> release so far
> Been doing a few test runs stuffing more than 1 billion records into a= 12
> node cluster and thing looks better than ever.
> VM's stable and nice at 11GB. No data corruptions, dead nodes, ful= l GC's or
> any of the other trouble that plagued early 0.7 releases.
> Still have to test more nasty stuff like rebalancing or recovering fai= led
> nodes, but so far I would recommend anyone to consider =A00.8 over 0.7= .x if
> setting up a new system
> Terje
>
> On Fri, Jun 3, 2011 at 5:25 PM, Stephen Connolly
> <stephen.alan.connolly@gmail.com> wrote:
>>
>> Great work!
>>
>> -Stephen
>>
>> P.S.
>> =A0As the release of artifacts to Maven Central is now part of the=
>> release process, the artifacts are all available from Maven Centra= l
>> already (for people who use Maven/ANT+Ivy/Gradle/Buildr/etc)
>>
>> On 3 June 2011 00:36, Eric Evans <eevans@rackspace.com> wrote:
>> >
>> > I am very pleased to announce the official release of Cassand= ra 0.8.0.
>> >
>> > If you haven't been paying attention to this release, thi= s is your last
>> > chance, because by this time tomorrow all your friends are go= ing to be
>> > raving, and you don't want to look silly.
>> >
>> > So why am I resorting to hyperbole? =A0Well, for one because = this is the
>> > release that debuts the Cassandra Query Language (CQL). =A0In= one fell
>> > swoop Cassandra has become more than NoSQL, it's MoSQL. >> >
>> > Cassandra also has distributed counters now. =A0With counters= , you can
>> > count stuff, and counting stuff rocks.
>> >
>> > A kickass use-case for Cassandra is spanning data-centers for=
>> > fault-tolerance and locality, but doing so has always meant s= ending data
>> > in the clear, or tunneling over a VPN. =A0 New for 0.8.0, enc= ryption of
>> > intranode traffic.
>> >
>> > If you're not motivated to go upgrade your clusters right= now, you're
>> > either not easily impressed, or you're very lazy. =A0If i= t's the latter,
>> > would it help knowing that rolling upgrades between releases = is now
>> > supported? =A0Yeah. =A0You can upgrade your 0.7 cluster to 0.= 8 without
>> > shutting it down.
>> >
>> > You see what I mean? =A0Then go read the release notes[1] to = learn about
>> > the full range of awesomeness, then grab a copy[2] and become= a
>> > (fashionably )early adopter.
>> >
>> > Drivers for CQL are available in Python[3], Java[3], and Node= .js[4].
>> >
>> > As usual, a Debian package is available from the project'= s APT
>> > repository[5].
>> >
>> > Enjoy!
>> >
>> >
>> > [1]: http:/= /goo.gl/CrJqJ (NEWS.txt)
>> > [2]: http://cassandra.debian.org/download
>> > [3]: http://www.apache.org/dist/cassandra/drivers
>> > [4]: https://github.com/racker/node-cassandra-client >> > [5]: http://wiki.apache.org/cassandra/DebianPackaging=
>> >
>> > --
>> > Eric Evans
>> > eev= ans@rackspace.com
>> >
>> >
>
>



--
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.c= om


--0016e6dee70fd5b10f04a50bc30c--