Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: local policy)
Subject: Re: Running multiple compactions concurrently
From: Daniel Josefsson <daniel.josefsson@shazamteam.com>
To: "user@cassandra.apache.org" <user@cassandra.apache.org>
In-Reply-To: <AANLkTi=WfrLuWpUDs4k1e6H2+j0TiUCkw5um3AHYYv0_@mail.gmail.com>
References: <AANLkTi=e6m7GzqDwyVH+e-ebnZV8cBjKjAY1D0K8tQsg@mail.gmail.com>
	 <AANLkTi=WfrLuWpUDs4k1e6H2+j0TiUCkw5um3AHYYv0_@mail.gmail.com>
Content-Type: multipart/alternative; boundary="=-Vpirzmp8IAkRlK78v+3z"
Date: Fri, 25 Feb 2011 14:53:13 +0000
Message-ID: <1298645593.2183.6.camel@danielj-OptiPlex-780>
MIME-Version: 1.0

--=-Vpirzmp8IAkRlK78v+3z
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: 7bit

The compaction will be part of a Cassandra upgrade (where all nodes will
have to be taken down), so no clients will be hitting it until the
upgrade is complete. I just want to minimize the downtime.

Thanks, this is basically what I wanted to hear.

Daniel

On Fri, 2011-02-25 at 13:24 +0000, Gary Dusbabek wrote:

> If your cluster has the overall IO capacity to perform a simultaneous
> compaction on every node and still adequately service reads and
> writes, then yes.  If you're concerned about availability, your best
> bet will be to stagger the compactions.
> 
> Gary.
> 
> 
> On Fri, Feb 25, 2011 at 04:24, Daniel Josefsson <jideji@gmail.com> wrote:
> > We experienced the java.lang.NegativeArraySizeException when upgrading to
> > 0.7.2 in staging. The proposed solution (running compaction) seems to have
> > solved this. However it took a lot of time to run.
> >
> > Is it safe to invoke a major compaction on all of the machines concurrently?
> >
> > I can't see a reason why it wouldn't, but I want to be sure :)
> >
> > Thanks,
> > Daniel
> >
> >
> 
> ______________________________________________________________________
> This email has been scanned by the MessageLabs Email Security System.
> For more information please visit http://www.messagelabs.com/email 
> ______________________________________________________________________


-- 


Daniel Josefsson

Software Engineer

Shazam Entertainment Ltd     
26-28 Hammersmith Grove, London W6 7HA
w:         www.shazam.com 

Please consider the environment before printing this document

This e-mail and its contents are strictly private and confidential. It
must not be disclosed, distributed or copied without our prior consent.
If you have received this transmission in error, please notify Shazam
Entertainment immediately on: +44 (0) 020 8742 6820 and then delete it
from your system. Please note that the information contained herein
shall additionally constitute Confidential Information for the purposes
of any NDA between the recipient/s and Shazam Entertainment. Shazam
Entertainment Limited is incorporated in England and Wales under company
number 3998831 and its registered office is at 26-28 Hammersmith Grove,
London W6 7HA.  


______________________________________________________________________
This email has been scanned by the MessageLabs Email Security System.
For more information please visit http://www.messagelabs.com/email 
______________________________________________________________________
--=-Vpirzmp8IAkRlK78v+3z
Content-Type: text/html; charset="utf-8"
Content-Transfer-Encoding: 7bit

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 TRANSITIONAL//EN">
<HTML>
<HEAD>
  <META HTTP-EQUIV="Content-Type" CONTENT="text/html; CHARSET=UTF-8">
  <META NAME="GENERATOR" CONTENT="GtkHTML/3.30.3">
</HEAD>
<BODY>
The compaction will be part of a Cassandra upgrade (where all nodes will have to be taken down), so no clients will be hitting it until the upgrade is complete. I just want to minimize the downtime.<BR>
<BR>
Thanks, this is basically what I wanted to hear.<BR>
<BR>
Daniel<BR>
<BR>
On Fri, 2011-02-25 at 13:24 +0000, Gary Dusbabek wrote:
<BLOCKQUOTE TYPE=CITE>
<PRE>
If your cluster has the overall IO capacity to perform a simultaneous
compaction on every node and still adequately service reads and
writes, then yes.  If you're concerned about availability, your best
bet will be to stagger the compactions.

Gary.


On Fri, Feb 25, 2011 at 04:24, Daniel Josefsson &lt;<A HREF="mailto:jideji@gmail.com">jideji@gmail.com</A>&gt; wrote:
&gt; We experienced the java.lang.NegativeArraySizeException when upgrading to
&gt; 0.7.2 in staging. The proposed solution (running compaction) seems to have
&gt; solved this. However it took a lot of time to run.
&gt;
&gt; Is it safe to invoke a major compaction on all of the machines concurrently?
&gt;
&gt; I can't see a reason why it wouldn't, but I want to be sure :)
&gt;
&gt; Thanks,
&gt; Daniel
&gt;
&gt;

______________________________________________________________________
This email has been scanned by the MessageLabs Email Security System.
For more information please visit <A HREF="http://www.messagelabs.com/email">http://www.messagelabs.com/email</A> 
______________________________________________________________________
</PRE>
</BLOCKQUOTE>
<BR>
<TABLE CELLSPACING="0" CELLPADDING="0" WIDTH="100%">
<TR>
<TD>
-- <BR>
<IMG SRC="http://www.shazam.com/email/email.jpg" ALIGN="bottom" BORDER="0"><BR>
<BR>
<B>Daniel Josefsson</B><BR>
<BR>
<B>Software Engineer</B><BR>
<BR>
<B><FONT COLOR="#969696">Shazam Entertainment Ltd&nbsp;&nbsp;&nbsp;&nbsp; </FONT></B><BR>
<B><FONT COLOR="#969696">26-28 Hammersmith Grove, London W6 7HA</FONT></B><BR>
<FONT COLOR="#969696">w:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <A HREF="http://www.shazam.com/">www.shazam.com</A> </FONT><BR>
<BR>
<B><FONT SIZE="1"><FONT COLOR="#969696">Please consider the environment before printing this document</FONT></FONT></B><BR>
<BR>
<FONT SIZE="1"><FONT COLOR="#969696">This e-mail and its contents are strictly private and confidential. It must not be disclosed, distributed or copied without our prior consent. If you have received this transmission in error, please notify Shazam Entertainment immediately on: +44 (0) 020 8742 6820 and then delete it from your system. Please note that the information contained herein shall additionally constitute Confidential Information for the purposes of any NDA between the recipient/s and Shazam Entertainment. Shazam Entertainment Limited is incorporated in England and Wales under company number 3998831 and its registered office is at 26-28 Hammersmith Grove, London W6 7HA.&nbsp; </FONT></FONT><BR>
<BR>
<BR>
</TD>
</TR>
</TABLE>
<BR>
______________________________________________________________________<BR>
This email has been scanned by the MessageLabs Email Security System.<BR>
For more information please visit http://www.messagelabs.com/email <BR>
______________________________________________________________________<BR>
</BODY>
</HTML>


--=-Vpirzmp8IAkRlK78v+3z--