incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nate McCall <zznat...@gmail.com>
Subject Re: sstable size ?
Date Fri, 19 Jul 2013 20:13:24 GMT
Awesome. Thanks Sylvain!
On Jul 19, 2013 3:59 AM, "Sylvain Lebresne" <sylvain@datastax.com> wrote:

>
> (Commiter folks: this is helpful. @Sylvain - can you commit a patch
>> under this ticket (or wherever):
>> https://issues.apache.org/jira/browse/CASSANDRA-4766 - happy to
>> review).
>>
>
>
> Right, should have done that sooner anyway. I've attached a rebased
> version to the ticket. Should get in soonish, it's not very complicated.
>
> --
> Sylvain
>
>
>>
>> On Thu, Jul 18, 2013 at 1:59 PM, Langston, Jim
>> <Jim.Langston@compuware.com> wrote:
>> > I have been looking at the stuff in the zip file, and also the
>> > sstablesplit command script. This script is looking for a java
>> > class StandaloneSplitter located in the package
>> org.apache.cassandra.tools.
>> >
>> > Where is this package located ? I looked in the lib directory but
>> nothing
>> > contains
>> > the class. Is this something I need to get as well ?
>> >
>> > Thanks,
>> >
>> > Jim
>> >
>> > From: "Langston, Jim" <Jim.Langston@compuware.com>
>> > Reply-To: <user@cassandra.apache.org>
>> > Date: Thu, 18 Jul 2013 10:28:39 +0000
>> >
>> > To: "user@cassandra.apache.org" <user@cassandra.apache.org>
>> > Subject: Re: sstable size ?
>> >
>> > I saw that msg in the thread, I pulled the git files and it looks
>> > like a suite of tools, do I install them on their own ? do I replace the
>> > current ones ? its production data but I can copy the data to where
>> > I want and experiment.
>> >
>> > Jim
>> >
>> > From: aaron morton <aaron@thelastpickle.com>
>> > Reply-To: <user@cassandra.apache.org>
>> > Date: Thu, 18 Jul 2013 21:41:24 +1200
>> > To: <user@cassandra.apache.org>
>> > Subject: Re: sstable size ?
>> >
>> > Does this help ?
>> > http://www.mail-archive.com/user@cassandra.apache.org/msg30973.html
>> >
>> > Can you pull the data off the node so you can test it somewhere safe ?
>> >
>> > Cheers
>> >
>> > -----------------
>> > Aaron Morton
>> > Cassandra Consultant
>> > New Zealand
>> >
>> > @aaronmorton
>> > http://www.thelastpickle.com
>> >
>> > On 18/07/2013, at 2:20 PM, "Langston, Jim" <Jim.Langston@compuware.com>
>> > wrote:
>> >
>> > Thanks, this does look like what I'm experiencing. Can someone
>> > post a walkthrough ? The README and the sstablesplit script
>> > don't seem to cover it use in any detail.
>> >
>> > Jim
>> >
>> > From: Colin Blower <cblower@barracuda.com>
>> > Reply-To: <user@cassandra.apache.org>
>> > Date: Wed, 17 Jul 2013 16:49:59 -0700
>> > To: "user@cassandra.apache.org" <user@cassandra.apache.org>
>> > Subject: Re: sstable size ?
>> >
>> > Take a look at the very recent thread called 'Alternate "major
>> compaction"'.
>> > There are some ideas in there about splitting up a large SSTable.
>> >
>> > http://www.mail-archive.com/user@cassandra.apache.org/msg30956.html
>> >
>> >
>> > On 07/17/2013 04:17 PM, Langston, Jim wrote:
>> >
>> > Hi all,
>> >
>> > Is there a way to get an SSTable to a smaller size ? By this I mean
>> that I
>> > currently have an SSTable that is nearly 1.2G, so that subsequent
>> SSTables
>> > when they compact are trying to grow to that size. The result is that
>> when
>> > the min_compaction_threshold reaches it value and a compaction is
>> needed,
>> > the compaction is taking a long time as the file grows (it is currently
>> at
>> > 52MB and
>> > takes ~22s to compact).
>> >
>> > I'm not sure how the SSTable initially grew to its current size of 1.2G,
>> > since the
>> > servers have been up for a couple of years. I hadn't noticed until I
>> just
>> > upgraded to 1.2.6,
>> > but now I see it affects everything.
>> >
>> >
>> > Jim
>> >
>> >
>> >
>> > --
>> > Colin Blower
>> > Software Engineer
>> > Barracuda Networks Inc.
>> > +1 408-342-5576 (o)
>> >
>> >
>>
>
>

Mime
View raw message