incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Langston, Jim" <Jim.Langs...@compuware.com>
Subject Re: sstable size ?
Date Thu, 18 Jul 2013 20:46:15 GMT
Thanks, was heading down that path .. after the build it
creates a 1.1.6 cassandra snapshot, I'm currently on 1.2.6 - will I
be able to use the tool ?

Jim

On 7/18/13 3:45 PM, "Nate McCall" <zznate.m@gmail.com> wrote:

>https://github.com/pcmanus/cassandra/tree/sstable_split/src/java/org/apach
>e/cassandra/tools
>
>You'll have to clone Sylvain's 'sstable_split' branch and build from
>there.
>
>(Commiter folks: this is helpful. @Sylvain - can you commit a patch
>under this ticket (or wherever):
>https://issues.apache.org/jira/browse/CASSANDRA-4766 - happy to
>review).
>
>On Thu, Jul 18, 2013 at 1:59 PM, Langston, Jim
><Jim.Langston@compuware.com> wrote:
>> I have been looking at the stuff in the zip file, and also the
>> sstablesplit command script. This script is looking for a java
>> class StandaloneSplitter located in the package
>>org.apache.cassandra.tools.
>>
>> Where is this package located ? I looked in the lib directory but
>>nothing
>> contains
>> the class. Is this something I need to get as well ?
>>
>> Thanks,
>>
>> Jim
>>
>> From: "Langston, Jim" <Jim.Langston@compuware.com>
>> Reply-To: <user@cassandra.apache.org>
>> Date: Thu, 18 Jul 2013 10:28:39 +0000
>>
>> To: "user@cassandra.apache.org" <user@cassandra.apache.org>
>> Subject: Re: sstable size ?
>>
>> I saw that msg in the thread, I pulled the git files and it looks
>> like a suite of tools, do I install them on their own ? do I replace the
>> current ones ? its production data but I can copy the data to where
>> I want and experiment.
>>
>> Jim
>>
>> From: aaron morton <aaron@thelastpickle.com>
>> Reply-To: <user@cassandra.apache.org>
>> Date: Thu, 18 Jul 2013 21:41:24 +1200
>> To: <user@cassandra.apache.org>
>> Subject: Re: sstable size ?
>>
>> Does this help ?
>> http://www.mail-archive.com/user@cassandra.apache.org/msg30973.html
>>
>> Can you pull the data off the node so you can test it somewhere safe ?
>>
>> Cheers
>>
>> -----------------
>> Aaron Morton
>> Cassandra Consultant
>> New Zealand
>>
>> @aaronmorton
>> http://www.thelastpickle.com
>>
>> On 18/07/2013, at 2:20 PM, "Langston, Jim" <Jim.Langston@compuware.com>
>> wrote:
>>
>> Thanks, this does look like what I'm experiencing. Can someone
>> post a walkthrough ? The README and the sstablesplit script
>> don't seem to cover it use in any detail.
>>
>> Jim
>>
>> From: Colin Blower <cblower@barracuda.com>
>> Reply-To: <user@cassandra.apache.org>
>> Date: Wed, 17 Jul 2013 16:49:59 -0700
>> To: "user@cassandra.apache.org" <user@cassandra.apache.org>
>> Subject: Re: sstable size ?
>>
>> Take a look at the very recent thread called 'Alternate "major
>>compaction"'.
>> There are some ideas in there about splitting up a large SSTable.
>>
>> http://www.mail-archive.com/user@cassandra.apache.org/msg30956.html
>>
>>
>> On 07/17/2013 04:17 PM, Langston, Jim wrote:
>>
>> Hi all,
>>
>> Is there a way to get an SSTable to a smaller size ? By this I mean
>>that I
>> currently have an SSTable that is nearly 1.2G, so that subsequent
>>SSTables
>> when they compact are trying to grow to that size. The result is that
>>when
>> the min_compaction_threshold reaches it value and a compaction is
>>needed,
>> the compaction is taking a long time as the file grows (it is currently
>>at
>> 52MB and
>> takes ~22s to compact).
>>
>> I'm not sure how the SSTable initially grew to its current size of 1.2G,
>> since the
>> servers have been up for a couple of years. I hadn't noticed until I
>>just
>> upgraded to 1.2.6,
>> but now I see it affects everything.
>>
>>
>> Jim
>>
>>
>>
>> --
>> Colin Blower
>> Software Engineer
>> Barracuda Networks Inc.
>> +1 408-342-5576 (o)
>>
>>
>



Mime
View raw message