cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lyubo Kamenov <k...@heroku.com>
Subject Re: Too many sstables with DateTieredCompactionStrategy
Date Tue, 01 Mar 2016 04:11:54 GMT
Maybe increase the number of tables that can be compacted by minor
compactions[1],
i.e. max_threshold (default is set to 32).

1.
https://docs.datastax.com/en/cql/3.1/cql/cql_reference/compactSubprop.html?scroll=compactSubprop__compactionSubpropertiesDTCS

On Mon, Feb 29, 2016 at 9:28 PM, Noorul Islam Kamal Malmiyoda <
noorul@noorul.com> wrote:

> Hello Marcus,
>
> I altered the table to set timestamp_resolution to 'MICROSECONDS'. I
> waited for sometime, but the sstable count did not come down. Do you
> think I should specific command to reduce the count of sstables after
> setting this?
>
> Thanks and Regards
> Noorul
>
>
> On Mon, Feb 29, 2016 at 7:22 PM, Marcus Eriksson <krummas@gmail.com>
> wrote:
> > why do you have 'timestamp_resolution': 'MILLISECONDS'? It should be
> left as
> > default (MICROSECONDS) unless you do "USING TIMESTAMP
> > <milliseconds>"-inserts, see
> > https://issues.apache.org/jira/browse/CASSANDRA-11041
> >
> > On Mon, Feb 29, 2016 at 2:36 PM, Noorul Islam K M <noorul@noorul.com>
> wrote:
> >>
> >>
> >> Hi all,
> >>
> >> We are using below compaction settings for a table
> >>
> >> compaction = {'timestamp_resolution': 'MILLISECONDS',
> >> 'max_sstable_age_days': '365', 'base_time_seconds': '60', 'class':
> >> 'org.apache.cassandra.db.compaction.DateTieredCompactionStrategy'}
> >>
> >> But it is creating too many sstables. Currently number of sstables
> >> is 40000. We have been injecting data for the last three days.
> >>
> >> We have set the compactionthroughput to 128 MB/s
> >>
> >> $ nodetool getcompactionthroughput
> >>
> >> Current compaction throughput: 128 MB/s
> >>
> >> But this is not helping.
> >>
> >> How can we control the number of sstables in this case?
> >>
> >> Thanks and Regards
> >> Noorul
> >
> >
>

Mime
View raw message