incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anty <anty....@gmail.com>
Subject Re: Why so many commitlogs ?
Date Thu, 08 Jul 2010 09:20:29 GMT
Hi:Jonathan
I have found out what's going wrong.
I change the configuration
<MemtableFlushAfterMinutes>1440</MemtableFlushAfterMinutes>
which prevent memtables of LocaitonInfo and HintsColumnFamily to flush if
there are a few hint records writen to many commitlog segment.
On Thu, Jul 8, 2010 at 9:43 AM, Anty <anty.rao@gmail.com> wrote:

>
>
> On Thu, Jul 8, 2010 at 9:21 AM, Jonathan Ellis <jbellis@gmail.com> wrote:
>
>> you're not out of disk space, are you?
>>
>> No.
>
>> if not you could try restarting, that should clear them out if nothing
>> else does
>>
> Yes. I restarted the node, then the commitlogs were removed.
> But recover so many commitlog take so much time.
>
>>
>> On Wed, Jul 7, 2010 at 8:07 PM, Anty <anty.rao@gmail.com> wrote:
>> > Thx Jonathan.
>> >
>> >
>> > On Wed, Jul 7, 2010 at 11:58 PM, Jonathan Ellis <jbellis@gmail.com>
>> wrote:
>> >>
>> >> number of memtables waiting to flush has a pretty low bound (# of data
>> >> file directories in 0.6.3)
>> >>
>> > O ,I seen
>> >>
>> >> did you check your log for exceptions?
>> >
>> > Yes ,but no exceptions.
>> >
>> >
>> >
>> >>
>> >> On Wed, Jul 7, 2010 at 10:35 AM, Anty <anty.rao@gmail.com> wrote:
>> >> > yes, i know. I only insert records into one CF.
>> >> >
>> >> > when a memtable flush complete, commitlog  will check if there are
>> some
>> >> > obsolete commitlog segments.
>> >> > I don't known why there are so many commitlog file out there.
>> >> > is there a possibility that too many memtables is waiting for
>> flushing,
>> >> > which prevent many commitlog files from  being removed.
>> >> >
>> >> > On Wed, Jul 7, 2010 at 10:13 PM, Jonathan Ellis <jbellis@gmail.com>
>> >> > wrote:
>> >> >>
>> >> >> commitlogs can be removed after _all_ the CFs they have data for
>> have
>> >> >> been flushed.
>> >> >>
>> >> >> On Wed, Jul 7, 2010 at 5:21 AM, Anty <anty.rao@gmail.com>
wrote:
>> >> >> > Hi:all
>> >> >> > In my little cluter ,after i insert many many records into
>> cassandra,
>> >> >> > there
>> >> >> > are hundreds of commit log files in commitlog log directory.
>> >> >> > is it normal ?
>> >> >> > I read the source code of commitlog , there shouldn't be so
many
>> >> >> > commitlog
>> >> >> > log files .
>> >> >> > any clue will be appreciate.
>> >> >> >
>> >> >> > --
>> >> >> > Best Regards
>> >> >> > Anty Rao
>> >> >> >
>> >> >>
>> >> >>
>> >> >>
>> >> >> --
>> >> >> Jonathan Ellis
>> >> >> Project Chair, Apache Cassandra
>> >> >> co-founder of Riptano, the source for professional Cassandra support
>> >> >> http://riptano.com
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Best Regards
>> >> > Anty Rao
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> Jonathan Ellis
>> >> Project Chair, Apache Cassandra
>> >> co-founder of Riptano, the source for professional Cassandra support
>> >> http://riptano.com
>> >
>> >
>> >
>> > --
>> > Best Regards
>> > Anty Rao
>> >
>>
>>
>>
>> --
>> Jonathan Ellis
>> Project Chair, Apache Cassandra
>> co-founder of Riptano, the source for professional Cassandra support
>> http://riptano.com
>>
>
>
>
> --
> Best Regards
> Anty Rao
>



-- 
Best Regards
Anty Rao

Mime
View raw message