Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 25857 invoked from network); 8 Jul 2010 01:08:10 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 8 Jul 2010 01:08:10 -0000 Received: (qmail 41552 invoked by uid 500); 8 Jul 2010 01:08:08 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 41505 invoked by uid 500); 8 Jul 2010 01:08:08 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 41497 invoked by uid 99); 8 Jul 2010 01:08:08 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Jul 2010 01:08:08 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of anty.rao@gmail.com designates 74.125.83.44 as permitted sender) Received: from [74.125.83.44] (HELO mail-gw0-f44.google.com) (74.125.83.44) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Jul 2010 01:08:01 +0000 Received: by gwj15 with SMTP id 15so144999gwj.31 for ; Wed, 07 Jul 2010 18:07:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type; bh=w6Q1NH5PI5yhiu1//JSYqLUlEpPbmbd1IHbqM/Q/a/Q=; b=H0tB79BKqh0Udn3sxQgZ/oWWK1HlD3ApmdUFgZsKb1uHIzmxTD6u7qocqOiWCpAG0d VpptmsWZEPSr+FmsbtB3sfUI0KUhVtwzJtYmf0lSNsENSeNhiJGFiId9WTdzhaIOFYtu UFrae8sSvk725A8mdsZSV+FMKTYr0gRqwL88U= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=BhtmAq0T/1LOcCRbeoASul45EXuGalyeCOMG/IwU4toY2Axf1FWwuXLidIsIZSlNNY z0JEpFTWHdyBCmLe/CijX8luOYpUUQSqzUzNaFFYLsV4qyf7jfQ3pHZnhp9n9GTq09ip lbpd12vUjRjbq3uIjtizzQx2nEgVA0isn648o= MIME-Version: 1.0 Received: by 10.229.250.68 with SMTP id mn4mr4375738qcb.199.1278551260104; Wed, 07 Jul 2010 18:07:40 -0700 (PDT) Received: by 10.229.38.148 with HTTP; Wed, 7 Jul 2010 18:07:39 -0700 (PDT) In-Reply-To: References: Date: Thu, 8 Jul 2010 09:07:39 +0800 Message-ID: Subject: Re: Why so many commitlogs ? From: Anty To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=0016363b8850af8862048ad5e93e X-Virus-Checked: Checked by ClamAV on apache.org --0016363b8850af8862048ad5e93e Content-Type: text/plain; charset=ISO-8859-1 Thx Jonathan. On Wed, Jul 7, 2010 at 11:58 PM, Jonathan Ellis wrote: > number of memtables waiting to flush has a pretty low bound (# of data > file directories in 0.6.3) > > O ,I seen > did you check your log for exceptions? > Yes ,but no exceptions. > On Wed, Jul 7, 2010 at 10:35 AM, Anty wrote: > > yes, i know. I only insert records into one CF. > > > > when a memtable flush complete, commitlog will check if there are some > > obsolete commitlog segments. > > I don't known why there are so many commitlog file out there. > > is there a possibility that too many memtables is waiting for flushing, > > which prevent many commitlog files from being removed. > > > > On Wed, Jul 7, 2010 at 10:13 PM, Jonathan Ellis > wrote: > >> > >> commitlogs can be removed after _all_ the CFs they have data for have > >> been flushed. > >> > >> On Wed, Jul 7, 2010 at 5:21 AM, Anty wrote: > >> > Hi:all > >> > In my little cluter ,after i insert many many records into cassandra, > >> > there > >> > are hundreds of commit log files in commitlog log directory. > >> > is it normal ? > >> > I read the source code of commitlog , there shouldn't be so many > >> > commitlog > >> > log files . > >> > any clue will be appreciate. > >> > > >> > -- > >> > Best Regards > >> > Anty Rao > >> > > >> > >> > >> > >> -- > >> Jonathan Ellis > >> Project Chair, Apache Cassandra > >> co-founder of Riptano, the source for professional Cassandra support > >> http://riptano.com > > > > > > > > -- > > Best Regards > > Anty Rao > > > > > > -- > Jonathan Ellis > Project Chair, Apache Cassandra > co-founder of Riptano, the source for professional Cassandra support > http://riptano.com > -- Best Regards Anty Rao --0016363b8850af8862048ad5e93e Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Thx Jonathan.


On Wed, Jul 7, 2010 at 11:58 PM, Jonathan Ellis <jbellis@gmail.com> wrote:
number of memtables waiting to flush has a pretty = low bound (# of data
file directories in 0.6.3)

O ,I seen
did you check your log for except= ions?
Yes ,but no exceptions.




On Wed, Jul 7, 2010 at 10:35 AM, Anty <anty.rao@gmail.com> wrote:
> yes, i know. I only insert records into one CF.
>
> when a memtable flush complete, commitlog=A0 will check if there are s= ome
> obsolete commitlog segments.
> I don't known why there are so many commitlog file out there.
> is there a possibility that too many memtables is waiting for flushing= ,
> which prevent many commitlog files from=A0 being removed.
>
> On Wed, Jul 7, 2010 at 10:13 PM, Jonathan Ellis <jbellis@gmail.com> wrote:
>>
>> commitlogs can be removed after _all_ the CFs they have data for h= ave
>> been flushed.
>>
>> On Wed, Jul 7, 2010 at 5:21 AM, Anty <anty.rao@gmail.com> wrote:
>> > Hi:all
>> > In my little cluter ,after i insert many many records into ca= ssandra,
>> > there
>> > are hundreds of commit log files in commitlog log directory.<= br> >> > is it normal ?
>> > I read the source code of commitlog , there shouldn't be = so many
>> > commitlog
>> > log files .
>> > any clue will be appreciate.
>> >
>> > --
>> > Best Regards
>> > Anty Rao
>> >
>>
>>
>>
>> --
>> Jonathan Ellis
>> Project Chair, Apache Cassandra
>> co-founder of Riptano, the source for professional Cassandra suppo= rt
>> http://riptano.co= m
>
>
>
> --
> Best Regards
> Anty Rao
>



--
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com



--
Best Regard= s
Anty Rao
--0016363b8850af8862048ad5e93e--