Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 80AA99A7A for ; Mon, 9 Apr 2012 09:13:49 +0000 (UTC) Received: (qmail 98616 invoked by uid 500); 9 Apr 2012 09:13:47 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 98543 invoked by uid 500); 9 Apr 2012 09:13:47 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 98532 invoked by uid 99); 9 Apr 2012 09:13:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Apr 2012 09:13:46 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a54.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Apr 2012 09:13:40 +0000 Received: from homiemail-a54.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a54.g.dreamhost.com (Postfix) with ESMTP id 53D8C3A406D for ; Mon, 9 Apr 2012 02:13:19 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; c=nofws; d=thelastpickle.com; h=from :mime-version:content-type:subject:date:in-reply-to:to :references:message-id; q=dns; s=thelastpickle.com; b=0EwcjYqbqp NAPymv5gaoUVlNuvanh4cnUGLJPXgqvmimc+Hzwp+TZvJTOfg23Z7V3wK+zXd+kz UVp5cKdg+M/eZDRVffNf14pTy9bamNCVbjGIlOjyVcfjuP4J18pGvn+cSEMATSNK RT+pGyzWRHUpu3RY6d1EnMOtJeG3T163w= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h=from :mime-version:content-type:subject:date:in-reply-to:to :references:message-id; s=thelastpickle.com; bh=vDgSN5R+cAifQLs7 Xm8b2mMaIxU=; b=vSkjgVJaTDadHYF1yXcXSsQBf+aEsu5SMUiKez7V75+YUj4T Ac8MaC6ZxHp91oVEIEgF738d5yibCYJRsE/6ETgCxzscGbHvo+jezsa+D/xq2Dzv Z0zC62usiy4XREjHRsCAyb6+a74C433FJ/4Z4yLjtWLazqO41tVs3cla4mA= Received: from [172.16.1.3] (125-236-193-159.adsl.xtra.co.nz [125.236.193.159]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a54.g.dreamhost.com (Postfix) with ESMTPSA id 9C1353A4057 for ; Mon, 9 Apr 2012 02:13:18 -0700 (PDT) From: aaron morton Mime-Version: 1.0 (Apple Message framework v1257) Content-Type: multipart/alternative; boundary="Apple-Mail=_0DECEAE7-9E4F-420E-A000-1CB2593BB278" Subject: Re: leveled compaction - improve log message Date: Mon, 9 Apr 2012 21:13:16 +1200 In-Reply-To: <4F7E3E05.6050803@filez.com> To: user@cassandra.apache.org References: <4F7E3E05.6050803@filez.com> Message-Id: <2ECE9B18-7700-46C8-BD0A-D31E13E090E4@thelastpickle.com> X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_0DECEAE7-9E4F-420E-A000-1CB2593BB278 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=iso-8859-2 If you would like to see a change create a request for an improvement = here https://issues.apache.org/jira/browse/CASSANDRA Cheers ----------------- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 6/04/2012, at 12:51 PM, Radim Kolar wrote: > it would be really helpfull if leveled compaction prints level into = syslog. >=20 > Demo: >=20 > INFO [CompactionExecutor:891] 2012-04-05 22:39:27,043 = CompactionTask.java (line 113) Compacting ***LEVEL 1*** = [SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-19= 690-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 88-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 91-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-197= 00-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 86-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 96-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 87-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 95-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 89-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 94-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 93-Data.db')] >=20 > INFO [CompactionExecutor:891] 2012-04-05 22:39:57,299 = CompactionTask.java (line 221) *** LEVEL 1 *** Compacted to = [/var/lib/cassandra/data/rapidshare/querycache-hc-19701-Data.db,/var/lib/c= assandra/data/rapidshare/querycache-hc-19702-Data.db,/var/lib/cassandra/da= ta/rapidshare/querycache-hc-19703-Data.db,/var/lib/cassandra/data/rapidsha= re/querycache-hc-19704-Data.db,/var/lib/cassandra/data/rapidshare/querycac= he-hc-19705-Data.db,/var/lib/cassandra/data/rapidshare/querycache-hc-19706= -Data.db,/var/lib/cassandra/data/rapidshare/querycache-hc-19707-Data.db,/v= ar/lib/cassandra/data/rapidshare/querycache-hc-19708-Data.db,/var/lib/cass= andra/data/rapidshare/querycache-hc-19709-Data.db,/var/lib/cassandra/data/= rapidshare/querycache-hc-19710-Data.db,/var/lib/cassandra/data/rapidshare/= querycache-hc-19711-Data.db,]. 59,643,011 to 57,564,216 (~96% of = original) bytes for 590,909 keys at 1.814434MB/s. Time: 30,256ms. >=20 >=20 --Apple-Mail=_0DECEAE7-9E4F-420E-A000-1CB2593BB278 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=iso-8859-2 If = you would like to see a change create a request for an improvement = here https://issues.ap= ache.org/jira/browse/CASSANDRA

Cheers
http://www.thelastpickle.com

On 6/04/2012, at 12:51 PM, Radim Kolar wrote:

it = would be really helpfull if leveled compaction prints level into = syslog.

Demo:

INFO [CompactionExecutor:891] 2012-04-05 = 22:39:27,043 CompactionTask.java (line 113) Compacting ***LEVEL 1*** = [SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-19= 690-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 88-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 91-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-197= 00-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 86-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 96-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 87-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 95-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 89-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 94-Data.db'), = SSTableReader(path=3D'/var/lib/cassandra/data/rapidshare/querycache-hc-196= 93-Data.db')]

INFO [CompactionExecutor:891] 2012-04-05 = 22:39:57,299 CompactionTask.java (line 221) *** LEVEL 1 *** Compacted to = [/var/lib/cassandra/data/rapidshare/querycache-hc-19701-Data.db,/var/lib/c= assandra/data/rapidshare/querycache-hc-19702-Data.db,/var/lib/cassandra/da= ta/rapidshare/querycache-hc-19703-Data.db,/var/lib/cassandra/data/rapidsha= re/querycache-hc-19704-Data.db,/var/lib/cassandra/data/rapidshare/querycac= he-hc-19705-Data.db,/var/lib/cassandra/data/rapidshare/querycache-hc-19706= -Data.db,/var/lib/cassandra/data/rapidshare/querycache-hc-19707-Data.db,/v= ar/lib/cassandra/data/rapidshare/querycache-hc-19708-Data.db,/var/lib/cass= andra/data/rapidshare/querycache-hc-19709-Data.db,/var/lib/cassandra/data/= rapidshare/querycache-hc-19710-Data.db,/var/lib/cassandra/data/rapidshare/= querycache-hc-19711-Data.db,].  59,643,011 to 57,564,216 (~96% of = original) bytes for 590,909 keys at 1.814434MB/s.  Time: = 30,256ms.



= --Apple-Mail=_0DECEAE7-9E4F-420E-A000-1CB2593BB278--