From user-return-27341-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Mon Jul 2 13:11:06 2012 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5F9D9930B for ; Mon, 2 Jul 2012 13:11:06 +0000 (UTC) Received: (qmail 50088 invoked by uid 500); 2 Jul 2012 13:11:04 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 50005 invoked by uid 500); 2 Jul 2012 13:11:03 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 49918 invoked by uid 99); 2 Jul 2012 13:11:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Jul 2012 13:11:01 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of pieter.callewaert@be-mobile.be designates 213.199.154.207 as permitted sender) Received: from [213.199.154.207] (HELO am1outboundpool.messaging.microsoft.com) (213.199.154.207) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Jul 2012 13:10:05 +0000 Received: from mail54-am1-R.bigfish.com (10.3.201.235) by AM1EHSOBE005.bigfish.com (10.3.204.25) with Microsoft SMTP Server id 14.1.225.23; Mon, 2 Jul 2012 13:07:47 +0000 Received: from mail54-am1 (localhost [127.0.0.1]) by mail54-am1-R.bigfish.com (Postfix) with ESMTP id 14DE3180523 for ; Mon, 2 Jul 2012 13:07:47 +0000 (UTC) X-Forefront-Antispam-Report: CIP:157.56.248.213;KIP:(null);UIP:(null);IPV:NLI;H:AMXPRD0610HT001.eurprd06.prod.outlook.com;RD:none;EFVD:NLI X-SpamScore: 0 X-BigFish: PS0(z38daoz936eIc85fh1be0I444eMzz1202hzz8275bh8275dhz2fh2a8h668h839hd25hf0ah) Received-SPF: pass (mail54-am1: domain of be-mobile.be designates 157.56.248.213 as permitted sender) client-ip=157.56.248.213; envelope-from=pieter.callewaert@be-mobile.be; helo=AMXPRD0610HT001.eurprd06.prod.outlook.com ;.outlook.com ; Received: from mail54-am1 (localhost.localdomain [127.0.0.1]) by mail54-am1 (MessageSwitch) id 1341234464608266_16538; Mon, 2 Jul 2012 13:07:44 +0000 (UTC) Received: from AM1EHSMHS016.bigfish.com (unknown [10.3.201.232]) by mail54-am1.bigfish.com (Postfix) with ESMTP id 88D95360047 for ; Mon, 2 Jul 2012 13:07:44 +0000 (UTC) Received: from AMXPRD0610HT001.eurprd06.prod.outlook.com (157.56.248.213) by AM1EHSMHS016.bigfish.com (10.3.207.154) with Microsoft SMTP Server (TLS) id 14.1.225.23; Mon, 2 Jul 2012 13:07:39 +0000 Received: from AMXPRD0610MB353.eurprd06.prod.outlook.com ([169.254.4.22]) by AMXPRD0610HT001.eurprd06.prod.outlook.com ([10.255.58.36]) with mapi id 14.16.0164.004; Mon, 2 Jul 2012 13:09:35 +0000 From: Pieter Callewaert To: "user@cassandra.apache.org" Subject: forceUserDefinedCompaction in 1.1.0 Thread-Topic: forceUserDefinedCompaction in 1.1.0 Thread-Index: Ac1YUiKcme05oGnERYKYF5+Vrc8Chw== Date: Mon, 2 Jul 2012 13:09:34 +0000 Message-ID: <0B2BF1E8E35731438C02772C683FB67B1674C8C6@AMXPRD0610MB353.eurprd06.prod.outlook.com> Accept-Language: nl-BE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [81.82.202.11] Content-Type: multipart/alternative; boundary="_000_0B2BF1E8E35731438C02772C683FB67B1674C8C6AMXPRD0610MB353_" MIME-Version: 1.0 X-OriginatorOrg: be-mobile.be X-Virus-Checked: Checked by ClamAV on apache.org --_000_0B2BF1E8E35731438C02772C683FB67B1674C8C6AMXPRD0610MB353_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi guys, We have a 6-node 1.0.9 cluster for production and 3-node 1.1.0 cluster for = testing the new version of Cassandra. In both we insert data in a particular CF with always a TTL of 31 days. To clean up the files faster we use the forceUserDefinedCompaction to manu= ally force compaction on the old sstables which we are sure the data has ex= pired. In 1.0 this works perfect, but in the 1.1 the command executes without erro= r, but in the log of the node I see the following: INFO [CompactionExecutor:546] 2012-07-02 15:05:11,837 CompactionManager.jav= a (line 337) Will not compact MapData024CTwT/MapData024CTwT-HOS-hc-21150: i= t is not an active sstable INFO [CompactionExecutor:546] 2012-07-02 15:05:11,838 CompactionManager.jav= a (line 350) No file to compact for user defined compaction I am pretty sure the sstable because it should contain partly expired data = en partly data which is still active. Does this have to do something with the new directory structure from 1.1 ? = Or are the parameters changed from the function? Kind regards, Pieter Callewaert --_000_0B2BF1E8E35731438C02772C683FB67B1674C8C6AMXPRD0610MB353_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi guys,

 

We have a 6-node 1.0.9 cluster = for production and 3-node 1.1.0 cluster for testing the new version of Cass= andra.

In both we insert data in a par= ticular CF with always a TTL of 31 days.

To clean up the files faster&nb= sp; we use the forceUserDefinedCompaction to manually force compaction on t= he old sstables which we are sure the data has expired.

In 1.0 this works perfect, but = in the 1.1 the command executes without error, but in the log of the node I= see the following:

 

INFO [CompactionExecutor:546] 2= 012-07-02 15:05:11,837 CompactionManager.java (line 337) Will not compact M= apData024CTwT/MapData024CTwT-HOS-hc-21150: it is not an active sstable=

INFO [CompactionExecutor:546] 2= 012-07-02 15:05:11,838 CompactionManager.java (line 350) No file to compact= for user defined compaction

 

I am pretty sure the sstable be= cause it should contain partly expired data en partly data which is still a= ctive.

Does this have to do something = with the new directory structure from 1.1 ? Or are the parameters changed f= rom the function?

 

Kind regards,=

Pieter Callewaert

&nbs= p;

--_000_0B2BF1E8E35731438C02772C683FB67B1674C8C6AMXPRD0610MB353_--