From user-return-27342-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Mon Jul 2 13:16:33 2012 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id ABF64931B for ; Mon, 2 Jul 2012 13:16:33 +0000 (UTC) Received: (qmail 68386 invoked by uid 500); 2 Jul 2012 13:16:31 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 68334 invoked by uid 500); 2 Jul 2012 13:16:31 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 68321 invoked by uid 99); 2 Jul 2012 13:16:30 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Jul 2012 13:16:30 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of pieter.callewaert@be-mobile.be designates 213.199.154.208 as permitted sender) Received: from [213.199.154.208] (HELO am1outboundpool.messaging.microsoft.com) (213.199.154.208) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Jul 2012 13:16:22 +0000 Received: from mail44-am1-R.bigfish.com (10.3.201.240) by AM1EHSOBE010.bigfish.com (10.3.204.30) with Microsoft SMTP Server id 14.1.225.23; Mon, 2 Jul 2012 13:14:04 +0000 Received: from mail44-am1 (localhost [127.0.0.1]) by mail44-am1-R.bigfish.com (Postfix) with ESMTP id 318183A0226 for ; Mon, 2 Jul 2012 13:14:04 +0000 (UTC) X-Forefront-Antispam-Report: CIP:157.56.248.213;KIP:(null);UIP:(null);IPV:NLI;H:AMXPRD0610HT003.eurprd06.prod.outlook.com;RD:none;EFVD:NLI X-SpamScore: 0 X-BigFish: PS0(z38daoz936eIc85fh1be0I444eMzz1202hzz8275bh8275dhz2fh2a8h668h839hd25hf0ah) Received-SPF: pass (mail44-am1: domain of be-mobile.be designates 157.56.248.213 as permitted sender) client-ip=157.56.248.213; envelope-from=pieter.callewaert@be-mobile.be; helo=AMXPRD0610HT003.eurprd06.prod.outlook.com ;.outlook.com ; Received: from mail44-am1 (localhost.localdomain [127.0.0.1]) by mail44-am1 (MessageSwitch) id 1341234842920599_19113; Mon, 2 Jul 2012 13:14:02 +0000 (UTC) Received: from AM1EHSMHS012.bigfish.com (unknown [10.3.201.243]) by mail44-am1.bigfish.com (Postfix) with ESMTP id D4E41140054 for ; Mon, 2 Jul 2012 13:14:02 +0000 (UTC) Received: from AMXPRD0610HT003.eurprd06.prod.outlook.com (157.56.248.213) by AM1EHSMHS012.bigfish.com (10.3.207.112) with Microsoft SMTP Server (TLS) id 14.1.225.23; Mon, 2 Jul 2012 13:14:02 +0000 Received: from AMXPRD0610MB353.eurprd06.prod.outlook.com ([169.254.4.22]) by AMXPRD0610HT003.eurprd06.prod.outlook.com ([10.255.58.38]) with mapi id 14.16.0164.004; Mon, 2 Jul 2012 13:15:58 +0000 From: Pieter Callewaert To: "user@cassandra.apache.org" Subject: RE: forceUserDefinedCompaction in 1.1.0 Thread-Topic: forceUserDefinedCompaction in 1.1.0 Thread-Index: Ac1YUiKcme05oGnERYKYF5+Vrc8ChwAAhu4w Date: Mon, 2 Jul 2012 13:15:57 +0000 Message-ID: <0B2BF1E8E35731438C02772C683FB67B1674C8EB@AMXPRD0610MB353.eurprd06.prod.outlook.com> References: <0B2BF1E8E35731438C02772C683FB67B1674C8C6@AMXPRD0610MB353.eurprd06.prod.outlook.com> In-Reply-To: <0B2BF1E8E35731438C02772C683FB67B1674C8C6@AMXPRD0610MB353.eurprd06.prod.outlook.com> Accept-Language: nl-BE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [81.82.202.11] Content-Type: multipart/alternative; boundary="_000_0B2BF1E8E35731438C02772C683FB67B1674C8EBAMXPRD0610MB353_" MIME-Version: 1.0 X-OriginatorOrg: be-mobile.be X-Virus-Checked: Checked by ClamAV on apache.org --_000_0B2BF1E8E35731438C02772C683FB67B1674C8EBAMXPRD0610MB353_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, While I was typing my mail I had the idea to try with the new directory lay= out. It seems you have to change the parameter settings from 1.0 to 1.1 In 1.0: Param 1: Param 2: In 1.1: Param 1: Param 2: / Don't know if this is a bug or a breaking change ? Kind regards, Pieter Callewaert From: Pieter Callewaert [mailto:pieter.callewaert@be-mobile.be] Sent: maandag 2 juli 2012 15:10 To: user@cassandra.apache.org Subject: forceUserDefinedCompaction in 1.1.0 Hi guys, We have a 6-node 1.0.9 cluster for production and 3-node 1.1.0 cluster for = testing the new version of Cassandra. In both we insert data in a particular CF with always a TTL of 31 days. To clean up the files faster we use the forceUserDefinedCompaction to manu= ally force compaction on the old sstables which we are sure the data has ex= pired. In 1.0 this works perfect, but in the 1.1 the command executes without erro= r, but in the log of the node I see the following: INFO [CompactionExecutor:546] 2012-07-02 15:05:11,837 CompactionManager.jav= a (line 337) Will not compact MapData024CTwT/MapData024CTwT-HOS-hc-21150: i= t is not an active sstable INFO [CompactionExecutor:546] 2012-07-02 15:05:11,838 CompactionManager.jav= a (line 350) No file to compact for user defined compaction I am pretty sure the sstable because it should contain partly expired data = en partly data which is still active. Does this have to do something with the new directory structure from 1.1 ? = Or are the parameters changed from the function? Kind regards, Pieter Callewaert --_000_0B2BF1E8E35731438C02772C683FB67B1674C8EBAMXPRD0610MB353_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

&n= bsp;

While I= was typing my mail I had the idea to try with the new directory layout.

It seem= s you have to change the parameter settings from 1.0 to 1.1

In 1.0:=

Param 1= : <keyspace name>

Param 2= : <datafile name>

In 1.1:=

Param 1= : <keyspace name>

Param 2= : <column family name>/<datafile name>

&n= bsp;

DonR= 17;t know if this is a bug or a breaking change ?

&n= bsp;

Kind re= gards,

Pieter = Callewaert

&n= bsp;

From:= Pieter Callewaert [mailto:pieter.callewaert@be-mobile.be]
Sent: maandag 2 juli 2012 15:10
To: user@cassandra.apache.org
Subject: forceUserDefinedCompaction in 1.1.0

 

Hi guys,

 

We have a 6-node 1.0.9 cluster = for production and 3-node 1.1.0 cluster for testing the new version of Cass= andra.

In both we insert data in a par= ticular CF with always a TTL of 31 days.

To clean up the files faster&nb= sp; we use the forceUserDefinedCompaction to manually force compaction on t= he old sstables which we are sure the data has expired.

In 1.0 this works perfect, but = in the 1.1 the command executes without error, but in the log of the node I= see the following:

 

INFO [CompactionExecutor:546] 2= 012-07-02 15:05:11,837 CompactionManager.java (line 337) Will not compact M= apData024CTwT/MapData024CTwT-HOS-hc-21150: it is not an active sstable=

INFO [CompactionExecutor:546] 2= 012-07-02 15:05:11,838 CompactionManager.java (line 350) No file to compact= for user defined compaction

 

I am pretty sure the sstable be= cause it should contain partly expired data en partly data which is still a= ctive.

Does this have to do something = with the new directory structure from 1.1 ? Or are the parameters changed f= rom the function?

 

Kind regards,=

Pieter Callewaert

&nbs= p;

--_000_0B2BF1E8E35731438C02772C683FB67B1674C8EBAMXPRD0610MB353_--