Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CA410C1B0 for ; Sat, 22 Jun 2013 06:27:21 +0000 (UTC) Received: (qmail 68493 invoked by uid 500); 22 Jun 2013 06:27:21 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 68468 invoked by uid 500); 22 Jun 2013 06:27:21 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 68460 invoked by uid 99); 22 Jun 2013 06:27:20 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 22 Jun 2013 06:27:20 +0000 Date: Sat, 22 Jun 2013 06:27:20 +0000 (UTC) From: =?utf-8?Q?Micha=C5=82_Michalski_=28JIRA=29?= To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CASSANDRA-5670) running compact on an index did not compact two index files into one MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-5670?page=3Dcom.atlas= sian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D= 13691065#comment-13691065 ]=20 Micha=C5=82 Michalski commented on CASSANDRA-5670: --------------------------------------------- I think it's impossible to compact secondary index CF using nodetool - I re= member that I tried it once with 1.2.1 when having a problem with indexes a= nd as far as I remember I was getting an exception (or just notting happene= d, I'm not sure now). I had to use JMX to compact it. Anyway, I'll check it= . =20 > running compact on an index did not compact two index files into one > -------------------------------------------------------------------- > > Key: CASSANDRA-5670 > URL: https://issues.apache.org/jira/browse/CASSANDRA-5670 > Project: Cassandra > Issue Type: Bug > Affects Versions: 1.2.5 > Reporter: Cathy Daw > Priority: Minor > > With a data directory containing secondary index files ending in -1 and -= 2, I expected that when I ran compact against the index that they would com= pact down to a set of -3 files. This column family uses SizeTieredCompacti= onStrategy. > Using our standard CQL example, the compact command used was:=20 > $ ./nodetool compact test1 test1-playlists.playlists_artist_idx > Please note: reproducing this test on 1.1.12 (using a single primary key)= , you will see that running compact on the keyspace also does not compact t= he index file. There is no option to compact the index, so I could not com= pare that. > {noformat} > CREATE KEYSPACE test1 WITH replication =3D {'class':'SimpleStrategy', 're= plication_factor':1}; > use test1; > CREATE TABLE playlists ( > id uuid, > song_order int, > song_id uuid, > title text, > album text, > artist text, > PRIMARY KEY (id, song_order ) ); > INSERT INTO playlists (id, song_order, song_id, title, artist, album) > VALUES (62c36092-82a1-3a00-93d1-46196ee77204, 1, > a3e64f8f-bd44-4f28-b8d9-6938726e34d4, 'La Grange', 'ZZ Top', 'Tres Homb= res'); > select * from playlists; > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > ./nodetool flush test1 > $ ls /var/lib/cassandra/data/test1/playlists > test1-playlists-ic-1-CompressionInfo.db=09=09=09=09 > test1-playlists-ic-1-Data.db=09 > test1-playlists-ic-1-Filter.db=09=09=09=09=09 > test1-playlists-ic-1-Index.db=09=09=09=09=09 > test1-playlists-ic-1-Statistics.db=09=09=09=09 > test1-playlists-ic-1-Summary.db=09=09=09=09=09 > test1-playlists-ic-1-TOC.txt=09=09=09=09=09 > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > CREATE INDEX ON playlists(artist ); > select * from playlists; > select * from playlists where artist =3D 'ZZ Top'; > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > $ ./nodetool flush test1 > $ ls /var/lib/cassandra/data/test1/playlists > test1-playlists-ic-1-CompressionInfo.db=09=09=09 > test1-playlists-ic-1-Data.db=09=09=09=09=09 > test1-playlists-ic-1-Filter.db=09=09=09=09=09 > test1-playlists-ic-1-Index.db=09=09=09=09=09 > test1-playlists-ic-1-Statistics.db=09=09=09=09 > test1-playlists-ic-1-Summary.db=09=09=09=09=09 > test1-playlists-ic-1-TOC.txt=09=09=09=09=09 > =09 > test1-playlists.playlists_artist_idx-ic-1-CompressionInfo.db > test1-playlists.playlists_artist_idx-ic-1-Data.db > test1-playlists.playlists_artist_idx-ic-1-Filter.db > test1-playlists.playlists_artist_idx-ic-1-Index.db > test1-playlists.playlists_artist_idx-ic-1-Statistics.db > test1-playlists.playlists_artist_idx-ic-1-Summary.db > test1-playlists.playlists_artist_idx-ic-1-TOC.txt > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > delete artist from playlists where id =3D 62c36092-82a1-3a00-93d1-46196ee= 77204 and song_order =3D 1; > select * from playlists; > select * from playlists where artist =3D 'ZZ Top'; > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > $ ./nodetool flush test1 > $ ls /var/lib/cassandra/data/test1/playlists > test1-playlists-ic-1-CompressionInfo.db=09 > test1-playlists-ic-1-Data.db=09=09=09=09=09 > test1-playlists-ic-1-Filter.db=09=09=09=09=09 > test1-playlists-ic-1-Index.db=09=09=09=09=09 > test1-playlists-ic-1-Statistics.db=09=09=09=09 > test1-playlists-ic-1-Summary.db=09=09=09=09=09 > test1-playlists-ic-1-TOC.txt=09=09=09=09=09 > test1-playlists-ic-2-CompressionInfo.db=09=09=09=09 > test1-playlists-ic-2-Data.db=09=09=09=09=09 > test1-playlists-ic-2-Filter.db=09=09=09=09=09 > test1-playlists-ic-2-Index.db=09=09=09=09=09 > test1-playlists-ic-2-Statistics.db=09=09=09=09 > test1-playlists-ic-2-Summary.db=09=09=09=09=09 > test1-playlists-ic-2-TOC.txt > =09=09=09 > test1-playlists.playlists_artist_idx-ic-1-CompressionInfo.db > test1-playlists.playlists_artist_idx-ic-1-Data.db > test1-playlists.playlists_artist_idx-ic-1-Filter.db > test1-playlists.playlists_artist_idx-ic-1-Index.db > test1-playlists.playlists_artist_idx-ic-1-Statistics.db > test1-playlists.playlists_artist_idx-ic-1-Summary.db > test1-playlists.playlists_artist_idx-ic-1-TOC.txt > test1-playlists.playlists_artist_idx-ic-2-CompressionInfo.db > test1-playlists.playlists_artist_idx-ic-2-Data.db > test1-playlists.playlists_artist_idx-ic-2-Filter.db > test1-playlists.playlists_artist_idx-ic-2-Index.db > test1-playlists.playlists_artist_idx-ic-2-Statistics.db > test1-playlists.playlists_artist_idx-ic-2-Summary.db > test1-playlists.playlists_artist_idx-ic-2-TOC.txt > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > ./nodetool compact test1 > $ ls /var/lib/cassandra/data/test1/playlists > test1-playlists-ic-3-CompressionInfo.db > test1-playlists-ic-3-Data.db > test1-playlists-ic-3-Filter.db > test1-playlists-ic-3-Index.db > test1-playlists-ic-3-Statistics.db > test1-playlists-ic-3-Summary.db > test1-playlists-ic-3-TOC.txt > test1-playlists.playlists_artist_idx-ic-1-CompressionInfo.db > test1-playlists.playlists_artist_idx-ic-1-Data.db > test1-playlists.playlists_artist_idx-ic-1-Filter.db > test1-playlists.playlists_artist_idx-ic-1-Index.db > test1-playlists.playlists_artist_idx-ic-1-Statistics.db > test1-playlists.playlists_artist_idx-ic-1-Summary.db > test1-playlists.playlists_artist_idx-ic-1-TOC.txt > test1-playlists.playlists_artist_idx-ic-2-CompressionInfo.db > test1-playlists.playlists_artist_idx-ic-2-Data.db > test1-playlists.playlists_artist_idx-ic-2-Filter.db > test1-playlists.playlists_artist_idx-ic-2-Index.db > test1-playlists.playlists_artist_idx-ic-2-Statistics.db > test1-playlists.playlists_artist_idx-ic-2-Summary.db > test1-playlists.playlists_artist_idx-ic-2-TOC.txt > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > $ ./nodetool compact test1 test1-playlists.playlists_artist_idx > $ ls /var/lib/cassandra/data/test1/playlists > test1-playlists-ic-3-CompressionInfo.db > test1-playlists-ic-3-Data.db > test1-playlists-ic-3-Filter.db > test1-playlists-ic-3-Index.db > test1-playlists-ic-3-Statistics.db > test1-playlists-ic-3-Summary.db > test1-playlists-ic-3-TOC.txt > test1-playlists.playlists_artist_idx-ic-1-CompressionInfo.db > test1-playlists.playlists_artist_idx-ic-1-Data.db > test1-playlists.playlists_artist_idx-ic-1-Filter.db > test1-playlists.playlists_artist_idx-ic-1-Index.db > test1-playlists.playlists_artist_idx-ic-1-Statistics.db > test1-playlists.playlists_artist_idx-ic-1-Summary.db > test1-playlists.playlists_artist_idx-ic-1-TOC.txt > test1-playlists.playlists_artist_idx-ic-2-CompressionInfo.db > test1-playlists.playlists_artist_idx-ic-2-Data.db > test1-playlists.playlists_artist_idx-ic-2-Filter.db > test1-playlists.playlists_artist_idx-ic-2-Index.db > test1-playlists.playlists_artist_idx-ic-2-Statistics.db > test1-playlists.playlists_artist_idx-ic-2-Summary.db > test1-playlists.playlists_artist_idx-ic-2-TOC.txt > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > cqlsh:test1> describe keyspace test1; > CREATE KEYSPACE test1 WITH replication =3D { > 'class': 'SimpleStrategy', > 'replication_factor': '1' > }; > USE test1; > CREATE TABLE playlists ( > id uuid, > song_order int, > album text, > artist text, > song_id uuid, > title text, > PRIMARY KEY (id, song_order) > ) WITH > bloom_filter_fp_chance=3D0.010000 AND > caching=3D'KEYS_ONLY' AND > comment=3D'' AND > dclocal_read_repair_chance=3D0.000000 AND > gc_grace_seconds=3D864000 AND > read_repair_chance=3D0.100000 AND > replicate_on_write=3D'true' AND > populate_io_cache_on_flush=3D'false' AND > compaction=3D{'class': 'SizeTieredCompactionStrategy'} AND > compression=3D{'sstable_compression': 'SnappyCompressor'}; > CREATE INDEX playlists_artist_idx ON playlists (artist); > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrato= rs For more information on JIRA, see: http://www.atlassian.com/software/jira