incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aaron morton <aa...@thelastpickle.com>
Subject Re: Unable to drop secondary index
Date Thu, 18 Apr 2013 18:31:53 GMT
Was the schema created with CQL or the CLI ? (It's not a good idea to manage one with the other)

Can you provide the schema after the update and the update cf statement? 

Cheers

-----------------
Aaron Morton
Freelance Cassandra Consultant
New Zealand

@aaronmorton
http://www.thelastpickle.com

On 19/04/2013, at 12:39 AM, Michal Michalski <michalm@opera.com> wrote:

> As stated in topic, I'm unable to drop secondary index either by using cli or cqlsh.
In both cases it looks like to command is processed properly (some uuid shows up in cli, no
output in cqlsh), I can see in logs that schema is going to be updated (index name and type
are set to null) and then... nothing. No exception, no information. Just a few lines of output
telling me that some system-related Memtables/CFs got flushed/compacted. Attaching logs at
the end of this email (I was dropping Users_username_idx_1).
> 
> I'm using C* 1.2.1, upgraded some time ago from 1.1.0. The same works perfectly on a
test cluster which uses the same C* configuration and a sample of production data (and was
upgraded at the same time as production).
> 
> However, when I setup out environment on a brand new C* 1.2.1 cluster (not upgraded),
I can see some differences in schemas comparing to the 1.1.0 -> 1.2.1 one; for example
missing 'type' column for system.schema_columns for example. I wonder if it's not a problem,
but as far as I can see in source code it seems to be handled.
> 
> Rebuilding indexes fails (no new files were created) with no errors too.
> 
> Any ideas?
> 
> 
> INFO [Thrift:24864] 2013-04-18 10:23:17,536 MigrationManager.java (line 246) Update ColumnFamily
'production/Users' From org.apache.cassandra.config.CFMetaData@4febff32[cfId=5230d831-0ac9-3c5f-835f-481296696252,ksName=production,cfName=Users,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=<null>,comment=,readRepairChance=1.0,dclocalReadRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.UTF8Type,keyValidator=org.apache.cassandra.db.marshal.LexicalUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,keyAliases=[],columnAliases=[],valueAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
lim=12 cap=12]=ColumnDefinition{name=646174655f63726561746564, validator=org.apache.cassandra.db.marshal.LongType,
index_type=null, index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=6 cap=6]=ColumnDefinition{name=616374697665,
validator=org.apache.cassandra.db.marshal.IntegerType, index_type=KEYS, index_name='Users_active_idx'},
java.nio.HeapByteBuffer[pos=0 lim=5 cap=5]=ColumnDefinition{name=656d61696c, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=KEYS, index_name='Users_email_idx'}, java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=757365726e616d65,
validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=KEYS, index_name='Users_username_idx'},
java.nio.HeapByteBuffer[pos=0 lim=18 cap=18]=ColumnDefinition{name=64656661756c745f6163636f756e745f6964,
validator=org.apache.cassandra.db.marshal.LexicalUUIDType, index_type=null, index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={sstable_compression=org.apache.cassandra.io.compress.SnappyCompressor},bloomFilterFpChance=<null>,caching=KEYS_ONLY]
To org.apache.cassandra.config.CFMetaData@2eb25d0[cfId=5230d831-0ac9-3c5f-835f-481296696252,ksName=production,cfName=Users,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=<null>,comment=,readRepairChance=1.0,dclocalReadRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.UTF8Type,keyValidator=org.apache.cassandra.db.marshal.LexicalUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,keyAliases=[],columnAliases=[],valueAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
lim=12 cap=12]=ColumnDefinition{name=646174655f63726561746564, validator=org.apache.cassandra.db.marshal.LongType,
index_type=null, index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=6 cap=6]=ColumnDefinition{name=616374697665,
validator=org.apache.cassandra.db.marshal.IntegerType, index_type=KEYS, index_name='Users_active_idx'},
java.nio.HeapByteBuffer[pos=0 lim=5 cap=5]=ColumnDefinition{name=656d61696c, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=null, index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=757365726e616d65,
validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=KEYS, index_name='Users_username_idx'},
java.nio.HeapByteBuffer[pos=0 lim=18 cap=18]=ColumnDefinition{name=64656661756c745f6163636f756e745f6964,
validator=org.apache.cassandra.db.marshal.LexicalUUIDType, index_type=null, index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={sstable_compression=org.apache.cassandra.io.compress.SnappyCompressor},bloomFilterFpChance=<null>,caching=KEYS_ONLY]
> INFO [MigrationStage:1] 2013-04-18 10:23:17,567 ColumnFamilyStore.java (line 640) Enqueuing
flush of Memtable-schema_columnfamilies@469728303(1023/2281 serialized/live bytes, 20 ops)
> INFO [FlushWriter:22] 2013-04-18 10:23:17,568 Memtable.java (line 447) Writing Memtable-schema_columnfamilies@469728303(1023/2281
serialized/live bytes, 20 ops)
> INFO [FlushWriter:22] 2013-04-18 10:23:17,573 Memtable.java (line 481) Completed flushing
/cassandra/system/schema_columnfamilies/system-schema_columnfamilies-ib-631-Data.db (648 bytes)
for commitlog position ReplayPosition(segmentId=1365620853206, position=2889368)
> INFO [CompactionExecutor:7616] 2013-04-18 10:23:17,574 CompactionTask.java (line 118)
Compacting [SSTableReader(path='/cassandra/system/schema_columnfamilies/system-schema_columnfamilies-ib-631-Data.db'),
SSTableReader(path='/cassandra/system/schema_columnfamilies/system-schema_columnfamilies-ib-629-Data.db'),
SSTableReader(path='/cassandra/system/schema_columnfamilies/system-schema_columnfamilies-ib-630-Data.db'),
SSTableReader(path='/cassandra/system/schema_columnfamilies/system-schema_columnfamilies-ib-628-Data.db')]
> INFO [MigrationStage:1] 2013-04-18 10:23:17,576 ColumnFamilyStore.java (line 640) Enqueuing
flush of Memtable-schema_columns@1106646812(248/700 serialized/live bytes, 5 ops)
> INFO [FlushWriter:22] 2013-04-18 10:23:17,577 Memtable.java (line 447) Writing Memtable-schema_columns@1106646812(248/700
serialized/live bytes, 5 ops)
> INFO [FlushWriter:22] 2013-04-18 10:23:17,595 Memtable.java (line 481) Completed flushing
/cassandra/system/schema_columns/system-schema_columns-ib-483-Data.db (199 bytes) for commitlog
position ReplayPosition(segmentId=1365620853206, position=2889368)
> INFO [CompactionExecutor:7617] 2013-04-18 10:23:17,595 CompactionTask.java (line 118)
Compacting [SSTableReader(path='/cassandra/system/schema_columns/system-schema_columns-ib-480-Data.db'),
SSTableReader(path='/cassandra/system/schema_columns/system-schema_columns-ib-482-Data.db'),
SSTableReader(path='/cassandra/system/schema_columns/system-schema_columns-ib-481-Data.db'),
SSTableReader(path='/cassandra/system/schema_columns/system-schema_columns-ib-483-Data.db')]
> INFO [CompactionExecutor:7616] 2013-04-18 10:23:17,611 CompactionTask.java (line 273)
Compacted 4 sstables to [/cassandra/system/schema_columnfamilies/system-schema_columnfamilies-ib-632,].
 17,018 bytes to 15,070 (~88% of original) in 36ms = 0.399219MB/s.  8 total rows, 5 unique.
 Row merge counts were {1:4, 2:0, 3:0, 4:1, }
> INFO [CompactionExecutor:7617] 2013-04-18 10:23:17,616 CompactionTask.java (line 273)
Compacted 4 sstables to [/cassandra/system/schema_columns/system-schema_columns-ib-484,].
 3,804 bytes to 3,148 (~82% of original) in 20ms = 0.150108MB/s.  7 total rows, 4 unique.
 Row merge counts were {1:3, 2:0, 3:0, 4:1, }
> 
> 
> M.
> 


Mime
View raw message