cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Feng Qu <mail...@gmail.com>
Subject Re: does secondary index get created(rebuilt?) every time Cassandra restarts?
Date Fri, 20 Jul 2012 18:25:07 GMT
No, but I see message of "Creating new index" after most recent restart of Cassandra which
is at 2012-07-18 13:51:37,306. 

grep -i "index" /data/cassandra/log/system/system.log.2|grep -v IndexInfo
 INFO [main] 2012-07-18 13:53:49,398 DatabaseDescriptor.java (line 170) DiskAccessMode 'auto'
determined to be mmap, indexAccessMode is mmap
 INFO [OptionalTasks:1] 2012-07-18 14:05:27,648 SecondaryIndexManager.java (line 183) Creating
new index : ColumnDefinition{name=74696d657374616d70, validator=org.apache.cassandra.db.marshal.DateType,
index_type=KEYS, index_name='MtsTrackingData_timestamp_idx'}
 INFO [OptionalTasks:1] 2012-07-18 14:14:46,163 SecondaryIndexManager.java (line 183) Creating
new index : ColumnDefinition{name=61646a557365724e616d65, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=KEYS, index_name='MobilePushNotificationLog_adjUserName_idx'}
 INFO [OptionalTasks:1] 2012-07-18 14:14:46,208 SecondaryIndexManager.java (line 183) Creating
new index : ColumnDefinition{name=636c69656e744964, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=KEYS, index_name='MobilePushNotificationLog_clientId_idx'}
 INFO [OptionalTasks:1] 2012-07-18 14:14:46,298 SecondaryIndexManager.java (line 183) Creating
new index : ColumnDefinition{name=636f6e73756d6572, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=KEYS, index_name='MobilePushNotificationLog_consumer_idx'}
 INFO [OptionalTasks:1] 2012-07-18 14:14:46,378 SecondaryIndexManager.java (line 183) Creating
new index : ColumnDefinition{name=6372656174656454696d65, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=KEYS, index_name='MobilePushNotificationLog_createdTime_idx'}
 INFO [OptionalTasks:1] 2012-07-18 14:15:32,855 SecondaryIndexManager.java (line 183) Creating
new index : ColumnDefinition{name=64656c69766572656454696d65, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=KEYS, index_name='MobilePushNotificationLog_deliveredTime_idx'}
 INFO [OptionalTasks:1] 2012-07-18 14:16:18,503 SecondaryIndexManager.java (line 183) Creating
new index : ColumnDefinition{name=6465766963654964, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=KEYS, index_name='MobilePushNotificationLog_deviceId_idx'}
 INFO [OptionalTasks:1] 2012-07-18 14:16:33,154 SecondaryIndexManager.java (line 183) Creating
new index : ColumnDefinition{name=646576696365546f6b656e, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=KEYS, index_name='MobilePushNotificationLog_deviceToken_idx'}
 INFO [OptionalTasks:1] 2012-07-18 14:16:49,189 SecondaryIndexManager.java (line 183) Creating
new index : ColumnDefinition{name=6576656e744e616d65, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=KEYS, index_name='MobilePushNotificationLog_eventName_idx'}
 INFO [OptionalTasks:1] 2012-07-18 14:16:49,318 SecondaryIndexManager.java (line 183) Creating
new index : ColumnDefinition{name=6e6f7469664964, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=KEYS, index_name='MobilePushNotificationLog_notifId_idx'}
 INFO [OptionalTasks:1] 2012-07-18 14:17:27,073 SecondaryIndexManager.java (line 183) Creating
new index : ColumnDefinition{name=7265666572656e63654964, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=KEYS, index_name='MobilePushNotificationLog_referenceId_idx'}
 INFO [OptionalTasks:1] 2012-07-18 14:17:47,574 SecondaryIndexManager.java (line 183) Creating
new index : ColumnDefinition{name=757365724e616d65, validator=org.apache.cassandra.db.marshal.UTF8Type,
index_type=KEYS, index_name='MobilePushNotificationLog_userName_idx'}

 
Feng Qu


>________________________________
> From: aaron morton <aaron@thelastpickle.com>
>To: user@cassandra.apache.org; Feng Qu <mail4qf@gmail.com> 
>Sent: Friday, July 20, 2012 2:25 AM
>Subject: Re: does secondary index get created(rebuilt?) every time Cassandra restarts?
> 
>>  INFO [OptionalTasks:1] 2012-07-18 14:05:27,648 SecondaryIndexManager.java (line
183) Creating new index : ColumnDefinition{name=74696d657374616d70, validator=org.apache.cassandra.db.marshal.DateType,
index_type=KEYS, index_name='MtsTrackingData_timestamp_idx'}
>Is the system reading the index meta data. 
>
>Do you see any INFO level messages with "Submitting index build" ?
>
>cheers
>
>-----------------
>Aaron Morton
>Freelance Developer
>@aaronmorton
>http://www.thelastpickle.com
>
>On 20/07/2012, at 5:52 AM, Feng Qu wrote:
>
>> We have a CF with 11 secondary indexes (don't ask me why) and I noticed restarting
cassandra takes much longer time comparing to other clusters without secondary indexes. In
system.log I see 20 mins pause on building index. 
>> 
>> this example shows a 12 mins gap.
>>  INFO [SSTableBatchOpen:13] 2012-07-18 13:53:51,556 SSTableReader.java (line 153)
Opening /data/cassandra/data/mobileks/MtsTrackingData-hc-5744 (1950145442 bytes)
>>  INFO [SSTableBatchOpen:12] 2012-07-18 13:53:51,556 SSTableReader.java (line 153)
Opening /data/cassandra/data/mobileks/MtsTrackingData-hc-5197 (12551211807 bytes)
>>  INFO [OptionalTasks:1] 2012-07-18 14:05:27,648 SecondaryIndexManager.java (line
183) Creating new index : ColumnDefinition{name=74696d657374616d70, validator=org.apache.cassandra.db.marshal.DateType,
index_type=KEYS, index_name='MtsTrackingData_timestamp_idx'}
>>  INFO [SSTableBatchOpen:2] 2012-07-18 14:05:27,673 SSTableReader.java (line 153)
Opening /data/cassandra/data/mobileks/MtsTrackingData.MtsTrackingData_timestamp_idx-hc-4354
(64493843 bytes)
>>  INFO [SSTableBatchOpen:1] 2012-07-18 14:05:27,673 SSTableReader.java (line 153)
Opening /data/cassandra/data/mobileks/MtsTrackingData.MtsTrackingData_timestamp_idx-hc-4344
(258674041 bytes)
>>  INFO [SSTableBatchOpen:5] 2012-07-18 14:05:27,673 SSTableReader.java (line 153)
Opening /data/cassandra/data/mobileks/MtsTrackingData.MtsTrackingData_timestamp_idx-hc-1826
(3397211685 bytes)
>> 
>> Is this by design? Why it has to be created during start up?
>>  
>> Feng Qu
>
>
>
>
Mime
View raw message