cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Ellis (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-2470) Secondary Indexes Build Very Slowly
Date Mon, 18 Apr 2011 19:28:06 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13021186#comment-13021186
] 

Jonathan Ellis commented on CASSANDRA-2470:
-------------------------------------------

I'm thinking that our best bet here is CASSANDRA-2324 (if repair doesn't transfer a lot more
data than necessary, index building will also be faster).

> Secondary Indexes Build Very Slowly
> -----------------------------------
>
>                 Key: CASSANDRA-2470
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2470
>             Project: Cassandra
>          Issue Type: Improvement
>            Reporter: Benjamin Coverston
>              Labels: repair, secondary_index
>
> While running repair I noticed that the time it took to run was easily dominated by building
the secondary indexes. They currently build at a rate of < 200KB/Second. This means that
indexing a 500MB file takes nearly an hour to index the file.
> Because this happens on the compaction thread it also causes repair to back up in general,
which for very active systems is a very bad thing.
> I suggest we look at it in the hope that we can improve the rate in which we build the
indexes by an order of magnitude.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message