cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nate McCall (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CASSANDRA-1258) rebuild indexes after streaming
Date Fri, 30 Jul 2010 00:13:22 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12893870#action_12893870
] 

Nate McCall commented on CASSANDRA-1258:
----------------------------------------

I would like to stick with the approach in v7 for the scope of this ticket. I just took a
stab at the above (CFMD at SSTR creation time to provide the comparator and CFMD).

The changes are starting to reach into a lot of places: Memtable/BinaryMem., CompartionMgr
(for SSTW.closeAndReopenReader), SST export, etc. 

I tried an initial set of changes with a fallback to DD when no CFMD was provided and got
into a weird race condition that hung junit/ant. 

I'd like to put in a new ticket for 'SSTable initialization cleanup to avoid DD usage' for
the above if your cool with that, primarily so I can stick a fork in this and knock out the
thrift update. 

> rebuild indexes after streaming
> -------------------------------
>
>                 Key: CASSANDRA-1258
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1258
>             Project: Cassandra
>          Issue Type: Sub-task
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Nate McCall
>             Fix For: 0.7 beta 1
>
>         Attachments: 1258-v4.txt, 1258-v5.txt, 1258-v6.txt, 1258-v7.txt, trunk-1258-src-2.txt,
trunk-1258-src-3.txt
>
>
> since index CFSes are "private," they won't be streamed with other sstables.  which is
good, because the normal partitioner logic wouldn't stream the right parts anyway.
> seems like the right solution is to extend SSTW.maybeRecover to rebuild indexes as well.
 (this has the added benefit of being able to use streaming as a relatively straightforward
"bulk loader.")

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message