cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aleksey Yeschenko (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-11324) Make SSTABLESCRUB and related jobs multi-threaded / parallelize somehow
Date Thu, 02 Jun 2016 17:05:59 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-11324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15312675#comment-15312675
] 

Aleksey Yeschenko commented on CASSANDRA-11324:
-----------------------------------------------

You can initiate multiple scrub processes to run in parallel, processing one sstable each.
It's not possible to parallelise scrub on a single sstable, however, as you really need to
go byte by byte, without skipping. As such, closing as Not A Problem.

> Make SSTABLESCRUB and related jobs multi-threaded  / parallelize somehow
> ------------------------------------------------------------------------
>
>                 Key: CASSANDRA-11324
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-11324
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Tools
>            Reporter: Thom Valley
>            Priority: Minor
>
> SSTABLE scrub right now appears to be single threaded in offline mode (unsure about online).
 When scrubbing a node, especially a well provisioned one, the node sits mostly idle for potentially
hours while scrubbing.
> Making better use of available resources through parallelization / multi-threading of
the scrub process seems like a good idea.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message