cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Brown (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-4663) Streaming sends one file at a time serially.
Date Fri, 20 Jan 2017 19:44:26 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-4663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832312#comment-15832312
] 

Jason Brown commented on CASSANDRA-4663:
----------------------------------------

OK, test look reasonable (no new dtest failures that are not currently failing on trunk).
For the record, [~iksaif]'s patch parallelizes the streaming of the keyspaces being sent.
If you have multiple keyspaces, you will potentially get an nice win. However, if there is
only one keyspace (or most data is in one), there is no parallelization gained. I'll update
the title of this jira to reflect that. As part of CASSANDRA-12229, or an immediate follow
up, I'll be addressing sending sending files in parallel, so that request won't fall off the
radar.

+1'ing the ticket and will commit briefly

> Streaming sends one file at a time serially. 
> ---------------------------------------------
>
>                 Key: CASSANDRA-4663
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4663
>             Project: Cassandra
>          Issue Type: Improvement
>            Reporter: sankalp kohli
>            Priority: Minor
>             Fix For: 3.x
>
>         Attachments: 0001-streaming-add-a-way-to-configure-the-number-of-conne.patch
>
>
> This is not fast enough when someone is using SSD and may be 10G link. We should try
to create multiple connections and send multiple files in parallel. 
> Current approach under utilize the link(even 1G).
> This change will improve the bootstrapping time of a node. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message