cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paulo Motta (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-4663) Streaming sends one file at a time serially.
Date Mon, 20 Jun 2016 14:42:05 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-4663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15339612#comment-15339612
] 

Paulo Motta commented on CASSANDRA-4663:
----------------------------------------

bq. I would think the easiest thing would be to send many files contained in the StreamSession
at once vs one at a time.

this would definitely be the best thing to do, but would probably require a non-trivial change
on the {{StreamSession}} to create/manage many connection handlers and split init/prepare
phase from file sending and probably require some additional headers/messages. the easiest
approach with the current protocol is to create multiple stream session objects, which can
in fact increase the number of sstables created after streaming.

with that said, I think we should go with the best (and not the easiest) approach, since we
already suffer from creating too many sstables due to vnodes and that could be worsened with
that approach.

> Streaming sends one file at a time serially. 
> ---------------------------------------------
>
>                 Key: CASSANDRA-4663
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4663
>             Project: Cassandra
>          Issue Type: Improvement
>            Reporter: sankalp kohli
>            Priority: Minor
>
> This is not fast enough when someone is using SSD and may be 10G link. We should try
to create multiple connections and send multiple files in parallel. 
> Current approach under utilize the link(even 1G).
> This change will improve the bootstrapping time of a node. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message