cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joshua McKenzie (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CASSANDRA-3668) Parallel streaming for sstableloader
Date Fri, 04 Apr 2014 21:27:30 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13960435#comment-13960435
] 

Joshua McKenzie edited comment on CASSANDRA-3668 at 4/4/14 9:26 PM:
--------------------------------------------------------------------

(edit) We're good with the multiple StreamSessions per peer, I just need to iron out a socket-connection
race on startup of streams.

Prelim parallelized stream testing is peaking at ~ 55MB/s on 5 connections-per-host vs. 49MB/s
on 4 connections - diminishing returns as we get higher.  Compared to the 24MB/s I'm benchmarking
on a single connection it's still a respectable increase.


was (Author: joshuamckenzie):
(edit) Scratch what I wrote previously - we're good with the multiple StreamSessions per peer,
I just need to iron out a socket-connection race on startup of streams.

Prelim parallelized stream testing is peaking at ~ 55MB/s on 5 connections-per-host vs. 49MB/s
on 4 connections - diminishing returns as we get higher.  Compared to the 24MB/s I'm benchmarking
on a single connection it's still a respectable increase.

> Parallel streaming for sstableloader
> ------------------------------------
>
>                 Key: CASSANDRA-3668
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3668
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: API
>            Reporter: Manish Zope
>            Assignee: Joshua McKenzie
>            Priority: Minor
>              Labels: streaming
>             Fix For: 2.1 beta2
>
>         Attachments: 3668-1.1-v2.txt, 3668-1.1.txt, 3688-reply_before_closing_writer.txt,
sstable-loader performance.txt
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> One of my colleague had reported the bug regarding the degraded performance of the sstable
generator and sstable loader.
> ISSUE :- https://issues.apache.org/jira/browse/CASSANDRA-3589 
> As stated in above issue generator performance is rectified but performance of the sstableloader
is still an issue.
> 3589 is marked as duplicate of 3618.Both issues shows resolved status.But the problem
with sstableloader still exists.
> So opening other issue so that sstbleloader problem should not go unnoticed.
> FYI : We have tested the generator part with the patch given in 3589.Its Working fine.
> Please let us know if you guys require further inputs from our side.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message