Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cassandra.apache.org
Date: Sun, 5 Feb 2017 16:45:42 +0000 (UTC)
From: "Aleksey Yeschenko (JIRA)" <jira@apache.org>
To: commits@cassandra.apache.org
Message-ID: <JIRA.12958481.1460557101000.1305.1486313142369@Atlassian.JIRA>
In-Reply-To: <JIRA.12958481.1460557101000@Atlassian.JIRA>
References: <JIRA.12958481.1460557101000@Atlassian.JIRA> <JIRA.12958481.1460557101445@jira-lw-us.apache.org>
Subject: [jira] [Updated] (CASSANDRA-11561) Improve Streaming Performance
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Sun, 05 Feb 2017 16:45:49 -0000


     [ https://issues.apache.org/jira/browse/CASSANDRA-11561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aleksey Yeschenko updated CASSANDRA-11561:
------------------------------------------
    Fix Version/s:     (was: 3.x)

> Improve Streaming Performance
> -----------------------------
>
>                 Key: CASSANDRA-11561
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-11561
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Streaming and Messaging
>            Reporter: T Jake Luciani
>            Assignee: T Jake Luciani
>
> Inspired by CASSANDRA-9766 I've taken a look at the streaming path and have been able to improve Streaming performance 25% with the following:
> * CompressedStreamReader had only implemented reading a single byte at a time. I added the read(byte[], int, int) method.
> * When writing to sstable, rather than calculate size of row, write the size then write the row (which causes 2x the cpu). Serialize the row to memory then write size of memory buffer and copy buffer to disk.
> * Added object recycling of the largest garbage sources.  Namely, BTreeSearchIterator, and DataOutputBuffer (for above fix). There are still a few more places recycling would help/ like the Object[] in BTree.Builder
> * Changed all ThreadLocals to use FastThreadLocal from netty, and subsequently adding FastThreadLocalThreads for all internal threads.
> There are still more things todo here, like we generate tons of garbage boxing types for StreamingHistogram.
> I've added a long test to stream and compact a large sstable.


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)