Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 198AC10F1C for ; Wed, 18 Sep 2013 01:07:53 +0000 (UTC) Received: (qmail 58652 invoked by uid 500); 18 Sep 2013 01:07:52 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 58631 invoked by uid 500); 18 Sep 2013 01:07:52 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 58622 invoked by uid 99); 18 Sep 2013 01:07:52 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Sep 2013 01:07:52 +0000 Date: Wed, 18 Sep 2013 01:07:52 +0000 (UTC) From: "Jonathan Ellis (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (CASSANDRA-5863) Create a Decompressed Chunk Cache MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13734890#comment-13734890 ] Jonathan Ellis edited comment on CASSANDRA-5863 at 9/18/13 1:06 AM: -------------------------------------------------------------------- Probably easier to just special case seq scans to not cache, the way we did with fadvise pre-CASSANDRA-4937. was (Author: jbellis): Probably easier to just special case seq scans to not cache, the way we [used to?] do with fadvise. > Create a Decompressed Chunk Cache > --------------------------------- > > Key: CASSANDRA-5863 > URL: https://issues.apache.org/jira/browse/CASSANDRA-5863 > Project: Cassandra > Issue Type: New Feature > Components: Core > Reporter: T Jake Luciani > Assignee: Tyler Hobbs > Fix For: 2.1 > > > Currently, for every read, the CRAR reads each compressed chunk into a byte[], sends it to ICompressor, gets back another byte[] and verifies a checksum. > This process is where the majority of time is spent in a read request. > Before compression, we would have zero-copy of data and could respond directly from the page-cache. > It would be useful to have some kind of Chunk cache that could speed up this process for hot data. Initially this could be a off heap cache but it would be great to put these decompressed chunks onto a SSD so the hot data lives on a fast disk similar to https://github.com/facebook/flashcache. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira