Return-Path: Delivered-To: apmail-cassandra-dev-archive@www.apache.org Received: (qmail 30570 invoked from network); 22 Sep 2010 03:47:07 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 22 Sep 2010 03:47:07 -0000 Received: (qmail 41687 invoked by uid 500); 22 Sep 2010 03:47:07 -0000 Delivered-To: apmail-cassandra-dev-archive@cassandra.apache.org Received: (qmail 41614 invoked by uid 500); 22 Sep 2010 03:47:03 -0000 Mailing-List: contact dev-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list dev@cassandra.apache.org Received: (qmail 41606 invoked by uid 99); 22 Sep 2010 03:47:02 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Sep 2010 03:47:02 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of schumi.han@gmail.com designates 209.85.214.44 as permitted sender) Received: from [209.85.214.44] (HELO mail-bw0-f44.google.com) (209.85.214.44) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Sep 2010 03:46:56 +0000 Received: by bwz9 with SMTP id 9so255140bwz.31 for ; Tue, 21 Sep 2010 20:46:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type; bh=+t7vloUNvWGas8ePnICaxyk4iMkj+j2iUE6Op3m8Adc=; b=Sx5/R0AB3Yi8QyzffKIOR2nY6VD7xbSK9dm54X67eSh2PMpTQIOu8RdRJichWYSilU Nf5R/SSpBrjI1RhCGwfcA/gto+DQy/N6wx8GJeCO5ECPjJtQLPpUzGD8Ygvnns3Rcum2 IdZtoK/quLAdjmwonUnz7WQNV+K2aFEakZESA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=KS8S6VL8kWYW5zorUzX1QiYuxAmkxxvZz4lf0DQy7byqZkph3sSo1v3Ux8PLxYtWPv z9vpjYvSEie+jG5YQw0sWcOQqzz+iIf0mR9JBJAEoBNOtogF7QkTjNAS7Od8NJHZQy8f nGzbtfszmOicJTL4l1hJJlU8uWCUz3Vmd3ulc= MIME-Version: 1.0 Received: by 10.204.133.146 with SMTP id f18mr8582070bkt.97.1285127193719; Tue, 21 Sep 2010 20:46:33 -0700 (PDT) Received: by 10.204.163.1 with HTTP; Tue, 21 Sep 2010 20:46:33 -0700 (PDT) In-Reply-To: References: <4C977450.5030908@corp.aol.com> <4C979A84.20904@corp.aol.com> Date: Wed, 22 Sep 2010 11:46:33 +0800 Message-ID: Subject: Re: improving read performance From: Zhu Han To: dev@cassandra.apache.org Content-Type: multipart/alternative; boundary=001517477fb0df73e60490d0fdab --001517477fb0df73e60490d0fdab Content-Type: text/plain; charset=ISO-8859-1 > Reasons to not use the row cache with large rows include: > > * In general it's a waste of memory better given to the OS page cache, > unless possibly you're continually reading entire rows rather than > subsets of rows. > > * For truly large rows you may have immediate issues with the size of > the data being cached; e.g. attempting to cache a 2 GB row is not the > best idea in terms of heap space consumption; you'll likely OOM or > trigger fallbacks to full GC, etc. > > * Having a larger key cache may often be more productive. > > > That aside, splitting the memtable in 2, could make checking the bloom > > filters unnecessary in most cases for me, but I'm not sure it's worth the > > effort. > > Write-through row caching seems like a more direct approach to me > personally, off hand. Also to the extent that you're worried about > false positive rates, larger bloom filters may still be an option (not > currently configurable; would require source changes). > > IMHO, it's very difficult to tune JVM when JVM caches a lot of data for a long time because the modern GC does not design for such purpose. There is a patch about make the row cache pluggable to be replaced by memcached[1]. This is likely the right way to go. [1]https://issues.apache.org/jira/browse/CASSANDRA-1283 > -- > / Peter Schuller > --001517477fb0df73e60490d0fdab--