Return-Path: Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: (qmail 19268 invoked from network); 5 Apr 2011 06:52:47 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 5 Apr 2011 06:52:47 -0000 Received: (qmail 96145 invoked by uid 500); 5 Apr 2011 06:52:47 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 95983 invoked by uid 500); 5 Apr 2011 06:52:46 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 95973 invoked by uid 99); 5 Apr 2011 06:52:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Apr 2011 06:52:46 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Apr 2011 06:52:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id D8AB6920C9 for ; Tue, 5 Apr 2011 06:52:05 +0000 (UTC) Date: Tue, 5 Apr 2011 06:52:05 +0000 (UTC) From: "Stu Hood (JIRA)" To: commits@cassandra.apache.org Message-ID: <1044580939.34346.1301986325884.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <712164.55091295426088991.JavaMail.jira@thor> Subject: [jira] [Commented] (CASSANDRA-2006) Serverwide caps on memtable thresholds MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/CASSANDRA-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015779#comment-13015779 ] Stu Hood commented on CASSANDRA-2006: ------------------------------------- Since the only one consuming the getLiveSize value is the MeteredFlusher thread, could the live-size update be moved into that thread instead? Adding a new executor and 2 new tasks seems like overkill, and it looks like it would remove the "potentially a flushed memtable being counted by jamm" fuzziness. > Serverwide caps on memtable thresholds > -------------------------------------- > > Key: CASSANDRA-2006 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2006 > Project: Cassandra > Issue Type: Improvement > Components: Core > Reporter: Stu Hood > Fix For: 0.8 > > Attachments: 2006-v2.txt, 2006.txt, jamm-0.2.jar > > > By storing global operation and throughput thresholds, we could eliminate the "many small memtables" problem caused by having many CFs. The global threshold would be set in the config file, to allow different classes of servers to have different values configured. > Operations occurring in the memtable would add to the global counters, in addition to the memtable-local counters. When a global threshold was violated, the memtable in the system that was using the largest fraction of it's local threshold would be flushed. Local thresholds would continue to act as they always have. > The result would be larger sstables, safer operation with multiple CFs and per node tuning. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira