Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CA58C10759 for ; Tue, 10 Sep 2013 00:12:05 +0000 (UTC) Received: (qmail 50382 invoked by uid 500); 10 Sep 2013 00:12:03 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 50349 invoked by uid 500); 10 Sep 2013 00:12:03 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 50341 invoked by uid 99); 10 Sep 2013 00:12:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Sep 2013 00:12:03 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_HELO_PASS X-Spam-Check-By: apache.org Received-SPF: error (athena.apache.org: local policy) Received: from [212.227.126.187] (HELO moutng.kundenserver.de) (212.227.126.187) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Sep 2013 00:11:58 +0000 Received: from [192.168.2.107] (p548F9B80.dip0.t-ipconnect.de [84.143.155.128]) by mrelayeu.kundenserver.de (node=mreu0) with ESMTP (Nemesis) id 0Lvfyq-1W2LYJ3mM0-017iTv; Tue, 10 Sep 2013 02:10:55 +0200 From: Jan Algermissen Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: One node out of three not flushing memtables Message-Id: <197D9A73-6FA2-4ED5-A05C-065F20B80FCF@nordsc.com> Date: Tue, 10 Sep 2013 02:11:01 +0200 To: "user@cassandra.apache.org" Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) X-Mailer: Apple Mail (2.1508) X-Provags-ID: V02:K0:KkNLIEp0Vdm8+xNGLJAGUS3j4BfZS1pQIFZTQCdTHux 7JzgvUuAitqn36TtQnRqoRZevNMdqjvj5taghIUWLiDZELvJel 5ReRCu2TYYBQsaoNX8w9yiqAmrMDsswvhXwTiQe8Euan8yOnai UGSttCouin0i6LI8ZHzi73vZmmc1vsBHSSOeVMJmf6wZSEgBu/ YjeLnK0vmSNpXdFB2tdj9vOsOI9USBbPcj+DHlraZmZyG4616U zLRLK2MDa91XUxOfcP+yTU+FprBFgXSb5riZ6p0731yqOgSdCG IrCabdNmhxOLBznE8Bg6fqfDTqTcHs2dThYXdE/XNC8jX1UcNH i9ycED/TZqub+D8CwI57MxyE6hiTTrBvAWXy5YsrdzhSM34/So oRiVfQlcSJqqQ== X-Virus-Checked: Checked by ClamAV on apache.org I have a strange pattern: In a cluster with three equally dimensioned = and configured nodes I keep loosing one because apparently it fails to = flush its memtables: http://twitpic.com/dcrtel It is a different node every time. So far I understand that I should expect to see the chain-saw graph when = memtables are build up and then get flushed. But what about that third = node? Has anyone seen something similar? Jan C* dsc 2.0 , 3x 4GB, 2CPU nodes with heavy writes of 70 col-rows (aprox = 10 of those rows per wide row) I have turned off caches, reduced overall memtable and set flush-wroters = to 2, rpc_reader and writer threads to 1.