Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1021D97F8 for ; Wed, 19 Oct 2011 17:30:29 +0000 (UTC) Received: (qmail 21154 invoked by uid 500); 19 Oct 2011 17:30:27 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 21124 invoked by uid 500); 19 Oct 2011 17:30:26 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 21116 invoked by uid 99); 19 Oct 2011 17:30:26 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Oct 2011 17:30:26 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,HK_RANDOM_ENVFROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of teddyyyy123@gmail.com designates 209.85.213.172 as permitted sender) Received: from [209.85.213.172] (HELO mail-yx0-f172.google.com) (209.85.213.172) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Oct 2011 17:30:19 +0000 Received: by yxj19 with SMTP id 19so2331034yxj.31 for ; Wed, 19 Oct 2011 10:29:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; bh=8CWm1Fg+bIyXw8DcXZV7bRoncFY4E+G0DBDcSF+64Dc=; b=trbiAvCtnhikTGZdkUjA7kCDFlqxvCKIKbSQK/UAH6pODfLvyAYk5aJIiIafWKAyWO hHgS74WpQGh+j91TeyBAywspdO2yfGDmsUtG9BPHw6xhOmazBbsalfjYg2TTknSzcnmY n3NKB8C9rBXIkCLuwX1yhA2QlTWou9MuBGLsM= MIME-Version: 1.0 Received: by 10.150.60.10 with SMTP id i10mr4401810yba.77.1319045398494; Wed, 19 Oct 2011 10:29:58 -0700 (PDT) Received: by 10.151.79.15 with HTTP; Wed, 19 Oct 2011 10:29:58 -0700 (PDT) Date: Wed, 19 Oct 2011 10:29:58 -0700 Message-ID: Subject: weird problem with performance From: Yang To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org I'm using a cassandra version compiled from 1.0.0 github HEAD. I have 3 nodes, A B and C, on node A I run a client, which talks only to B as the coordinator. the performance is pretty good, a QUORUM read+write takes < 10ms. but then I shutdown C, quickly the performance starts to degrade, and QUORUM read+write time steadily increase to about 300ms. if I shutdown A and keep C, I observe the same effect. I understand that "2 out of 3" is going to give you faster response than "2 out of 2", but the difference should not be that dramatic as 10ms vs 300ms. any possible reasons for this?(or how to debug this?) Thanks Yang