Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 47201921F for ; Fri, 21 Oct 2011 13:38:39 +0000 (UTC) Received: (qmail 45668 invoked by uid 500); 21 Oct 2011 13:38:37 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 45639 invoked by uid 500); 21 Oct 2011 13:38:37 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 45629 invoked by uid 99); 21 Oct 2011 13:38:37 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Oct 2011 13:38:37 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jbellis@gmail.com designates 209.85.215.172 as permitted sender) Received: from [209.85.215.172] (HELO mail-ey0-f172.google.com) (209.85.215.172) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Oct 2011 13:38:31 +0000 Received: by eyg24 with SMTP id 24so4272700eyg.31 for ; Fri, 21 Oct 2011 06:38:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding; bh=ZIQascdA7QfXtUB2jQ2jV7rumRjyVSmomUcNE9h7r8M=; b=q8fBd1PMxCNVDDmc/qH4KU+QWLAaNpArknWOMudcSDX+yTBhXzysmmDiCvqpnfzKP9 mNaC9ljiC2H/TrY1bdZcTWLQXF0WZ2842VYtr6KfJ/MYmoG77clo13I81AgYRmAAKRKl 8zDW9ld58k0BVbCwbrjUjMA3Kql2hIeQYUm94= Received: by 10.213.16.146 with SMTP id o18mr1879845eba.16.1319204291195; Fri, 21 Oct 2011 06:38:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.213.14.84 with HTTP; Fri, 21 Oct 2011 06:37:51 -0700 (PDT) In-Reply-To: References: <4ea051fc.0476ec0a.3048.2246@mx.google.com> From: Jonathan Ellis Date: Fri, 21 Oct 2011 08:37:51 -0500 Message-ID: Subject: Re: Cassandra 1.0.0 - Node Load Bug To: user@cassandra.apache.org Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org You're right, that is in 1.0.0. Don't know what the OP is seeing, then. On Fri, Oct 21, 2011 at 6:32 AM, Jeremiah Jordan wrote: > I thought this patch made it into the 1.0 release? =A0I remember it being= referenced in one of the re-rolls. > > > On Oct 20, 2011, at 9:56 PM, "Jonathan Ellis" wrote: > >> That looks to me like it's reporting uncompressed size as the load. >> Should be fixed in the 1.0 branch for 1.0.1. >> (https://issues.apache.org/jira/browse/CASSANDRA-3338) >> >> On Thu, Oct 20, 2011 at 11:53 AM, Dan Hendry = wrote: >>> I have been playing around with Cassandra 1.0.0 in our test environment= it >>> seems pretty sweet so far. I have however come across what appears to b= e a >>> bug tracking node load. I have enabled compression and levelled compact= ion >>> on all CFs (scrub =A0+ snapshot deletion) and the nodes have been opera= ting >>> normally for a day or two. I started getting concerned when the load as >>> reported by nodetool ring kept increasing (it seems monotonically) desp= ite >>> seeing a compression ratio of ~2.5x (as a side note, I find it strange >>> Cassandra does not provide the compression ratio via jmx or in the logs= ). I >>> initially thought there might be a bug in cleaning up obsolete SSTables= but >>> I then noticed the following discrepancy: >>> >>> >>> >>> Nodetool ring reports: >>> >>> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 10.112.27.65 =A0 =A0datacenter1 rack1 = =A0 =A0 =A0 Up =A0 =A0 Normal =A08.64 >>> GB =A0 =A0 =A0 =A0 50.00% =A0170141183460469231731687303715884105727 >>> >>> >>> >>> Yet du . =96h reports: only 2.4G in the data directory. >>> >>> >>> >>> After restarting the node, nodetool ring reports a more accurate: >>> >>> 10.112.27.65 =A0 =A0datacenter1 rack1 =A0 =A0 =A0 Up =A0 =A0 Normal =A0= 2.35 GB >>> 50.00% =A0170141183460469231731687303715884105727 >>> >>> >>> >>> Again, both compression and levelled compaction have been enabled on al= l >>> CFs. Is this a known issue or has anybody else observed a similar patte= rn? >>> >>> >>> >>> Dan Hendry >>> >>> (403) 660-2297 >>> >>> >> >> >> >> -- >> Jonathan Ellis >> Project Chair, Apache Cassandra >> co-founder of DataStax, the source for professional Cassandra support >> http://www.datastax.com > --=20 Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com