Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 020E7CE23 for ; Mon, 21 May 2012 13:56:06 +0000 (UTC) Received: (qmail 88503 invoked by uid 500); 21 May 2012 13:56:03 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 88464 invoked by uid 500); 21 May 2012 13:56:03 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 88456 invoked by uid 99); 21 May 2012 13:56:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 May 2012 13:56:03 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of arodrime@gmail.com designates 74.125.82.172 as permitted sender) Received: from [74.125.82.172] (HELO mail-we0-f172.google.com) (74.125.82.172) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 May 2012 13:55:57 +0000 Received: by werb13 with SMTP id b13so2382889wer.31 for ; Mon, 21 May 2012 06:55:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=4sOH3IKxmGnov9lDF5O1UTNgpWT3OffQPTS1zT2wW4M=; b=dlmbqiBP8xrwpbDCLt4MkoBsh2YwzexjkExZOhj5XVe1jFeY9YoP+qynCoGGTn47QQ BET0M8IQO37kY5xxFs/zrskf3EfXBKdpG0g97NiAQlmGeIE8vDUsbZgitWVZbwMscoDL 5Kc2hjduseN1pzS/vXYzhqhTeOLA92nJDBvNVjYDBToY5m1gybuiyBBx+8YLa/u8XOsA RVNz+rgeS4VWfsh0XYXph2xYza3mgNWbX9zI34tuKH9pcm6LBvtgzRW/UIYypOn0gaSo BH7gkELdwsz1hvYmps1KRVqeBn+IRdMVUrB0n1zVz9DhaUKBkW0ByM2vAHYReEg4DCx6 bASA== Received: by 10.180.75.241 with SMTP id f17mr25525215wiw.11.1337608536121; Mon, 21 May 2012 06:55:36 -0700 (PDT) MIME-Version: 1.0 Received: by 10.223.120.78 with HTTP; Mon, 21 May 2012 06:55:15 -0700 (PDT) From: Alain RODRIGUEZ Date: Mon, 21 May 2012 15:55:15 +0200 Message-ID: Subject: Wrong data after rolling restart To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org Hi, I re-post this here because it's a new subject far away from my initial tuning questions. I wanted to try a new config. After doing a rolling restart I have all my counters false, with wrong values. I stopped my servers with the following : nodetool -h localhost disablegossip nodetool -h localhost disablethrift nodetool -h localhost drain kill cassandra sigterm (15) via htop And after restarting the second one I have lost all the consistency of my data. All my statistics since September are totally false now in production. As reminder I'm using a 2 node cluster RF=2, CL.ONE 1 - How to fix it ? (I have a backup from this morning, but I will lose all the data after this date if I restore this backup) 2 - What happened ? How to avoid it ? Any Idea would be greatly appreciated, I'm quite desperated. Alain