Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5E99C759D for ; Mon, 19 Sep 2011 01:51:57 +0000 (UTC) Received: (qmail 7934 invoked by uid 500); 19 Sep 2011 01:51:55 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 7911 invoked by uid 500); 19 Sep 2011 01:51:55 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 7903 invoked by uid 500); 19 Sep 2011 01:51:55 -0000 Delivered-To: apmail-incubator-cassandra-user@incubator.apache.org Received: (qmail 7899 invoked by uid 99); 19 Sep 2011 01:51:55 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Sep 2011 01:51:55 +0000 X-ASF-Spam-Status: No, hits=2.6 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,TRACKER_ID,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of springrider@gmail.com designates 209.85.215.51 as permitted sender) Received: from [209.85.215.51] (HELO mail-ew0-f51.google.com) (209.85.215.51) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Sep 2011 01:51:49 +0000 Received: by ewy5 with SMTP id 5so473864ewy.24 for ; Sun, 18 Sep 2011 18:51:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:from:date:message-id:subject:to:content-type; bh=Mfujfc2CNej4P7wFaMSP3YephvWAanNC1KZapNb3vIU=; b=dsxr1dTOA15fxuQJgP/ysFvsBPV8/REB3YT8Mdd9hsn5MDAI+HiuVIllj2w8h2zjsZ l2/jzIyvSUOe783kPsJydO6JxtKArphBJmmHJ0m1fg/YLdURsp7SPnl3Wcc3XqI1Nx5h +SK4W8sj2TI/UHyG4jk4zHSxhYCtV7n4SLjpo= Received: by 10.213.26.74 with SMTP id d10mr540960ebc.97.1316397087674; Sun, 18 Sep 2011 18:51:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.213.32.199 with HTTP; Sun, 18 Sep 2011 18:51:07 -0700 (PDT) From: Yan Chunlu Date: Mon, 19 Sep 2011 09:51:07 +0800 Message-ID: Subject: cassandra crashed while repairing, leave node size X3 To: cassandra-user@incubator.apache.org Content-Type: multipart/alternative; boundary=0015174bdc9ccb52ce04ad419416 --0015174bdc9ccb52ce04ad419416 Content-Type: text/plain; charset=ISO-8859-1 while doing repair on node3, the "Load" keep increasing, suddenly cassandra has encountered OOM, and the "Load" stopped at 140GB, after cassandra came back, I tried node cleanup but it seems not working.... does node repair generate many temp sstables? how to get rid of them? thanks! Address Status State Load Owns Token 113427455640312821154458202477256070484 node1 Up Normal 43 GB 33.33% 0 node2 Up Normal 59.52 GB 33.33% 56713727820156410577229101238628035242 node3 Down Normal 142.57 GB 33.33% 113427455640312821154458202477256070484 --0015174bdc9ccb52ce04ad419416 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
while doing repair on node3, the "Load" keep increasing, sud= denly cassandra has encountered OOM, and the "Load" stopped at 14= 0GB, =A0after cassandra came back, I tried node cleanup but it seems not wo= rking....=A0

does node repair generate many temp sstables? =A0 how t= o get rid of them? =A0thanks!

Address =A0 =A0 =A0 = =A0 Status State =A0 Load =A0 =A0 =A0 =A0 =A0 =A0Owns =A0 =A0Token =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=A0
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A011342745564031282115445820247725= 6070484 =A0 =A0=A0
node1 =A0 =A0 =A0Up =A0 =A0 Normal =A043 GB = =A0 =A0 =A0 =A0 =A0 33.33% =A00 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=A0
node2 =A0 =A0 Up =A0 =A0 Normal =A059.52 GB =A0 =A0 =A0 =A033.33% =A0567137= 27820156410577229101238628035242 =A0 =A0 =A0
node3 =A0 =A0 =A0Down =A0 Normal =A0142.57 GB =A0 =A0 =A0 33.33% =A011= 3427455640312821154458202477256070484=A0
--0015174bdc9ccb52ce04ad419416--