Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2BF09118C3 for ; Wed, 6 Aug 2014 08:12:04 +0000 (UTC) Received: (qmail 526 invoked by uid 500); 6 Aug 2014 08:12:01 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 488 invoked by uid 500); 6 Aug 2014 08:12:01 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 478 invoked by uid 99); 6 Aug 2014 08:12:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Aug 2014 08:12:01 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of duncan.sands@gmail.com designates 74.125.82.47 as permitted sender) Received: from [74.125.82.47] (HELO mail-wg0-f47.google.com) (74.125.82.47) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Aug 2014 08:11:57 +0000 Received: by mail-wg0-f47.google.com with SMTP id b13so2237183wgh.30 for ; Wed, 06 Aug 2014 01:11:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=8F5xy5o9mREI5I82/4iq4JMeNmEg0OhKjl6xyooSF4g=; b=fm3cG3pofmvv7W14JSmozqOjF4srzfPC4KvOgyHVtHPTQGMWCC++nwFg/hWtkfsNVR /EehceVT7B3Kmatwp6f76nPHOmw4K/3O3hBaScP2/70SGdhYWenTVsCGmOJuQJ6wX7sb 1Fsg3jw97X86KbYqwXIwgxAHIPnpjNW6//+gxd1h1dbbJJuSvoECDQptfUhemzpElnH+ uNCoQ4yy/0HQ5ykdyyNyEhK/h32puE/LCcacZq1Z8dEg1ExonE4wLuY5f/AkUOdelRgO wJivyxsp6fxUIfx4QfMP/4wkqU0FLX84mWx5EOJfihmDS7IaUl1VWxYW44+0twoo1MWw G7hQ== X-Received: by 10.180.100.133 with SMTP id ey5mr14363023wib.16.1407312696123; Wed, 06 Aug 2014 01:11:36 -0700 (PDT) Received: from ?IPv6:2a01:e35:2e83:a840:69:4932:d856:1e45? ([2a01:e35:2e83:a840:69:4932:d856:1e45]) by mx.google.com with ESMTPSA id ft7sm3682729wib.9.2014.08.06.01.11.34 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 06 Aug 2014 01:11:35 -0700 (PDT) Message-ID: <53E1E335.4080603@gmail.com> Date: Wed, 06 Aug 2014 10:11:33 +0200 From: Duncan Sands User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.0 MIME-Version: 1.0 To: user@cassandra.apache.org Subject: Re: Cassandra process exiting mysteriously References: In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Hi Clint, > INFO [StorageServiceShutdownHook] 2014-08-05 19:14:51,903 > ThriftServer.java (line 141) Stop listening to thrift clients > INFO [StorageServiceShutdownHook] 2014-08-05 19:14:51,920 Server.java > (line 182) Stop listening for CQL clients > INFO [StorageServiceShutdownHook] 2014-08-05 19:14:51,930 > Gossiper.java (line 1279) Announcing shutdown > INFO [StorageServiceShutdownHook] 2014-08-05 19:14:53,930 > MessagingService.java (line 683) Waiting for messaging service to > quiesce > INFO [ACCEPT-/127.0.0.10] 2014-08-05 19:14:53,931 > MessagingService.java (line 923) MessagingService has terminated the > accept() thread > > Does anyone have any ideas about how to debug this? Looking around on > google I found some threads suggesting that this could occur from an > OOM error (http://stackoverflow.com/questions/23755040/cassandra-exits-with-no-errors). this doesn't look like an OOM to me. If the kernel OOM kills Cassandra then Cassandra instantly vaporizes, and there will be nothing in the Cassandra logs (you will find information about the OOM in the system logs though, eg in dmesg). In the log snippet above you see an orderly shutdown, this is completely different to the instant OOM kill. Ciao, Duncan.