Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 15308102CF for ; Wed, 18 Sep 2013 12:58:14 +0000 (UTC) Received: (qmail 92353 invoked by uid 500); 18 Sep 2013 12:58:03 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 92184 invoked by uid 500); 18 Sep 2013 12:57:59 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 91978 invoked by uid 99); 18 Sep 2013 12:57:56 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Sep 2013 12:57:56 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jformoso@gmail.com designates 209.85.215.47 as permitted sender) Received: from [209.85.215.47] (HELO mail-la0-f47.google.com) (209.85.215.47) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Sep 2013 12:57:50 +0000 Received: by mail-la0-f47.google.com with SMTP id eo20so5599576lab.34 for ; Wed, 18 Sep 2013 05:57:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=Y9+JGzG1xvjrT8EZ85L6dUFhMOwebsThJzJPzLd06Po=; b=ZLQalVEIpFCr4ljtaSjUoKDGx8gTrw8kAyMM/1lJpPEgGRb3gE1/9LEWLTf+ScsrFy 4RL9ArKzQ4toYA67zwOnlAP4wpFw5FUBrAdnemPFW2HV9cpHATPL6mOD8s/RcrY7tTK6 4NFAdqNdWkb4jOsr+saT7Fn/oybVL/f4yh32dLsvix9of1qw6ZZf+8YqTH9f0O5cvXfm kJA0MF/NjecfbKVPZTlR9npgdhzcej0iqmfICYO43UamSklZuVTT/FfsDKFoNYaL/MSa Dg4x7a84sNApu1PNxuAb2hZgC18rW2sPstq/p6cav0F/YifFi0+xJ8TaUBPhY4aVhDW0 XNnw== MIME-Version: 1.0 X-Received: by 10.152.116.109 with SMTP id jv13mr2217348lab.30.1379509049797; Wed, 18 Sep 2013 05:57:29 -0700 (PDT) Received: by 10.114.181.68 with HTTP; Wed, 18 Sep 2013 05:57:29 -0700 (PDT) In-Reply-To: References: Date: Wed, 18 Sep 2013 09:57:29 -0300 Message-ID: Subject: Re: cassandra just gone..no heap dump, no log info From: Juan Manuel Formoso To: "user@cassandra.apache.org" Content-Type: multipart/alternative; boundary=001a11c3675ee0b61404e6a7fa87 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c3675ee0b61404e6a7fa87 Content-Type: text/plain; charset=ISO-8859-1 This shouldn't happen if you have swap active in the server On Wednesday, September 18, 2013, Franc Carter wrote: > > A random guess - possibly an OOM (Out of Memory) where Linux will kill a > process to recover memory when it is desperately low on memory. Have a look > in either your syslog output of the output of dmesg > > cheers > > > On Wed, Sep 18, 2013 at 10:21 PM, Hiller, Dean > > wrote: > >> Anyone know how to debug cassandra processes just exiting? There is no >> info in the cassandra logs and there is no heap dump file(which in the past >> has shown up in /opt/cassandra/bin directory for me). >> >> This occurs when running a map/reduce job that put severe load on the >> system. The logs look completely fine. I find it odd >> >> 1. No logs of why it exited at all >> 2. No heap dump which would imply there would be no logs as it crashed >> >> Is there any other way a process can die and linux would log it somehow? >> (like running out of memory) >> >> Thanks, >> Dean >> > > > > -- > > *Franc Carter* | Systems architect | Sirca Ltd > > > franc.carter@sirca.org.au 'franc.carter@sirca.org.au');> | www.sirca.org.au > > Tel: +61 2 8355 2514 > > Level 4, 55 Harrington St, The Rocks NSW 2000 > > PO Box H58, Australia Square, Sydney NSW 1215 > > > -- *Juan Manuel Formoso *Senior Geek http://twitter.com/juanformoso http://seniorgeek.com.ar LLAP --001a11c3675ee0b61404e6a7fa87 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable This shouldn't happen if you have swap active in the server=A0

On Wednesday, September 18, 2013, Franc Carter wrote:

A random guess - possibly an OOM (Out = of Memory) where Linux will kill a process to recover memory when it is des= perately low on memory. Have a look in either your syslog output of the out= put of dmesg

cheers


On Wed, Sep 18, 2013 at 10:21 PM, Hiller, Dean <Dean.Hiller@nrel.gov> wrote:
Anyone know how to debug cassandra processes= just exiting? =A0There is no info in the cassandra logs and there is no he= ap dump file(which in the past has shown up in /opt/cassandra/bin directory= for me).

This occurs when running a map/reduce job that put severe load on the syste= m. =A0The logs look completely fine. =A0I find it odd

=A01. =A0No logs of why it exited at all
=A02. =A0No heap dump which would imply there would be no logs as it crashe= d

Is there any other way a process can die and linux would log it somehow? = =A0(like running out of memory)

Thanks,
Dean



--

Franc Carter<= /b> |<= /span> Systems architect | Sirca Ltd

franc.carter@sirca.org.au=A0|=A0www.sirca.org= .au

Tel:= =A0+61 2 8355 2514

Level 4, 55 Harrington St, The Rocks NSW 2000

PO Box H58, Australia Square, Sydney NSW 1215<= /span>




--
Juan Manuel Formoso
Senior Geek
http://twitter.com/juanformoso
http://seniorgeek.com.ar
LLAP=
--001a11c3675ee0b61404e6a7fa87--