Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D1A5C4B4E for ; Mon, 11 Jul 2011 20:57:42 +0000 (UTC) Received: (qmail 15787 invoked by uid 500); 11 Jul 2011 20:57:40 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 15695 invoked by uid 500); 11 Jul 2011 20:57:39 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 15687 invoked by uid 99); 11 Jul 2011 20:57:39 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Jul 2011 20:57:39 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jeffpk@gmail.com designates 74.125.83.172 as permitted sender) Received: from [74.125.83.172] (HELO mail-pv0-f172.google.com) (74.125.83.172) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Jul 2011 20:57:33 +0000 Received: by pvh18 with SMTP id 18so4472865pvh.31 for ; Mon, 11 Jul 2011 13:57:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=xjRFLYF7vM4etjHCSeuUdMTsePZiDsL+ZzlR/ItcvNY=; b=jY9p+T0HdrkuJ6CTpOO7v6I07cr8Zy+pGz4M09q+dKMWB/dq79H6SKf8PlP9+IE0Up ZnWqECvClb2ivzV2mMB+5vBoj+BFiBwhwDC2Tk4Q6UiBoAhuRGdkpfGVIM4tsuYgqxLk AkpKm6269zk5pFOnZbBor3YsahvCwPrr0qBqw= MIME-Version: 1.0 Received: by 10.68.22.231 with SMTP id h7mr7250214pbf.25.1310417833037; Mon, 11 Jul 2011 13:57:13 -0700 (PDT) Received: by 10.68.48.9 with HTTP; Mon, 11 Jul 2011 13:57:11 -0700 (PDT) In-Reply-To: References: Date: Mon, 11 Jul 2011 16:57:11 -0400 Message-ID: Subject: Re: Out of memory error in cassandra From: Jeffrey Kesselman To: user@cassandra.apache.org Cc: anurag.gujral@gmail.com Content-Type: multipart/alternative; boundary=bcaec5216183720f2604a7d16de7 --bcaec5216183720f2604a7d16de7 Content-Type: text/plain; charset=ISO-8859-1 Are you on a 64 bit VM? A 32 bit vm will basically ignore any setting over 2GB On Mon, Jul 11, 2011 at 4:55 PM, Anurag Gujral wrote: > Hi All, > I am getting following error from cassandra: > ERROR [ReadStage:23] 2011-07-10 17:19:18,300 > DebuggableThreadPoolExecutor.java (line 103) Error in ThreadPoolExecutor > java.lang.OutOfMemoryError: Java heap space > at > org.apache.cassandra.utils.BloomFilterSerializer.deserialize(BloomFilterSerializer.java:49) > at > org.apache.cassandra.utils.BloomFilterSerializer.deserialize(BloomFilterSerializer.java:30) > at > org.apache.cassandra.io.sstable.IndexHelper.defreezeBloomFilter(IndexHelper.java:117) > at > org.apache.cassandra.io.sstable.IndexHelper.defreezeBloomFilter(IndexHelper.java:94) > at > org.apache.cassandra.db.columniterator.SSTableNamesIterator.read(SSTableNamesIterator.java:107) > at > org.apache.cassandra.db.columniterator.SSTableNamesIterator.(SSTableNamesIterator.java:72) > at > org.apache.cassandra.db.filter.NamesQueryFilter.getSSTableColumnIterator(NamesQueryFilter.java:59) > at > org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:80) > at > org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1311) > at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1203) > at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1131) > at org.apache.cassandra.db.Table.getRow(Table.java:333) > at > org.apache.cassandra.db.SliceByNamesReadCommand.getRow(SliceByNamesReadCommand.java:60) > at > org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:69) > at > org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:72) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > INFO [ScheduledTasks:1] 2011-07-10 17:19:18,306 StatusLogger.java (line > 66) RequestResponseStage 0 0 > ERROR [ReadStage:23] 2011-07-10 17:19:18,306 AbstractCassandraDaemon.java > (line 114) Fatal exception in thread Thread[ReadStage:23,5,main] > java.lang.OutOfMemoryError: Java heap space > at > org.apache.cassandra.utils.BloomFilterSerializer.deserialize(BloomFilterSerializer.java:49) > at > org.apache.cassandra.utils.BloomFilterSerializer.deserialize(BloomFilterSerializer.java:30) > at > org.apache.cassandra.io.sstable.IndexHelper.defreezeBloomFilter(IndexHelper.java:117) > at > org.apache.cassandra.io.sstable.IndexHelper.defreezeBloomFilter(IndexHelper.java:94) > at > org.apache.cassandra.db.columniterator.SSTableNamesIterator.read(SSTableNamesIterator.java:107) > at > org.apache.cassandra.db.columniterator.SSTableNamesIterator.(SSTableNamesIterator.java:72) > at > org.apache.cassandra.db.filter.NamesQueryFilter.getSSTableColumnIterator(NamesQueryFilter.java:59) > at > org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:80) > at > org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1311) > at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1203) > at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1131) > > > Can someone please help debug this? The maximum heap size is 28G . > > I am not sure why cassandra is giving Out of memory error here. > > Thanks > Anurag > -- It's always darkest just before you are eaten by a grue. --bcaec5216183720f2604a7d16de7 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Are you on a 64 bit VM? =A0A 32 bit vm=A0will=A0basically ignore any settin= g over 2GB

On Mon, Jul 11, 2011 at 4:55 P= M, Anurag Gujral <anurag.gujral@gmail.com> wrote:
Hi All,
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 I= am getting following error from cassandra:
ERROR [ReadStage:23] 2011-07= -10 17:19:18,300 DebuggableThreadPoolExecutor.java (line 103) Error in Thre= adPoolExecutor
java.lang.OutOfMemoryError: Java heap space
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.utils.BloomFilterSerializer.d= eserialize(BloomFilterSerializer.java:49)
=A0=A0=A0=A0=A0=A0=A0 at org.a= pache.cassandra.utils.BloomFilterSerializer.deserialize(BloomFilterSerializ= er.java:30)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.io.sstable.Ind= exHelper.defreezeBloomFilter(IndexHelper.java:117)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.io.sstable.IndexHelper.defree= zeBloomFilter(IndexHelper.java:94)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.c= assandra.db.columniterator.SSTableNamesIterator.read(SSTableNamesIterator.j= ava:107)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.columniterator= .SSTableNamesIterator.<init>(SSTableNamesIterator.java:72)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.filter.NamesQueryFilter.ge= tSSTableColumnIterator(NamesQueryFilter.java:59)
=A0=A0=A0=A0=A0=A0=A0 a= t org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(Query= Filter.java:80)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.ColumnF= amilyStore.getTopLevelColumns(ColumnFamilyStore.java:1311)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.ColumnFamilyStore.getColum= nFamily(ColumnFamilyStore.java:1203)
=A0=A0=A0=A0=A0=A0=A0 at org.apache= .cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1131= )
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.Table.getRow(Table.ja= va:333)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.SliceByNamesReadCommand.ge= tRow(SliceByNamesReadCommand.java:60)
=A0=A0=A0=A0=A0=A0=A0 at org.apach= e.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:69)
=A0=A0=A0= =A0=A0=A0=A0 at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDel= iveryTask.java:72)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.ThreadPoolExecutor.runWorker(= ThreadPoolExecutor.java:1110)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurr= ent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
=A0=A0=A0= =A0=A0=A0=A0 at java.lang.Thread.run(Thread.java:636)
=A0INFO [ScheduledTasks:1] 2011-07-10 17:19:18,306 StatusLogger.java (line = 66) RequestResponseStage=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0=A0=A0=A0= =A0=A0=A0=A0=A0 0
ERROR [ReadStage:23] 2011-07-10 17:19:18,306 AbstractC= assandraDaemon.java (line 114) Fatal exception in thread Thread[ReadStage:2= 3,5,main]
java.lang.OutOfMemoryError: Java heap space
=A0=A0=A0=A0=A0=A0=A0 at org= .apache.cassandra.utils.BloomFilterSerializer.deserialize(BloomFilterSerial= izer.java:49)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.utils.BloomF= ilterSerializer.deserialize(BloomFilterSerializer.java:30)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.io.sstable.IndexHelper.defree= zeBloomFilter(IndexHelper.java:117)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.= cassandra.io.sstable.IndexHelper.defreezeBloomFilter(IndexHelper.java:94)=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.columniterator.SSTableNa= mesIterator.read(SSTableNamesIterator.java:107)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.columniterator.SSTableName= sIterator.<init>(SSTableNamesIterator.java:72)
=A0=A0=A0=A0=A0=A0= =A0 at org.apache.cassandra.db.filter.NamesQueryFilter.getSSTableColumnIter= ator(NamesQueryFilter.java:59)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.filter.QueryFilter.getSSTa= bleColumnIterator(QueryFilter.java:80)
=A0=A0=A0=A0=A0=A0=A0 at org.apac= he.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java= :1311)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.ColumnFamilyStor= e.getColumnFamily(ColumnFamilyStore.java:1203)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.ColumnFamilyStore.getColum= nFamily(ColumnFamilyStore.java:1131)


Can someone please help deb= ug this? The maximum heap size is 28G .

I am not sure why cassandra = is giving Out of memory error here.

Thanks
Anurag



--
It's always = darkest just before you are eaten by a grue.
--bcaec5216183720f2604a7d16de7--