Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of mohitanchlia@gmail.com
 designates 209.85.160.43 as permitted sender)
References: <l55o2d$3cb$1@ger.gmane.org>
Mime-Version: 1.0 (1.0)
In-Reply-To: <l55o2d$3cb$1@ger.gmane.org>
Content-Type: text/plain;
	charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Message-Id: <CEDA005B-5D35-4DA2-A027-3EF4956088C4@gmail.com>
Cc: "user@cassandra.apache.org" <user@cassandra.apache.org>
From: Mohit Anchlia <mohitanchlia@gmail.com>
Subject: Re: Cass 1.1.11 out of memory during compaction ?
Date: Sun, 3 Nov 2013 13:19:00 -0800
To: "user@cassandra.apache.org" <user@cassandra.apache.org>

Post your gc logs

Sent from my iPhone

On Nov 3, 2013, at 6:54 AM, Oleg Dulin  <oleg.dulin@gmail.com> wrote:

> Cass 1.1.11 ran out of memory on me with this exception (see below).
>=20
> My parameters are 8gig heap, new gen is 1200M.
>=20
> ERROR [ReadStage:55887] 2013-11-02 23:35:18,419 AbstractCassandraDaemon.ja=
va (line 132) Exception in thread Thread[ReadStage:55887,5,main]
> java.lang.OutOfMemoryError: Java heap space
>       at org.apache.cassandra.io.util.RandomAccessReader.readBytes(RandomA=
ccessReader.java:323)=20
>       at org.apache.cassandra.utils.ByteBufferUtil.read(ByteBufferUtil.jav=
a:398)
>       at org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(Byt=
eBufferUtil.java:380)=20
>       at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerial=
izer.java:88)=20
>       at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerial=
izer.java:83)=20
>       at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerial=
izer.java:73)=20
>       at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerial=
izer.java:37)=20
>       at org.apache.cassandra.db.columniterator.IndexedSliceReader$Indexed=
BlockFetcher.getNextBlock(IndexedSliceReader.java:179)=20
>       at org.apache.cassandra.db.columniterator.IndexedSliceReader.compute=
Next(IndexedSliceReader.java:121)=20
>       at org.apache.cassandra.db.columniterator.IndexedSliceReader.compute=
Next(IndexedSliceReader.java:48)=20
>       at com.google.common.collect.AbstractIterator.tryToComputeNext(Abstr=
actIterator.java:140)=20
>       at com.google.common.collect.AbstractIterator.hasNext(AbstractIterat=
or.java:135)=20
>       at org.apache.cassandra.db.columniterator.SSTableSliceIterator.hasNe=
xt(SSTableSliceIterator.java:116)=20
>       at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeI=
terator.java:147)=20
>       at org.apache.cassandra.utils.MergeIterator$ManyToOne.advance(MergeI=
terator.java:126)=20
>       at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(Me=
rgeIterator.java:100)=20
>       at com.google.common.collect.AbstractIterator.tryToComputeNext(Abstr=
actIterator.java:140)=20
>       at com.google.common.collect.AbstractIterator.hasNext(AbstractIterat=
or.java:135)=20
>       at org.apache.cassandra.db.filter.SliceQueryFilter.collectReducedCol=
umns(SliceQueryFilter.java:117)=20
>       at org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFi=
lter.java:140)=20
>       at org.apache.cassandra.db.CollationController.collectAllData(Collat=
ionController.java:292)=20
>       at org.apache.cassandra.db.CollationController.getTopLevelColumns(Co=
llationController.java:64)=20
>       at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(Colu=
mnFamilyStore.java:1362)=20
>       at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFa=
milyStore.java:1224)=20
>       at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFa=
milyStore.java:1159)=20
>       at org.apache.cassandra.db.Table.getRow(Table.java:378)
>       at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromRead=
Command.java:69)=20
>       at org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.ja=
va:51)
>       at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryT=
ask.java:59)=20
>       at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecu=
tor.java:1145)=20
>       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExec=
utor.java:615)=20
>       at java.lang.Thread.run(Thread.java:722)
>=20
>=20
> Any thoughts ?
>=20
> This is a dual data center set up, with 4 nodes in each DC and RF=3D2 in e=
ach.
>=20
>=20
> --=20
> Regards,
> Oleg Dulin
> http://www.olegdulin.com
>=20
>=20