incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark <static.void....@gmail.com>
Subject Re: OOM exceptions
Date Fri, 04 Mar 2011 20:43:34 GMT
We have 7 column families and we are not using the default key cache 
(200000).

These were our initial settings so it was not in response to anything. 
Would you recommend anything else? Thanks


On 3/4/11 12:34 PM, Chris Burroughs wrote:
> - Are you using a key cache?  How many keys do you have?  Across how
> many column families
>
> You configuration is unusual both in terms of not setting min heap ==
> max heap and the percentage of available RAM used for the heap.  Did you
> change the heap size in response to errors or for another reason?
>
> On 03/04/2011 03:25 PM, Mark wrote:
>> This happens during compaction and we are not using the RowsCached
>> attribute.
>>
>> Our initial/max heap are 2 and 6 respectively and we have 8 gigs in
>> these machines.
>>
>> Thanks
>>
>> On 3/4/11 12:05 PM, Chris Burroughs wrote:
>>> - Does this occur only during compaction or at seemingly random times?
>>> - How large is your heap?  What jvm settings are you using? How much
>>> physical RAM do you have?
>>> - Do you have the row and/or key cache enabled?  How are they
>>> configured?  How large are they when the OOM is thrown?
>>>
>>> On 03/04/2011 02:38 PM, Mark Miller wrote:
>>>> Other than adding more memory to the machine is there a way to solve
>>>> this? Please help. Thanks
>>>>
>>>> ERROR [COMPACTION-POOL:1] 2011-03-04 11:11:44,891 CassandraDaemon.java
>>>> (line org.apache.cassandra.thrift.CassandraDaemon$1) Uncaught exception
>>>> in thread Thread[COMPACTION-POOL:1,5,main]
>>>> java.lang.OutOfMemoryError: Java heap space
>>>>       at java.util.Arrays.copyOf(Arrays.java:2798)
>>>>       at
>>>> java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:111)
>>>>       at java.io.DataOutputStream.write(DataOutputStream.java:107)
>>>>       at java.io.FilterOutputStream.write(FilterOutputStream.java:97)
>>>>       at
>>>> org.apache.cassandra.utils.FBUtilities.writeByteArray(FBUtilities.java:298)
>>>>
>>>>       at
>>>> org.apache.cassandra.db.ColumnSerializer.serialize(ColumnSerializer.java:66)
>>>>
>>>>
>>>>       at
>>>> org.apache.cassandra.db.SuperColumnSerializer.serialize(SuperColumn.java:311)
>>>>
>>>>
>>>>       at
>>>> org.apache.cassandra.db.SuperColumnSerializer.serialize(SuperColumn.java:284)
>>>>
>>>>
>>>>       at
>>>> org.apache.cassandra.db.ColumnFamilySerializer.serializeForSSTable(ColumnFamilySerializer.java:87)
>>>>
>>>>
>>>>       at
>>>> org.apache.cassandra.db.ColumnFamilySerializer.serializeWithIndexes(ColumnFamilySerializer.java:99)
>>>>
>>>>
>>>>       at
>>>> org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:140)
>>>>
>>>>
>>>>       at
>>>> org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:43)
>>>>
>>>>
>>>>       at
>>>> org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:73)
>>>>
>>>>
>>>>       at
>>>> com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:135)
>>>>
>>>>
>>>>       at
>>>> com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:130)
>>>>
>>>>
>>>>       at
>>>> org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183)
>>>>
>>>>
>>>>       at
>>>> org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94)
>>>>
>>>>
>>>>       at
>>>> org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:294)
>>>>
>>>>
>>>>       at
>>>> org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:101)
>>>>
>>>>
>>>>       at
>>>> org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:82)
>>>>
>>>>       at
>>>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>>>>       at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>>>       at
>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>>>>
>>>>
>>>>       at
>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>>>>
>>>>
>>>>       at java.lang.Thread.run(Thread.java:636)
>>>>

Mime
View raw message