cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ian Flatness (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CASSANDRA-6260) Cassandra 2.0.1 OutOfMemoryError: Requested array size exceeds VM limit
Date Tue, 29 Oct 2013 20:37:27 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-6260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13808113#comment-13808113
] 

Ian Flatness edited comment on CASSANDRA-6260 at 10/29/13 8:37 PM:
-------------------------------------------------------------------

I have gotten the same error with the nodes on my cluster.

The cluster is running 2.0.1, and the error started on 28.10.2013 for me as well.
My machines are each running with heaps of 512mb, and that was consistent with how they were
before the restart. On initialization system memory drops extremely low right before the error
output (after which java stops and the memory is freed). There are 4 machines in my cluster
and the partitioner is Murmur3.

-On 2 of the nodes, a different error is thrown- Upgrading to 2.0.2 fixed the other error.
The heap error is unchanged with the upgrade to 2.0.2




was (Author: iflatness):
I have gotten the same error with the nodes on my cluster.

The cluster is running 2.0.1, and the error started on 28.10.2013 for me as well.
My machines are each running with heaps of 512mb, and that was consistent with how they were
before the restart. On initialization system memory drops extremely low right before the error
output (after which java stops and the memory is freed). There are 4 machines in my cluster
and the partitioner is Murmur3.

On 2 of the nodes, a different error is thrown

{quote}
ERROR 08:46:08,205 Exception in thread Thread[MutationStage:16,5,main]
java.lang.IndexOutOfBoundsException: index (1) must be less than size (1)
	at com.google.common.base.Preconditions.checkElementIndex(Preconditions.java:306)
	at com.google.common.base.Preconditions.checkElementIndex(Preconditions.java:285)
	at com.google.common.collect.SingletonImmutableList.get(SingletonImmutableList.java:45)
	at org.apache.cassandra.db.marshal.CompositeType.getComparator(CompositeType.java:102)
	at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:80)
	at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:35)
	at edu.stanford.ppl.concurrent.SnapTreeMap$1.compareTo(SnapTreeMap.java:538)
	at edu.stanford.ppl.concurrent.SnapTreeMap.attemptUpdate(SnapTreeMap.java:1108)
	at edu.stanford.ppl.concurrent.SnapTreeMap.updateUnderRoot(SnapTreeMap.java:1059)
	at edu.stanford.ppl.concurrent.SnapTreeMap.update(SnapTreeMap.java:1023)
	at edu.stanford.ppl.concurrent.SnapTreeMap.putIfAbsent(SnapTreeMap.java:985)
	at org.apache.cassandra.db.AtomicSortedColumns$Holder.addColumn(AtomicSortedColumns.java:323)
	at org.apache.cassandra.db.AtomicSortedColumns.addAllWithSizeDelta(AtomicSortedColumns.java:195)
	at org.apache.cassandra.db.Memtable.resolve(Memtable.java:196)
	at org.apache.cassandra.db.Memtable.put(Memtable.java:160)
	at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:842)
	at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:373)
	at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:338)
	at org.apache.cassandra.db.commitlog.CommitLogReplayer$1.runMayThrow(CommitLogReplayer.java:265)
	at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
{quote}



> Cassandra 2.0.1 OutOfMemoryError:  Requested array size exceeds VM limit
> ------------------------------------------------------------------------
>
>                 Key: CASSANDRA-6260
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-6260
>             Project: Cassandra
>          Issue Type: Bug
>         Environment: Cassandra server 2.0.1
>            Reporter: Prateek
>            Priority: Critical
>
> I am running cassandra 2.0.1 server with cascading client https://github.com/ifesdjeen/cascading-cassandra/
(v 1.0.0-rc6). I am running a problem on restarting one of the nodes in the cassandra cluster.
All other nodes in the cluster started properly without any issues. I had originally assigned
8G of RAM to heap space. I tried starting the node with 12G of RAM but it still fails with
the following error. This is currently blocking a production release so appreciate your quick
response.
> [(bloomreach-ami) ubuntu@ip-10-179-26-169 :/mnt/cassandra_latest]# ERROR 20:55:58,738
Exception encountered during startup
> java.lang.OutOfMemoryError: Requested array size exceeds VM limit
>         at org.apache.cassandra.utils.ByteBufferUtil.read(ByteBufferUtil.java:394)
>         at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:355)
>         at org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:352)
>         at org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:119)
>         at org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:267)
>         at org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:411)
>         at org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:383)
>         at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:314)
>         at org.apache.cassandra.db.Keyspace.<init>(Keyspace.java:268)
>         at org.apache.cassandra.db.Keyspace.open(Keyspace.java:110)
>         at org.apache.cassandra.db.Keyspace.open(Keyspace.java:88)
>         at org.apache.cassandra.db.SystemKeyspace.checkHealth(SystemKeyspace.java:474)
>         at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:226)
>         at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:442)
>         at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:485)
>  INFO 20:55:58,739 Initializing system.schema_triggers
> java.lang.OutOfMemoryError: Requested array size exceeds VM limit
>         at org.apache.cassandra.utils.ByteBufferUtil.read(ByteBufferUtil.java:394)
>         at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:355)
>         at org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:352)
>         at org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:119)



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message