incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aaron morton <aa...@thelastpickle.com>
Subject Re: Cassandra 1.1.1 Fails to Start
Date Thu, 07 Jun 2012 09:52:54 GMT
How much data do you have on the node ? 
Was this a previously running system that was upgraded ? 

> with disk_access_mode mmap_index_only and mmap I see OOM map failed error on SSTableBatchOpen
thread
Do you have the stack trace from the log ?

> ERROR [CompactionExecutor:6] 2012-06-06 20:24:19,772 AbstractCassandraDaemon.java (line
134) Exception in thread Thread[CompactionExecutor:6,1,main]
> java.lang.StackOverflowError
>         at com.google.common.collect.Sets$1.iterator(Sets.java:578)
>         at com.google.common.collect.Sets$1.iterator(Sets.java:578)
>         at com.google.common.collect.Sets$1.iterator(Sets.java:578)
Was there more to this stack trace ? 
What were the log messages before this error ? 


>  INFO [main] 2012-06-06 20:17:10,267 AbstractCassandraDaemon.java (line 122) Heap size:
1525415936/1525415936
The JVM only has 1.5 G of ram, this is at the lower limit. If you have some data to load I
would not be surprised if it failed to start. 

Cheers

-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com

On 7/06/2012, at 8:41 AM, Javier Sotelo wrote:

> Hi All,
> 
> On SuSe Linux blade with 6GB of RAM.
> 
> with disk_access_mode mmap_index_only and mmap I see OOM map failed error on SSTableBatchOpen
thread. cat /proc/<pid>/maps shows a peak of 53521 right before it dies. vm.max_map_count
= 1966080 and /proc/<pid>/limits shows unlimited locked memory.
> 
> with disk_access_mode standard, the node does start up but I see the repeated error:
> ERROR [CompactionExecutor:6] 2012-06-06 20:24:19,772 AbstractCassandraDaemon.java (line
134) Exception in thread Thread[CompactionExecutor:6,1,main]
> java.lang.StackOverflowError
>         at com.google.common.collect.Sets$1.iterator(Sets.java:578)
>         at com.google.common.collect.Sets$1.iterator(Sets.java:578)
>         at com.google.common.collect.Sets$1.iterator(Sets.java:578)
> ...
> 
> I'm not sure the second error is related to the first. I prefer to run with full mmap
but I have run out of ideas. Is there anything else I can do to debug this?
> 
> Here's startup settings from debug log:
>  INFO [main] 2012-06-06 20:17:10,267 AbstractCassandraDaemon.java (line 121) JVM vendor/version:
Java HotSpot(TM) 64-Bit Server VM/1.6.0_31
>  INFO [main] 2012-06-06 20:17:10,267 AbstractCassandraDaemon.java (line 122) Heap size:
1525415936/1525415936
>  ...
>  INFO [main] 2012-06-06 20:17:10,946 CLibrary.java (line 111) JNA mlockall successful
>  ...
>  INFO [main] 2012-06-06 20:17:11,055 DatabaseDescriptor.java (line 191) DiskAccessMode
is standard, indexAccessMode is standard
>  INFO [main] 2012-06-06 20:17:11,213 DatabaseDescriptor.java (line 247) Global memtable
threshold is enabled at 484MB
>  INFO [main] 2012-06-06 20:17:11,499 CacheService.java (line 96) Initializing key cache
with capacity of 72 MBs.
>  INFO [main] 2012-06-06 20:17:11,509 CacheService.java (line 107) Scheduling key cache
save to each 14400 seconds (going to save all keys).
>  INFO [main] 2012-06-06 20:17:11,510 CacheService.java (line 121) Initializing row cache
with capacity of 0 MBs and provider org.apache.cassandra.cache.SerializingCacheProvider
>  INFO [main] 2012-06-06 20:17:11,513 CacheService.java (line 133) Scheduling row cache
save to each 0 seconds (going to save all keys).
> 
> Thanks In Advance,
> Javier


Mime
View raw message