cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "cuser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-5986) Cassandra hangs while reading saved cache
Date Wed, 11 Sep 2013 07:04:51 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13764066#comment-13764066
] 

cuser commented on CASSANDRA-5986:
----------------------------------

After 13 hours of cache loading cassandra was failed with "java.lang.OutOfMemoryError: Java
heap space" error, but MAX_HEAP_SIZE is set to 25G. We can't increase heap size, it's already
much more than recommended.
In case of removing cache files cassandra starts successfuly, but that is NOT a solution.
Production cluster MUST start with warm key cache.

Any ideas? Workarounds?


                
> Cassandra hangs while reading saved cache
> -----------------------------------------
>
>                 Key: CASSANDRA-5986
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-5986
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>            Reporter: cuser
>             Fix For: 2.0
>
>
> We've got a cluster ~6Tb size running on 5 nodes with vnodes(256) enabled.
> After some cache heat-up one of the nodes was restarted and cassandra just hangs with
no error. Last message:
> cassandra.log:
> ...
>  INFO 11:12:27,649 Opening /cassandra/data/usertable/data/usertable-data-ja-1360 (6273771
bytes)
>  INFO 11:12:27,649 Opening /cassandra/data/usertable/data/usertable-data-ic-1339 (522628274110
bytes)
>  INFO 11:12:49,224 reading saved cache /cassandra/saved_caches/usertable-data-KeyCache-b.db
> system.log:
> ...
>  INFO [SSTableBatchOpen:6] 2013-09-09 11:12:27,649 SSTableReader.java (line 213) Opening
/cassandra/data/usertable/data/usertable-data-ja-1360 (6273771 bytes)
>  INFO [SSTableBatchOpen:7] 2013-09-09 11:12:27,649 SSTableReader.java (line 213) Opening
/cassandra/data/usertable/data/usertable-data-ic-1339 (522628274110 bytes)
>  INFO [CompactionExecutor:1] 2013-09-09 11:12:49,224 AutoSavingCache.java (line 142)
reading saved cache /cassandra/saved_caches/usertable-data-KeyCache-b.db
> usertable-data-KeyCache-b.db size is about 3.5G.
> All other nodes are restarting successfuly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message