cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aleksey Yeschenko (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CASSANDRA-8285) OOME in Cassandra 2.0.11
Date Mon, 15 Dec 2014 18:42:14 GMT

     [ https://issues.apache.org/jira/browse/CASSANDRA-8285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Aleksey Yeschenko updated CASSANDRA-8285:
-----------------------------------------
    Reviewer: Sam Tunnicliffe

> OOME in Cassandra 2.0.11
> ------------------------
>
>                 Key: CASSANDRA-8285
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-8285
>             Project: Cassandra
>          Issue Type: Bug
>         Environment: Cassandra 2.0.11 + java-driver 2.0.8-SNAPSHOT
> Cassandra 2.0.11 + ruby-driver 1.0-beta
>            Reporter: Pierre Laporte
>            Assignee: Aleksey Yeschenko
>             Fix For: 2.0.12
>
>         Attachments: 8285-v2.txt, 8285.txt, OOME_node_system.log, gc-1416849312.log.gz,
gc.log.gz, heap-usage-after-gc-zoom.png, heap-usage-after-gc.png, system.log.gz
>
>
> We ran drivers 3-days endurance tests against Cassandra 2.0.11 and C* crashed with an
OOME.  This happened both with ruby-driver 1.0-beta and java-driver 2.0.8-snapshot.
> Attached are :
> | OOME_node_system.log | The system.log of one Cassandra node that crashed |
> | gc.log.gz | The GC log on the same node |
> | heap-usage-after-gc.png | The heap occupancy evolution after every GC cycle |
> | heap-usage-after-gc-zoom.png | A focus on when things start to go wrong |
> Workload :
> Our test executes 5 CQL statements (select, insert, select, delete, select) for a given
unique id, during 3 days, using multiple threads.  There is not change in the workload during
the test.
> Symptoms :
> In the attached log, it seems something starts in Cassandra between 2014-11-06 10:29:22
and 2014-11-06 10:45:32.  This causes an allocation that fills the heap.  We eventually get
stuck in a Full GC storm and get an OOME in the logs.
> I have run the java-driver tests against Cassandra 1.2.19 and 2.1.1.  The error does
not occur.  It seems specific to 2.0.11.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message