cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bill Au <>
Subject Cassandra crashed - possible JMX threads leak
Date Wed, 20 Oct 2010 20:09:42 GMT
One of my Cassandra server crashed with the following:

ERROR [] 2010-10-19 00:25:10,419 (line 82) Uncaught exception in thread
java.lang.OutOfMemoryError: unable to create new native thread
        at java.lang.Thread.start0(Native Method)
        at java.lang.Thread.start(

I took threads dump in the JVM on all the other Cassandra severs in my
cluster.  They all have thousand of threads looking like this:

"JMX server connection timeout 183373" daemon prio=10 tid=0x00002aad230db800
nid=0x5cf6 in Object.wait() [0x00002aad7a316000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - locked <0x00002aab056ccee0> (a [I)

It seems to me that there is a JMX threads leak in Cassandra.  NodeProbe
creates a JMXConnector but never calls its close() method.  I tried setting
jmx.remote.x.server.connection.timeout to 0 hoping that would disable the
JMX server connection timeout threads.  But that did not make any

Has anyone else seen this?


View raw message