cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ruoran Wang (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CASSANDRA-9625) GraphiteReporter not reporting
Date Tue, 15 Mar 2016 22:01:34 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194091#comment-15194091 ] 

Ruoran Wang edited comment on CASSANDRA-9625 at 3/15/16 10:01 PM:
------------------------------------------------------------------

Here are the thread-dump result. First one is when the reporter is still working, the second one is when reporter is stopped. The cfs is blocked during compaction, where the graphite-reporter thread can't access the same cfs to fetch PendingCompection count.

{noformat}
"metrics-graphite-reporter-thread-1" #574 daemon prio=5 os_prio=0 tid=0x00007fae39b21800 nid=0x4940 waiting on condition [0x00007fa571910000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00007fa67d7972d0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
{noformat}


{noformat}
2016-03-14 20:29:05
Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.66-b17 mixed mode):

"Attach Listener" #92037 daemon prio=9 os_prio=0 tid=0x00007fd3ae3aa000 nid=0x2ca5 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"MemtablePostFlush:2423" #92036 daemon prio=5 os_prio=0 tid=0x00007fd362509000 nid=0x2c1e waiting on condition [0x00007fd6d0fab000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c126e58> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"ReadRepairStage:3467" #92033 daemon prio=5 os_prio=0 tid=0x00007fd348875000 nid=0x2b4a waiting on condition [0x00007fd6d0ea7000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c10caa0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"RMI TCP Connection(idle)" #91875 daemon prio=5 os_prio=0 tid=0x0000000007a20000 nid=0x5c5b waiting on condition [0x00007fd6d102d000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c213790> (a java.util.concurrent.SynchronousQueue$TransferStack)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"RMI TCP Connection(51618)-127.0.0.1" #91601 daemon prio=5 os_prio=0 tid=0x0000000004a17000 nid=0x63ce runnable [0x00007fd6d1a13000]
   java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
- locked <0x00007fda5c74f0e0> (a java.io.BufferedInputStream)
at java.io.FilterInputStream.read(FilterInputStream.java:83)
at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:550)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$95(TCPTransport.java:683)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$1/36280281.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"JMX server connection timeout 91344" #91344 daemon prio=5 os_prio=0 tid=0x00007fd36b06d800 nid=0x7897 in Object.wait() [0x00007fd46b951000]
   java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:150)
- locked <0x00007fd7ab54b7b0> (a [I)
at java.lang.Thread.run(Thread.java:745)

"RMI TCP Connection(50370)-127.0.0.1" #91343 daemon prio=5 os_prio=0 tid=0x0000000007c3d800 nid=0x7896 waiting for monitor entry [0x00007fd681c3e000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getSSTableCountPerLevel(WrappingCompactionStrategy.java:207)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.ColumnFamilyStore.getSSTableCountPerLevel(ColumnFamilyStore.java:2960)
at sun.reflect.GeneratedMethodAccessor78.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:71)
at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:275)
at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:112)
at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:46)
at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:237)
at com.sun.jmx.mbeanserver.PerInterface.getAttribute(PerInterface.java:83)
at com.sun.jmx.mbeanserver.MBeanSupport.getAttribute(MBeanSupport.java:206)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getAttribute(DefaultMBeanServerInterceptor.java:647)
at com.sun.jmx.mbeanserver.JmxMBeanServer.getAttribute(JmxMBeanServer.java:678)
at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1448)
at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:76)
at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1312)
at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1404)
at javax.management.remote.rmi.RMIConnectionImpl.getAttribute(RMIConnectionImpl.java:641)
at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:323)
at sun.rmi.transport.Transport$1.run(Transport.java:200)
at sun.rmi.transport.Transport$1.run(Transport.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.Transport.serviceCall(Transport.java:196)
at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:568)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$95(TCPTransport.java:683)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$1/36280281.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"JMX server connection timeout 91319" #91319 daemon prio=5 os_prio=0 tid=0x00007fd4bdf87800 nid=0x69ed in Object.wait() [0x00007fd68157d000]
   java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:150)
- locked <0x00007fd7a92c8cb8> (a [I)
at java.lang.Thread.run(Thread.java:745)

"ValidationExecutor:60" #91300 daemon prio=1 os_prio=4 tid=0x00007fd368a81000 nid=0x67dc waiting for monitor entry [0x00007fd550799000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getScanners(WrappingCompactionStrategy.java:399)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.compaction.CompactionManager.doValidationCompaction(CompactionManager.java:1037)
at org.apache.cassandra.db.compaction.CompactionManager.access$600(CompactionManager.java:89)
at org.apache.cassandra.db.compaction.CompactionManager$9.call(CompactionManager.java:662)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"CompactionExecutor:9418" #91232 daemon prio=1 os_prio=4 tid=0x00007fdf4e5d4800 nid=0x4ecd waiting for monitor entry [0x00007fd68cfde000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getNextBackgroundTask(WrappingCompactionStrategy.java:72)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:257)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"CompactionExecutor:9416" #91206 daemon prio=1 os_prio=4 tid=0x00007fd3b359a800 nid=0x45af waiting for monitor entry [0x00007fd637e10000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getNextBackgroundTask(WrappingCompactionStrategy.java:72)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:257)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"CompactionExecutor:9415" #91205 daemon prio=1 os_prio=4 tid=0x00007fd3b415d000 nid=0x45ae waiting for monitor entry [0x00007fd6d1500000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getNextBackgroundTask(WrappingCompactionStrategy.java:72)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:257)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"CompactionExecutor:9414" #91204 daemon prio=1 os_prio=4 tid=0x00007fd394f1d800 nid=0x45ad waiting for monitor entry [0x00007fd6d1686000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getNextBackgroundTask(WrappingCompactionStrategy.java:72)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:257)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"CompactionExecutor:9413" #91203 daemon prio=1 os_prio=4 tid=0x00007fdf4ea42000 nid=0x45ac waiting for monitor entry [0x00007fd46b992000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getNextBackgroundTask(WrappingCompactionStrategy.java:72)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:257)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"CompactionExecutor:9412" #91186 daemon prio=1 os_prio=4 tid=0x00007fdf4ed3d000 nid=0x3e7b waiting for monitor entry [0x00007fd6cf4f2000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getNextBackgroundTask(WrappingCompactionStrategy.java:72)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:257)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"CompactionExecutor:9405" #91174 daemon prio=1 os_prio=4 tid=0x00007fd3b24e3000 nid=0x3cab runnable [0x00007fd6d188e000]
   java.lang.Thread.State: RUNNABLE
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getMaxSSTableBytes(WrappingCompactionStrategy.java:169)
- locked <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.compaction.LeveledManifest.getCompactionCandidates(LeveledManifest.java:349)
- locked <0x00007fd72e7bd458> (a org.apache.cassandra.db.compaction.LeveledManifest)
at org.apache.cassandra.db.compaction.LeveledCompactionStrategy.getMaximalTask(LeveledCompactionStrategy.java:101)
at org.apache.cassandra.db.compaction.LeveledCompactionStrategy.getNextBackgroundTask(LeveledCompactionStrategy.java:90)
- locked <0x00007fd72e7bd418> (a org.apache.cassandra.db.compaction.LeveledCompactionStrategy)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getNextBackgroundTask(WrappingCompactionStrategy.java:84)
- locked <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:257)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"CompactionExecutor:9381" #91070 daemon prio=1 os_prio=4 tid=0x00007fdf2ee7a000 nid=0x174c waiting for monitor entry [0x00007fd6935bb000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getNextBackgroundTask(WrappingCompactionStrategy.java:72)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:257)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"MessagingService-Incoming-/10.57.198.15" #91026 prio=5 os_prio=0 tid=0x00007fdf2ef58800 nid=0x81b runnable [0x00007fd693d3f000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
- locked <0x00007fd78f9fc440> (a java.lang.Object)
at sun.nio.ch.SocketAdaptor$SocketInputStream.read(SocketAdaptor.java:192)
- locked <0x00007fd78f9fc500> (a java.lang.Object)
at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:103)
- locked <0x00007fd78f9fc558> (a sun.nio.ch.SocketAdaptor$SocketInputStream)
at net.jpountz.lz4.LZ4BlockInputStream.readFully(LZ4BlockInputStream.java:215)
at net.jpountz.lz4.LZ4BlockInputStream.refill(LZ4BlockInputStream.java:149)
at net.jpountz.lz4.LZ4BlockInputStream.read(LZ4BlockInputStream.java:101)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:171)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:88)

"RMI TCP Connection(50648)-127.0.0.1" #87542 daemon prio=5 os_prio=0 tid=0x000000000326b800 nid=0xd9b waiting for monitor entry [0x00007fd637b7a000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getSSTableCountPerLevel(WrappingCompactionStrategy.java:207)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.ColumnFamilyStore.getSSTableCountPerLevel(ColumnFamilyStore.java:2960)
at sun.reflect.GeneratedMethodAccessor78.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:71)
at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:275)
at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:112)
at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:46)
at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:237)
at com.sun.jmx.mbeanserver.PerInterface.getAttribute(PerInterface.java:83)
at com.sun.jmx.mbeanserver.MBeanSupport.getAttribute(MBeanSupport.java:206)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getAttribute(DefaultMBeanServerInterceptor.java:647)
at com.sun.jmx.mbeanserver.JmxMBeanServer.getAttribute(JmxMBeanServer.java:678)
at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1448)
at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:76)
at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1312)
at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1404)
at javax.management.remote.rmi.RMIConnectionImpl.getAttribute(RMIConnectionImpl.java:641)
at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:323)
at sun.rmi.transport.Transport$1.run(Transport.java:200)
at sun.rmi.transport.Transport$1.run(Transport.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.Transport.serviceCall(Transport.java:196)
at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:568)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$95(TCPTransport.java:683)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$1/36280281.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"RMI TCP Connection(50332)-127.0.0.1" #87541 daemon prio=5 os_prio=0 tid=0x00007fdf4fe0a000 nid=0xd97 waiting for monitor entry [0x00007fd681987000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getSSTableCountPerLevel(WrappingCompactionStrategy.java:207)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.db.ColumnFamilyStore.getSSTableCountPerLevel(ColumnFamilyStore.java:2960)
at sun.reflect.GeneratedMethodAccessor78.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:71)
at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:275)
at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:112)
at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:46)
at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:237)
at com.sun.jmx.mbeanserver.PerInterface.getAttribute(PerInterface.java:83)
at com.sun.jmx.mbeanserver.MBeanSupport.getAttribute(MBeanSupport.java:206)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getAttribute(DefaultMBeanServerInterceptor.java:647)
at com.sun.jmx.mbeanserver.JmxMBeanServer.getAttribute(JmxMBeanServer.java:678)
at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1448)
at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:76)
at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1312)
at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1404)
at javax.management.remote.rmi.RMIConnectionImpl.getAttribute(RMIConnectionImpl.java:641)
at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:323)
at sun.rmi.transport.Transport$1.run(Transport.java:200)
at sun.rmi.transport.Transport$1.run(Transport.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.Transport.serviceCall(Transport.java:196)
at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:568)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$95(TCPTransport.java:683)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$1/36280281.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"MessagingService-Incoming-/10.125.218.156" #64762 prio=5 os_prio=0 tid=0x00007fdf2d0ac800 nid=0x3572 runnable [0x00007fd6d19d3000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
- locked <0x00007fd8e85d3ba8> (a java.lang.Object)
at sun.nio.ch.SocketAdaptor$SocketInputStream.read(SocketAdaptor.java:192)
- locked <0x00007fd8e85d3c68> (a java.lang.Object)
at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:103)
- locked <0x00007fd8e85d3cc0> (a sun.nio.ch.SocketAdaptor$SocketInputStream)
at net.jpountz.lz4.LZ4BlockInputStream.readFully(LZ4BlockInputStream.java:215)
at net.jpountz.lz4.LZ4BlockInputStream.refill(LZ4BlockInputStream.java:149)
at net.jpountz.lz4.LZ4BlockInputStream.read(LZ4BlockInputStream.java:101)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:171)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:88)

"MessagingService-Incoming-/10.125.218.102" #64748 prio=5 os_prio=0 tid=0x00007fd349d21000 nid=0x3215 runnable [0x00007fd6cf7bd000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
- locked <0x00007fd8e7542a50> (a java.lang.Object)
at sun.nio.ch.SocketAdaptor$SocketInputStream.read(SocketAdaptor.java:192)
- locked <0x00007fd8e7542b10> (a java.lang.Object)
at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:103)
- locked <0x00007fd8e7542b68> (a sun.nio.ch.SocketAdaptor$SocketInputStream)
at net.jpountz.lz4.LZ4BlockInputStream.readFully(LZ4BlockInputStream.java:215)
at net.jpountz.lz4.LZ4BlockInputStream.refill(LZ4BlockInputStream.java:149)
at net.jpountz.lz4.LZ4BlockInputStream.read(LZ4BlockInputStream.java:101)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:171)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:88)

"MessagingService-Incoming-/10.57.198.67" #64735 prio=5 os_prio=0 tid=0x00007fd34a940800 nid=0x2ea4 runnable [0x00007fd6d0ceb000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
- locked <0x00007fd8e618d970> (a java.lang.Object)
at sun.nio.ch.SocketAdaptor$SocketInputStream.read(SocketAdaptor.java:192)
- locked <0x00007fd8e618da30> (a java.lang.Object)
at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:103)
- locked <0x00007fd8e618da88> (a sun.nio.ch.SocketAdaptor$SocketInputStream)
at net.jpountz.lz4.LZ4BlockInputStream.readFully(LZ4BlockInputStream.java:215)
at net.jpountz.lz4.LZ4BlockInputStream.refill(LZ4BlockInputStream.java:149)
at net.jpountz.lz4.LZ4BlockInputStream.read(LZ4BlockInputStream.java:101)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:171)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:88)

"MessagingService-Incoming-/10.57.198.217" #64721 prio=5 os_prio=0 tid=0x00007fd4bce1a000 nid=0x2952 runnable [0x00007fd5508b5000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
- locked <0x00007fd8e40dac00> (a java.lang.Object)
at sun.nio.ch.SocketAdaptor$SocketInputStream.read(SocketAdaptor.java:192)
- locked <0x00007fd8e40dacc0> (a java.lang.Object)
at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:103)
- locked <0x00007fd8e40dad18> (a sun.nio.ch.SocketAdaptor$SocketInputStream)
at net.jpountz.lz4.LZ4BlockInputStream.readFully(LZ4BlockInputStream.java:215)
at net.jpountz.lz4.LZ4BlockInputStream.refill(LZ4BlockInputStream.java:149)
at net.jpountz.lz4.LZ4BlockInputStream.read(LZ4BlockInputStream.java:101)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:171)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:88)

"MessagingService-Incoming-/10.57.198.15" #64709 prio=5 os_prio=0 tid=0x00007fdf2c793000 nid=0x25bd runnable [0x00007fd686927000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
- locked <0x00007fd8e2d29f80> (a java.lang.Object)
at sun.nio.ch.SocketAdaptor$SocketInputStream.read(SocketAdaptor.java:192)
- locked <0x00007fd8e2d2a040> (a java.lang.Object)
at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:103)
- locked <0x00007fd8e2d2a098> (a sun.nio.ch.SocketAdaptor$SocketInputStream)
at net.jpountz.lz4.LZ4BlockInputStream.readFully(LZ4BlockInputStream.java:215)
at net.jpountz.lz4.LZ4BlockInputStream.refill(LZ4BlockInputStream.java:149)
at net.jpountz.lz4.LZ4BlockInputStream.read(LZ4BlockInputStream.java:101)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:171)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:88)

"MessagingService-Incoming-/10.125.218.83" #27063 prio=5 os_prio=0 tid=0x00007fdf2d034000 nid=0xf6a runnable [0x00007fd6300a7000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
- locked <0x00007fd7323e1ac8> (a java.lang.Object)
at sun.nio.ch.SocketAdaptor$SocketInputStream.read(SocketAdaptor.java:192)
- locked <0x00007fd7323e1b88> (a java.lang.Object)
at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:103)
- locked <0x00007fd7323e1be0> (a sun.nio.ch.SocketAdaptor$SocketInputStream)
at net.jpountz.lz4.LZ4BlockInputStream.readFully(LZ4BlockInputStream.java:215)
at net.jpountz.lz4.LZ4BlockInputStream.refill(LZ4BlockInputStream.java:149)
at net.jpountz.lz4.LZ4BlockInputStream.read(LZ4BlockInputStream.java:101)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:171)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:88)

"MessagingService-Incoming-/10.125.218.83" #27061 prio=5 os_prio=0 tid=0x00007fdf2d2db800 nid=0xf68 runnable [0x00007fd6d10af000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
- locked <0x00007fd736b34198> (a java.lang.Object)
at sun.nio.ch.SocketAdaptor$SocketInputStream.read(SocketAdaptor.java:192)
- locked <0x00007fd736b34258> (a java.lang.Object)
at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:103)
- locked <0x00007fd736b342b0> (a sun.nio.ch.SocketAdaptor$SocketInputStream)
at net.jpountz.lz4.LZ4BlockInputStream.readFully(LZ4BlockInputStream.java:215)
at net.jpountz.lz4.LZ4BlockInputStream.refill(LZ4BlockInputStream.java:149)
at net.jpountz.lz4.LZ4BlockInputStream.read(LZ4BlockInputStream.java:101)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
at org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:171)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:88)

"MessagingService-Outgoing-/10.125.218.83" #27059 daemon prio=5 os_prio=0 tid=0x00007fdf2d200800 nid=0xf66 waiting on condition [0x00007fd6d12f8000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd7322984f0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
at org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)

"MessagingService-Outgoing-/10.125.218.83" #27056 daemon prio=5 os_prio=0 tid=0x00007fdf2d017800 nid=0xf65 waiting on condition [0x00007fd62ec23000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd7323e1e80> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
at org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)

"StreamConnectionEstablisher:24" #2514 daemon prio=5 os_prio=0 tid=0x00007fdf2cca7000 nid=0x62d5 waiting on condition [0x00007fd6d0af1000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:23" #2506 daemon prio=5 os_prio=0 tid=0x00007fdf2cca5800 nid=0x62cd waiting on condition [0x00007fd550833000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:22" #2445 daemon prio=5 os_prio=0 tid=0x00007fdf2cd66800 nid=0x628f waiting on condition [0x00007fd6d342e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:21" #2440 daemon prio=5 os_prio=0 tid=0x00007fdf2c4d5800 nid=0x628a waiting on condition [0x00007fd550874000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:20" #2417 daemon prio=5 os_prio=0 tid=0x00007fdf2cd65000 nid=0x6272 waiting on condition [0x00007fd6d0a67000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:19" #2407 daemon prio=5 os_prio=0 tid=0x00007fdf2ccae800 nid=0x6268 waiting on condition [0x00007fd6d106e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:18" #2399 daemon prio=5 os_prio=0 tid=0x00007fdf2e0c9800 nid=0x6260 waiting on condition [0x00007fd6d1541000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:17" #2391 daemon prio=5 os_prio=0 tid=0x00007fdf2cbc3000 nid=0x6258 waiting on condition [0x00007fd6d137a000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:16" #2346 daemon prio=5 os_prio=0 tid=0x00007fdf2dd5a800 nid=0x6093 waiting on condition [0x00007fd6d16c7000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:15" #2337 daemon prio=5 os_prio=0 tid=0x00007fdf2c64f000 nid=0x608a waiting on condition [0x00007fd6d0caa000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:14" #2318 daemon prio=5 os_prio=0 tid=0x00007fdf2cdec800 nid=0x6077 waiting on condition [0x00007fd55096b000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:13" #2312 daemon prio=5 os_prio=0 tid=0x00007fdf2c4b4800 nid=0x6071 waiting on condition [0x00007fd6d0d6d000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:12" #2300 daemon prio=5 os_prio=0 tid=0x00007fdf2cab7800 nid=0x6065 waiting on condition [0x00007fd6d143d000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:11" #2284 daemon prio=5 os_prio=0 tid=0x00007fdf2d884800 nid=0x6055 waiting on condition [0x00007fd6d13bb000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:10" #2270 daemon prio=5 os_prio=0 tid=0x00007fdf2cd0a800 nid=0x6047 waiting on condition [0x00007fd6d0ee8000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:9" #2241 daemon prio=5 os_prio=0 tid=0x00007fdf2e169800 nid=0x6029 waiting on condition [0x00007fd6cf574000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:8" #2156 daemon prio=5 os_prio=0 tid=0x00007fdf2c2c9800 nid=0x5ef7 waiting on condition [0x00007fd6d1276000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:7" #2127 daemon prio=5 os_prio=0 tid=0x00007fdf2da03800 nid=0x5e1f waiting on condition [0x00007fd6d0fec000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:6" #2115 daemon prio=5 os_prio=0 tid=0x00007fdf2e0fc000 nid=0x5e13 waiting on condition [0x00007fd6d1131000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:5" #2104 daemon prio=5 os_prio=0 tid=0x00007fdf2dec9000 nid=0x5e08 waiting on condition [0x00007fd6d1235000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:4" #2095 daemon prio=5 os_prio=0 tid=0x00007fdf2de31000 nid=0x5dff waiting on condition [0x00007fd6d1339000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:3" #2070 daemon prio=5 os_prio=0 tid=0x00007fdf2d8f7800 nid=0x5de6 waiting on condition [0x00007fd6d15c3000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:2" #2055 daemon prio=5 os_prio=0 tid=0x00007fdf2c273800 nid=0x5dd7 waiting on condition [0x00007fd6d1910000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamingTransferTaskTimeouts:1" #2039 daemon prio=5 os_prio=0 tid=0x00007fdf2d7a9800 nid=0x5dc7 waiting on condition [0x00007fd6d18cf000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd730362350> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"StreamConnectionEstablisher:1" #2029 daemon prio=5 os_prio=0 tid=0x00007fdf2c8db000 nid=0x5dbd waiting on condition [0x00007fd6d2895000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd735a71e20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-48" #609 prio=10 os_prio=0 tid=0x00007fdf2c41b000 nid=0x35ef runnable [0x00007fd55206d000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-47" #608 prio=10 os_prio=0 tid=0x00007fdf2c211800 nid=0x343f runnable [0x00007fd552017000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-46" #607 prio=10 os_prio=0 tid=0x00007fdf2d8f2800 nid=0x343c runnable [0x00007fd5507da000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-45" #606 prio=10 os_prio=0 tid=0x00007fdf2c5a4000 nid=0x329e runnable [0x00007fd5520ae000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-44" #605 prio=10 os_prio=0 tid=0x00007fdf2caca800 nid=0x329b runnable [0x00007fd5520ef000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-43" #604 prio=10 os_prio=0 tid=0x00007fdf2cae5000 nid=0x3101 runnable [0x00007fd5ca153000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-42" #603 prio=10 os_prio=0 tid=0x00007fdf2c545800 nid=0x30fe runnable [0x00007fd5e2d9a000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-41" #602 prio=10 os_prio=0 tid=0x00007fdf2ca30800 nid=0x2f2d runnable [0x00007fd61d5b4000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-40" #601 prio=10 os_prio=0 tid=0x00007fdf2c31b000 nid=0x2f2a runnable [0x00007fd61d5f5000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-39" #600 prio=10 os_prio=0 tid=0x00007fdf2c467000 nid=0x2d90 runnable [0x00007fd62edae000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-38" #599 prio=10 os_prio=0 tid=0x00007fdf2c15c000 nid=0x2d8d runnable [0x00007fd62ed6d000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-37" #598 prio=10 os_prio=0 tid=0x00007fdf2c710000 nid=0x2bf3 runnable [0x00007fd62edef000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-36" #597 prio=10 os_prio=0 tid=0x00007fdf2c3a8800 nid=0x2bf0 runnable [0x00007fd68ac43000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-35" #596 prio=10 os_prio=0 tid=0x00007fdf2e073800 nid=0x2a57 runnable [0x00007fd66c5a0000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-34" #595 prio=10 os_prio=0 tid=0x00007fdf2e243800 nid=0x2a54 runnable [0x00007fd66c55f000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-33" #594 prio=10 os_prio=0 tid=0x00007fdf2c43f800 nid=0x289c runnable [0x00007fd62ee71000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-32" #593 prio=10 os_prio=0 tid=0x00007fdf2c7d0000 nid=0x2899 runnable [0x00007fd630053000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-31" #592 prio=10 os_prio=0 tid=0x00007fdf2c3a0800 nid=0x26d4 runnable [0x00007fd62ee30000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-30" #591 prio=10 os_prio=0 tid=0x00007fdf2c1b3000 nid=0x26cf runnable [0x00007fd62eeb2000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-29" #590 prio=10 os_prio=0 tid=0x00007fdf2c8b5000 nid=0x2516 runnable [0x00007fd66c5e1000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-28" #589 prio=10 os_prio=0 tid=0x00007fdf2c943000 nid=0x2513 runnable [0x00007fd66c622000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-27" #588 prio=10 os_prio=0 tid=0x00007fdf2de8e800 nid=0x2375 runnable [0x00007fd4175fe000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-26" #587 prio=10 os_prio=0 tid=0x00007fdf2c5d9800 nid=0x2372 runnable [0x00007fd6d08dd000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-25" #586 prio=10 os_prio=0 tid=0x00007fdf2c748000 nid=0x21d8 runnable [0x00007fd6d30aa000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-24" #585 prio=10 os_prio=0 tid=0x00007fdf2c1f1800 nid=0x21d5 runnable [0x00007fd6d089c000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-23" #584 prio=10 os_prio=0 tid=0x00007fdf2c89b800 nid=0x203c runnable [0x00007fd6d091e000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-22" #583 prio=10 os_prio=0 tid=0x00007fdf2e1fe000 nid=0x2038 runnable [0x00007fd6d3069000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-21" #582 prio=10 os_prio=0 tid=0x00007fdf2c07b000 nid=0x1e71 runnable [0x00007fd6d316d000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-20" #581 prio=10 os_prio=0 tid=0x00007fdf2c27b000 nid=0x1e6d runnable [0x00007fd6d312c000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-19" #580 prio=10 os_prio=0 tid=0x00007fdf2c928800 nid=0x1cd2 runnable [0x00007fd6d085b000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-18" #579 prio=10 os_prio=0 tid=0x00007fdf2ca58000 nid=0x1ccd runnable [0x00007fd6d31ae000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-17" #578 prio=10 os_prio=0 tid=0x00007fdf2c11c000 nid=0x1b17 runnable [0x00007fd6cf5b5000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-16" #577 prio=10 os_prio=0 tid=0x00007fdf2de97000 nid=0x1b14 runnable [0x00007fd6cf470000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-15" #576 prio=10 os_prio=0 tid=0x00007fdf2d90a000 nid=0x197b runnable [0x00007fd6d332a000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-14" #575 prio=10 os_prio=0 tid=0x00007fdf2c1e5800 nid=0x1974 runnable [0x00007fd6cf533000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-13" #574 prio=10 os_prio=0 tid=0x00007fdf2cbd4000 nid=0x17cc runnable [0x00007fd68cf1b000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-12" #573 prio=10 os_prio=0 tid=0x00007fdf2e239000 nid=0x17c9 runnable [0x00007fd6cf5f6000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-11" #572 prio=10 os_prio=0 tid=0x00007fdf2c1aa800 nid=0x15c7 runnable [0x00007fd4675c1000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-10" #571 prio=10 os_prio=0 tid=0x00007fdf2cae9800 nid=0x15c4 runnable [0x00007fd46909a000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-9" #570 prio=10 os_prio=0 tid=0x00007fdf2c9c8000 nid=0x1415 runnable [0x00007fd46753f000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-8" #569 prio=10 os_prio=0 tid=0x00007fdf2c23a800 nid=0x1411 runnable [0x00007fd6d336b000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-7" #568 prio=10 os_prio=0 tid=0x00007fdf2d945000 nid=0x1278 runnable [0x00007fd4674fe000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-6" #567 prio=10 os_prio=0 tid=0x00007fdf2c2db000 nid=0x1275 runnable [0x00007fd467602000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-5" #566 prio=10 os_prio=0 tid=0x00007fdf2d70d000 nid=0x10c6 runnable [0x00007fd6cf73b000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-4" #565 prio=10 os_prio=0 tid=0x00007fdf2e197800 nid=0x10c2 runnable [0x00007fd6cf678000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-3" #564 prio=10 os_prio=0 tid=0x00007fdf2e238000 nid=0xf1e runnable [0x00007fd6cf6b9000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"threadDeathWatcher-3-1" #617 daemon prio=1 os_prio=4 tid=0x00007fdf2d8fc000 nid=0xf1b waiting on condition [0x00007fd6cf77c000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at io.netty.util.ThreadDeathWatcher$Watcher.run(ThreadDeathWatcher.java:137)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"epollEventLoopGroup-2-2" #563 prio=10 os_prio=0 tid=0x00007fdf2d8ff000 nid=0xf1a runnable [0x00007fd6adc40000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"DestroyJavaVM" #612 prio=5 os_prio=0 tid=0x00007fdf4c00d000 nid=0xa81 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Thread-4" #611 prio=5 os_prio=0 tid=0x00007fdf4d848000 nid=0xe4d runnable [0x00007fd6cf4b1000]
   java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
at java.net.ServerSocket.implAccept(ServerSocket.java:545)
at java.net.ServerSocket.accept(ServerSocket.java:513)
at org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:102)
at org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:36)
at org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:60)
at org.apache.cassandra.thrift.CustomTThreadPoolServer.serve(CustomTThreadPoolServer.java:110)
at org.apache.cassandra.thrift.ThriftServer$ThriftServerThread.run(ThriftServer.java:137)

"epollEventLoopGroup-2-1" #562 prio=10 os_prio=0 tid=0x00007fdf4eb28800 nid=0xe4c runnable [0x00007fd6cf637000]
   java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait(Native Method)
at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:194)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:219)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)

"MessagingService-Outgoing-/10.57.198.67" #559 daemon prio=5 os_prio=0 tid=0x00007fdf2d749800 nid=0xe47 waiting on condition [0x00007fd68cf9d000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76e000220> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
at org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)

"MessagingService-Outgoing-/10.57.198.67" #558 daemon prio=5 os_prio=0 tid=0x00007fdf2d748800 nid=0xe46 waiting on condition [0x00007fd68ceda000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76defc038> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
at org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)

"metrics-graphite-reporter-thread-1" #555 daemon prio=5 os_prio=0 tid=0x00007fdf4e7f7800 nid=0xe43 waiting for monitor entry [0x00007fd6bb86b000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getEstimatedRemainingTasks(WrappingCompactionStrategy.java:162)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.metrics.ColumnFamilyMetrics$13.value(ColumnFamilyMetrics.java:357)
at org.apache.cassandra.metrics.ColumnFamilyMetrics$13.value(ColumnFamilyMetrics.java:354)
at org.apache.cassandra.metrics.ColumnFamilyMetrics$33.value(ColumnFamilyMetrics.java:662)
at org.apache.cassandra.metrics.ColumnFamilyMetrics$33.value(ColumnFamilyMetrics.java:656)
at com.yammer.metrics.reporting.GraphiteReporter.processGauge(GraphiteReporter.java:304)
at com.yammer.metrics.reporting.GraphiteReporter.processGauge(GraphiteReporter.java:26)
at com.yammer.metrics.core.Gauge.processWith(Gauge.java:28)
at com.yammer.metrics.reporting.GraphiteReporter.printRegularMetrics(GraphiteReporter.java:247)
at com.yammer.metrics.reporting.GraphiteReporter.run(GraphiteReporter.java:213)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"MessagingService-Outgoing-/10.125.218.156" #554 daemon prio=5 os_prio=0 tid=0x00007fdf2d747000 nid=0xe42 waiting on condition [0x00007fd693cfe000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76dba6048> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
at org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)

"MessagingService-Outgoing-/10.125.218.156" #553 daemon prio=5 os_prio=0 tid=0x00007fdf2dde7000 nid=0xe41 waiting on condition [0x00007fd693cbd000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76e0ab290> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
at org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)

"MessagingService-Outgoing-/10.125.218.102" #551 daemon prio=5 os_prio=0 tid=0x00007fdf2e25e000 nid=0xe3f waiting on condition [0x00007fd68cf5c000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76dcfbf28> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
at org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)

"MessagingService-Outgoing-/10.125.218.102" #550 daemon prio=5 os_prio=0 tid=0x00007fdf2dd75000 nid=0xe3e waiting on condition [0x00007fd477ca6000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76e000528> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
at org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)

"NanoTimeToCurrentTimeMillis updater" #549 daemon prio=5 os_prio=0 tid=0x00007fdf2ce15000 nid=0xe3d in Object.wait() [0x00007fd693c7c000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at org.apache.cassandra.utils.NanoTimeToCurrentTimeMillis$1.run(NanoTimeToCurrentTimeMillis.java:71)
- locked <0x00007fd76dafbcc0> (a java.lang.Object)

"MessagingService-Outgoing-/10.57.198.217" #546 daemon prio=5 os_prio=0 tid=0x00007fdf2e25f000 nid=0xe3a waiting on condition [0x00007fd46e58c000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76e000830> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
at org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)

"MessagingService-Outgoing-/10.57.198.217" #545 daemon prio=5 os_prio=0 tid=0x00007fdf2c68c000 nid=0xe39 waiting on condition [0x00007fd477c65000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76defc378> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
at org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)

"PendingRangeCalculator:1" #543 daemon prio=5 os_prio=0 tid=0x00007fdf4e0ec800 nid=0xe37 waiting on condition [0x00007fd46e54b000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76e000af0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"MessagingService-Outgoing-/10.57.198.15" #542 daemon prio=5 os_prio=0 tid=0x00007fdf2c63a000 nid=0xe36 waiting on condition [0x00007fd46e4c9000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76dba6350> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
at org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)

"MessagingService-Outgoing-/10.57.198.15" #541 daemon prio=5 os_prio=0 tid=0x00007fdf2e244800 nid=0xe35 waiting on condition [0x00007fd46e447000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76dcfc230> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
at org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
at org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)

"BatchlogTasks:1" #537 daemon prio=5 os_prio=0 tid=0x00007fdf4e201800 nid=0xe31 waiting on condition [0x00007fd46b910000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76dba6610> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"HintedHandoffManager:1" #536 daemon prio=1 os_prio=4 tid=0x00007fdf4e0fb000 nid=0xe30 waiting on condition [0x00007fd46b84d000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76dcff990> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"HintedHandoff:2" #535 daemon prio=1 os_prio=4 tid=0x00007fdf4ee06800 nid=0xe2f waiting on condition [0x00007fd46b8cf000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76dafbe80> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"HintedHandoff:1" #534 daemon prio=1 os_prio=4 tid=0x00007fdf4e50c000 nid=0xe2e waiting on condition [0x00007fd46e50a000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76dafbe80> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"ACCEPT-/10.125.218.83" #533 prio=5 os_prio=0 tid=0x00007fdf4e56c800 nid=0xe2d runnable [0x00007fd46e488000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
- locked <0x00007fd76dba69c8> (a java.lang.Object)
at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:100)
- locked <0x00007fd76dba69d8> (a java.lang.Object)
at org.apache.cassandra.net.MessagingService$SocketThread.run(MessagingService.java:976)

"GossipTasks:1" #532 daemon prio=5 os_prio=0 tid=0x00007fdf4db88800 nid=0xe2c waiting on condition [0x00007fd46911c000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72e785b90> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"IndexSummaryManager:1" #530 daemon prio=1 os_prio=4 tid=0x00007fdf4e487000 nid=0xe2b waiting on condition [0x00007fd46b88e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd76dcffd38> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-86" #519 daemon prio=5 os_prio=0 tid=0x00007fdf2c3a9800 nid=0xcbd waiting on condition [0x00007fd46547e000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-128" #483 daemon prio=5 os_prio=0 tid=0x00007fdf2cc36800 nid=0xcbc waiting on condition [0x00007fd4654bf000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-124" #487 daemon prio=5 os_prio=0 tid=0x00007fdf2cc2c000 nid=0xcbb waiting on condition [0x00007fd465500000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-122" #489 daemon prio=5 os_prio=0 tid=0x00007fdf2cc41000 nid=0xcba waiting on condition [0x00007fd465541000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-118" #492 daemon prio=5 os_prio=0 tid=0x00007fdf2cc2a800 nid=0xcb9 waiting on condition [0x00007fd465582000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-116" #494 daemon prio=5 os_prio=0 tid=0x00007fdf2cc27000 nid=0xcb8 waiting on condition [0x00007fd4655c3000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-113" #497 daemon prio=5 os_prio=0 tid=0x00007fdf2cd80000 nid=0xcb7 waiting on condition [0x00007fd465604000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-111" #499 daemon prio=5 os_prio=0 tid=0x00007fdf2cd7e000 nid=0xcb6 waiting on condition [0x00007fd465645000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-109" #500 daemon prio=5 os_prio=0 tid=0x00007fdf2c33e800 nid=0xcb5 waiting on condition [0x00007fd465686000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-106" #502 daemon prio=5 os_prio=0 tid=0x00007fdf2c30d800 nid=0xcb4 waiting on condition [0x00007fd4656c7000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-104" #503 daemon prio=5 os_prio=0 tid=0x00007fdf2c36a800 nid=0xcb3 waiting on condition [0x00007fd465708000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-105" #504 daemon prio=5 os_prio=0 tid=0x00007fdf2ca82800 nid=0xcb2 waiting on condition [0x00007fd465749000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-101" #506 daemon prio=5 os_prio=0 tid=0x00007fdf2cd7c000 nid=0xcb1 waiting on condition [0x00007fd46578a000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-100" #507 daemon prio=5 os_prio=0 tid=0x00007fdf2c974800 nid=0xcb0 waiting on condition [0x00007fd4657cb000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-99" #508 daemon prio=5 os_prio=0 tid=0x00007fdf2c972800 nid=0xcaf waiting on condition [0x00007fd46580c000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-95" #511 daemon prio=5 os_prio=0 tid=0x00007fdf2c970800 nid=0xcae waiting on condition [0x00007fd46584d000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-92" #513 daemon prio=5 os_prio=0 tid=0x00007fdf2c30e800 nid=0xcad waiting on condition [0x00007fd46588e000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-91" #515 daemon prio=5 os_prio=0 tid=0x00007fdf2c36e800 nid=0xcac waiting on condition [0x00007fd4658cf000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-87" #518 daemon prio=5 os_prio=0 tid=0x00007fdf2c36c800 nid=0xcab waiting on condition [0x00007fd465910000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-88" #517 daemon prio=5 os_prio=0 tid=0x00007fdf2c96e800 nid=0xcaa waiting on condition [0x00007fd465951000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-89" #516 daemon prio=5 os_prio=0 tid=0x00007fdf2c479000 nid=0xca9 waiting on condition [0x00007fd465992000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-83" #446 daemon prio=5 os_prio=0 tid=0x00007fdf2c476800 nid=0xca8 waiting on condition [0x00007fd4659d3000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-90" #514 daemon prio=5 os_prio=0 tid=0x00007fdf2c474800 nid=0xca7 waiting on condition [0x00007fd465a14000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-93" #512 daemon prio=5 os_prio=0 tid=0x00007fdf2cac2800 nid=0xca6 waiting on condition [0x00007fd465a55000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-80" #449 daemon prio=5 os_prio=0 tid=0x00007fdf2cac0800 nid=0xca5 waiting on condition [0x00007fd465a96000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-96" #510 daemon prio=5 os_prio=0 tid=0x00007fdf2cabe800 nid=0xca4 waiting on condition [0x00007fd465ad7000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-97" #509 daemon prio=5 os_prio=0 tid=0x00007fdf2cabc800 nid=0xca3 waiting on condition [0x00007fd465b18000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-79" #451 daemon prio=5 os_prio=0 tid=0x00007fdf2c4fc800 nid=0xca2 waiting on condition [0x00007fd465b59000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-78" #452 daemon prio=5 os_prio=0 tid=0x00007fdf2c4fa800 nid=0xca1 waiting on condition [0x00007fd465b9a000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-75" #454 daemon prio=5 os_prio=0 tid=0x00007fdf2c4f8000 nid=0xca0 waiting on condition [0x00007fd465bdb000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-102" #505 daemon prio=5 os_prio=0 tid=0x00007fdf2c4f6800 nid=0xc9f waiting on condition [0x00007fd465c1c000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-103" #456 daemon prio=5 os_prio=0 tid=0x00007fdf2c4c0000 nid=0xc9e waiting on condition [0x00007fd465c5d000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-107" #501 daemon prio=5 os_prio=0 tid=0x00007fdf2c081800 nid=0xc9d waiting on condition [0x00007fd465c9e000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-108" #459 daemon prio=5 os_prio=0 tid=0x00007fdf2c07f800 nid=0xc9c waiting on condition [0x00007fd465cdf000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-112" #498 daemon prio=5 os_prio=0 tid=0x00007fdf2c07e000 nid=0xc9b waiting on condition [0x00007fd465d20000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-114" #496 daemon prio=5 os_prio=0 tid=0x00007fdf2ca89000 nid=0xc9a waiting on condition [0x00007fd465d61000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-115" #495 daemon prio=5 os_prio=0 tid=0x00007fdf2ca87000 nid=0xc99 waiting on condition [0x00007fd465da2000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-69" #463 daemon prio=5 os_prio=0 tid=0x00007fdf2ca85000 nid=0xc98 waiting on condition [0x00007fd465de3000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-117" #493 daemon prio=5 os_prio=0 tid=0x00007fdf2c313000 nid=0xc97 waiting on condition [0x00007fd465e24000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-119" #491 daemon prio=5 os_prio=0 tid=0x00007fdf2c311000 nid=0xc96 waiting on condition [0x00007fd465e65000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-120" #490 daemon prio=5 os_prio=0 tid=0x00007fdf2c370800 nid=0xc95 waiting on condition [0x00007fd465ea6000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-123" #488 daemon prio=5 os_prio=0 tid=0x00007fdf2ca51800 nid=0xc94 waiting on condition [0x00007fd465ee7000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-64" #468 daemon prio=5 os_prio=0 tid=0x00007fdf2c9f8000 nid=0xc93 waiting on condition [0x00007fd465f28000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-125" #486 daemon prio=5 os_prio=0 tid=0x00007fdf2c492000 nid=0xc92 waiting on condition [0x00007fd465f69000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-127" #485 daemon prio=5 os_prio=0 tid=0x00007fdf2c490000 nid=0xc91 waiting on condition [0x00007fd465faa000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-126" #484 daemon prio=5 os_prio=0 tid=0x00007fdf2c979000 nid=0xc90 waiting on condition [0x00007fd465feb000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-60" #471 daemon prio=5 os_prio=0 tid=0x00007fdf2c977800 nid=0xc8f waiting on condition [0x00007fd46602c000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-58" #475 daemon prio=5 os_prio=0 tid=0x00007fdf2c47d800 nid=0xc8e waiting on condition [0x00007fd46606d000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-50" #482 daemon prio=5 os_prio=0 tid=0x00007fdf2c47b800 nid=0xc8d waiting on condition [0x00007fd4660ae000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-49" #424 daemon prio=5 os_prio=0 tid=0x00007fdf2cacb800 nid=0xc8c waiting on condition [0x00007fd4660ef000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-48" #425 daemon prio=5 os_prio=0 tid=0x00007fdf2ca28000 nid=0xc8b waiting on condition [0x00007fd466130000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-51" #481 daemon prio=5 os_prio=0 tid=0x00007fdf2ca25800 nid=0xc8a waiting on condition [0x00007fd466171000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-47" #426 daemon prio=5 os_prio=0 tid=0x00007fdf2ca24000 nid=0xc89 waiting on condition [0x00007fd4661b2000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-52" #480 daemon prio=5 os_prio=0 tid=0x00007fdf2ca21800 nid=0xc88 waiting on condition [0x00007fd4661f3000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-54" #479 daemon prio=5 os_prio=0 tid=0x00007fdf2c007800 nid=0xc87 waiting on condition [0x00007fd466234000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-53" #478 daemon prio=5 os_prio=0 tid=0x00007fdf2c005800 nid=0xc86 waiting on condition [0x00007fd466275000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-55" #477 daemon prio=5 os_prio=0 tid=0x00007fdf2c777000 nid=0xc85 waiting on condition [0x00007fd4662b6000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-43" #429 daemon prio=5 os_prio=0 tid=0x00007fdf2c786000 nid=0xc84 waiting on condition [0x00007fd4662f7000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-56" #476 daemon prio=5 os_prio=0 tid=0x00007fdf2c787800 nid=0xc83 waiting on condition [0x00007fd466338000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-57" #474 daemon prio=5 os_prio=0 tid=0x00007fdf2c784800 nid=0xc82 waiting on condition [0x00007fd466379000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-59" #473 daemon prio=5 os_prio=0 tid=0x00007fdf2c219000 nid=0xc81 waiting on condition [0x00007fd4663ba000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-61" #472 daemon prio=5 os_prio=0 tid=0x00007fdf2c215800 nid=0xc80 waiting on condition [0x00007fd4663fb000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-62" #470 daemon prio=5 os_prio=0 tid=0x00007fdf2c213800 nid=0xc7f waiting on condition [0x00007fd46643c000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-63" #469 daemon prio=5 os_prio=0 tid=0x00007fdf2c8bd000 nid=0xc7e waiting on condition [0x00007fd46647d000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-65" #467 daemon prio=5 os_prio=0 tid=0x00007fdf2c8bb000 nid=0xc7d waiting on condition [0x00007fd4664be000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-121" #466 daemon prio=5 os_prio=0 tid=0x00007fdf2c8b9000 nid=0xc7c waiting on condition [0x00007fd4664ff000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-66" #465 daemon prio=5 os_prio=0 tid=0x00007fdf2c8b6800 nid=0xc7b waiting on condition [0x00007fd466540000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-67" #464 daemon prio=5 os_prio=0 tid=0x00007fdf2c718000 nid=0xc7a waiting on condition [0x00007fd466581000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-68" #462 daemon prio=5 os_prio=0 tid=0x00007fdf2c716000 nid=0xc79 waiting on condition [0x00007fd4665c2000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-70" #461 daemon prio=5 os_prio=0 tid=0x00007fdf2c714000 nid=0xc78 waiting on condition [0x00007fd466603000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-110" #460 daemon prio=5 os_prio=0 tid=0x00007fdf2c712800 nid=0xc77 waiting on condition [0x00007fd466644000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-71" #458 daemon prio=5 os_prio=0 tid=0x00007fdf2c8f7000 nid=0xc76 waiting on condition [0x00007fd466685000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-36" #436 daemon prio=5 os_prio=0 tid=0x00007fdf2c8f5000 nid=0xc75 waiting on condition [0x00007fd4666c6000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-73" #457 daemon prio=5 os_prio=0 tid=0x00007fdf2c8f3000 nid=0xc74 waiting on condition [0x00007fd466707000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-74" #455 daemon prio=5 os_prio=0 tid=0x00007fdf2c8f1000 nid=0xc73 waiting on condition [0x00007fd466748000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-76" #453 daemon prio=5 os_prio=0 tid=0x00007fdf2c320800 nid=0xc72 waiting on condition [0x00007fd466789000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-34" #438 daemon prio=5 os_prio=0 tid=0x00007fdf2c31e800 nid=0xc71 waiting on condition [0x00007fd4667ca000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-98" #450 daemon prio=5 os_prio=0 tid=0x00007fdf2c31c800 nid=0xc70 waiting on condition [0x00007fd46680b000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-94" #448 daemon prio=5 os_prio=0 tid=0x00007fdf2c582000 nid=0xc6f waiting on condition [0x00007fd46684c000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-81" #447 daemon prio=5 os_prio=0 tid=0x00007fdf2c580000 nid=0xc6e waiting on condition [0x00007fd46688d000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-84" #445 daemon prio=5 os_prio=0 tid=0x00007fdf2c57d800 nid=0xc6d waiting on condition [0x00007fd4668ce000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-31" #443 daemon prio=5 os_prio=0 tid=0x00007fdf2cb0b000 nid=0xc6c waiting on condition [0x00007fd46690f000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-85" #444 daemon prio=5 os_prio=0 tid=0x00007fdf2cb09800 nid=0xc6b waiting on condition [0x00007fd466950000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-29" #412 daemon prio=5 os_prio=0 tid=0x00007fdf2cb08000 nid=0xc6a waiting on condition [0x00007fd466991000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-82" #442 daemon prio=5 os_prio=0 tid=0x00007fdf2ca33800 nid=0xc69 waiting on condition [0x00007fd4669d2000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-32" #441 daemon prio=5 os_prio=0 tid=0x00007fdf2ca31800 nid=0xc68 waiting on condition [0x00007fd466a13000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-33" #440 daemon prio=5 os_prio=0 tid=0x00007fdf2c46d000 nid=0xc67 waiting on condition [0x00007fd466a54000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-77" #439 daemon prio=5 os_prio=0 tid=0x00007fdf2c46b800 nid=0xc66 waiting on condition [0x00007fd466a95000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-35" #437 daemon prio=5 os_prio=0 tid=0x00007fdf2cb3d800 nid=0xc65 waiting on condition [0x00007fd466ad6000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-72" #435 daemon prio=5 os_prio=0 tid=0x00007fdf2cb3c800 nid=0xc64 waiting on condition [0x00007fd466b17000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-37" #434 daemon prio=5 os_prio=0 tid=0x00007fdf2c63d000 nid=0xc63 waiting on condition [0x00007fd466b58000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-38" #433 daemon prio=5 os_prio=0 tid=0x00007fdf2c3c3800 nid=0xc62 waiting on condition [0x00007fd466b99000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-39" #432 daemon prio=5 os_prio=0 tid=0x00007fdf2c3c2000 nid=0xc61 waiting on condition [0x00007fd466bda000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-40" #416 daemon prio=5 os_prio=0 tid=0x00007fdf2c82c800 nid=0xc60 waiting on condition [0x00007fd466c1b000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-24" #417 daemon prio=5 os_prio=0 tid=0x00007fdf2c82a800 nid=0xc5f waiting on condition [0x00007fd466c5c000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-41" #431 daemon prio=5 os_prio=0 tid=0x00007fdf2cb6f800 nid=0xc5e waiting on condition [0x00007fd466c9d000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-42" #430 daemon prio=5 os_prio=0 tid=0x00007fdf2cb6e000 nid=0xc5d waiting on condition [0x00007fd466cde000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-21" #420 daemon prio=5 os_prio=0 tid=0x00007fdf2ca5e800 nid=0xc5c waiting on condition [0x00007fd466d1f000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-44" #428 daemon prio=5 os_prio=0 tid=0x00007fdf2cb76800 nid=0xc5b waiting on condition [0x00007fd466d60000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-45" #427 daemon prio=5 os_prio=0 tid=0x00007fdf2cb74800 nid=0xc5a waiting on condition [0x00007fd466da1000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-19" #422 daemon prio=5 os_prio=0 tid=0x00007fdf2c409800 nid=0xc59 waiting on condition [0x00007fd466de2000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-20" #423 daemon prio=5 os_prio=0 tid=0x00007fdf2c407800 nid=0xc58 waiting on condition [0x00007fd466e23000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-46" #421 daemon prio=5 os_prio=0 tid=0x00007fdf2cba0000 nid=0xc57 waiting on condition [0x00007fd466e64000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-16" #409 daemon prio=5 os_prio=0 tid=0x00007fdf2cb9e800 nid=0xc56 waiting on condition [0x00007fd466ea5000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-22" #419 daemon prio=5 os_prio=0 tid=0x00007fdf2c815800 nid=0xc55 waiting on condition [0x00007fd466ee6000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-23" #418 daemon prio=5 os_prio=0 tid=0x00007fdf2c814000 nid=0xc54 waiting on condition [0x00007fd466f27000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-25" #415 daemon prio=5 os_prio=0 tid=0x00007fdf2c64c800 nid=0xc53 waiting on condition [0x00007fd466f68000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-26" #410 daemon prio=5 os_prio=0 tid=0x00007fdf2c608800 nid=0xc52 waiting on condition [0x00007fd466fa9000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-27" #414 daemon prio=5 os_prio=0 tid=0x00007fdf2c607000 nid=0xc51 waiting on condition [0x00007fd466fea000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-28" #413 daemon prio=5 os_prio=0 tid=0x00007fdf2cb81000 nid=0xc50 waiting on condition [0x00007fd46702b000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-30" #411 daemon prio=5 os_prio=0 tid=0x00007fdf2cb80800 nid=0xc4f waiting on condition [0x00007fd46706c000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-15" #406 daemon prio=5 os_prio=0 tid=0x00007fdf2cb7f800 nid=0xc4e waiting on condition [0x00007fd4670ad000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-17" #408 daemon prio=5 os_prio=0 tid=0x00007fdf2c4cb000 nid=0xc4d waiting on condition [0x00007fd4670ee000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-18" #407 daemon prio=5 os_prio=0 tid=0x00007fdf2c7fd800 nid=0xc4c waiting on condition [0x00007fd46712f000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-12" #402 daemon prio=5 os_prio=0 tid=0x00007fdf2caeb800 nid=0xc4b waiting on condition [0x00007fd467170000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-13" #405 daemon prio=5 os_prio=0 tid=0x00007fdf2c5bc000 nid=0xc4a waiting on condition [0x00007fd4671b1000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-11" #404 daemon prio=5 os_prio=0 tid=0x00007fdf2c3c8000 nid=0xc49 waiting on condition [0x00007fd4671f2000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-14" #403 daemon prio=5 os_prio=0 tid=0x00007fdf2ca68000 nid=0xc48 waiting on condition [0x00007fd467233000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-9" #401 daemon prio=5 os_prio=0 tid=0x00007fdf2cba5800 nid=0xc47 waiting on condition [0x00007fd467274000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-10" #400 daemon prio=5 os_prio=0 tid=0x00007fdf2c98a000 nid=0xc46 waiting on condition [0x00007fd4672b5000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-8" #399 daemon prio=5 os_prio=0 tid=0x00007fdf2ca92800 nid=0xc45 waiting on condition [0x00007fd4672f6000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-7" #398 daemon prio=5 os_prio=0 tid=0x00007fdf2c088000 nid=0xc44 waiting on condition [0x00007fd467337000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-6" #397 daemon prio=5 os_prio=0 tid=0x00007fdf2c0ff800 nid=0xc43 waiting on condition [0x00007fd467378000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-5" #396 daemon prio=5 os_prio=0 tid=0x00007fdf4eb1f000 nid=0xc42 waiting on condition [0x00007fd4673b9000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-4" #395 daemon prio=5 os_prio=0 tid=0x00007fdf2c8f8000 nid=0xc41 waiting on condition [0x00007fd4673fa000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-3" #394 daemon prio=5 os_prio=0 tid=0x00007fdf2c907800 nid=0xc40 waiting on condition [0x00007fd46743b000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-2" #393 daemon prio=5 os_prio=0 tid=0x00007fdf4e415800 nid=0xc3f waiting on condition [0x00007fd46747c000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"SharedPool-Worker-1" #392 daemon prio=5 os_prio=0 tid=0x00007fdf4e414800 nid=0xc3e waiting on condition [0x00007fd4674bd000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:85)
at java.lang.Thread.run(Thread.java:745)

"MiscStage:1" #367 daemon prio=5 os_prio=0 tid=0x00007fdf4e7ee000 nid=0xc25 waiting on condition [0x00007fd477d28000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c10d268> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"MigrationStage:1" #366 daemon prio=5 os_prio=0 tid=0x00007fdf4eba9800 nid=0xc24 waiting on condition [0x00007fd489c6c000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c138cb8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"AntiEntropyStage:1" #365 daemon prio=5 os_prio=0 tid=0x00007fdf4e0b8800 nid=0xc23 waiting on condition [0x00007fd489cad000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c113330> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"GossipStage:1" #364 daemon prio=5 os_prio=0 tid=0x00007fdf4e0b8000 nid=0xc22 waiting on condition [0x00007fd48c455000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c112060> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"pool-1-thread-1" #80 prio=5 os_prio=0 tid=0x0000000001916000 nid=0xb06 waiting on condition [0x00007fd6cf6fa000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c112b18> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"NonPeriodicTasks:1" #76 daemon prio=5 os_prio=0 tid=0x00007fdf4e8c2000 nid=0xb02 waiting on condition [0x00007fd6cf9fe000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c139248> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"Reference-Reaper:1" #47 daemon prio=5 os_prio=0 tid=0x00007fdf34332800 nid=0xae5 in Object.wait() [0x00007fd6d30eb000]
   java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
- locked <0x00007fd72c12ae48> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
at org.apache.cassandra.utils.concurrent.Ref$1.run(Ref.java:307)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"PERIODIC-COMMIT-LOG-SYNCER" #43 prio=5 os_prio=0 tid=0x00007fdf4e3a2800 nid=0xadf waiting on condition [0x00007fd6d3267000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c112e38> (a java.util.concurrent.Semaphore$NonfairSync)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.Semaphore.tryAcquire(Semaphore.java:409)
at org.apache.cassandra.db.commitlog.AbstractCommitLogService$1.run(AbstractCommitLogService.java:116)
at java.lang.Thread.run(Thread.java:745)

"COMMIT-LOG-ALLOCATOR" #42 prio=5 os_prio=0 tid=0x00007fdf4e3a0000 nid=0xade waiting on condition [0x00007fd6d32a8000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c11d9b0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.cassandra.db.commitlog.CommitLogSegmentManager$1.runMayThrow(CommitLogSegmentManager.java:144)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
at java.lang.Thread.run(Thread.java:745)

"CommitLogArchiver:1" #41 daemon prio=5 os_prio=0 tid=0x00007fdf4e3c9800 nid=0xadd waiting on condition [0x00007fd6d32e9000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c119d68> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"NativePoolCleaner" #40 daemon prio=5 os_prio=0 tid=0x00007fdf4e0d7800 nid=0xadc waiting on condition [0x00007fd6d31ef000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at org.apache.cassandra.utils.concurrent.WaitQueue$AbstractSignal.awaitUninterruptibly(WaitQueue.java:283)
at org.apache.cassandra.utils.memory.MemtableCleanerThread.run(MemtableCleanerThread.java:66)

"OptionalTasks:1" #34 daemon prio=5 os_prio=0 tid=0x00007fdf4e0a0000 nid=0xad2 waiting on condition [0x00007fd6d346f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c11a0c0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"RMI RenewClean-[127.0.0.1:58667]" #32 daemon prio=5 os_prio=0 tid=0x00007fdf4e08d000 nid=0xacf in Object.wait() [0x00007fd6d34f1000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
- locked <0x00007fd72c121160> (a java.lang.ref.ReferenceQueue$Lock)
at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:553)
at java.lang.Thread.run(Thread.java:745)

"RMI Scheduler(0)" #31 daemon prio=5 os_prio=0 tid=0x00007fdf4e1b6000 nid=0xace waiting on condition [0x00007fd6d3532000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c134608> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"Background_Reporter:1" #30 daemon prio=5 os_prio=0 tid=0x00007fdf3419d000 nid=0xacd waiting on condition [0x00007fd6d3773000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c125640> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"EXPIRING-MAP-REAPER:1" #29 daemon prio=5 os_prio=0 tid=0x00007fdf342ba800 nid=0xacc waiting on condition [0x00007fd6d37b4000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c1235b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"metrics-meter-tick-thread-2" #28 daemon prio=5 os_prio=0 tid=0x00007fdf342b7000 nid=0xacb waiting on condition [0x00007fd6d37f5000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c11c430> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"metrics-meter-tick-thread-1" #27 daemon prio=5 os_prio=0 tid=0x00007fdf342b2800 nid=0xaca waiting on condition [0x00007fd6d4442000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c11c430> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"GC Daemon" #25 daemon prio=2 os_prio=3 tid=0x00007fdf4e19d000 nid=0xac8 in Object.wait() [0x00007fd6d44c4000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at sun.misc.GC$Daemon.run(GC.java:117)
- locked <0x00007fd72c1195c8> (a sun.misc.GC$LatencyLock)

"RMI Reaper" #24 prio=5 os_prio=0 tid=0x00007fdf4e197000 nid=0xac7 in Object.wait() [0x00007fd6d4505000]
   java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00007fd72c12ae68> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
- locked <0x00007fd72c12ae68> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:351)
at java.lang.Thread.run(Thread.java:745)

"RMI TCP Accept-0" #23 daemon prio=5 os_prio=0 tid=0x00007fdf4e195800 nid=0xac6 runnable [0x00007fd6d4546000]
   java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
at java.net.ServerSocket.implAccept(ServerSocket.java:545)
at java.net.ServerSocket.accept(ServerSocket.java:513)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:400)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
at java.lang.Thread.run(Thread.java:745)

"RMI TCP Accept-7199" #22 daemon prio=5 os_prio=0 tid=0x00007fdf4e18f000 nid=0xac5 runnable [0x00007fd6d47ef000]
   java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
at java.net.ServerSocket.implAccept(ServerSocket.java:545)
at java.net.ServerSocket.accept(ServerSocket.java:513)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:400)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
at java.lang.Thread.run(Thread.java:745)

"ScheduledTasks:1" #20 daemon prio=5 os_prio=0 tid=0x00007fdf4ded8800 nid=0xac4 waiting on condition [0x00007fd6d4948000]
   java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00007fd72c1238a0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

"Service Thread" #18 daemon prio=9 os_prio=0 tid=0x00007fdf4d7f3000 nid=0xac2 waiting for monitor entry [0x00007fd6d5e6e000]
   java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getEstimatedRemainingTasks(WrappingCompactionStrategy.java:162)
- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
at org.apache.cassandra.metrics.CompactionMetrics$1.value(CompactionMetrics.java:65)
at org.apache.cassandra.metrics.CompactionMetrics$1.value(CompactionMetrics.java:57)
at org.apache.cassandra.db.compaction.CompactionManager.getPendingTasks(CompactionManager.java:1422)
at org.apache.cassandra.utils.StatusLogger.log(StatusLogger.java:76)
at org.apache.cassandra.service.GCInspector.handleNotification(GCInspector.java:263)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor$ListenerWrapper.handleNotification(DefaultMBeanServerInterceptor.java:1754)
at sun.management.NotificationEmitterSupport.sendNotification(NotificationEmitterSupport.java:156)
at sun.management.GarbageCollectorImpl.createGCNotification(GarbageCollectorImpl.java:147)

"C1 CompilerThread11" #17 daemon prio=9 os_prio=0 tid=0x00007fdf4d7d4800 nid=0xac1 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread10" #16 daemon prio=9 os_prio=0 tid=0x00007fdf4d7ba800 nid=0xac0 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread9" #15 daemon prio=9 os_prio=0 tid=0x00007fdf4d7a7800 nid=0xabf waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread8" #14 daemon prio=9 os_prio=0 tid=0x00007fdf4d79c800 nid=0xabe waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread7" #13 daemon prio=9 os_prio=0 tid=0x00007fdf4d789800 nid=0xabd waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread6" #12 daemon prio=9 os_prio=0 tid=0x00007fdf4d77f800 nid=0xabc waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread5" #11 daemon prio=9 os_prio=0 tid=0x00007fdf4d77d000 nid=0xabb waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread4" #10 daemon prio=9 os_prio=0 tid=0x00007fdf4d77b000 nid=0xaba waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread3" #9 daemon prio=9 os_prio=0 tid=0x00007fdf4d771000 nid=0xab9 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread2" #8 daemon prio=9 os_prio=0 tid=0x00007fdf4d76e800 nid=0xab8 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread1" #7 daemon prio=9 os_prio=0 tid=0x00007fdf4d76c000 nid=0xab7 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #6 daemon prio=9 os_prio=0 tid=0x00007fdf4d760800 nid=0xab6 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" #5 daemon prio=9 os_prio=0 tid=0x00007fdf4d69e800 nid=0xab5 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Surrogate Locker Thread (Concurrent GC)" #4 daemon prio=9 os_prio=0 tid=0x00007fdf4d69d800 nid=0xab4 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007fdf4d665800 nid=0xab3 in Object.wait() [0x00007fd6d6d2e000]
   java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
- locked <0x00007fd72c123d38> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)

"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007fdf4d65e000 nid=0xab2 in Object.wait() [0x00007fd6d6d6f000]
   java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:157)
- locked <0x00007fd72c12ae58> (a java.lang.ref.Reference$Lock)

"VM Thread" os_prio=0 tid=0x00007fdf4d659000 nid=0xab1 runnable

"Gang worker#0 (Parallel GC Threads)" os_prio=0 tid=0x00007fdf4c025000 nid=0xa82 runnable

"Gang worker#1 (Parallel GC Threads)" os_prio=0 tid=0x00007fdf4c026800 nid=0xa83 runnable

"Gang worker#2 (Parallel GC Threads)" os_prio=0 tid=0x00007fdf4c028800 nid=0xa84 runnable

"Gang worker#3 (Parallel GC Threads)" os_prio=0 tid=0x00007fdf4c02a000 nid=0xa85 runnable

"Gang worker#4 (Parallel GC Threads)" os_prio=0 tid=0x00007fdf4c02b800 nid=0xa86 runnable

"Gang worker#5 (Parallel GC Threads)" os_prio=0 tid=0x00007fdf4c02d800 nid=0xa87 runnable

"Gang worker#6 (Parallel GC Threads)" os_prio=0 tid=0x00007fdf4c02f000 nid=0xa88 runnable

"Gang worker#7 (Parallel GC Threads)" os_prio=0 tid=0x00007fdf4c031000 nid=0xa89 runnable

"Gang worker#8 (Parallel GC Threads)" os_prio=0 tid=0x00007fdf4c032800 nid=0xa8a runnable

"Gang worker#9 (Parallel GC Threads)" os_prio=0 tid=0x00007fdf4c034800 nid=0xa8b runnable

"Gang worker#10 (Parallel GC Threads)" os_prio=0 tid=0x00007fdf4c036000 nid=0xa8c runnable

"Gang worker#11 (Parallel GC Threads)" os_prio=0 tid=0x00007fdf4c038000 nid=0xa8d runnable

"G1 Main Concurrent Mark GC Thread" os_prio=0 tid=0x00007fdf4c064000 nid=0xa9b runnable

"Gang worker#0 (G1 Parallel Marking Threads)" os_prio=0 tid=0x00007fdf4c066000 nid=0xa9c runnable

"Gang worker#1 (G1 Parallel Marking Threads)" os_prio=0 tid=0x00007fdf4c067800 nid=0xa9d runnable

"Gang worker#2 (G1 Parallel Marking Threads)" os_prio=0 tid=0x00007fdf4c069800 nid=0xa9e runnable

"G1 Concurrent Refinement Thread#0" os_prio=0 tid=0x00007fdf4c050800 nid=0xa9a runnable

"G1 Concurrent Refinement Thread#1" os_prio=0 tid=0x00007fdf4c04e800 nid=0xa99 runnable

"G1 Concurrent Refinement Thread#2" os_prio=0 tid=0x00007fdf4c04d000 nid=0xa98 runnable

"G1 Concurrent Refinement Thread#3" os_prio=0 tid=0x00007fdf4c04b000 nid=0xa97 runnable

"G1 Concurrent Refinement Thread#4" os_prio=0 tid=0x00007fdf4c049000 nid=0xa96 runnable

"G1 Concurrent Refinement Thread#5" os_prio=0 tid=0x00007fdf4c047800 nid=0xa95 runnable

"G1 Concurrent Refinement Thread#6" os_prio=0 tid=0x00007fdf4c045800 nid=0xa94 runnable

"G1 Concurrent Refinement Thread#7" os_prio=0 tid=0x00007fdf4c044000 nid=0xa93 runnable

"G1 Concurrent Refinement Thread#8" os_prio=0 tid=0x00007fdf4c042000 nid=0xa92 runnable

"G1 Concurrent Refinement Thread#9" os_prio=0 tid=0x00007fdf4c040800 nid=0xa91 runnable

"G1 Concurrent Refinement Thread#10" os_prio=0 tid=0x00007fdf4c03e800 nid=0xa90 runnable

"G1 Concurrent Refinement Thread#11" os_prio=0 tid=0x00007fdf4c03c800 nid=0xa8f runnable

"G1 Concurrent Refinement Thread#12" os_prio=0 tid=0x00007fdf4c03b000 nid=0xa8e runnable

"VM Periodic Task Thread" os_prio=0 tid=0x00007fdf4d7f8800 nid=0xac3 waiting on condition

JNI global references: 341
{noformat}



was (Author: ruoranwang):
Here are the thread-dump result. First one is when the reporter is still working, the second one is when reporter is stopped. 

{noformat}
"metrics-graphite-reporter-thread-1" #574 daemon prio=5 os_prio=0 tid=0x00007fae39b21800 nid=0x4940 waiting on condition [0x00007fa571910000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00007fa67d7972d0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
{noformat}


{noformat}
"metrics-graphite-reporter-thread-1" #555 daemon prio=5 os_prio=0 tid=0x00007fdf4e7f7800 nid=0xe43 waiting for monitor entry [0x00007fd6bb86b000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.apache.cassandra.db.compaction.WrappingCompactionStrategy.getEstimatedRemainingTasks(WrappingCompactionStrategy.java:162)
	- waiting to lock <0x00007fd72ced3e38> (a org.apache.cassandra.db.compaction.WrappingCompactionStrategy)
	at org.apache.cassandra.metrics.ColumnFamilyMetrics$13.value(ColumnFamilyMetrics.java:357)
	at org.apache.cassandra.metrics.ColumnFamilyMetrics$13.value(ColumnFamilyMetrics.java:354)
	at org.apache.cassandra.metrics.ColumnFamilyMetrics$33.value(ColumnFamilyMetrics.java:662)
	at org.apache.cassandra.metrics.ColumnFamilyMetrics$33.value(ColumnFamilyMetrics.java:656)
	at com.yammer.metrics.reporting.GraphiteReporter.processGauge(GraphiteReporter.java:304)
	at com.yammer.metrics.reporting.GraphiteReporter.processGauge(GraphiteReporter.java:26)
	at com.yammer.metrics.core.Gauge.processWith(Gauge.java:28)
	at com.yammer.metrics.reporting.GraphiteReporter.printRegularMetrics(GraphiteReporter.java:247)
	at com.yammer.metrics.reporting.GraphiteReporter.run(GraphiteReporter.java:213)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
{noformat}


> GraphiteReporter not reporting
> ------------------------------
>
>                 Key: CASSANDRA-9625
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-9625
>             Project: Cassandra
>          Issue Type: Bug
>         Environment: Debian Jessie, 7u79-2.5.5-1~deb8u1, Cassandra 2.1.3
>            Reporter: Eric Evans
>            Assignee: T Jake Luciani
>         Attachments: metrics.yaml, thread-dump.log
>
>
> When upgrading from 2.1.3 to 2.1.6, the Graphite metrics reporter stops working.  The usual startup is logged, and one batch of samples is sent, but the reporting interval comes and goes, and no other samples are ever sent.  The logs are free from errors.
> Frustratingly, metrics reporting works in our smaller (staging) environment on 2.1.6; We are able to reproduce this on all 6 of production nodes, but not on a 3 node (otherwise identical) staging cluster (maybe it takes a certain level of concurrency?).
> Attached is a thread dump, and our metrics.yaml.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message