ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nikolai Tikhonov <ntikho...@apache.org>
Subject Re: Ignite 1.9 Version: Error GridCachePartitionExchangeManager Found long running cache future
Date Fri, 08 Sep 2017 14:52:40 GMT
Hi,

I see from logs that operations stuck on marshaller cache. Since 2.0
versions this logic was significant refactored and improved. Can you update
Apache Ignite version in your Application and check this case?

On Sat, Jul 29, 2017 at 3:19 AM, Senthil Chandrasekaran <
senthilanand.c@gmail.com> wrote:

> Also attached is the client side thread dump when this issue is happening
> in
> the client node:
>
> 2017-07-28 14:56:29
> Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.60-b23 mixed mode):
>
> "VM JFR Buffer Thread" #200 daemon prio=5 os_prio=0 tid=0x00007f85b5d6b800
> nid=0xe1c waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "JFR request timer" #198 daemon prio=9 os_prio=0 tid=0x00000000032c5800
> nid=0xe1b in Object.wait() [0x00007f85902cf000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000007837026a0> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "marshaller-cache-#47%null%" #197 prio=5 os_prio=0 tid=0x00007f85a4be1800
> nid=0xdfa waiting on condition [0x00007f85916e3000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b940cad0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1066)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-25" #193 daemon prio=5 os_prio=0 tid=0x000000000266c800
> nid=0xdf4 waiting on condition [0x00007f85904ce000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000783d993e0> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x00000007a05e7bd8> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "marshaller-cache-#44%null%" #192 prio=5 os_prio=0 tid=0x00000000038d1000
> nid=0xdf3 waiting on condition [0x00007f85905d2000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b940cad0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1066)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "marshaller-cache-#43%null%" #191 prio=5 os_prio=0 tid=0x00000000038cf800
> nid=0xdf2 waiting on condition [0x00007f85906d3000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b940cad0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1066)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-24" #190 daemon prio=5 os_prio=0 tid=0x0000000002b9f000
> nid=0xdf1 waiting on condition [0x00007f85907d0000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000781ea79e8> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x00000007a05f6ad0> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-23" #189 daemon prio=5 os_prio=0 tid=0x0000000002b9d000
> nid=0xdf0 waiting on condition [0x00007f85908d1000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000788380b90> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x00000007a0570418> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-22" #188 daemon prio=5 os_prio=0 tid=0x0000000003c3e800
> nid=0xdef waiting on condition [0x00007f85909d2000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000786a81330> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x00000007a059d100> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-21" #187 daemon prio=5 os_prio=0 tid=0x0000000003c3c800
> nid=0xdee waiting on condition [0x00007f8590ad7000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000076937e160> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:103)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:31)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-20" #186 daemon prio=5 os_prio=0 tid=0x0000000003c5c800
> nid=0xded waiting on condition [0x00007f8590bd8000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000076937e160> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:103)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:31)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "marshaller-cache-#42%null%" #185 prio=5 os_prio=0 tid=0x0000000003c5a800
> nid=0xdec waiting on condition [0x00007f8590cd9000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b940cad0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1066)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "marshaller-cache-#41%null%" #184 prio=5 os_prio=0 tid=0x0000000002fc7800
> nid=0xdeb waiting on condition [0x00007f8590dda000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b940cad0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1066)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "marshaller-cache-#40%null%" #183 prio=5 os_prio=0 tid=0x00007f85a4c61800
> nid=0xdea waiting on condition [0x00007f8590edb000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b940cad0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1066)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-19" #182 daemon prio=5 os_prio=0 tid=0x00000000033f9800
> nid=0xde9 waiting on condition [0x00007f8590fd8000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000788a9c758> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x00000007a0561520> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-18" #181 daemon prio=5 os_prio=0 tid=0x0000000002beb800
> nid=0xde8 waiting on condition [0x00007f85910dd000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000076937e160> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:103)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:31)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-17" #180 daemon prio=5 os_prio=0 tid=0x0000000002be9800
> nid=0xde7 waiting on condition [0x00007f85911da000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007817b9220> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x0000000782008cf8> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-16" #179 daemon prio=5 os_prio=0 tid=0x0000000001fc3800
> nid=0xde6 waiting on condition [0x00007f85912df000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000076937e160> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:103)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:31)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-15" #178 daemon prio=5 os_prio=0 tid=0x0000000001fc1800
> nid=0xde5 waiting on condition [0x00007f85913dc000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007858936c0> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x00000007a05baef0> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-14" #177 daemon prio=5 os_prio=0 tid=0x0000000001fbd800
> nid=0xde4 waiting on condition [0x00007f85914e1000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000076937e160> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:103)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:31)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "marshaller-cache-#39%null%" #176 prio=5 os_prio=0 tid=0x0000000001fbc800
> nid=0xde3 waiting on condition [0x00007f85915e2000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b940cad0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1066)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "marshaller-cache-#37%null%" #174 prio=5 os_prio=0 tid=0x00007f85a511c800
> nid=0xde1 waiting on condition [0x00007f85917e4000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b940cad0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1066)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "metrics-com.paypal.sherlock.apisvc.metrics.groups.APIMetricGroup-
> SherlockReporter-thread-1"
> #172 daemon prio=5 os_prio=0 tid=0x00000000035b7000 nid=0xddf waiting on
> condition [0x00007f8598918000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000789f6ba58> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-13" #171 daemon prio=5 os_prio=0 tid=0x0000000001e57800
> nid=0xdde waiting on condition [0x00007f8598813000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000789c60e58> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x00000007a0506af8> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-12" #170 daemon prio=5 os_prio=0 tid=0x0000000001e56800
> nid=0xddd waiting on condition [0x00007f8598712000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007872edcb8> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x00000007a058e208> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-11" #169 daemon prio=5 os_prio=0 tid=0x0000000003870800
> nid=0xddc waiting on condition [0x00007f8598615000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000076937e160> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:103)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:31)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-10" #168 daemon prio=5 os_prio=0 tid=0x000000000386e800
> nid=0xddb waiting on condition [0x00007f8598514000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000076937e160> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:103)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:31)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-9" #167 daemon prio=5 os_prio=0 tid=0x0000000003867800
> nid=0xdda waiting on condition [0x00007f8598413000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000076937e160> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:103)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:31)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-8" #166 daemon prio=5 os_prio=0 tid=0x0000000003866000
> nid=0xdd9 waiting on condition [0x00007f8596e03000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000076937e160> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:103)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:31)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-7" #165 daemon prio=5 os_prio=0 tid=0x0000000002019000
> nid=0xdd8 waiting on condition [0x00007f85965fa000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000078499ef60> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x00000007a05d8ce0> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-6" #164 daemon prio=5 os_prio=0 tid=0x0000000002740000
> nid=0xdd7 waiting on condition [0x00007f85964f8000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007811b40e0> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x0000000782017bf0> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-5" #163 daemon prio=5 os_prio=0 tid=0x0000000003862800
> nid=0xdd6 waiting on condition [0x00007f85966fa000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000787889c48> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x00000007a057f310> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-4" #162 daemon prio=5 os_prio=0 tid=0x000000000205d000
> nid=0xdd5 waiting on condition [0x00007f85967ff000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000076937e160> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:103)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:31)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-3" #161 daemon prio=5 os_prio=0 tid=0x0000000002c1a000
> nid=0xdd4 waiting on condition [0x00007f859afc5000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000076937e160> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:103)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:31)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DefaultThreadPool-2" #160 daemon prio=5 os_prio=0 tid=0x000000000205e000
> nid=0xdd3 waiting on condition [0x00007f859941e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007865583f8> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x00000007a05abff8> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "Attach Listener" #158 daemon prio=9 os_prio=0 tid=0x00000000026c4000
> nid=0xdcb runnable [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "com.ebay.kernel.schedulednotification.CommandRunnerNotifier_1501278314762
> -
> 1" #155 daemon prio=5 os_prio=0 tid=0x0000000001e10800 nid=0xd8d in
> Object.wait() [0x00007f85963fb000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> com.ebay.kernel.util.threadpool.ThreadPoolWorker.
> waitForWork(ThreadPoolWorker.java:428)
>         - locked <0x000000079b402620> (a java.lang.Object)
>         at
> com.ebay.kernel.util.threadpool.ThreadPoolWorker.
> runInt(ThreadPoolWorker.java:341)
>         at
> com.ebay.kernel.util.threadpool.ThreadPoolWorker.
> run(ThreadPoolWorker.java:293)
>
> "com.ebay.kernel.schedulednotification.CommandRunnerNotifier_1501278314762
> -
> 0" #154 daemon prio=5 os_prio=0 tid=0x0000000002718800 nid=0xd8a in
> Object.wait() [0x00007f8592be7000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> com.ebay.kernel.util.threadpool.ThreadPoolWorker.
> waitForWork(ThreadPoolWorker.java:428)
>         - locked <0x000000079b400820> (a java.lang.Object)
>         at
> com.ebay.kernel.util.threadpool.ThreadPoolWorker.
> runInt(ThreadPoolWorker.java:341)
>         at
> com.ebay.kernel.util.threadpool.ThreadPoolWorker.
> run(ThreadPoolWorker.java:293)
>
> "ScheduledNotificationProcessor" #153 daemon prio=5 os_prio=0
> tid=0x00007f85a4bdb000 nid=0xd89 in Object.wait() [0x00007f859a128000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> com.ebay.kernel.schedulednotify.ScheduledNotificationManager$
> ScheduledNotificationProcessor.findNotificationOrWait(
> ScheduledNotificationManager.java:327)
>         - locked <0x0000000768378fc8> (a java.util.PriorityQueue)
>         at
> com.ebay.kernel.schedulednotify.ScheduledNotificationManager$
> ScheduledNotificationProcessor.run(ScheduledNotificationManager.java:337)
>         at java.lang.Thread.run(Thread.java:745)
>
> "com.ebay.kernel.schedulednotification.Default_1501278254061 - 0" #152
> daemon prio=5 os_prio=0 tid=0x0000000002bf9800 nid=0xd88 in Object.wait()
> [0x00007f859a229000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> com.ebay.kernel.util.threadpool.ThreadPoolWorker.
> waitForWork(ThreadPoolWorker.java:428)
>         - locked <0x000000079c399440> (a java.lang.Object)
>         at
> com.ebay.kernel.util.threadpool.ThreadPoolWorker.
> runInt(ThreadPoolWorker.java:341)
>         at
> com.ebay.kernel.util.threadpool.ThreadPoolWorker.
> run(ThreadPoolWorker.java:293)
>
> "DefaultThreadPool-1" #151 daemon prio=5 os_prio=0 tid=0x00000000028d3000
> nid=0xd7d waiting on condition [0x00007f8594ee7000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000784d07040> (a
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicUpdateFuture)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:161)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:119)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.tryGetAndPut(GridDhtAtomicCache.java:718)
>         at
> org.apache.ignite.internal.MarshallerContextImpl.registerClassName(
> MarshallerContextImpl.java:160)
>         at
> org.apache.ignite.internal.MarshallerContextAdapter.registerClass(
> MarshallerContextAdapter.java:157)
>         at
> org.apache.ignite.internal.binary.BinaryContext.
> registerUserClassDescriptor(BinaryContext.java:770)
>         at
> org.apache.ignite.internal.binary.BinaryContext.registerClassDescriptor(
> BinaryContext.java:747)
>         at
> org.apache.ignite.internal.binary.BinaryContext.descriptorForClass(
> BinaryContext.java:619)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal0(BinaryWriterExImpl.java:164)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:147)
>         at
> org.apache.ignite.internal.binary.BinaryWriterExImpl.
> marshal(BinaryWriterExImpl.java:134)
>         at
> org.apache.ignite.internal.binary.GridBinaryMarshaller.
> marshal(GridBinaryMarshaller.java:239)
>         at
> org.apache.ignite.internal.binary.BinaryMarshaller.
> marshal0(BinaryMarshaller.java:82)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(
> AbstractNodeNameAwareMarshaller.java:58)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9902)
>         at
> org.apache.ignite.internal.util.IgniteUtils.marshal(IgniteUtils.java:9966)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:850)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(
> GridCacheUtils.java:823)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateInvokeRequest.prepareMarshal(
> GridNearAtomicSingleUpdateInvokeRequest.java:209)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.onSend(
> GridCacheIoManager.java:876)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:898)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(
> GridCacheIoManager.java:1059)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.mapSingle(
> GridNearAtomicAbstractUpdateFuture.java:272)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.map(GridNearAtomicSingleUpdateFutu
> re.java:494)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicSingleUpdateFuture.mapOnTopology(
> GridNearAtomicSingleUpdateFuture.java:436)
>         at
> org.apache.ignite.internal.processors.cache.distributed.dht.atomic.
> GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFu
> ture.java:208)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.update0(GridDhtAtomicCache.java:1236)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke0(GridDhtAtomicCache.java:937)
>         at
> org.apache.ignite.internal.processors.cache.distributed.
> dht.atomic.GridDhtAtomicCache.invoke(GridDhtAtomicCache.java:894)
>         at
> org.apache.ignite.internal.processors.cache.IgniteCacheProxy.invoke(
> IgniteCacheProxy.java:1770)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler$
> QueryAnalyzerService.getRequestCachePolicy(QueryAnalyzerHandler.java:157)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.<init>(
> QueryAnalyzerHandler.java:60)
>         at
> com.paypal.sherlock.apisvc.handler.analyzer.QueryAnalyzerHandler.from(
> QueryAnalyzerHandler.java:54)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.
> setupPipeline(MetricTimeseriesResourceImpl.java:322)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.runPipeline(
> MetricTimeseriesResourceImpl.java:186)
>         at
> com.paypal.sherlock.apisvc.impl.MetricTimeseriesResourceImpl.getData(
> MetricTimeseriesResourceImpl.java:89)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at
> org.jboss.resteasy.core.MethodInjectorImpl.invoke(
> MethodInjectorImpl.java:139)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(
> ResourceMethodInvoker.java:295)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:249)
>         at
> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(
> ResourceMethodInvoker.java:236)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:395)
>         at
> org.jboss.resteasy.core.SynchronousDispatcher.invoke(
> SynchronousDispatcher.java:202)
>         at
> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.
> service(ServletContainerDispatcher.java:221)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:56)
>         at
> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(
> HttpServletDispatcher.java:51)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:292)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.CoreContextFilter.
> doFilter(CoreContextFilter.java:75)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.filters.SSLApplicationFilter.
> doFilter(SSLApplicationFilter.java:64)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> com.paypal.platform.service.rest.logging.OuterTransactionCalFilter.
> doFilter(OuterTransactionCalFilter.java:140)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(
> RequestContextFilter.java:99)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(
> HttpPutFormContentFilter.java:87)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(
> HiddenHttpMethodFilter.java:77)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(
> CharacterEncodingFilter.java:121)
>         at
> org.springframework.web.filter.OncePerRequestFilter.
> doFilter(OncePerRequestFilter.java:107)
>         at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:240)
>         at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:207)
>         at
> org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:212)
>         at
> org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:106)
>         at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:502)
>         at
> org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:141)
>         at
> org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:79)
>         at
> org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:88)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:522)
>         at
> org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1095)
>         at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:672)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> doRun(NioEndpoint.java:1500)
>         at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.
> run(NioEndpoint.java:1456)
>         - locked <0x00000007a05c9de8> (a
> org.apache.tomcat.util.net.SecureNioChannel)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:745)
>
> "http-nio-23368-Acceptor-0" #148 daemon prio=5 os_prio=0
> tid=0x00007f85a59d5000 nid=0xd7b runnable [0x00007f8594feb000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at
> sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:
> 422)
>         at
> sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:
> 250)
>         - locked <0x00000007a10a0a50> (a java.lang.Object)
>         at
> org.apache.tomcat.util.net.NioEndpoint$Acceptor.run(NioEndpoint.java:682)
>         at java.lang.Thread.run(Thread.java:745)
>
> "http-nio-23368-ClientPoller-1" #147 daemon prio=5 os_prio=0
> tid=0x00007f85a59d3000 nid=0xd7a runnable [0x00007f85950ec000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007a06a77b0> (a sun.nio.ch.Util$2)
>         - locked <0x00000007a06a77a0> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007a06a7688> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at org.apache.tomcat.util.net.NioEndpoint$Poller.run(
> NioEndpoint.java:1034)
>         at java.lang.Thread.run(Thread.java:745)
>
> "http-nio-23368-ClientPoller-0" #146 daemon prio=5 os_prio=0
> tid=0x00007f85a59d1800 nid=0xd79 runnable [0x00007f85951ed000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007a0696d40> (a sun.nio.ch.Util$2)
>         - locked <0x00000007a0696d30> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007a0696c18> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at org.apache.tomcat.util.net.NioEndpoint$Poller.run(
> NioEndpoint.java:1034)
>         at java.lang.Thread.run(Thread.java:745)
>
> "NioBlockingSelector.BlockPoller-3" #145 daemon prio=5 os_prio=0
> tid=0x00007f85a5819800 nid=0xd78 runnable [0x00007f85952ee000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007a06855e8> (a sun.nio.ch.Util$2)
>         - locked <0x00000007a06855d8> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007a06854c0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.tomcat.util.net.NioBlockingSelector$BlockPoller.run(
> NioBlockingSelector.java:342)
>
> "http-nio-23363-Acceptor-0" #144 daemon prio=5 os_prio=0
> tid=0x00007f85a4a83800 nid=0xd77 runnable [0x00007f85953ef000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at
> sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:
> 422)
>         at
> sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:
> 250)
>         - locked <0x00000007a1069cf0> (a java.lang.Object)
>         at
> org.apache.tomcat.util.net.NioEndpoint$Acceptor.run(NioEndpoint.java:682)
>         at java.lang.Thread.run(Thread.java:745)
>
> "http-nio-23363-ClientPoller-1" #143 daemon prio=5 os_prio=0
> tid=0x00007f85a4a82000 nid=0xd76 runnable [0x00007f85954f0000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007a108c1c0> (a sun.nio.ch.Util$2)
>         - locked <0x00000007a108c1b0> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007a108c098> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at org.apache.tomcat.util.net.NioEndpoint$Poller.run(
> NioEndpoint.java:1034)
>         at java.lang.Thread.run(Thread.java:745)
>
> "http-nio-23363-ClientPoller-0" #142 daemon prio=5 os_prio=0
> tid=0x00007f85a4a80000 nid=0xd75 runnable [0x00007f85955f1000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007a107b750> (a sun.nio.ch.Util$2)
>         - locked <0x00000007a107b740> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007a107b628> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at org.apache.tomcat.util.net.NioEndpoint$Poller.run(
> NioEndpoint.java:1034)
>         at java.lang.Thread.run(Thread.java:745)
>
> "NioBlockingSelector.BlockPoller-2" #141 daemon prio=5 os_prio=0
> tid=0x00007f85a4a7e800 nid=0xd74 runnable [0x00007f85956f2000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007a1069ff8> (a sun.nio.ch.Util$2)
>         - locked <0x00000007a1069fe8> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007a1069ed0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.tomcat.util.net.NioBlockingSelector$BlockPoller.run(
> NioBlockingSelector.java:342)
>
> "http-nio-23362-Acceptor-0" #140 daemon prio=5 os_prio=0
> tid=0x00007f85a5812000 nid=0xd73 runnable [0x00007f85957f3000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at
> sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:
> 422)
>         at
> sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:
> 250)
>         - locked <0x00000007a1395358> (a java.lang.Object)
>         at
> org.apache.tomcat.util.net.NioEndpoint$Acceptor.run(NioEndpoint.java:682)
>         at java.lang.Thread.run(Thread.java:745)
>
> "http-nio-23362-ClientPoller-1" #139 daemon prio=5 os_prio=0
> tid=0x00007f85a5810000 nid=0xd72 runnable [0x00007f85958f4000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007a1038838> (a sun.nio.ch.Util$2)
>         - locked <0x00000007a1038828> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007a1038710> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at org.apache.tomcat.util.net.NioEndpoint$Poller.run(
> NioEndpoint.java:1034)
>         at java.lang.Thread.run(Thread.java:745)
>
> "http-nio-23362-ClientPoller-0" #138 daemon prio=5 os_prio=0
> tid=0x00007f85a580e800 nid=0xd71 runnable [0x00007f85959f5000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007a1027d80> (a sun.nio.ch.Util$2)
>         - locked <0x00000007a1027d70> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007a1027c58> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at org.apache.tomcat.util.net.NioEndpoint$Poller.run(
> NioEndpoint.java:1034)
>         at java.lang.Thread.run(Thread.java:745)
>
> "NioBlockingSelector.BlockPoller-1" #137 daemon prio=5 os_prio=0
> tid=0x00007f85a580d000 nid=0xd70 runnable [0x00007f8595ff7000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007a1395660> (a sun.nio.ch.Util$2)
>         - locked <0x00000007a1395650> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007a1395538> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.tomcat.util.net.NioBlockingSelector$BlockPoller.run(
> NioBlockingSelector.java:342)
>
> "pool-4-thread-1" #136 prio=5 os_prio=0 tid=0x00007f85a54f3800 nid=0xd6f
> waiting on condition [0x00007f8595ef6000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> io.netty.util.HashedWheelTimer$Worker.waitForNextTick(
> HashedWheelTimer.java:461)
>         at io.netty.util.HashedWheelTimer$Worker.run(
> HashedWheelTimer.java:360)
>         at java.lang.Thread.run(Thread.java:745)
>
> "metrics-com.paypal.sherlock.apisvc.metrics.groups.APIHandlerMetrics-
> SherlockReporter-thread-1"
> #126 daemon prio=5 os_prio=0 tid=0x00007f85a50fd800 nid=0xd6d waiting on
> condition [0x00007f85960f8000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007accf0710> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "metrics-com.paypal.sherlock.apisvc.metrics.groups.CacheMetricGroup-
> SherlockReporter-thread-1"
> #125 daemon prio=5 os_prio=0 tid=0x00007f85a50fc000 nid=0xd6c waiting on
> condition [0x00007f85961f9000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007accd9b38> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "session-timeout-worker-#21%null%" #107 daemon prio=5 os_prio=0
> tid=0x00007f85b5a2c800 nid=0xd6b waiting on condition [0x00007f85962fa000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.processors.rest.GridRestProcessor$4.body(
> GridRestProcessor.java:421)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:745)
>
> "exchange-worker-#26%null%" #118 daemon prio=5 os_prio=0
> tid=0x00007f85b5d29000 nid=0xd65 waiting on condition [0x00007f8596900000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b5a5ab18> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingDeque.pollFirst(
> LinkedBlockingDeque.java:522)
>         at
> java.util.concurrent.LinkedBlockingDeque.poll(
> LinkedBlockingDeque.java:684)
>         at
> org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeMana
> ger.poll(GridCachePartitionExchangeManager.java:1564)
>         at
> org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeMana
> ger.access$1900(GridCachePartitionExchangeManager.java:116)
>         at
> org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeMana
> ger$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1655)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:745)
>
> "grid-time-server-reader-#25%null%" #117 daemon prio=10 os_prio=0
> tid=0x0000000002bbd000 nid=0xd64 runnable [0x00007f8596c01000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.PlainDatagramSocketImpl.receive0(Native Method)
>         - locked <0x00000007b75573c0> (a java.net.PlainDatagramSocketImpl)
>         at
> java.net.AbstractPlainDatagramSocketImpl.receive(
> AbstractPlainDatagramSocketImpl.java:144)
>         - locked <0x00000007b75573c0> (a java.net.PlainDatagramSocketImpl)
>         at java.net.DatagramSocket.receive(DatagramSocket.java:812)
>         - locked <0x00000007af400920> (a java.net.DatagramPacket)
>         - locked <0x00000007b7556418> (a java.net.DatagramSocket)
>         at
> org.apache.ignite.internal.processors.clock.GridClockServer$ReadWorker.
> body(GridClockServer.java:200)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:745)
>
> "ignite-update-notifier-timer" #116 daemon prio=5 os_prio=0
> tid=0x00007f85b5c07800 nid=0xd63 in Object.wait() [0x00007f8596d02000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000007afa84cf0> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "upd-ver-checker" #114 daemon prio=5 os_prio=0 tid=0x00007f85a4be4000
> nid=0xd61 waiting on condition [0x00007f8596f04000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.processors.cluster.GridUpdateNotifier$1.run(
> GridUpdateNotifier.java:144)
>         at java.lang.Thread.run(Thread.java:745)
>
> "disco-event-worker-#23%null%" #113 daemon prio=5 os_prio=0
> tid=0x0000000003cda800 nid=0xd60 waiting on condition [0x00007f8597005000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b74d0230> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$
> DiscoveryWorker.body0(GridDiscoveryManager.java:2131)
>         at
> org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$
> DiscoveryWorker.body(GridDiscoveryManager.java:2113)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:745)
>
> "tcp-client-disco-msg-worker-#4%null%" #112 daemon prio=5 os_prio=0
> tid=0x0000000003026000 nid=0xd5f waiting on condition [0x00007f8597306000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b4e78190> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingDeque.takeFirst(
> LinkedBlockingDeque.java:492)
>         at
> java.util.concurrent.LinkedBlockingDeque.take(
> LinkedBlockingDeque.java:680)
>         at
> org.apache.ignite.spi.discovery.tcp.ClientImpl$
> MessageWorker.body(ClientImpl.java:1359)
>         at org.apache.ignite.spi.IgniteSpiThread.run(
> IgniteSpiThread.java:62)
>
> "tcp-client-disco-sock-reader-#3%null%" #111 daemon prio=5 os_prio=0
> tid=0x0000000003019000 nid=0xd5e runnable [0x00007f8597407000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:170)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
>         - locked <0x00000007b4dba720> (a java.io.BufferedInputStream)
>         at
> org.apache.ignite.marshaller.jdk.JdkMarshallerInputStreamWrapper.read(
> JdkMarshallerInputStreamWrapper.java:53)
>         at
> java.io.ObjectInputStream$PeekInputStream.read(
> ObjectInputStream.java:2320)
>         at
> java.io.ObjectInputStream$PeekInputStream.readFully(
> ObjectInputStream.java:2333)
>         at
> java.io.ObjectInputStream$BlockDataInputStream.
> readShort(ObjectInputStream.java:2804)
>         at java.io.ObjectInputStream.readStreamHeader(
> ObjectInputStream.java:802)
>         at java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
>         at
> org.apache.ignite.marshaller.jdk.JdkMarshallerObjectInputStream.<init>(
> JdkMarshallerObjectInputStream.java:39)
>         at
> org.apache.ignite.marshaller.jdk.JdkMarshaller.unmarshal0(
> JdkMarshaller.java:117)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.unmarshal(
> AbstractNodeNameAwareMarshaller.java:94)
>         at
> org.apache.ignite.internal.util.IgniteUtils.unmarshal(
> IgniteUtils.java:9765)
>         at
> org.apache.ignite.spi.discovery.tcp.ClientImpl$
> SocketReader.body(ClientImpl.java:911)
>         at org.apache.ignite.spi.IgniteSpiThread.run(
> IgniteSpiThread.java:62)
>
> "tcp-client-disco-sock-writer-#2%null%" #110 daemon prio=5 os_prio=0
> tid=0x0000000003017800 nid=0xd5d in Object.wait() [0x00007f8597508000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.Object.wait(Object.java:502)
>         at
> org.apache.ignite.spi.discovery.tcp.ClientImpl$
> SocketWriter.body(ClientImpl.java:1075)
>         - locked <0x00000007b4e34258> (a java.lang.Object)
>         at org.apache.ignite.spi.IgniteSpiThread.run(
> IgniteSpiThread.java:62)
>
> "TcpDiscoverySpi.timer" #109 daemon prio=5 os_prio=0 tid=0x0000000003014000
> nid=0xd5c in Object.wait() [0x00007f8597609000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000007b507d380> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "grid-data-loader-flusher-#22%null%" #108 daemon prio=5 os_prio=0
> tid=0x00000000021ff800 nid=0xd5b waiting on condition [0x00007f859770a000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b593cb30> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
>         at
> org.apache.ignite.internal.processors.datastreamer.
> DataStreamProcessor$2.body(DataStreamProcessor.java:104)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:745)
>
> "tcp-comm-worker-#1%null%" #106 daemon prio=5 os_prio=0
> tid=0x0000000003660800 nid=0xd5a waiting on condition [0x00007f8597a0b000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007b8196a48> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$
> CommunicationWorker.body(TcpCommunicationSpi.java:3591)
>         at org.apache.ignite.spi.IgniteSpiThread.run(
> IgniteSpiThread.java:62)
>
> "grid-nio-worker-tcp-comm-3-#20%null%" #100 prio=5 os_prio=0
> tid=0x000000000365f800 nid=0xd59 runnable [0x00007f8597e0f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007b8123440> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000007b81131e8> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007b81130d0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:1858)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1568)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:745)
>
> "grid-nio-worker-tcp-comm-2-#19%null%" #99 prio=5 os_prio=0
> tid=0x00000000038d5000 nid=0xd58 runnable [0x00007f8597d0e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007b81108b8> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000007b80fe040> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007b80fdf28> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:1858)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1568)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:745)
>
> "grid-nio-worker-tcp-comm-1-#18%null%" #98 prio=5 os_prio=0
> tid=0x00000000038d4000 nid=0xd57 runnable [0x00007f8597f10000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007b80fb710> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000007b80eb4b8> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007b80eb3a0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:1858)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1568)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:745)
>
> "grid-nio-worker-tcp-comm-0-#17%null%" #97 prio=5 os_prio=0
> tid=0x00000000038d3800 nid=0xd56 runnable [0x00007f8597c0d000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007b80e8b88> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000007b80cc268> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007b80cc150> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:1858)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1568)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:745)
>
> "nio-acceptor-#16%null%" #96 daemon prio=5 os_prio=0 tid=0x00000000033e9800
> nid=0xd55 runnable [0x00007f8597b0c000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007b80ba548> (a sun.nio.ch.Util$2)
>         - locked <0x00000007b80ba538> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x00000007b80ba420> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.accept(GridNioServer.java:2438)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.body(GridNioServer.java:2410)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:745)
>
> "grid-timeout-worker-#15%null%" #95 daemon prio=5 os_prio=0
> tid=0x00007f85b5bba800 nid=0xd4f in Object.wait() [0x00007f8598211000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$
> TimeoutWorker.body(GridTimeoutProcessor.java:184)
>         - locked <0x00000007b87f1740> (a java.lang.Object)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:745)
>
> "ignite-clock" #94 daemon prio=10 os_prio=0 tid=0x00007f85b62fd000
> nid=0xd4e
> waiting on condition [0x00007f8598312000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.util.IgniteUtils$22.run(IgniteUtils.java:3221)
>         at java.lang.Thread.run(Thread.java:745)
>
> "sys-stripe-7-#8%null%" #87 daemon prio=5 os_prio=0 tid=0x00007f85b5840800
> nid=0xd47 waiting on condition [0x00007f8598a19000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:526)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:422)
>         at java.lang.Thread.run(Thread.java:745)
>
> "sys-stripe-6-#7%null%" #86 daemon prio=5 os_prio=0 tid=0x00007f85b54d5800
> nid=0xd46 waiting on condition [0x00007f8598b1a000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:526)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:422)
>         at java.lang.Thread.run(Thread.java:745)
>
> "sys-stripe-5-#6%null%" #85 daemon prio=5 os_prio=0 tid=0x00007f85b54d3800
> nid=0xd45 waiting on condition [0x00007f8598c1b000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:526)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:422)
>         at java.lang.Thread.run(Thread.java:745)
>
> "sys-stripe-4-#5%null%" #84 daemon prio=5 os_prio=0 tid=0x00007f85b5eec800
> nid=0xd44 waiting on condition [0x00007f8598d1c000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:526)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:422)
>         at java.lang.Thread.run(Thread.java:745)
>
> "sys-stripe-3-#4%null%" #83 daemon prio=5 os_prio=0 tid=0x00007f85b5eea800
> nid=0xd43 waiting on condition [0x00007f8598e1d000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:526)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:422)
>         at java.lang.Thread.run(Thread.java:745)
>
> "sys-stripe-2-#3%null%" #82 daemon prio=5 os_prio=0 tid=0x00007f85b5ee9800
> nid=0xd42 waiting on condition [0x00007f8598f1e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:526)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:422)
>         at java.lang.Thread.run(Thread.java:745)
>
> "sys-stripe-1-#2%null%" #81 daemon prio=5 os_prio=0 tid=0x00007f85b6ad7000
> nid=0xd41 waiting on condition [0x00007f859901f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:526)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:422)
>         at java.lang.Thread.run(Thread.java:745)
>
> "sys-stripe-0-#1%null%" #80 daemon prio=5 os_prio=0 tid=0x00007f85b69b2000
> nid=0xd40 waiting on condition [0x00007f8599120000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:526)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:422)
>         at java.lang.Thread.run(Thread.java:745)
>
> "RxCachedWorkerPoolEvictor-1" #78 daemon prio=5 os_prio=0
> tid=0x0000000001fee000 nid=0xd3e waiting on condition [0x00007f8599522000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007bbfd58c8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "global-client-idle-conn-cleanup-scheduler-3-1" #77 daemon prio=5
> os_prio=0
> tid=0x00000000032fb000 nid=0xd3d waiting on condition [0x00007f8599623000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000007bc71b1d0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> io.netty.util.concurrent.DefaultThreadFactory$
> DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
>         at java.lang.Thread.run(Thread.java:745)
>
> "container-0" #71 prio=5 os_prio=0 tid=0x00007f85b6722800 nid=0xd3c waiting
> on condition [0x00007f8599924000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at org.apache.catalina.core.StandardServer.await(
> StandardServer.java:407)
>         at
> org.springframework.boot.context.embedded.tomcat.
> TomcatEmbeddedServletContainer$1.run(TomcatEmbeddedServletContainer
> .java:140)
>
> "ContainerBackgroundProcessor[StandardEngine[Tomcat].
> StandardHost[localhost].StandardContext[]]"
> #70 daemon prio=5 os_prio=0 tid=0x00007f85b6546000 nid=0xd3b waiting on
> condition [0x00007f8599a25000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.
> run(ContainerBase.java:1344)
>         at java.lang.Thread.run(Thread.java:745)
>
> "nioEventLoopGroup-2-1" #26 prio=10 os_prio=0 tid=0x00007f85b6721800
> nid=0xd3a runnable [0x00007f8599b26000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000007686358d0> (a
> io.netty.channel.nio.SelectedSelectionKeySet)
>         - locked <0x0000000768637950> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x0000000768635838> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:622)
>         at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:310)
>         at
> io.netty.util.concurrent.SingleThreadEventExecutor$2.
> run(SingleThreadEventExecutor.java:112)
>         at
> io.netty.util.concurrent.DefaultThreadFactory$
> DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
>         at java.lang.Thread.run(Thread.java:745)
>
> "com.ebay.kernel.bean.configuration.PropertyChangeSupport-4" #68 daemon
> prio=5 os_prio=0 tid=0x00007f85b64c8000 nid=0xd38 waiting on condition
> [0x00007f8599e27000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f006c8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "Timer-1" #65 daemon prio=5 os_prio=0 tid=0x0000000003a6b800 nid=0xd35 in
> Object.wait() [0x00007f859a52a000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x0000000769d1b4d8> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "DynamicConfiguration" #64 daemon prio=5 os_prio=0 tid=0x0000000003a61800
> nid=0xd34 waiting on condition [0x00007f859a62b000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f02bf0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "Timer-0" #62 prio=5 os_prio=0 tid=0x00007f85b5291800 nid=0xd32 in
> Object.wait() [0x00007f859b4c6000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x0000000769d1bac8> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "threadDeathWatcher-4-1" #61 daemon prio=1 os_prio=0 tid=0x00007f85a5042000
> nid=0xd31 waiting on condition [0x00007f859c5c8000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.ebayopensource.sherlock.client.common.netty.util.
> ThreadDeathWatcher$Watcher.run(ThreadDeathWatcher.java:137)
>         at
> org.ebayopensource.sherlock.client.common.netty.util.concurrent.
> DefaultThreadFactory$DefaultRunnableDecorator.run(
> DefaultThreadFactory.java:137)
>         at java.lang.Thread.run(Thread.java:745)
>
> "com.ebay.kernel.bean.configuration.PropertyChangeSupport-3" #60 daemon
> prio=5 os_prio=0 tid=0x00007f85b5405000 nid=0xd30 waiting on condition
> [0x00007f859c6c9000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f006c8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "com.ebay.kernel.bean.configuration.PropertyChangeSupport-2" #59 daemon
> prio=5 os_prio=0 tid=0x00007f85b5fa0800 nid=0xd2f waiting on condition
> [0x00007f859c7ca000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f006c8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "Sherlock-Nio-Worker-1-1" #56 prio=5 os_prio=0 tid=0x0000000002e20800
> nid=0xd2e runnable [0x00007f859cacb000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x0000000769f024e0> (a
> org.ebayopensource.sherlock.client.common.netty.channel.
> nio.SelectedSelectionKeySet)
>         - locked <0x0000000769f02500> (a java.util.Collections$
> UnmodifiableSet)
>         - locked <0x0000000769f02498> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.ebayopensource.sherlock.client.common.netty.channel.
> nio.NioEventLoop.select(NioEventLoop.java:622)
>         at
> org.ebayopensource.sherlock.client.common.netty.channel.
> nio.NioEventLoop.run(NioEventLoop.java:310)
>         at
> org.ebayopensource.sherlock.client.common.netty.util.concurrent.
> SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
>         at
> org.ebayopensource.sherlock.client.common.netty.util.concurrent.
> DefaultThreadFactory$DefaultRunnableDecorator.run(
> DefaultThreadFactory.java:137)
>         at java.lang.Thread.run(Thread.java:745)
>
> "Sherlock-Worker-3-1" #57 prio=5 os_prio=0 tid=0x0000000002df6800 nid=0xd2c
> waiting on condition [0x00007f859cbcc000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f02720> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at
> org.ebayopensource.sherlock.client.common.netty.util.concurrent.
> DefaultThreadFactory$DefaultRunnableDecorator.run(
> DefaultThreadFactory.java:137)
>         at java.lang.Thread.run(Thread.java:745)
>
> "metrics-PerfMonReporter-SherlockReporter-thread-1" #55 daemon prio=5
> os_prio=0 tid=0x000000000237f000 nid=0xd2b waiting on condition
> [0x00007f859cecd000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f02990> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DynamicConfiguration" #54 daemon prio=5 os_prio=0 tid=0x0000000002379800
> nid=0xd2a waiting on condition [0x00007f859cfce000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f02bf0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1088)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "AeroPerfmonCollectTimer" #53 daemon prio=5 os_prio=0
> tid=0x00007f85a54f9800
> nid=0xd29 in Object.wait() [0x00007f859d0cf000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x0000000769f02e58> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "nanny-1" #52 daemon prio=5 os_prio=0 tid=0x00000000024f7800 nid=0xd28
> waiting on condition [0x00007f859d1d0000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f03030> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1081)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "com.ebay.kernel.bean.configuration.PropertyChangeSupport-1" #51 daemon
> prio=5 os_prio=0 tid=0x00007f85a54f8800 nid=0xd27 waiting on condition
> [0x00007f859d2d1000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f006c8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "ScheduledNotificationProcessor" #50 daemon prio=5 os_prio=0
> tid=0x00007f85a4359000 nid=0xd26 in Object.wait() [0x00007f859d3d2000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> com.ebay.kernel.schedulednotify.ScheduledNotificationManager$
> ScheduledNotificationProcessor.findNotificationOrWait(
> ScheduledNotificationManager.java:327)
>         - locked <0x0000000769f03458> (a java.util.PriorityQueue)
>         at
> com.ebay.kernel.schedulednotify.ScheduledNotificationManager$
> ScheduledNotificationProcessor.run(ScheduledNotificationManager.java:337)
>         at java.lang.Thread.run(Thread.java:745)
>
> "CAL_channel_flusher-5" #49 daemon prio=5 os_prio=0 tid=0x00007f85a5517800
> nid=0xd25 in Object.wait() [0x00007f859d4d3000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x0000000769f03608> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "CalQosThread-4-4" #48 daemon prio=5 os_prio=0 tid=0x00007f85a5311000
> nid=0xd24 waiting on condition [0x00007f859d5d4000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f03820> (a
> java.util.concurrent.Semaphore$NonfairSync)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at java.util.concurrent.Semaphore.acquire(Semaphore.java:312)
>         at
> com.ebay.kernel.cal.java.qos.CalQosThread.runInternal(
> CalQosThread.java:88)
>         at com.ebay.kernel.cal.java.qos.CalQosThread.run(CalQosThread.
> java:73)
>
> "CalClientMetricsThread-4-4" #47 daemon prio=5 os_prio=0
> tid=0x00007f85a530f000 nid=0xd23 waiting on condition [0x00007f859d6d5000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f03ac0> (a
> java.util.concurrent.Semaphore$NonfairSync)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
>         at java.util.concurrent.Semaphore.tryAcquire(Semaphore.java:409)
>         at
> com.ebay.kernel.cal.java.metrics.CalClientMetricsThread.runInternal(
> CalClientMetricsThread.java:95)
>         at
> com.ebay.kernel.cal.java.metrics.CalClientMetricsThread.run(
> CalClientMetricsThread.java:82)
>
> "CAL_channel_flusher-4" #46 daemon prio=5 os_prio=0 tid=0x00007f85a530d000
> nid=0xd22 in Object.wait() [0x00007f859d7d6000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x0000000769f03cf8> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "CalQosThread-3-3" #45 daemon prio=5 os_prio=0 tid=0x00007f85a5065800
> nid=0xd21 waiting on condition [0x00007f859d8d7000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f03f10> (a
> java.util.concurrent.Semaphore$NonfairSync)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at java.util.concurrent.Semaphore.acquire(Semaphore.java:312)
>         at
> com.ebay.kernel.cal.java.qos.CalQosThread.runInternal(
> CalQosThread.java:88)
>         at com.ebay.kernel.cal.java.qos.CalQosThread.run(CalQosThread.
> java:73)
>
> "CalClientMetricsThread-3-3" #44 daemon prio=5 os_prio=0
> tid=0x00007f85a5063800 nid=0xd20 waiting on condition [0x00007f859d9d8000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f041b0> (a
> java.util.concurrent.Semaphore$NonfairSync)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
>         at java.util.concurrent.Semaphore.tryAcquire(Semaphore.java:409)
>         at
> com.ebay.kernel.cal.java.metrics.CalClientMetricsThread.runInternal(
> CalClientMetricsThread.java:95)
>         at
> com.ebay.kernel.cal.java.metrics.CalClientMetricsThread.run(
> CalClientMetricsThread.java:82)
>
> "CAL_channel_flusher-3" #43 daemon prio=5 os_prio=0 tid=0x00007f85a5061800
> nid=0xd1f in Object.wait() [0x00007f859dad9000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x0000000769f043d0> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "CalQosThread-2-2" #42 daemon prio=5 os_prio=0 tid=0x00007f85a5060000
> nid=0xd1e waiting on condition [0x00007f859dbda000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f045e8> (a
> java.util.concurrent.Semaphore$NonfairSync)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at java.util.concurrent.Semaphore.acquire(Semaphore.java:312)
>         at
> com.ebay.kernel.cal.java.qos.CalQosThread.runInternal(
> CalQosThread.java:88)
>         at com.ebay.kernel.cal.java.qos.CalQosThread.run(CalQosThread.
> java:73)
>
> "CalClientMetricsThread-2-2" #41 daemon prio=5 os_prio=0
> tid=0x00007f85a5909000 nid=0xd1d waiting on condition [0x00007f859dcdb000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f04888> (a
> java.util.concurrent.Semaphore$NonfairSync)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
>         at java.util.concurrent.Semaphore.tryAcquire(Semaphore.java:409)
>         at
> com.ebay.kernel.cal.java.metrics.CalClientMetricsThread.runInternal(
> CalClientMetricsThread.java:95)
>         at
> com.ebay.kernel.cal.java.metrics.CalClientMetricsThread.run(
> CalClientMetricsThread.java:82)
>
> "CAL_channel_flusher-2" #40 daemon prio=5 os_prio=0 tid=0x00007f85a5907000
> nid=0xd1c in Object.wait() [0x00007f859dddc000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x0000000769f04aa8> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "CalQosThread-1-1" #39 daemon prio=5 os_prio=0 tid=0x00007f85a5905000
> nid=0xd1b waiting on condition [0x00007f859dedd000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f04cc0> (a
> java.util.concurrent.Semaphore$NonfairSync)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at java.util.concurrent.Semaphore.acquire(Semaphore.java:312)
>         at
> com.ebay.kernel.cal.java.qos.CalQosThread.runInternal(
> CalQosThread.java:88)
>         at com.ebay.kernel.cal.java.qos.CalQosThread.run(CalQosThread.
> java:73)
>
> "CalClientMetricsThread-1-1" #38 daemon prio=5 os_prio=0
> tid=0x00007f85a511d800 nid=0xd1a waiting on condition [0x00007f859dfde000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f04f60> (a
> java.util.concurrent.Semaphore$NonfairSync)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
>         at java.util.concurrent.Semaphore.tryAcquire(Semaphore.java:409)
>         at
> com.ebay.kernel.cal.java.metrics.CalClientMetricsThread.runInternal(
> CalClientMetricsThread.java:95)
>         at
> com.ebay.kernel.cal.java.metrics.CalClientMetricsThread.run(
> CalClientMetricsThread.java:82)
>
> "CAL_channel_flusher-1" #37 daemon prio=5 os_prio=0 tid=0x00007f85a497f000
> nid=0xd19 in Object.wait() [0x00007f859e0df000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x0000000769f05180> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "CalQosThread-0-0" #36 daemon prio=5 os_prio=0 tid=0x00007f85a4981000
> nid=0xd18 waiting on condition [0x00007f859e1e0000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f05398> (a
> java.util.concurrent.Semaphore$NonfairSync)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at java.util.concurrent.Semaphore.acquire(Semaphore.java:312)
>         at
> com.ebay.kernel.cal.java.qos.CalQosThread.runInternal(
> CalQosThread.java:88)
>         at com.ebay.kernel.cal.java.qos.CalQosThread.run(CalQosThread.
> java:73)
>
> "CalClientMetricsThread-0-0" #35 daemon prio=5 os_prio=0
> tid=0x0000000002b1c000 nid=0xd17 waiting on condition [0x00007f85a05eb000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f05638> (a
> java.util.concurrent.Semaphore$NonfairSync)
>         at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
>         at java.util.concurrent.Semaphore.tryAcquire(Semaphore.java:409)
>         at
> com.ebay.kernel.cal.java.metrics.CalClientMetricsThread.runInternal(
> CalClientMetricsThread.java:95)
>         at
> com.ebay.kernel.cal.java.metrics.CalClientMetricsThread.run(
> CalClientMetricsThread.java:82)
>
> "pool-1-thread-1" #34 prio=5 os_prio=0 tid=0x00007f85a482e800 nid=0xd0e
> waiting on condition [0x00007f85a09ed000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> io.netty.util.HashedWheelTimer$Worker.waitForNextTick(
> HashedWheelTimer.java:461)
>         at io.netty.util.HashedWheelTimer$Worker.run(
> HashedWheelTimer.java:360)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DynamicConfiguration" #25 daemon prio=5 os_prio=0 tid=0x00007f85a46a5800
> nid=0xd0b waiting on condition [0x00007f859ece1000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f02bf0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1088)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DynamicConfiguration" #24 daemon prio=5 os_prio=0 tid=0x00007f85a4697000
> nid=0xd0a waiting on condition [0x00007f859ede2000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f02bf0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1088)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DynamicConfiguration" #23 daemon prio=5 os_prio=0 tid=0x00007f85a4694000
> nid=0xd09 waiting on condition [0x00007f85a03e9000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000769f02bf0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1088)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
>
> "DestroyJavaVM" #18 prio=5 os_prio=0 tid=0x00007f85b58d2800 nid=0xcdc
> waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "Wrapper-Connection" #17 daemon prio=10 os_prio=0 tid=0x00007f85b58d0000
> nid=0xcfc runnable [0x00007f85a06ec000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:170)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.net.SocketInputStream.read(SocketInputStream.java:223)
>         at java.io.DataInputStream.readByte(DataInputStream.java:265)
>         at
> org.tanukisoftware.wrapper.WrapperManager.handleBackend(
> WrapperManager.java:5373)
>         at org.tanukisoftware.wrapper.WrapperManager.run(
> WrapperManager.java:5752)
>         at java.lang.Thread.run(Thread.java:745)
>
> "Wrapper-Control-Event-Monitor" #15 daemon prio=5 os_prio=0
> tid=0x00007f85b57f1000 nid=0xcfa sleeping[0x00007f85a0aee000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.tanukisoftware.wrapper.WrapperManager$3.run(WrapperManager.java:1035)
>
> "RMI TCP Accept-0" #13 daemon prio=5 os_prio=0 tid=0x00007f85b573d800
> nid=0xcf8 runnable [0x00007f85a0efc000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.PlainSocketImpl.socketAccept(Native Method)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(
> LocalRMIServerSocketFactory.java:52)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(
> TCPTransport.java:400)
>         at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(
> TCPTransport.java:372)
>         at java.lang.Thread.run(Thread.java:745)
>
> "RMI TCP Accept-23365" #12 daemon prio=5 os_prio=0 tid=0x00007f85b5735000
> nid=0xcf7 runnable [0x00007f85a0ffd000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.PlainSocketImpl.socketAccept(Native Method)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(
> TCPTransport.java:400)
>         at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(
> TCPTransport.java:372)
>         at java.lang.Thread.run(Thread.java:745)
>
> "RMI TCP Accept-0" #11 daemon prio=5 os_prio=0 tid=0x00007f85b5720800
> nid=0xcf6 runnable [0x00007f85a8156000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.PlainSocketImpl.socketAccept(Native Method)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(
> TCPTransport.java:400)
>         at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(
> TCPTransport.java:372)
>         at java.lang.Thread.run(Thread.java:745)
>
> "Service Thread" #9 daemon prio=9 os_prio=0 tid=0x0000000001c63000
> nid=0xcf5
> runnable [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C1 CompilerThread2" #8 daemon prio=9 os_prio=0 tid=0x00007f85b4cd7800
> nid=0xcf4 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C2 CompilerThread1" #7 daemon prio=9 os_prio=0 tid=0x00007f85b4cd5800
> nid=0xcf3 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C2 CompilerThread0" #6 daemon prio=9 os_prio=0 tid=0x00007f85b4cd3000
> nid=0xcf2 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "Signal Dispatcher" #5 daemon prio=9 os_prio=0 tid=0x00007f85b4cd1000
> nid=0xcf1 runnable [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "Surrogate Locker Thread (Concurrent GC)" #4 daemon prio=9 os_prio=0
> tid=0x00007f85b4ccf800 nid=0xcf0 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007f85b4c9b000 nid=0xceb in
> Object.wait() [0x00007f85a93fd000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x0000000769f08038> (a java.lang.ref.ReferenceQueue$
> Lock)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
>         - locked <0x0000000769f08038> (a java.lang.ref.ReferenceQueue$
> Lock)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
>         at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
>
> "Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007f85b4c98800
> nid=0xcea in Object.wait() [0x00007f85a94fe000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x0000000769f7a5d0> (a java.lang.ref.Reference$Lock)
>         at java.lang.Object.wait(Object.java:502)
>         at java.lang.ref.Reference$ReferenceHandler.run(
> Reference.java:157)
>         - locked <0x0000000769f7a5d0> (a java.lang.ref.Reference$Lock)
>
> "VM Thread" os_prio=0 tid=0x00007f85b4c93800 nid=0xce8 runnable
>
> "Gang worker#0 (Parallel GC Threads)" os_prio=0 tid=0x0000000001c41800
> nid=0xcdd runnable
>
> "Gang worker#1 (Parallel GC Threads)" os_prio=0 tid=0x0000000001c43800
> nid=0xcde runnable
>
> "Gang worker#2 (Parallel GC Threads)" os_prio=0 tid=0x0000000001c45000
> nid=0xcdf runnable
>
> "Gang worker#3 (Parallel GC Threads)" os_prio=0 tid=0x0000000001c47000
> nid=0xce0 runnable
>
> "G1 Main Concurrent Mark GC Thread" os_prio=0 tid=0x00007f85b4014800
> nid=0xce6 runnable
>
> "Gang worker#0 (G1 Parallel Marking Threads)" os_prio=0
> tid=0x00007f85b4016800 nid=0xce7 runnable
>
> "G1 Concurrent Refinement Thread#0" os_prio=0 tid=0x00007f85b4009000
> nid=0xce5 runnable
>
> "G1 Concurrent Refinement Thread#1" os_prio=0 tid=0x00007f85b4007000
> nid=0xce4 runnable
>
> "G1 Concurrent Refinement Thread#2" os_prio=0 tid=0x00007f85b4005800
> nid=0xce3 runnable
>
> "G1 Concurrent Refinement Thread#3" os_prio=0 tid=0x00007f85b4003800
> nid=0xce2 runnable
>
> "G1 Concurrent Refinement Thread#4" os_prio=0 tid=0x00007f85b4002000
> nid=0xce1 runnable
>
> "VM Periodic Task Thread" os_prio=0 tid=0x00007f85b5744000 nid=0xcf9
> runnable
>
> JNI global references: 317
>
>
>
> --
> View this message in context: http://apache-ignite-users.
> 70518.x6.nabble.com/Ignite-1-9Version-Error-GridCachePartitionExchangeMana
> ger-Found-long-running-cache-future-tp15755p15795.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>
>

Mime
View raw message