nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marco Gaido <marcogaid...@gmail.com>
Subject Re: Flowfiles stuck. Thread lock?
Date Mon, 08 Jan 2018 20:37:50 GMT
How is the processor scheduled? Is is scheduled on all nodes?

2018-01-08 21:00 GMT+01:00 FoodEssentials <hnguyen@labelinsight.com>:

> version: 1.2.0
>
> Processor is a custom processor that we built and it shows 0 threads
> across the entire cluster.
>
>
> Thanks.
>
>
> > On Jan 8, 2018, at 1:58 PM, Mark Payne <markap14@hotmail.com> wrote:
> >
> > Hello,
> >
> > What version of NiFi are you running? What processor are you seeing get
> 'stuck'? Does the processor show 1 or more active threads?
> >
> > Thanks
> > -Mark
> >
> >
> >> On Jan 8, 2018, at 2:55 PM, FoodEssentials <hnguyen@labelinsight.com>
> wrote:
> >>
> >> I have a thread dump. My flow file just randomly gets stuck. No errors
> in the logs, processor doesn’t seem to care about it. Thanks for your help.
> >>
> >> 2018-01-08 19:22:26,354 INFO [main] o.a.n.b.NotificationServiceManager
> Successfully loaded the following 0 services: []
> >> 2018-01-08 19:22:26,370 INFO [main] org.apache.nifi.bootstrap.RunNiFi
> Registered no Notification Services for Notification Type NIFI_STARTED
> >> 2018-01-08 19:22:26,370 INFO [main] org.apache.nifi.bootstrap.RunNiFi
> Registered no Notification Services for Notification Type NIFI_STOPPED
> >> 2018-01-08 19:22:26,370 INFO [main] org.apache.nifi.bootstrap.RunNiFi
> Registered no Notification Services for Notification Type NIFI_DIED
> >> 2018-01-08 19:22:27,756 INFO [main] org.apache.nifi.bootstrap.RunNiFi
> >> "Cleanup Archive for default" Id=40 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@7eb4cf85
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Cluster Socket Listener" Id=74 RUNNABLE  (in native code)
> >>      at java.net.PlainSocketImpl.socketAccept(Native Method)
> >>      at java.net.AbstractPlainSocketImpl.accept(
> AbstractPlainSocketImpl.java:409)
> >>      at java.net.ServerSocket.implAccept(ServerSocket.java:545)
> >>      at java.net.ServerSocket.accept(ServerSocket.java:513)
> >>      at org.apache.nifi.io.socket.SocketListener$2.run(
> SocketListener.java:112)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Clustering Tasks Thread-1" Id=154 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@76e160b7
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Clustering Tasks Thread-2" Id=155 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@76e160b7
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Clustering Tasks Thread-3" Id=163 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@76e160b7
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "CommitProcessor:3" Id=61 WAITING  on org.apache.zookeeper.server.
> quorum.CommitProcessor@4f065825
> >>      at java.lang.Object.wait(Native Method)
> >>      at java.lang.Object.wait(Object.java:502)
> >>      at org.apache.zookeeper.server.quorum.CommitProcessor.run(
> CommitProcessor.java:80)
> >>
> >> "xxx-cluster-3.xxx.com/172.30.2.194:3888" Id=49 RUNNABLE  (in native
> code)
> >>      at java.net.PlainSocketImpl.socketAccept(Native Method)
> >>      at java.net.AbstractPlainSocketImpl.accept(
> AbstractPlainSocketImpl.java:409)
> >>      at java.net.ServerSocket.implAccept(ServerSocket.java:545)
> >>      at java.net.ServerSocket.accept(ServerSocket.java:513)
> >>      at org.apache.zookeeper.server.quorum.QuorumCnxManager$
> Listener.run(QuorumCnxManager.java:509)
> >>
> >> "Curator-ConnectionStateManager-0" Id=64 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@73aff979
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ArrayBlockingQueue.take(
> ArrayBlockingQueue.java:403)
> >>      at org.apache.curator.framework.state.ConnectionStateManager.
> processEvents(ConnectionStateManager.java:245)
> >>      at org.apache.curator.framework.state.ConnectionStateManager.
> access$000(ConnectionStateManager.java:43)
> >>      at org.apache.curator.framework.state.ConnectionStateManager$
> 1.call(ConnectionStateManager.java:111)
> >>      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@6987a0f3
> >>
> >> "Curator-Framework-0" Id=67 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@4127ff34
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
> >>      at java.util.concurrent.DelayQueue.take(DelayQueue.java:70)
> >>      at org.apache.curator.framework.imps.CuratorFrameworkImpl.
> backgroundOperationsLoop(CuratorFrameworkImpl.java:804)
> >>      at org.apache.curator.framework.imps.CuratorFrameworkImpl.
> access$300(CuratorFrameworkImpl.java:64)
> >>      at org.apache.curator.framework.imps.CuratorFrameworkImpl$4.
> call(CuratorFrameworkImpl.java:267)
> >>      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@12bb0322
> >>
> >> "DestroyJavaVM" Id=158 RUNNABLE
> >>
> >> "Event-Driven Process Thread-1" Id=42 TIMED_WAITING  on
> java.lang.Object@3fa3723c
> >>      at java.lang.Object.wait(Native Method)
> >>      at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(
> EventDrivenWorkerQueue.java:70)
> >>      at org.apache.nifi.controller.scheduling.
> EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.
> java:166)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@3a5922ec
> >>
> >> "Event-Driven Process Thread-2" Id=43 TIMED_WAITING  on
> java.lang.Object@3fa3723c
> >>      at java.lang.Object.wait(Native Method)
> >>      at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(
> EventDrivenWorkerQueue.java:70)
> >>      at org.apache.nifi.controller.scheduling.
> EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.
> java:166)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@3e6b08d4
> >>
> >> "Event-Driven Process Thread-3" Id=44 TIMED_WAITING  on
> java.lang.Object@3fa3723c
> >>      at java.lang.Object.wait(Native Method)
> >>      at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(
> EventDrivenWorkerQueue.java:70)
> >>      at org.apache.nifi.controller.scheduling.
> EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.
> java:166)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@40f88929
> >>
> >> "Event-Driven Process Thread-4" Id=45 TIMED_WAITING  on
> java.lang.Object@3fa3723c
> >>      at java.lang.Object.wait(Native Method)
> >>      at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(
> EventDrivenWorkerQueue.java:70)
> >>      at org.apache.nifi.controller.scheduling.
> EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.
> java:166)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@18a9762
> >>
> >> "Event-Driven Process Thread-5" Id=46 TIMED_WAITING  on
> java.lang.Object@3fa3723c
> >>      at java.lang.Object.wait(Native Method)
> >>      at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(
> EventDrivenWorkerQueue.java:70)
> >>      at org.apache.nifi.controller.scheduling.
> EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.
> java:166)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@72378bfd
> >>
> >> "FileSystemRepository Workers Thread-1" Id=38 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@7afc433e
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "FileSystemRepository Workers Thread-2" Id=39 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@7afc433e
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "FileSystemRepository Workers Thread-3" Id=70 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@7afc433e
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "FileSystemRepository Workers Thread-4" Id=71 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@7afc433e
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Finalizer" Id=3 WAITING  on java.lang.ref.ReferenceQueue$Lock@5b99011b
> >>      at java.lang.Object.wait(Native Method)
> >>      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
> >>      at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
> >>      at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
> >>
> >> "Flow Service Tasks Thread-1" Id=72 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@381206f5
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Flow Service Tasks Thread-2" Id=73 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@381206f5
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "FollowerRequestProcessor:3" Id=62 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1bed157a
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at org.apache.zookeeper.server.quorum.
> FollowerRequestProcessor.run(FollowerRequestProcessor.java:58)
> >>
> >> "Framework Task Thread Thread-1" Id=84 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@90bcb09
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Framework Task Thread Thread-2" Id=178 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@90bcb09
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Framework Task Thread Thread-2-EventThread" Id=467 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@c8f64d4
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at org.apache.zookeeper.ClientCnxn$EventThread.run(
> ClientCnxn.java:494)
> >>
> >> "Framework Task Thread Thread-2-SendThread(localhost:2181)" Id=466
> RUNNABLE
> >>      at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
> >>      at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
> >>      at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:93)
> >>      at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
> >>      - waiting on sun.nio.ch.Util$3@4950fff4
> >>      - waiting on java.util.Collections$UnmodifiableSet@74d74707
> >>      - waiting on sun.nio.ch.EPollSelectorImpl@18cd7dc5
> >>      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
> >>      at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:349)
> >>      at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1081)
> >>
> >> "Framework Task Thread Thread-3" Id=181 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@90bcb09
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Framework Task Thread Thread-4" Id=183 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@90bcb09
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "H2 File Lock Watchdog /usr/local/bin/nifi-1.2.0/
> database_repository/nifi-flow-audit.lock.db" Id=31 TIMED_WAITING  on null
> >>      at java.lang.Thread.sleep(Native Method)
> >>      at org.h2.store.FileLock.run(FileLock.java:517)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "H2 File Lock Watchdog /usr/local/bin/nifi-1.2.0/
> database_repository/nifi-user-keys.lock.db" Id=29 TIMED_WAITING  on null
> >>      at java.lang.Thread.sleep(Native Method)
> >>      at org.h2.store.FileLock.run(FileLock.java:517)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "H2 Log Writer NIFI-FLOW-AUDIT" Id=32 TIMED_WAITING  on
> org.h2.store.WriterThread@67ce071
> >>      at java.lang.Object.wait(Native Method)
> >>      at org.h2.store.WriterThread.run(WriterThread.java:103)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "H2 Log Writer NIFI-USER-KEYS" Id=30 TIMED_WAITING  on
> org.h2.store.WriterThread@35d2d170
> >>      at java.lang.Object.wait(Native Method)
> >>      at org.h2.store.WriterThread.run(WriterThread.java:103)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Heartbeat Monitor Thread-1" Id=68 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@692a694a
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Http Site-to-Site Transaction Maintenance" Id=85 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@54b75cd5
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "java-sdk-http-connection-reaper" Id=157 TIMED_WAITING  on null
> >>      at java.lang.Thread.sleep(Native Method)
> >>      at com.amazonaws.http.IdleConnectionReaper.run(
> IdleConnectionReaper.java:181)
> >>
> >> "JDWP Event Helper Thread" Id=7 RUNNABLE
> >>
> >> "JDWP Transport Listener: dt_socket" Id=6 RUNNABLE  (in native code)
> >>
> >> "Keep-Alive-Timer" Id=494 TIMED_WAITING  on null
> >>      at java.lang.Thread.sleep(Native Method)
> >>      at sun.net.www.http.KeepAliveCache.run(KeepAliveCache.java:172)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Leader Election Notification Thread-1" Id=81 WAITING  on
> org.apache.curator.framework.recipes.locks.LockInternals@53c23ae6
> >>      at java.lang.Object.wait(Native Method)
> >>      at java.lang.Object.wait(Object.java:502)
> >>      at org.apache.curator.framework.recipes.locks.LockInternals.
> internalLockLoop(LockInternals.java:308)
> >>      at org.apache.curator.framework.recipes.locks.LockInternals.
> attemptLock(LockInternals.java:218)
> >>      at org.apache.curator.framework.recipes.locks.InterProcessMutex.
> internalLock(InterProcessMutex.java:232)
> >>      at org.apache.curator.framework.recipes.locks.
> InterProcessMutex.acquire(InterProcessMutex.java:89)
> >>      at org.apache.curator.framework.recipes.leader.LeaderSelector.
> doWork(LeaderSelector.java:386)
> >>      at org.apache.curator.framework.recipes.leader.LeaderSelector.
> doWorkLoop(LeaderSelector.java:441)
> >>      at org.apache.curator.framework.recipes.leader.LeaderSelector.
> access$100(LeaderSelector.java:64)
> >>      at org.apache.curator.framework.recipes.leader.LeaderSelector$
> 2.call(LeaderSelector.java:245)
> >>      at org.apache.curator.framework.recipes.leader.LeaderSelector$
> 2.call(LeaderSelector.java:239)
> >>      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@1443e114
> >>
> >> "Leader Election Notification Thread-2" Id=82 WAITING  on
> org.apache.curator.framework.recipes.locks.LockInternals@c19c6b7
> >>      at java.lang.Object.wait(Native Method)
> >>      at java.lang.Object.wait(Object.java:502)
> >>      at org.apache.curator.framework.recipes.locks.LockInternals.
> internalLockLoop(LockInternals.java:308)
> >>      at org.apache.curator.framework.recipes.locks.LockInternals.
> attemptLock(LockInternals.java:218)
> >>      at org.apache.curator.framework.recipes.locks.InterProcessMutex.
> internalLock(InterProcessMutex.java:232)
> >>      at org.apache.curator.framework.recipes.locks.
> InterProcessMutex.acquire(InterProcessMutex.java:89)
> >>      at org.apache.curator.framework.recipes.leader.LeaderSelector.
> doWork(LeaderSelector.java:386)
> >>      at org.apache.curator.framework.recipes.leader.LeaderSelector.
> doWorkLoop(LeaderSelector.java:441)
> >>      at org.apache.curator.framework.recipes.leader.LeaderSelector.
> access$100(LeaderSelector.java:64)
> >>      at org.apache.curator.framework.recipes.leader.LeaderSelector$
> 2.call(LeaderSelector.java:245)
> >>      at org.apache.curator.framework.recipes.leader.LeaderSelector$
> 2.call(LeaderSelector.java:239)
> >>      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@70dd183b
> >>
> >> "Listen to Bootstrap" Id=15 RUNNABLE  (in native code)
> >>      at java.net.PlainSocketImpl.socketAccept(Native Method)
> >>      at java.net.AbstractPlainSocketImpl.accept(
> AbstractPlainSocketImpl.java:409)
> >>      at java.net.ServerSocket.implAccept(ServerSocket.java:545)
> >>      at java.net.ServerSocket.accept(ServerSocket.java:513)
> >>      at org.apache.nifi.BootstrapListener$Listener.
> run(BootstrapListener.java:158)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "logback-1" Id=12 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@2d321f65
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "logback-2" Id=164 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@2d321f65
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "logback-3" Id=180 TIMED_WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@2d321f65
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "logback-4" Id=182 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@2d321f65
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "logback-5" Id=184 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@2d321f65
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "logback-6" Id=185 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@2d321f65
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "logback-7" Id=188 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@2d321f65
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "logback-8" Id=191 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@2d321f65
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "main-EventThread" Id=66 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@595ab19d
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at org.apache.zookeeper.ClientCnxn$EventThread.run(
> ClientCnxn.java:494)
> >>
> >> "main-SendThread(ip-172-30-0-82.ec2.internal:2181)" Id=65 RUNNABLE
> >>      at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
> >>      at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
> >>      at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:93)
> >>      at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
> >>      - waiting on sun.nio.ch.Util$3@3b0fb600
> >>      - waiting on java.util.Collections$UnmodifiableSet@1d5e812
> >>      - waiting on sun.nio.ch.EPollSelectorImpl@7ff57943
> >>      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
> >>      at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:349)
> >>      at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1081)
> >>
> >> "NiFi Web Server-21-lowPrioritySelector" Id=21 RUNNABLE  (in native
> code)
> >>      at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
> >>      at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
> >>      at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:93)
> >>      at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
> >>      - waiting on sun.nio.ch.Util$3@7c627b70
> >>      - waiting on java.util.Collections$UnmodifiableSet@5f986cdd
> >>      - waiting on sun.nio.ch.EPollSelectorImpl@2565d83e
> >>      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
> >>      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
> >>      at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(
> ManagedSelector.java:302)
> >>      at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(
> ManagedSelector.java:254)
> >>      - waiting on org.eclipse.jetty.io.ManagedSelector$
> SelectorProducer@3de01b52
> >>      at org.eclipse.jetty.util.thread.strategy.
> ProduceExecuteConsume.produce(ProduceExecuteConsume.java:75)
> >>      at org.eclipse.jetty.io.ManagedSelector.lowPriorityProduce(
> ManagedSelector.java:113)
> >>      at org.eclipse.jetty.io.ManagedSelector$$Lambda$94/1929089580.run(Unknown
> Source)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
> QueuedThreadPool.java:672)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:590)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-23-lowPrioritySelector" Id=23 BLOCKED  on
> org.eclipse.jetty.io.ManagedSelector$SelectorProducer@1c8301b9
> >>      at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(
> ManagedSelector.java:240)
> >>      at org.eclipse.jetty.util.thread.strategy.
> ProduceExecuteConsume.produce(ProduceExecuteConsume.java:75)
> >>      at org.eclipse.jetty.io.ManagedSelector.lowPriorityProduce(
> ManagedSelector.java:113)
> >>      at org.eclipse.jetty.io.ManagedSelector$$Lambda$94/1929089580.run(Unknown
> Source)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
> QueuedThreadPool.java:672)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:590)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-25-acceptor-0@691a8144-ServerConnector@65f809cb{HTTP/
> 1.1,[http/1.1]}{xxx-cluster-3.xxx.com:8080}" Id=25 RUNNABLE  (in native
> code)
> >>      at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
> >>      at sun.nio.ch.ServerSocketChannelImpl.accept(
> ServerSocketChannelImpl.java:422)
> >>      at sun.nio.ch.ServerSocketChannelImpl.accept(
> ServerSocketChannelImpl.java:250)
> >>      - waiting on java.lang.Object@1d7c7fc6
> >>      at org.eclipse.jetty.server.ServerConnector.accept(
> ServerConnector.java:352)
> >>      at org.eclipse.jetty.server.AbstractConnector$Acceptor.
> run(AbstractConnector.java:603)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
> QueuedThreadPool.java:672)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:590)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-465" Id=465 RUNNABLE  (in native code)
> >>      at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
> >>      at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
> >>      at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:93)
> >>      at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
> >>      - waiting on sun.nio.ch.Util$3@6f1313cc
> >>      - waiting on java.util.Collections$UnmodifiableSet@2172ee85
> >>      - waiting on sun.nio.ch.EPollSelectorImpl@6fd36ad3
> >>      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
> >>      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
> >>      at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(
> ManagedSelector.java:302)
> >>      at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(
> ManagedSelector.java:254)
> >>      - waiting on org.eclipse.jetty.io.ManagedSelector$
> SelectorProducer@1c8301b9
> >>      at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.
> produceConsume(ExecuteProduceConsume.java:147)
> >>      at org.eclipse.jetty.util.thread.strategy.
> ExecuteProduceConsume.run(ExecuteProduceConsume.java:133)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
> QueuedThreadPool.java:672)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:590)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-470" Id=470 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@39df88b1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:564)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:49)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:627)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-472" Id=472 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@39df88b1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:564)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:49)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:627)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-476" Id=476 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@39df88b1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:564)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:49)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:627)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-481" Id=481 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@39df88b1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:564)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:49)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:627)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-485" Id=485 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@39df88b1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:564)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:49)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:627)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-486" Id=486 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@39df88b1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:564)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:49)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:627)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-488" Id=488 BLOCKED  on org.eclipse.jetty.io.
> ManagedSelector$SelectorProducer@3de01b52
> >>      at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(
> ManagedSelector.java:240)
> >>      at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.
> produceConsume(ExecuteProduceConsume.java:147)
> >>      at org.eclipse.jetty.util.thread.strategy.
> ExecuteProduceConsume.run(ExecuteProduceConsume.java:133)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
> QueuedThreadPool.java:672)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:590)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-489" Id=489 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@39df88b1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:564)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:49)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:627)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-490" Id=490 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@39df88b1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:564)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:49)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:627)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NiFi Web Server-491" Id=491 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@39df88b1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:564)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:49)
> >>      at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:627)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181" Id=47 RUNNABLE
> >>      at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
> >>      at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
> >>      at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:93)
> >>      at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
> >>      - waiting on sun.nio.ch.Util$3@238f51f3
> >>      - waiting on java.util.Collections$UnmodifiableSet@6d5eb101
> >>      - waiting on sun.nio.ch.EPollSelectorImpl@5df03e57
> >>      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
> >>      at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> NIOServerCnxnFactory.java:178)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "OkHttp ConnectionPool" Id=477 TIMED_WAITING  on com.squareup.okhttp.
> ConnectionPool@78e2828a
> >>      at java.lang.Object.wait(Native Method)
> >>      at java.lang.Object.wait(Object.java:460)
> >>      at com.squareup.okhttp.ConnectionPool$1.run(
> ConnectionPool.java:101)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@2be92cea
> >>
> >> "Okio Watchdog" Id=205 WAITING  on java.lang.Class@7ccc25ac
> >>      at java.lang.Object.wait(Native Method)
> >>      at java.lang.Object.wait(Object.java:502)
> >>      at okio.AsyncTimeout.awaitTimeout(AsyncTimeout.java:311)
> >>      at okio.AsyncTimeout.access$000(AsyncTimeout.java:40)
> >>      at okio.AsyncTimeout$Watchdog.run(AsyncTimeout.java:286)
> >>
> >> "pool-12-thread-1" Id=83 TIMED_WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@505aa60b
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "pool-2-thread-1" Id=495 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@37187022
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "pool-2-thread-2" Id=496 RUNNABLE
> >>      at sun.management.ThreadImpl.dumpThreads0(Native Method)
> >>      at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:454)
> >>      at org.apache.nifi.BootstrapListener.writeDump(
> BootstrapListener.java:221)
> >>      at org.apache.nifi.BootstrapListener.access$500(
> BootstrapListener.java:49)
> >>      at org.apache.nifi.BootstrapListener$Listener$1.
> run(BootstrapListener.java:196)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@56893868
> >>
> >> "Process Cluster Protocol Request-1" Id=80 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@4b158039
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Process Cluster Protocol Request-2" Id=156 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@4b158039
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Provenance Maintenance Thread-1" Id=34 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@22ea4482
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Provenance Maintenance Thread-2" Id=35 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@22ea4482
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Provenance Maintenance Thread-3" Id=36 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@22ea4482
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Provenance Query Thread-1" Id=273 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@5dc921aa
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Provenance Repository Rollover Thread-1" Id=206 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@29385d32
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Provenance Repository Rollover Thread-2" Id=210 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@29385d32
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "QuorumPeer[myid=3]/0.0.0.0:2181" Id=3 RUNNABLE
> >>      at java.net.SocketInputStream.socketRead0(Native Method)
> >>      at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
> >>      at java.net.SocketInputStream.read(SocketInputStream.java:171)
> >>      at java.net.SocketInputStream.read(SocketInputStream.java:141)
> >>      at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
> >>      at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
> >>      - waiting on java.io.BufferedInputStream@327a9af2
> >>      at java.io.DataInputStream.readInt(DataInputStream.java:387)
> >>      at org.apache.jute.BinaryInputArchive.readInt(
> BinaryInputArchive.java:63)
> >>      at org.apache.zookeeper.server.quorum.QuorumPacket.
> deserialize(QuorumPacket.java:83)
> >>      at org.apache.jute.BinaryInputArchive.readRecord(
> BinaryInputArchive.java:103)
> >>      at org.apache.zookeeper.server.quorum.Learner.readPacket(
> Learner.java:153)
> >>      - waiting on org.apache.jute.BinaryInputArchive@4fc02be8
> >>      at org.apache.zookeeper.server.quorum.Follower.followLeader(
> Follower.java:85)
> >>      at org.apache.zookeeper.server.quorum.QuorumPeer.run(
> QuorumPeer.java:786)
> >>
> >> "RecvWorker:1" Id=54 RUNNABLE  (in native code)
> >>      at java.net.SocketInputStream.socketRead0(Native Method)
> >>      at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
> >>      at java.net.SocketInputStream.read(SocketInputStream.java:171)
> >>      at java.net.SocketInputStream.read(SocketInputStream.java:141)
> >>      at java.net.SocketInputStream.read(SocketInputStream.java:224)
> >>      at java.io.DataInputStream.readInt(DataInputStream.java:387)
> >>      at org.apache.zookeeper.server.quorum.QuorumCnxManager$
> RecvWorker.run(QuorumCnxManager.java:765)
> >>
> >> "RecvWorker:2" Id=56 RUNNABLE  (in native code)
> >>      at java.net.SocketInputStream.socketRead0(Native Method)
> >>      at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
> >>      at java.net.SocketInputStream.read(SocketInputStream.java:171)
> >>      at java.net.SocketInputStream.read(SocketInputStream.java:141)
> >>      at java.net.SocketInputStream.read(SocketInputStream.java:224)
> >>      at java.io.DataInputStream.readInt(DataInputStream.java:387)
> >>      at org.apache.zookeeper.server.quorum.QuorumCnxManager$
> RecvWorker.run(QuorumCnxManager.java:765)
> >>
> >> "Reference Handler" Id=2 WAITING  on java.lang.ref.Reference$Lock@
> 34cf58e3
> >>      at java.lang.Object.wait(Native Method)
> >>      at java.lang.Object.wait(Object.java:502)
> >>      at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
> >>      at java.lang.ref.Reference$ReferenceHandler.run(
> Reference.java:153)
> >>
> >> "Replicate Request Thread-1" Id=165 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1ddb7ff3
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Replicate Request Thread-10" Id=175 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1ddb7ff3
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Replicate Request Thread-2" Id=167 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1ddb7ff3
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Replicate Request Thread-3" Id=168 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1ddb7ff3
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Replicate Request Thread-4" Id=169 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1ddb7ff3
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Replicate Request Thread-5" Id=170 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1ddb7ff3
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Replicate Request Thread-6" Id=171 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1ddb7ff3
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Replicate Request Thread-7" Id=172 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1ddb7ff3
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Replicate Request Thread-8" Id=173 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1ddb7ff3
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Replicate Request Thread-9" Id=174 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1ddb7ff3
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Scheduler-1457263953" Id=79 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@3dfd95bf
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Scheduler-600980888" Id=27 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@6dc2f8a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Search Lucene Index-1" Id=274 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@6bf9ec96
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Search Lucene Index-2" Id=275 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@6bf9ec96
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "SendWorker:1" Id=53 TIMED_WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@41cf0174
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ArrayBlockingQueue.poll(
> ArrayBlockingQueue.java:418)
> >>      at org.apache.zookeeper.server.quorum.QuorumCnxManager.
> pollSendQueue(QuorumCnxManager.java:849)
> >>      at org.apache.zookeeper.server.quorum.QuorumCnxManager.
> access$500(QuorumCnxManager.java:64)
> >>      at org.apache.zookeeper.server.quorum.QuorumCnxManager$
> SendWorker.run(QuorumCnxManager.java:685)
> >>
> >> "SendWorker:2" Id=55 TIMED_WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@43ee048d
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ArrayBlockingQueue.poll(
> ArrayBlockingQueue.java:418)
> >>      at org.apache.zookeeper.server.quorum.QuorumCnxManager.
> pollSendQueue(QuorumCnxManager.java:849)
> >>      at org.apache.zookeeper.server.quorum.QuorumCnxManager.
> access$500(QuorumCnxManager.java:64)
> >>      at org.apache.zookeeper.server.quorum.QuorumCnxManager$
> SendWorker.run(QuorumCnxManager.java:685)
> >>
> >> "Signal Dispatcher" Id=5 RUNNABLE
> >>
> >> "Site-to-Site Listener" Id=86 RUNNABLE
> >>      at sun.nio.ch.Net.poll(Native Method)
> >>      at sun.nio.ch.ServerSocketChannelImpl.poll(
> ServerSocketChannelImpl.java:363)
> >>      - waiting on java.lang.Object@573165c2
> >>      at sun.nio.ch.ServerSocketAdaptor.accept(
> ServerSocketAdaptor.java:116)
> >>      - waiting on java.lang.Object@168921ab
> >>      at org.apache.nifi.remote.SocketRemoteSiteListener$1.
> run(SocketRemoteSiteListener.java:120)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-1" Id=91 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1c1149d1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-1" Id=76 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@5af39947
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-2" Id=92 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1c1149d1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-2" Id=77 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@5af39947
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-3" Id=94 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1c1149d1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-3" Id=78 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@5af39947
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-4" Id=148 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1c1149d1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-4" Id=89 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@5af39947
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-5" Id=150 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1c1149d1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-5" Id=90 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@5af39947
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-6" Id=151 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1c1149d1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-6" Id=93 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@5af39947
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-7" Id=152 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1c1149d1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-7" Id=147 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@5af39947
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-8" Id=153 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@1c1149d1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "StandardProcessScheduler Thread-8" Id=149 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@5af39947
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "SyncThread:3" Id=63 WAITING  on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@3556eeba
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
> >>      at org.apache.zookeeper.server.SyncRequestProcessor.run(
> SyncRequestProcessor.java:127)
> >>
> >> "ThreadPoolRequestReplicator Maintenance Thread" Id=69 TIMED_WAITING
> on java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@38ab538d
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Timer-Driven Process Thread-1" Id=52 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@102fe2c5
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@6354a50a
> >>
> >> "Timer-Driven Process Thread-10" Id=100 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@6a79bee9
> >>
> >> "Timer-Driven Process Thread-11" Id=101 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@56d060f9
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Timer-Driven Process Thread-12" Id=102 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@5a4bfc44
> >>
> >> "Timer-Driven Process Thread-13" Id=103 WAITING  on
> java.util.concurrent.locks.ReentrantLock$NonfairSync@624467a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireQueued(AbstractQueuedSynchronizer.java:870)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(
> AbstractQueuedSynchronizer.java:1199)
> >>      at java.util.concurrent.locks.ReentrantLock$NonfairSync.
> lock(ReentrantLock.java:209)
> >>      at java.util.concurrent.locks.ReentrantLock.lock(
> ReentrantLock.java:285)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.offer(ScheduledThreadPoolExecutor.java:1010)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:1037)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> delayedExecute(ScheduledThreadPoolExecutor.java:328)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> scheduleWithFixedDelay(ScheduledThreadPoolExecutor.java:597)
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:179)
> >>      - waiting on org.apache.nifi.controller.scheduling.ScheduleState@
> 4099e6fa
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@939f7b4
> >>
> >> "Timer-Driven Process Thread-14" Id=104 WAITING  on
> java.util.concurrent.locks.ReentrantLock$NonfairSync@624467a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireQueued(AbstractQueuedSynchronizer.java:870)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(
> AbstractQueuedSynchronizer.java:1199)
> >>      at java.util.concurrent.locks.ReentrantLock$NonfairSync.
> lock(ReentrantLock.java:209)
> >>      at java.util.concurrent.locks.ReentrantLock.lock(
> ReentrantLock.java:285)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.offer(ScheduledThreadPoolExecutor.java:1010)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:1037)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> delayedExecute(ScheduledThreadPoolExecutor.java:328)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> scheduleWithFixedDelay(ScheduledThreadPoolExecutor.java:597)
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:179)
> >>      - waiting on org.apache.nifi.controller.scheduling.ScheduleState@
> 386781c1
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@46c312d8
> >>
> >> "Timer-Driven Process Thread-15" Id=105 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@1c9e3
> >>
> >> "Timer-Driven Process Thread-16" Id=106 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@77cff000
> >>
> >> "Timer-Driven Process Thread-17" Id=107 WAITING  on
> java.util.concurrent.locks.ReentrantLock$NonfairSync@624467a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireQueued(AbstractQueuedSynchronizer.java:870)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(
> AbstractQueuedSynchronizer.java:1199)
> >>      at java.util.concurrent.locks.ReentrantLock$NonfairSync.
> lock(ReentrantLock.java:209)
> >>      at java.util.concurrent.locks.ReentrantLock.lock(
> ReentrantLock.java:285)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.offer(ScheduledThreadPoolExecutor.java:1010)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:1037)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> reExecutePeriodic(ScheduledThreadPoolExecutor.java:346)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:296)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@78e77581
> >>
> >> "Timer-Driven Process Thread-18" Id=108 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@26eced97
> >>
> >> "Timer-Driven Process Thread-19" Id=109 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@28ac6678
> >>
> >> "Timer-Driven Process Thread-2" Id=75 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@cec9f23
> >>
> >> "Timer-Driven Process Thread-20" Id=110 WAITING  on
> java.util.concurrent.locks.ReentrantLock$NonfairSync@624467a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireQueued(AbstractQueuedSynchronizer.java:870)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(
> AbstractQueuedSynchronizer.java:1199)
> >>      at java.util.concurrent.locks.ReentrantLock$NonfairSync.
> lock(ReentrantLock.java:209)
> >>      at java.util.concurrent.locks.ReentrantLock.lock(
> ReentrantLock.java:285)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.offer(ScheduledThreadPoolExecutor.java:1010)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:1037)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> delayedExecute(ScheduledThreadPoolExecutor.java:328)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> scheduleWithFixedDelay(ScheduledThreadPoolExecutor.java:597)
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:179)
> >>      - waiting on org.apache.nifi.controller.scheduling.ScheduleState@
> 102fe2c5
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@206bcc9d
> >>
> >> "Timer-Driven Process Thread-21" Id=111 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@63e3fe6c
> >>
> >> "Timer-Driven Process Thread-22" Id=112 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@22a237d2
> >>
> >> "Timer-Driven Process Thread-23" Id=113 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@69f60a58
> >>
> >> "Timer-Driven Process Thread-24" Id=114 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@17873cdf
> >>
> >> "Timer-Driven Process Thread-25" Id=115 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@6b6ba0dd
> >>
> >> "Timer-Driven Process Thread-26" Id=116 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@584416c5
> >>
> >> "Timer-Driven Process Thread-27" Id=117 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@1b9735f
> >>
> >> "Timer-Driven Process Thread-28" Id=118 RUNNABLE
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:1037)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> reExecutePeriodic(ScheduledThreadPoolExecutor.java:346)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:296)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@2f76d673
> >>
> >> "Timer-Driven Process Thread-29" Id=119 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@192de608
> >>
> >> "Timer-Driven Process Thread-3" Id=87 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@6ceaef8e
> >>
> >> "Timer-Driven Process Thread-30" Id=120 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@61a739d6
> >>
> >> "Timer-Driven Process Thread-31" Id=121 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@2b4e8d36
> >>
> >> "Timer-Driven Process Thread-32" Id=122 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@32920362
> >>
> >> "Timer-Driven Process Thread-33" Id=123 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@3f500ddf
> >>
> >> "Timer-Driven Process Thread-34" Id=124 WAITING  on
> java.util.concurrent.locks.ReentrantLock$NonfairSync@624467a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireInterruptibly(AbstractQueuedSynchronizer.java:897)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireInterruptibly(AbstractQueuedSynchronizer.java:1222)
> >>      at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(
> ReentrantLock.java:335)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1076)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Timer-Driven Process Thread-35" Id=125 WAITING  on
> java.util.concurrent.locks.ReentrantLock$NonfairSync@624467a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireQueued(AbstractQueuedSynchronizer.java:870)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(
> AbstractQueuedSynchronizer.java:1199)
> >>      at java.util.concurrent.locks.ReentrantLock$NonfairSync.
> lock(ReentrantLock.java:209)
> >>      at java.util.concurrent.locks.ReentrantLock.lock(
> ReentrantLock.java:285)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.offer(ScheduledThreadPoolExecutor.java:1010)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:1037)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> delayedExecute(ScheduledThreadPoolExecutor.java:328)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> scheduleWithFixedDelay(ScheduledThreadPoolExecutor.java:597)
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:179)
> >>      - waiting on org.apache.nifi.controller.scheduling.ScheduleState@
> 6de5e32c
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@1527d9e1
> >>
> >> "Timer-Driven Process Thread-36" Id=126 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@102fe2c5
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@72ec6751
> >>
> >> "Timer-Driven Process Thread-37" Id=127 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@5b3e6210
> >>
> >> "Timer-Driven Process Thread-38" Id=128 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@6f64b82c
> >>
> >> "Timer-Driven Process Thread-39" Id=129 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@1809b671
> >>
> >> "Timer-Driven Process Thread-4" Id=88 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@6fe096ad
> >>
> >> "Timer-Driven Process Thread-40" Id=130 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@571f79b1
> >>
> >> "Timer-Driven Process Thread-41" Id=131 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@2b7e2a6b
> >>
> >> "Timer-Driven Process Thread-42" Id=132 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@4225256f
> >>
> >> "Timer-Driven Process Thread-43" Id=133 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@30e7593
> >>
> >> "Timer-Driven Process Thread-44" Id=134 WAITING  on
> java.util.concurrent.locks.ReentrantLock$NonfairSync@624467a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireInterruptibly(AbstractQueuedSynchronizer.java:897)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireInterruptibly(AbstractQueuedSynchronizer.java:1222)
> >>      at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(
> ReentrantLock.java:335)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1076)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Timer-Driven Process Thread-45" Id=135 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@72fd141b
> >>
> >> "Timer-Driven Process Thread-46" Id=136 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@23b129d8
> >>
> >> "Timer-Driven Process Thread-47" Id=137 WAITING  on
> java.util.concurrent.locks.ReentrantLock$NonfairSync@624467a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> doAcquireInterruptibly(AbstractQueuedSynchronizer.java:897)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireInterruptibly(AbstractQueuedSynchronizer.java:1222)
> >>      at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(
> ReentrantLock.java:335)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1076)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Timer-Driven Process Thread-48" Id=138 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@4e7e270a
> >>
> >> "Timer-Driven Process Thread-49" Id=139 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@67b3be4f
> >>
> >> "Timer-Driven Process Thread-5" Id=95 WAITING  on
> java.util.concurrent.locks.ReentrantLock$NonfairSync@624467a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireQueued(AbstractQueuedSynchronizer.java:870)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(
> AbstractQueuedSynchronizer.java:1199)
> >>      at java.util.concurrent.locks.ReentrantLock$NonfairSync.
> lock(ReentrantLock.java:209)
> >>      at java.util.concurrent.locks.ReentrantLock.lock(
> ReentrantLock.java:285)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.offer(ScheduledThreadPoolExecutor.java:1010)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:1037)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> reExecutePeriodic(ScheduledThreadPoolExecutor.java:346)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:296)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@39fbcca5
> >>
> >> "Timer-Driven Process Thread-50" Id=140 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@384775a7
> >>
> >> "Timer-Driven Process Thread-51" Id=141 WAITING  on
> java.util.concurrent.locks.ReentrantLock$NonfairSync@624467a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireQueued(AbstractQueuedSynchronizer.java:870)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(
> AbstractQueuedSynchronizer.java:1199)
> >>      at java.util.concurrent.locks.ReentrantLock$NonfairSync.
> lock(ReentrantLock.java:209)
> >>      at java.util.concurrent.locks.ReentrantLock.lock(
> ReentrantLock.java:285)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.offer(ScheduledThreadPoolExecutor.java:1010)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:1037)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> delayedExecute(ScheduledThreadPoolExecutor.java:328)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> scheduleWithFixedDelay(ScheduledThreadPoolExecutor.java:597)
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:179)
> >>      - waiting on org.apache.nifi.controller.scheduling.ScheduleState@
> 27eaae76
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@698314cc
> >>
> >> "Timer-Driven Process Thread-52" Id=142 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@559c9880
> >>
> >> "Timer-Driven Process Thread-53" Id=143 WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@56d060f9
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Timer-Driven Process Thread-54" Id=144 WAITING  on
> java.util.concurrent.locks.ReentrantLock$NonfairSync@624467a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireQueued(AbstractQueuedSynchronizer.java:870)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2083)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Timer-Driven Process Thread-55" Id=145 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@2cd8a9e
> >>
> >> "Timer-Driven Process Thread-56" Id=146 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@102fe2c5
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@3682eb0a
> >>
> >> "Timer-Driven Process Thread-6" Id=96 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@102fe2c5
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@1ea6c66f
> >>
> >> "Timer-Driven Process Thread-7" Id=97 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@27eaae76
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@7c6dddd6
> >>
> >> "Timer-Driven Process Thread-8" Id=98 WAITING  on
> java.util.concurrent.locks.ReentrantLock$NonfairSync@624467a8
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireQueued(AbstractQueuedSynchronizer.java:870)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(
> AbstractQueuedSynchronizer.java:1199)
> >>      at java.util.concurrent.locks.ReentrantLock$NonfairSync.
> lock(ReentrantLock.java:209)
> >>      at java.util.concurrent.locks.ReentrantLock.lock(
> ReentrantLock.java:285)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.offer(ScheduledThreadPoolExecutor.java:1010)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:1037)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.add(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor.
> reExecutePeriodic(ScheduledThreadPoolExecutor.java:346)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:296)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@2b44b4d2
> >>
> >> "Timer-Driven Process Thread-9" Id=99 BLOCKED  on
> org.apache.nifi.controller.scheduling.ScheduleState@4099e6fa
> >>      at org.apache.nifi.controller.scheduling.
> TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:177)
> >>      at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> >>      at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>      Number of Locked Synchronizers: 1
> >>      - java.util.concurrent.ThreadPoolExecutor$Worker@2f7b3562
> >>
> >> "WorkerReceiver[myid=3]" Id=51 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@7cb984f1
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ArrayBlockingQueue.poll(
> ArrayBlockingQueue.java:418)
> >>      at org.apache.zookeeper.server.quorum.QuorumCnxManager.
> pollRecvQueue(QuorumCnxManager.java:901)
> >>      at org.apache.zookeeper.server.quorum.FastLeaderElection$
> Messenger$WorkerReceiver.run(FastLeaderElection.java:245)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "WorkerSender[myid=3]" Id=50 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@45c4feb3
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
> >>      at org.apache.zookeeper.server.quorum.FastLeaderElection$
> Messenger$WorkerSender.run(FastLeaderElection.java:427)
> >>      at java.lang.Thread.run(Thread.java:748)
> >>
> >> "Write-Ahead Local State Provider Maintenance" Id=41 TIMED_WAITING  on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@667aacf2
> >>      at sun.misc.Unsafe.park(Native Method)
> >>      at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> >>      at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> >>      at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> >>      at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> >>      at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> >>      at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >>      at java.lang.Thread.run(Thread.java:748)
> >
>
>

Mime
View raw message