lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1126 - Still Failing!
Date Sun, 12 Feb 2017 04:23:39 GMT
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1126/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestTolerantUpdateProcessorRandomCloud

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestTolerantUpdateProcessorRandomCloud:     1) Thread[id=30574, name=OverseerHdfsCoreFailoverThread-97443614124081172-127.0.0.1:59066_solr-n_0000000004, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)         at java.lang.Thread.run(Thread.java:745)    2) Thread[id=30572, name=OverseerStateUpdate-97443614124081172-127.0.0.1:59066_solr-n_0000000004, state=TIMED_WAITING, group=Overseer state updater.]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:164)         at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:138)         at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:179)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestTolerantUpdateProcessorRandomCloud: 
   1) Thread[id=30574, name=OverseerHdfsCoreFailoverThread-97443614124081172-127.0.0.1:59066_solr-n_0000000004, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=30572, name=OverseerStateUpdate-97443614124081172-127.0.0.1:59066_solr-n_0000000004, state=TIMED_WAITING, group=Overseer state updater.]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:164)
        at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:138)
        at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:179)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([E880CF9BE662A713]:0)




Build Log:
[...truncated 12534 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestTolerantUpdateProcessorRandomCloud
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/init-core-data-001
   [junit4]   2> 2786233 INFO  (SUITE-TestTolerantUpdateProcessorRandomCloud-seed#[E880CF9BE662A713]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields
   [junit4]   2> 2786235 INFO  (SUITE-TestTolerantUpdateProcessorRandomCloud-seed#[E880CF9BE662A713]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-9182 - causes OOM)
   [junit4]   2> 2786235 INFO  (SUITE-TestTolerantUpdateProcessorRandomCloud-seed#[E880CF9BE662A713]-worker) [    ] o.a.s.c.TestTolerantUpdateProcessorRandomCloud Configuring cluster: servers=7, shards=3, repfactor=2
   [junit4]   2> 2786236 INFO  (SUITE-TestTolerantUpdateProcessorRandomCloud-seed#[E880CF9BE662A713]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 7 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001
   [junit4]   2> 2786236 INFO  (SUITE-TestTolerantUpdateProcessorRandomCloud-seed#[E880CF9BE662A713]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2786236 INFO  (Thread-7277) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2786237 INFO  (Thread-7277) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2786336 INFO  (SUITE-TestTolerantUpdateProcessorRandomCloud-seed#[E880CF9BE662A713]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:54088
   [junit4]   2> 2786345 INFO  (jetty-launcher-5461-thread-1) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 2786346 INFO  (jetty-launcher-5461-thread-4) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 2786346 INFO  (jetty-launcher-5461-thread-6) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 2786346 INFO  (jetty-launcher-5461-thread-2) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 2786346 INFO  (jetty-launcher-5461-thread-5) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 2786347 INFO  (jetty-launcher-5461-thread-3) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 2786347 INFO  (jetty-launcher-5461-thread-7) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 2786352 INFO  (jetty-launcher-5461-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@584fcbbd{/solr,null,AVAILABLE}
   [junit4]   2> 2786353 INFO  (jetty-launcher-5461-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@709f0bc6{/solr,null,AVAILABLE}
   [junit4]   2> 2786353 INFO  (jetty-launcher-5461-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5ea94616{/solr,null,AVAILABLE}
   [junit4]   2> 2786354 INFO  (jetty-launcher-5461-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@332a6509{HTTP/1.1,[http/1.1]}{127.0.0.1:55101}
   [junit4]   2> 2786354 INFO  (jetty-launcher-5461-thread-1) [    ] o.e.j.s.Server Started @2789849ms
   [junit4]   2> 2786354 INFO  (jetty-launcher-5461-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@40e27e84{HTTP/1.1,[http/1.1]}{127.0.0.1:61589}
   [junit4]   2> 2786354 INFO  (jetty-launcher-5461-thread-4) [    ] o.e.j.s.Server Started @2789849ms
   [junit4]   2> 2786354 INFO  (jetty-launcher-5461-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=61589}
   [junit4]   2> 2786354 INFO  (jetty-launcher-5461-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=55101}
   [junit4]   2> 2786354 ERROR (jetty-launcher-5461-thread-4) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2786354 ERROR (jetty-launcher-5461-thread-1) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@19071077{/solr,null,AVAILABLE}
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-02-12T03:52:33.524Z
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-6) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4deaa889{/solr,null,AVAILABLE}
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2f600e9{HTTP/1.1,[http/1.1]}{127.0.0.1:64430}
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-5) [    ] o.e.j.s.Server Started @2789850ms
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64430}
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-6) [    ] o.e.j.s.AbstractConnector Started ServerConnector@f1edc30{HTTP/1.1,[http/1.1]}{127.0.0.1:59066}
   [junit4]   2> 2786355 ERROR (jetty-launcher-5461-thread-5) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-6) [    ] o.e.j.s.Server Started @2789850ms
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-6) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59066}
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 2786356 INFO  (jetty-launcher-5461-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2786356 ERROR (jetty-launcher-5461-thread-6) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2786356 INFO  (jetty-launcher-5461-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2786356 INFO  (jetty-launcher-5461-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-02-12T03:52:33.525Z
   [junit4]   2> 2786356 INFO  (jetty-launcher-5461-thread-6) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 2786356 INFO  (jetty-launcher-5461-thread-6) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2786356 INFO  (jetty-launcher-5461-thread-6) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2786356 INFO  (jetty-launcher-5461-thread-6) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-02-12T03:52:33.525Z
   [junit4]   2> 2786356 INFO  (jetty-launcher-5461-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@675a81cc{HTTP/1.1,[http/1.1]}{127.0.0.1:39480}
   [junit4]   2> 2786356 INFO  (jetty-launcher-5461-thread-2) [    ] o.e.j.s.Server Started @2789851ms
   [junit4]   2> 2786356 INFO  (jetty-launcher-5461-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39480}
   [junit4]   2> 2786356 ERROR (jetty-launcher-5461-thread-2) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2786357 INFO  (jetty-launcher-5461-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 2786357 INFO  (jetty-launcher-5461-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2786357 INFO  (jetty-launcher-5461-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2786357 INFO  (jetty-launcher-5461-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-02-12T03:52:33.526Z
   [junit4]   2> 2786358 INFO  (jetty-launcher-5461-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@485331aa{/solr,null,AVAILABLE}
   [junit4]   2> 2786358 INFO  (jetty-launcher-5461-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@147cd8ee{HTTP/1.1,[http/1.1]}{127.0.0.1:41793}
   [junit4]   2> 2786358 INFO  (jetty-launcher-5461-thread-3) [    ] o.e.j.s.Server Started @2789853ms
   [junit4]   2> 2786358 INFO  (jetty-launcher-5461-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41793}
   [junit4]   2> 2786359 ERROR (jetty-launcher-5461-thread-3) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2786359 INFO  (jetty-launcher-5461-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 2786359 INFO  (jetty-launcher-5461-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2786359 INFO  (jetty-launcher-5461-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2786359 INFO  (jetty-launcher-5461-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-02-12T03:52:33.528Z
   [junit4]   2> 2786355 INFO  (jetty-launcher-5461-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 2786360 INFO  (jetty-launcher-5461-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2786360 INFO  (jetty-launcher-5461-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2786360 INFO  (jetty-launcher-5461-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-02-12T03:52:33.529Z
   [junit4]   2> 2786363 INFO  (jetty-launcher-5461-thread-7) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@62e9f5ff{/solr,null,AVAILABLE}
   [junit4]   2> 2786364 INFO  (jetty-launcher-5461-thread-7) [    ] o.e.j.s.AbstractConnector Started ServerConnector@31cf3a4e{HTTP/1.1,[http/1.1]}{127.0.0.1:33012}
   [junit4]   2> 2786364 INFO  (jetty-launcher-5461-thread-7) [    ] o.e.j.s.Server Started @2789859ms
   [junit4]   2> 2786364 INFO  (jetty-launcher-5461-thread-7) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33012}
   [junit4]   2> 2786364 ERROR (jetty-launcher-5461-thread-7) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2786364 INFO  (jetty-launcher-5461-thread-7) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 2786364 INFO  (jetty-launcher-5461-thread-7) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2786364 INFO  (jetty-launcher-5461-thread-7) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2786364 INFO  (jetty-launcher-5461-thread-7) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-02-12T03:52:33.533Z
   [junit4]   2> 2786365 INFO  (jetty-launcher-5461-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2786369 INFO  (jetty-launcher-5461-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2786369 INFO  (jetty-launcher-5461-thread-6) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2786371 INFO  (jetty-launcher-5461-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2786372 INFO  (jetty-launcher-5461-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2786380 INFO  (jetty-launcher-5461-thread-7) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2786382 INFO  (jetty-launcher-5461-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2786387 INFO  (jetty-launcher-5461-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54088/solr
   [junit4]   2> 2786387 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15a3073657f0007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2786390 INFO  (jetty-launcher-5461-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54088/solr
   [junit4]   2> 2786390 INFO  (jetty-launcher-5461-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54088/solr
   [junit4]   2> 2786393 INFO  (jetty-launcher-5461-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54088/solr
   [junit4]   2> 2786394 INFO  (jetty-launcher-5461-thread-6) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54088/solr
   [junit4]   2> 2786395 INFO  (jetty-launcher-5461-thread-7) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54088/solr
   [junit4]   2> 2786401 INFO  (jetty-launcher-5461-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54088/solr
   [junit4]   2> 2786405 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15a3073657f000d, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2786406 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15a3073657f000b, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2786408 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15a3073657f0011, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2786472 INFO  (jetty-launcher-5461-thread-7) [n:127.0.0.1:33012_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33012_solr
   [junit4]   2> 2786473 INFO  (jetty-launcher-5461-thread-3) [n:127.0.0.1:41793_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41793_solr
   [junit4]   2> 2786473 INFO  (jetty-launcher-5461-thread-1) [n:127.0.0.1:55101_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55101_solr
   [junit4]   2> 2786474 INFO  (jetty-launcher-5461-thread-7) [n:127.0.0.1:33012_solr    ] o.a.s.c.Overseer Overseer (id=97443614124081171-127.0.0.1:33012_solr-n_0000000000) starting
   [junit4]   2> 2786475 INFO  (jetty-launcher-5461-thread-2) [n:127.0.0.1:39480_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39480_solr
   [junit4]   2> 2786476 INFO  (jetty-launcher-5461-thread-4) [n:127.0.0.1:61589_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61589_solr
   [junit4]   2> 2786479 INFO  (zkCallback-5488-thread-1-processing-n:127.0.0.1:41793_solr) [n:127.0.0.1:41793_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2786480 INFO  (zkCallback-5494-thread-1-processing-n:127.0.0.1:55101_solr) [n:127.0.0.1:55101_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2786492 INFO  (zkCallback-5490-thread-1-processing-n:127.0.0.1:39480_solr) [n:127.0.0.1:39480_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2786492 INFO  (zkCallback-5495-thread-1-processing-n:127.0.0.1:33012_solr) [n:127.0.0.1:33012_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2786492 INFO  (zkCallback-5489-thread-1-processing-n:127.0.0.1:64430_solr) [n:127.0.0.1:64430_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2786492 INFO  (zkCallback-5497-thread-1-processing-n:127.0.0.1:61589_solr) [n:127.0.0.1:61589_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2786494 INFO  (zkCallback-5490-thread-1-processing-n:127.0.0.1:39480_solr) [n:127.0.0.1:39480_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 2786495 INFO  (zkCallback-5494-thread-1-processing-n:127.0.0.1:55101_solr) [n:127.0.0.1:55101_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 2786500 INFO  (zkCallback-5497-thread-2-processing-n:127.0.0.1:61589_solr) [n:127.0.0.1:61589_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 2786500 INFO  (zkCallback-5488-thread-1-processing-n:127.0.0.1:41793_solr) [n:127.0.0.1:41793_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 2786500 INFO  (zkCallback-5495-thread-2-processing-n:127.0.0.1:33012_solr) [n:127.0.0.1:33012_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2786500 INFO  (zkCallback-5489-thread-1-processing-n:127.0.0.1:64430_solr) [n:127.0.0.1:64430_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 2786500 INFO  (zkCallback-5495-thread-1-processing-n:127.0.0.1:33012_solr) [n:127.0.0.1:33012_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2786501 INFO  (zkCallback-5496-thread-1-processing-n:127.0.0.1:59066_solr) [n:127.0.0.1:59066_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2786508 INFO  (jetty-launcher-5461-thread-5) [n:127.0.0.1:64430_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64430_solr
   [junit4]   2> 2786510 INFO  (zkCallback-5496-thread-2-processing-n:127.0.0.1:59066_solr) [n:127.0.0.1:59066_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 2786511 INFO  (zkCallback-5488-thread-1-processing-n:127.0.0.1:41793_solr) [n:127.0.0.1:41793_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2786511 INFO  (zkCallback-5490-thread-1-processing-n:127.0.0.1:39480_solr) [n:127.0.0.1:39480_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2786511 INFO  (zkCallback-5494-thread-1-processing-n:127.0.0.1:55101_solr) [n:127.0.0.1:55101_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2786511 INFO  (zkCallback-5489-thread-1-processing-n:127.0.0.1:64430_solr) [n:127.0.0.1:64430_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2786511 INFO  (jetty-launcher-5461-thread-6) [n:127.0.0.1:59066_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59066_solr
   [junit4]   2> 2786512 INFO  (zkCallback-5497-thread-2-processing-n:127.0.0.1:61589_solr) [n:127.0.0.1:61589_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2786512 INFO  (zkCallback-5495-thread-1-processing-n:127.0.0.1:33012_solr) [n:127.0.0.1:33012_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2786515 INFO  (zkCallback-5496-thread-2-processing-n:127.0.0.1:59066_solr) [n:127.0.0.1:59066_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2786517 INFO  (zkCallback-5490-thread-1-processing-n:127.0.0.1:39480_solr) [n:127.0.0.1:39480_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2786517 INFO  (zkCallback-5494-thread-1-processing-n:127.0.0.1:55101_solr) [n:127.0.0.1:55101_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2786519 INFO  (zkCallback-5497-thread-2-processing-n:127.0.0.1:61589_solr) [n:127.0.0.1:61589_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2786519 INFO  (zkCallback-5488-thread-1-processing-n:127.0.0.1:41793_solr) [n:127.0.0.1:41793_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2786519 INFO  (zkCallback-5495-thread-1-processing-n:127.0.0.1:33012_solr) [n:127.0.0.1:33012_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2786519 INFO  (zkCallback-5489-thread-1-processing-n:127.0.0.1:64430_solr) [n:127.0.0.1:64430_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2786520 INFO  (zkCallback-5496-thread-2-processing-n:127.0.0.1:59066_solr) [n:127.0.0.1:59066_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 2786536 INFO  (jetty-launcher-5461-thread-7) [n:127.0.0.1:33012_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33012_solr
   [junit4]   2> 2786550 INFO  (zkCallback-5494-thread-1-processing-n:127.0.0.1:55101_solr) [n:127.0.0.1:55101_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (7)
   [junit4]   2> 2786550 INFO  (zkCallback-5488-thread-1-processing-n:127.0.0.1:41793_solr) [n:127.0.0.1:41793_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (7)
   [junit4]   2> 2786556 INFO  (zkCallback-5490-thread-1-processing-n:127.0.0.1:39480_solr) [n:127.0.0.1:39480_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (7)
   [junit4]   2> 2786556 INFO  (zkCallback-5495-thread-1-processing-n:127.0.0.1:33012_solr) [n:127.0.0.1:33012_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (7)
   [junit4]   2> 2786556 INFO  (zkCallback-5489-thread-1-processing-n:127.0.0.1:64430_solr) [n:127.0.0.1:64430_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (7)
   [junit4]   2> 2786556 INFO  (zkCallback-5497-thread-2-processing-n:127.0.0.1:61589_solr) [n:127.0.0.1:61589_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (7)
   [junit4]   2> 2786569 INFO  (zkCallback-5496-thread-2-processing-n:127.0.0.1:59066_solr) [n:127.0.0.1:59066_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (7)
   [junit4]   2> 2786610 INFO  (jetty-launcher-5461-thread-2) [n:127.0.0.1:39480_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node2/.
   [junit4]   2> 2786708 INFO  (jetty-launcher-5461-thread-1) [n:127.0.0.1:55101_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node1/.
   [junit4]   2> 2786781 INFO  (jetty-launcher-5461-thread-3) [n:127.0.0.1:41793_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node6/.
   [junit4]   2> 2786814 INFO  (jetty-launcher-5461-thread-5) [n:127.0.0.1:64430_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node5/.
   [junit4]   2> 2786903 INFO  (jetty-launcher-5461-thread-6) [n:127.0.0.1:59066_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node4/.
   [junit4]   2> 2786933 INFO  (jetty-launcher-5461-thread-7) [n:127.0.0.1:33012_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node7/.
   [junit4]   2> 2786987 INFO  (jetty-launcher-5461-thread-4) [n:127.0.0.1:61589_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node3/.
   [junit4]   2> 2790841 INFO  (SUITE-TestTolerantUpdateProcessorRandomCloud-seed#[E880CF9BE662A713]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (7)
   [junit4]   2> 2790842 INFO  (SUITE-TestTolerantUpdateProcessorRandomCloud-seed#[E880CF9BE662A713]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54088/solr ready
   [junit4]   2> 2791565 INFO  (qtp1629588653-30303) [n:127.0.0.1:39480_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&collection.configName=solrCloudCollectionConfig&name=test_col&action=CREATE&numShards=3&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2791569 INFO  (OverseerThreadFactory-11184-thread-1-processing-n:127.0.0.1:33012_solr) [n:127.0.0.1:33012_solr    ] o.a.s.c.CreateCollectionCmd Create collection test_col
   [junit4]   2> 2791682 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr    ] o.a.s.h.a.CoreAdminOperation core create command property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&name=test_col_shard3_replica2&action=CREATE&numShards=3&collection=test_col&shard=shard3&wt=javabin&version=2
   [junit4]   2> 2791682 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr    ] o.a.s.h.a.CoreAdminOperation core create command property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&name=test_col_shard1_replica1&action=CREATE&numShards=3&collection=test_col&shard=shard1&wt=javabin&version=2
   [junit4]   2> 2791684 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr    ] o.a.s.h.a.CoreAdminOperation core create command property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&name=test_col_shard2_replica2&action=CREATE&numShards=3&collection=test_col&shard=shard2&wt=javabin&version=2
   [junit4]   2> 2791685 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr    ] o.a.s.h.a.CoreAdminOperation core create command property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&name=test_col_shard2_replica1&action=CREATE&numShards=3&collection=test_col&shard=shard2&wt=javabin&version=2
   [junit4]   2> 2791691 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr    ] o.a.s.h.a.CoreAdminOperation core create command property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&name=test_col_shard3_replica1&action=CREATE&numShards=3&collection=test_col&shard=shard3&wt=javabin&version=2
   [junit4]   2> 2791692 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr    ] o.a.s.h.a.CoreAdminOperation core create command property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&name=test_col_shard1_replica2&action=CREATE&numShards=3&collection=test_col&shard=shard1&wt=javabin&version=2
   [junit4]   2> 2791809 INFO  (zkCallback-5494-thread-1-processing-n:127.0.0.1:55101_solr) [n:127.0.0.1:55101_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2791809 INFO  (zkCallback-5488-thread-1-processing-n:127.0.0.1:41793_solr) [n:127.0.0.1:41793_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2791809 INFO  (zkCallback-5496-thread-2-processing-n:127.0.0.1:59066_solr) [n:127.0.0.1:59066_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2791809 INFO  (zkCallback-5497-thread-2-processing-n:127.0.0.1:61589_solr) [n:127.0.0.1:61589_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2791809 INFO  (zkCallback-5490-thread-1-processing-n:127.0.0.1:39480_solr) [n:127.0.0.1:39480_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2791810 INFO  (zkCallback-5495-thread-3-processing-n:127.0.0.1:33012_solr) [n:127.0.0.1:33012_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2792711 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 2792718 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema15.xml instead
   [junit4]   2> 2792723 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.IndexSchema [test_col_shard3_replica2] Schema name=test
   [junit4]   2> 2792730 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 2792753 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 2792755 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 2792756 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema15.xml instead
   [junit4]   2> 2792763 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema15.xml instead
   [junit4]   2> 2792767 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 2792790 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema15.xml instead
   [junit4]   2> 2792790 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema15.xml instead
   [junit4]   2> 2792795 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.IndexSchema [test_col_shard2_replica2] Schema name=test
   [junit4]   2> 2792796 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.IndexSchema [test_col_shard2_replica1] Schema name=test
   [junit4]   2> 2792820 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.IndexSchema [test_col_shard3_replica1] Schema name=test
   [junit4]   2> 2792821 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.IndexSchema [test_col_shard1_replica1] Schema name=test
   [junit4]   2> 2792826 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 2792843 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema15.xml instead
   [junit4]   2> 2792937 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.IndexSchema [test_col_shard1_replica2] Schema name=test
   [junit4]   2> 2792992 WARN  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.IndexSchema [test_col_shard2_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 2793031 WARN  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.IndexSchema [test_col_shard3_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 2793066 WARN  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.IndexSchema [test_col_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 2793072 WARN  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.IndexSchema [test_col_shard3_replica2] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 2793074 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2793090 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2793102 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/solrCloudCollectionConfig/managed-schema
   [junit4]   2> 2793102 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2793107 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/solrCloudCollectionConfig/schema15.xml to /configs/solrCloudCollectionConfig/schema15.xml.bak
   [junit4]   2> 2793108 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.CoreContainer Creating SolrCore 'test_col_shard2_replica1' using configuration from collection test_col
   [junit4]   2> 2793109 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SolrCore [[test_col_shard2_replica1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node3/test_col_shard2_replica1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node3/./test_col_shard2_replica1/data/]
   [junit4]   2> 2793109 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3774df79
   [junit4]   2> 2793110 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=9.767578125, floorSegmentMB=0.3857421875, forceMergeDeletesPctAllowed=11.065629076629586, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2793114 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/solrCloudCollectionConfig/managed-schema already exists - no need to create it
   [junit4]   2> 2793115 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, the non-managed schema /configs/solrCloudCollectionConfig/schema15.xml no longer exists.
   [junit4]   2> 2793116 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'test_col_shard1_replica1' using configuration from collection test_col
   [junit4]   2> 2793116 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.SolrCore [[test_col_shard1_replica1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node2/test_col_shard1_replica1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node2/./test_col_shard1_replica1/data/]
   [junit4]   2> 2793116 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3774df79
   [junit4]   2> 2793118 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=9.767578125, floorSegmentMB=0.3857421875, forceMergeDeletesPctAllowed=11.065629076629586, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2793125 WARN  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.IndexSchema [test_col_shard1_replica2] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 2793132 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/solrCloudCollectionConfig/managed-schema already exists - no need to create it
   [junit4]   2> 2793133 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, the non-managed schema /configs/solrCloudCollectionConfig/schema15.xml no longer exists.
   [junit4]   2> 2793134 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.c.CoreContainer Creating SolrCore 'test_col_shard3_replica2' using configuration from collection test_col
   [junit4]   2> 2793135 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.c.SolrCore [[test_col_shard3_replica2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node7/test_col_shard3_replica2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node7/./test_col_shard3_replica2/data/]
   [junit4]   2> 2793135 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3774df79
   [junit4]   2> 2793138 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=9.767578125, floorSegmentMB=0.3857421875, forceMergeDeletesPctAllowed=11.065629076629586, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2793146 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2793165 WARN  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.IndexSchema [test_col_shard2_replica2] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 2793186 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/solrCloudCollectionConfig/managed-schema already exists - no need to create it
   [junit4]   2> 2793187 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, the non-managed schema /configs/solrCloudCollectionConfig/schema15.xml no longer exists.
   [junit4]   2> 2793188 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.CoreContainer Creating SolrCore 'test_col_shard1_replica2' using configuration from collection test_col
   [junit4]   2> 2793189 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SolrCore [[test_col_shard1_replica2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node1/test_col_shard1_replica2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node1/./test_col_shard1_replica2/data/]
   [junit4]   2> 2793189 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3774df79
   [junit4]   2> 2793190 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=9.767578125, floorSegmentMB=0.3857421875, forceMergeDeletesPctAllowed=11.065629076629586, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2793217 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2793223 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2793243 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/solrCloudCollectionConfig/managed-schema already exists - no need to create it
   [junit4]   2> 2793243 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, the non-managed schema /configs/solrCloudCollectionConfig/schema15.xml no longer exists.
   [junit4]   2> 2793244 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.c.CoreContainer Creating SolrCore 'test_col_shard3_replica1' using configuration from collection test_col
   [junit4]   2> 2793245 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.c.SolrCore [[test_col_shard3_replica1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node4/test_col_shard3_replica1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node4/./test_col_shard3_replica1/data/]
   [junit4]   2> 2793245 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3774df79
   [junit4]   2> 2793247 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=9.767578125, floorSegmentMB=0.3857421875, forceMergeDeletesPctAllowed=11.065629076629586, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2793250 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/solrCloudCollectionConfig/managed-schema already exists - no need to create it
   [junit4]   2> 2793250 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, the non-managed schema /configs/solrCloudCollectionConfig/schema15.xml no longer exists.
   [junit4]   2> 2793251 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.CoreContainer Creating SolrCore 'test_col_shard2_replica2' using configuration from collection test_col
   [junit4]   2> 2793252 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.SolrCore [[test_col_shard2_replica2] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node6/test_col_shard2_replica2], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorRandomCloud_E880CF9BE662A713-001/tempDir-001/node6/./test_col_shard2_replica2/data/]
   [junit4]   2> 2793252 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3774df79
   [junit4]   2> 2793253 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=9.767578125, floorSegmentMB=0.3857421875, forceMergeDeletesPctAllowed=11.065629076629586, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2793326 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2793326 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2793327 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2793327 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2793327 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.306980825872113]
   [junit4]   2> 2793328 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@12d02b42[test_col_shard3_replica1] main]
   [junit4]   2> 2793336 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2793336 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2793337 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2793337 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2793337 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.306980825872113]
   [junit4]   2> 2793338 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.SolrIndexSearcher Opening [Searcher@76a43748[test_col_shard1_replica2] main]
   [junit4]   2> 2793340 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 2793340 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 2793340 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/solrCloudCollectionConfig/managed-schema
   [junit4]   2> 2793341 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 2793345 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2793345 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2793345 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.IndexSchema [test_col_shard1_replica2] Schema name=test
   [junit4]   2> 2793346 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2793346 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2793347 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.306980825872113]
   [junit4]   2> 2793347 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.SolrIndexSearcher Opening [Searcher@44f310d4[test_col_shard3_replica2] main]
   [junit4]   2> 2793348 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 2793349 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 2793349 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/solrCloudCollectionConfig/managed-schema
   [junit4]   2> 2793349 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 2793349 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 2793349 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/solrCloudCollectionConfig/managed-schema
   [junit4]   2> 2793350 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 2793351 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2793351 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2793391 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2793391 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2793391 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.306980825872113]
   [junit4]   2> 2793392 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@68ca2cfe[test_col_shard2_replica1] main]
   [junit4]   2> 2793393 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 2793394 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 2793394 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/solrCloudCollectionConfig/managed-schema
   [junit4]   2> 2793395 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 2793396 INFO  (searcherExecutor-11199-thread-1-processing-n:127.0.0.1:61589_solr x:test_col_shard2_replica1 s:shard2 c:test_col) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SolrCore [test_col_shard2_replica1] Registered new searcher Searcher@68ca2cfe[test_col_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2793396 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559097833491005440
   [junit4]   2> 2793414 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9992ms
   [junit4]   2> 2793414 INFO  (zkCallback-5495-thread-1-processing-n:127.0.0.1:33012_solr) [n:127.0.0.1:33012_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2793414 INFO  (zkCallback-5497-thread-2-processing-n:127.0.0.1:61589_solr) [n:127.0.0.1:61589_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2793415 INFO  (zkCallback-5494-thread-1-processing-n:127.0.0.1:55101_solr) [n:127.0.0.1:55101_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2793414 INFO  (zkCallback-5496-thread-2-processing-n:127.0.0.1:59066_solr) [n:127.0.0.1:59066_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2793415 INFO  (zkCallback-5490-thread-1-processing-n:127.0.0.1:39480_solr) [n:127.0.0.1:39480_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2793416 INFO  (zkCallback-5488-thread-1-processing-n:127.0.0.1:41793_solr) [n:127.0.0.1:41793_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2793426 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 2793427 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.IndexSchema [test_col_shard3_replica1] Schema name=test
   [junit4]   2> 2793429 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.IndexSchema [test_col_shard3_replica2] Schema name=test
   [junit4]   2> 2793474 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2793474 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2793475 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2793475 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2793476 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.306980825872113]
   [junit4]   2> 2793477 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.SolrIndexSearcher Opening [Searcher@3075adde[test_col_shard2_replica2] main]
   [junit4]   2> 2793478 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 2793479 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 2793479 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/solrCloudCollectionConfig/managed-schema
   [junit4]   2> 2793480 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 2793507 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.IndexSchema [test_col_shard2_replica2] Schema name=test
   [junit4]   2> 2793518 WARN  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.IndexSchema [test_col_shard1_replica2] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 2793544 WARN  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.IndexSchema [test_col_shard3_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 2793580 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2793581 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2793593 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2793593 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2793594 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.306980825872113]
   [junit4]   2> 2793594 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@f3778d0[test_col_shard1_replica1] main]
   [junit4]   2> 2793623 WARN  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.IndexSchema [test_col_shard2_replica2] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 2793629 WARN  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.IndexSchema [test_col_shard3_replica2] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 2793653 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2793654 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2793655 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2793666 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2793677 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 196 ms
   [junit4]   2> 2793678 INFO  (searcherExecutor-11204-thread-1-processing-n:127.0.0.1:41793_solr x:test_col_shard2_replica2 s:shard2 c:test_col) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.c.SolrCore [test_col_shard2_replica2] Registered new searcher Searcher@3075adde[test_col_shard2_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2793679 INFO  (qtp1676013452-30357) [n:127.0.0.1:41793_solr c:test_col s:shard2  x:test_col_shard2_replica2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559097833787752448
   [junit4]   2> 2793689 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 2793691 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 2793691 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/solrCloudCollectionConfig/managed-schema
   [junit4]   2> 2793697 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 2793701 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.IndexSchema [test_col_shard1_replica1] Schema name=test
   [junit4]   2> 2793756 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 414 ms
   [junit4]   2> 2793757 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 407 ms
   [junit4]   2> 2793757 INFO  (searcherExecutor-11202-thread-1-processing-n:127.0.0.1:55101_solr x:test_col_shard1_replica2 s:shard1 c:test_col) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.SolrCore [test_col_shard1_replica2] Registered new searcher Searcher@76a43748[test_col_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2793758 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559097833870589952
   [junit4]   2> 2793758 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559097833870589952
   [junit4]   2> 2793760 INFO  (searcherExecutor-11203-thread-1-processing-n:127.0.0.1:59066_solr x:test_col_shard3_replica1 s:shard3 c:test_col) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.c.SolrCore [test_col_shard3_replica1] Registered new searcher Searcher@12d02b42[test_col_shard3_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2793766 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 340 ms
   [junit4]   2> 2793768 INFO  (searcherExecutor-11201-thread-1-processing-n:127.0.0.1:33012_solr x:test_col_shard3_replica2 s:shard3 c:test_col) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.c.SolrCore [test_col_shard3_replica2] Registered new searcher Searcher@44f310d4[test_col_shard3_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2793768 INFO  (qtp1571178598-30325) [n:127.0.0.1:33012_solr c:test_col s:shard3  x:test_col_shard3_replica2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559097833881075712
   [junit4]   2> 2793769 INFO  (qtp544137359-30328) [n:127.0.0.1:55101_solr c:test_col s:shard1  x:test_col_shard1_replica2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 2793769 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard3: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 2793772 WARN  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.IndexSchema [test_col_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 2793792 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2793811 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 113 ms
   [junit4]   2> 2793811 INFO  (searcherExecutor-11200-thread-1-processing-n:127.0.0.1:39480_solr x:test_col_shard1_replica1 s:shard1 c:test_col) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.c.SolrCore [test_col_shard1_replica1] Registered new searcher Searcher@f3778d0[test_col_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2793812 INFO  (qtp1629588653-30305) [n:127.0.0.1:39480_solr c:test_col s:shard1  x:test_col_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1559097833927213056
   [junit4]   2> 2793875 INFO  (zkCallback-5490-thread-1-processing-n:127.0.0.1:39480_solr) [n:127.0.0.1:39480_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2793875 INFO  (zkCallback-5494-thread-1-processing-n:127.0.0.1:55101_solr) [n:127.0.0.1:55101_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2793876 INFO  (zkCallback-5496-thread-2-processing-n:127.0.0.1:59066_solr) [n:127.0.0.1:59066_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2793875 INFO  (zkCallback-5488-thread-1-processing-n:127.0.0.1:41793_solr) [n:127.0.0.1:41793_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2793876 INFO  (zkCallback-5497-thread-2-processing-n:127.0.0.1:61589_solr) [n:127.0.0.1:61589_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2793876 INFO  (zkCallback-5495-thread-3-processing-n:127.0.0.1:33012_solr) [n:127.0.0.1:33012_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2793917 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2793917 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2793917 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:61589/solr/test_col_shard2_replica1/
   [junit4]   2> 2793918 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.PeerSync PeerSync: core=test_col_shard2_replica1 url=http://127.0.0.1:61589/solr START replicas=[http://127.0.0.1:41793/solr/test_col_shard2_replica2/] nUpdates=100
   [junit4]   2> 2793918 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.u.PeerSync PeerSync: core=test_col_shard2_replica1 url=http://127.0.0.1:61589/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 2793919 INFO  (qtp1676013452-30359) [n:127.0.0.1:41793_solr c:test_col s:shard2 r:core_node2 x:test_col_shard2_replica2] o.a.s.c.S.Request [test_col_shard2_replica2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2793920 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 2793920 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 2793926 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:61589/solr/test_col_shard2_replica1/ shard2
   [junit4]   2> 2794031 INFO  (zkCallback-5490-thread-1-processing-n:127.0.0.1:39480_solr) [n:127.0.0.1:39480_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2794031 INFO  (zkCallback-5488-thread-1-processing-n:127.0.0.1:41793_solr) [n:127.0.0.1:41793_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2794031 INFO  (zkCallback-5494-thread-1-processing-n:127.0.0.1:55101_solr) [n:127.0.0.1:55101_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2794031 INFO  (zkCallback-5496-thread-2-processing-n:127.0.0.1:59066_solr) [n:127.0.0.1:59066_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2794031 INFO  (zkCallback-5497-thread-2-processing-n:127.0.0.1:61589_solr) [n:127.0.0.1:61589_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2794031 INFO  (zkCallback-5495-thread-3-processing-n:127.0.0.1:33012_solr) [n:127.0.0.1:33012_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2794082 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2794085 INFO  (qtp1438662574-30312) [n:127.0.0.1:61589_solr c:test_col s:shard2  x:test_col_shard2_replica1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&name=test_col_shard2_replica1&action=CREATE&numShards=3&collection=test_col&shard=shard2&wt=javabin&version=2} status=0 QTime=2400
   [junit4]   2> 2794189 INFO  (zkCallback-5490-thread-1-processing-n:127.0.0.1:39480_solr) [n:127.0.0.1:39480_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2794189 INFO  (zkCallback-5488-thread-1-processing-n:127.0.0.1:41793_solr) [n:127.0.0.1:41793_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2794189 INFO  (zkCallback-5494-thread-1-processing-n:127.0.0.1:55101_solr) [n:127.0.0.1:55101_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2794189 INFO  (zkCallback-5496-thread-2-processing-n:127.0.0.1:59066_solr) [n:127.0.0.1:59066_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2794190 INFO  (zkCallback-5495-thread-2-processing-n:127.0.0.1:33012_solr) [n:127.0.0.1:33012_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2794191 INFO  (zkCallback-5497-thread-2-processing-n:127.0.0.1:61589_solr) [n:127.0.0.1:61589_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [7])
   [junit4]   2> 2794277 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2794277 INFO  (qtp1964210261-30310) [n:127.0.0.1:59066_solr c:test_col s:shard3  x:test_col_shard3_replica1] o.a.s.c.

[...truncated too long message...]

NumericTerms32, DistributedDebugComponentTest, TestRecoveryHdfs, TestFuzzyAnalyzedSuggestions, DistributedFacetPivotLongTailTest, TestManagedSchema, TestMiniSolrCloudCluster, TestPKIAuthenticationPlugin, TestSolrConfigHandlerCloud, TestStressRecovery, JsonValidatorTest, TestConfigsApi, TestSuggestSpellingConverter, TestIndexingPerformance, StatsComponentTest, BadIndexSchemaTest, SolrCoreMetricManagerTest, TestLeaderElectionZkExpiry, ChangedSchemaMergeTest, TestNoOpRegenerator, WordBreakSolrSpellCheckerTest, MinimalSchemaTest, TestRangeQuery, SolrGangliaReporterTest, TestConfig, BasicDistributedZk2Test, AnalysisErrorHandlingTest, TestHdfsCloudBackupRestore, URLClassifyProcessorTest, TestFieldSortValues, SuggesterTest, TestOmitPositions, TestMiniSolrCloudClusterSSL, FullHLLTest, TestSSLRandomization, TestDistributedGrouping, HighlighterConfigTest, TestClusterStateMutator, TestQueryWrapperFilter, LeaderInitiatedRecoveryOnCommitTest, TestManagedStopFilterFactory, TestQueryUtils, FileBasedSpellCheckerTest, FieldMutatingUpdateProcessorTest, SmileWriterTest, TestSolrCoreParser, ExternalFileFieldSortTest, TestCloudSchemaless, HLLUtilTest, CacheHeaderTest, DistributedIntervalFacetingTest, TestJsonFacets, DistributedFacetExistsSmallTest, BlockCacheTest, TestMaxScoreQueryParser, TestNonDefinedSimilarityFactory, TestLocalFSCloudBackupRestore, TestReload, IndexSchemaTest, ConjunctionSolrSpellCheckerTest, TestSubQueryTransformer, BadCopyFieldTest, VMParamsZkACLAndCredentialsProvidersTest, CustomCollectionTest, TestXmlQParserPlugin, CSVRequestHandlerTest, SortByFunctionTest, LeaderFailoverAfterPartitionTest, PKIAuthenticationIntegrationTest, DistributedQueryComponentCustomSortTest, TestSolrCoreProperties, BasicZkTest, DocValuesMissingTest, TestTrieFacet, TestFieldCacheSortRandom, TestQueryTypes, TestCrossCoreJoin, DeleteReplicaTest, SuggestComponentContextFilterQueryTest, ReplicationFactorTest, TestDistributedMissingSort, BasicFunctionalityTest, CurrencyFieldOpenExchangeTest, TestMacros, SimpleCollectionCreateDeleteTest, TestInitParams, TestShortCircuitedRequests, TestRebalanceLeaders, BitVectorTest, TestCopyFieldCollectionResource, RegexBoostProcessorTest, TestSolrQueryResponse, TestPathTrie, DistributedFacetPivotSmallTest, FullSolrCloudDistribCmdsTest, CursorMarkTest, TestSQLHandler, RankQueryTest, ZkStateWriterTest, TestClusterProperties, HdfsRecoveryZkTest, ShardRoutingCustomTest, SolrCoreCheckLockOnStartupTest, BJQParserTest, OverriddenZkACLAndCredentialsProvidersTest, TestCloudManagedSchema, TestSolrCloudWithSecureImpersonation, TestCloudInspectUtil, TestSolrCloudWithDelegationTokens, TestLuceneMatchVersion, TestReloadAndDeleteDocs, SuggesterWFSTTest, SpellPossibilityIteratorTest, TestSolr4Spatial, TestRandomFaceting, MetricsHandlerTest, TestUseDocValuesAsStored, TestExceedMaxTermLength, TestInPlaceUpdatesDistrib, TlogReplayBufferedWhileIndexingTest, TestPHPSerializedResponseWriter, TestSearcherReuse, TestRTimerTree, ScriptEngineTest, CloudMLTQParserTest, ConnectionManagerTest, TestDynamicFieldCollectionResource, SolrIndexSplitterTest, TestScoreJoinQPScore, HdfsChaosMonkeySafeLeaderTest, DistributedTermsComponentTest, TestCloudPseudoReturnFields, TestHdfsBackupRestoreCore, TestSolrConfigHandler, CachingDirectoryFactoryTest, DebugComponentTest, MultiThreadedOCPTest, TestNamedUpdateProcessors, ManagedSchemaRoundRobinCloudTest, CloudExitableDirectoryReaderTest, TestIntervalFaceting, TestSolrIndexConfig, TestTrie, TestManagedSchemaThreadSafety, DataDrivenBlockJoinTest, TestSolrQueryParserResource, DirectUpdateHandlerOptimizeTest, TestUninvertingReader, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, RecoveryZkTest, ZkSolrClientTest, TestRandomDVFaceting, TestDistributedSearch, TestHashPartitioner, TestJoin, TestCoreContainer, SimpleFacetsTest, SolrCoreTest, SolrCmdDistributorTest, TestFiltering, TestLazyCores, TestIndexSearcher, DistributedQueryElevationComponentTest, SolrRequestParserTest, SuggesterTSTTest, PolyFieldTest, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, TestRemoteStreaming, DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, PrimitiveFieldTypeTest, TestValueSourceCache, TermVectorComponentTest, FieldAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, ReturnFieldsTest, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, TestComponentsName, SearchHandlerTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, CopyFieldTest, ResponseLogComponentTest, BadComponentTest, MultiTermTest, SampleTest, TestDocSet, TestSearchPerf, OutputWriterTest, DirectSolrConnectionTest, TestPhraseSuggestions, TestCodecSupport, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, TestJmxMonitoredMap, TimeZoneUtilsTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, DateMathParserTest, PreAnalyzedFieldTest, TestSystemIdResolver, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, ClusterStateTest, TestSolrJ, TestUtils, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, TestRTGBase, CursorPagingTest, CleanupOldIndexTest, CollectionTooManyReplicasTest, CollectionsAPISolrJTest, DeleteShardTest, DeleteStatusTest, DistributedQueueTest, DistributedVersionInfoTest, LeaderElectionContextKeyTest, LeaderInitiatedRecoveryOnShardRestartTest, MigrateRouteKeyTest, MissingSegmentRecoveryTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerModifyCollectionTest, OverseerRolesTest, OverseerStatusTest, RemoteQueryErrorTest, RollingRestartTest, SharedFSAutoReplicaFailoverTest, SolrCLIZkUtilsTest, SolrCloudExampleTest, SolrXmlInZkTest, TestAuthenticationFramework, TestCloudDeleteByQuery, TestCollectionAPI, TestConfigSetsAPI, TestConfigSetsAPIZkFailure, TestDeleteCollectionOnDownNodes, TestDownShardTolerantSearch, TestRandomFlRTGCloud, TestReplicaProperties, TestRequestForwarding, TestRequestStatusCollectionAPI, TestSegmentSorting, TestSolrCloudWithKerberosAlt, TestStressCloudBlindAtomicUpdates, TestStressLiveNodes, TestTolerantUpdateProcessorCloud, TestTolerantUpdateProcessorRandomCloud]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestTolerantUpdateProcessorRandomCloud -Dtests.seed=E880CF9BE662A713 -Dtests.slow=true -Dtests.locale=ar-YE -Dtests.timezone=Africa/El_Aaiun -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | TestTolerantUpdateProcessorRandomCloud (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestTolerantUpdateProcessorRandomCloud: 
   [junit4]    >    1) Thread[id=30574, name=OverseerHdfsCoreFailoverThread-97443614124081172-127.0.0.1:59066_solr-n_0000000004, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    2) Thread[id=30572, name=OverseerStateUpdate-97443614124081172-127.0.0.1:59066_solr-n_0000000004, state=TIMED_WAITING, group=Overseer state updater.]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   [junit4]    >         at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:164)
   [junit4]    >         at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:138)
   [junit4]    >         at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:179)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([E880CF9BE662A713]:0)
   [junit4] Completed [535/694 (1!)] on J1 in 37.04s, 2 tests, 1 error <<< FAILURES!

[...truncated 62711 lines...]
-documentation-lint:
    [jtidy] Checking for broken html (such as invalid tags)...
   [delete] Deleting directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/build/jtidy_tmp
     [echo] Checking for broken links...
     [exec] 
     [exec] Crawl/parse...
     [exec] 
     [exec] Verify...
     [echo] Checking for malformed docs...
     [exec] 
     [exec] /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/docs/solr-solrj/overview-summary.html
     [exec]   missing: org.apache.solr.client.solrj.io.eval
     [exec] 
     [exec] Missing javadocs were found!

BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/build.xml:775: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/build.xml:101: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build.xml:654: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build.xml:670: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:2493: exec returned: 1

Total time: 97 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Mime
View raw message