lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 431 - Still Unstable!
Date Fri, 09 Feb 2018 09:52:23 GMT
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/431/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testListeners

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([2F8A91C2FB18F026:C24A06D246746DFF]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testListeners(TriggerIntegrationTest.java:1053)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14023 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4]   2> 3596927 INFO  (SUITE-TriggerIntegrationTest-seed#[2F8A91C2FB18F026]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_2F8A91C2FB18F026-001/init-core-data-001
   [junit4]   2> 3596928 INFO  (SUITE-TriggerIntegrationTest-seed#[2F8A91C2FB18F026]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 3596930 INFO  (SUITE-TriggerIntegrationTest-seed#[2F8A91C2FB18F026]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 3596931 INFO  (SUITE-TriggerIntegrationTest-seed#[2F8A91C2FB18F026]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_2F8A91C2FB18F026-001/tempDir-001
   [junit4]   2> 3596931 INFO  (SUITE-TriggerIntegrationTest-seed#[2F8A91C2FB18F026]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 3596931 INFO  (Thread-6705) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3596931 INFO  (Thread-6705) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 3596933 ERROR (Thread-6705) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 3597031 INFO  (SUITE-TriggerIntegrationTest-seed#[2F8A91C2FB18F026]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:53321
   [junit4]   2> 3597034 INFO  (zkConnectionManagerCallback-6523-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3597040 INFO  (jetty-launcher-6520-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 3597040 INFO  (jetty-launcher-6520-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 3597042 INFO  (jetty-launcher-6520-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3597042 INFO  (jetty-launcher-6520-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3597042 INFO  (jetty-launcher-6520-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 3597043 INFO  (jetty-launcher-6520-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3597043 INFO  (jetty-launcher-6520-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3597043 INFO  (jetty-launcher-6520-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 3597043 INFO  (jetty-launcher-6520-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a7daf68{/solr,null,AVAILABLE}
   [junit4]   2> 3597043 INFO  (jetty-launcher-6520-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4277e9d6{/solr,null,AVAILABLE}
   [junit4]   2> 3597043 INFO  (jetty-launcher-6520-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@286e9cf3{HTTP/1.1,[http/1.1]}{127.0.0.1:46803}
   [junit4]   2> 3597043 INFO  (jetty-launcher-6520-thread-2) [    ] o.e.j.s.Server Started @3604761ms
   [junit4]   2> 3597043 INFO  (jetty-launcher-6520-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@11d5320c{HTTP/1.1,[http/1.1]}{127.0.0.1:54453}
   [junit4]   2> 3597043 INFO  (jetty-launcher-6520-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46803}
   [junit4]   2> 3597043 INFO  (jetty-launcher-6520-thread-1) [    ] o.e.j.s.Server Started @3604761ms
   [junit4]   2> 3597044 INFO  (jetty-launcher-6520-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=54453}
   [junit4]   2> 3597044 ERROR (jetty-launcher-6520-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3597044 ERROR (jetty-launcher-6520-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3597044 INFO  (jetty-launcher-6520-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.3.0
   [junit4]   2> 3597044 INFO  (jetty-launcher-6520-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3597044 INFO  (jetty-launcher-6520-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.3.0
   [junit4]   2> 3597044 INFO  (jetty-launcher-6520-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3597044 INFO  (jetty-launcher-6520-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3597044 INFO  (jetty-launcher-6520-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3597044 INFO  (jetty-launcher-6520-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-09T09:22:53.796Z
   [junit4]   2> 3597044 INFO  (jetty-launcher-6520-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-09T09:22:53.796Z
   [junit4]   2> 3597046 INFO  (zkConnectionManagerCallback-6525-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3597046 INFO  (zkConnectionManagerCallback-6527-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3597046 INFO  (jetty-launcher-6520-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3597046 INFO  (jetty-launcher-6520-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3597053 INFO  (jetty-launcher-6520-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53321/solr
   [junit4]   2> 3597054 INFO  (jetty-launcher-6520-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53321/solr
   [junit4]   2> 3597054 INFO  (zkConnectionManagerCallback-6532-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3597055 INFO  (zkConnectionManagerCallback-6535-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3597057 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1006462eed40004, likely client has closed socket
   [junit4]   2> 3597057 INFO  (zkConnectionManagerCallback-6537-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3597058 INFO  (zkConnectionManagerCallback-6539-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3597234 INFO  (jetty-launcher-6520-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3597235 INFO  (jetty-launcher-6520-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54453_solr
   [junit4]   2> 3597237 INFO  (jetty-launcher-6520-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.Overseer Overseer (id=72167970114371590-127.0.0.1:54453_solr-n_0000000000) starting
   [junit4]   2> 3597242 INFO  (jetty-launcher-6520-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3597248 INFO  (jetty-launcher-6520-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46803_solr
   [junit4]   2> 3597251 INFO  (zkCallback-6538-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3597252 INFO  (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3597253 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 3597255 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 3597255 INFO  (jetty-launcher-6520-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54453_solr
   [junit4]   2> 3597255 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:46803_solr]
   [junit4]   2> 3597255 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 3597255 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 3597257 INFO  (zkCallback-6538-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3597258 INFO  (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3597259 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3597259 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 3597260 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3597347 INFO  (jetty-launcher-6520-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54453.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3597377 INFO  (jetty-launcher-6520-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54453.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3597377 INFO  (jetty-launcher-6520-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54453.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3597378 INFO  (jetty-launcher-6520-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_2F8A91C2FB18F026-001/tempDir-001/node1/.
   [junit4]   2> 3597462 INFO  (jetty-launcher-6520-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46803.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3597468 INFO  (jetty-launcher-6520-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46803.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3597469 INFO  (jetty-launcher-6520-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46803.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3597469 INFO  (jetty-launcher-6520-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_2F8A91C2FB18F026-001/tempDir-001/node2/.
   [junit4]   2> 3597491 INFO  (zkConnectionManagerCallback-6545-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3597495 INFO  (zkConnectionManagerCallback-6549-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3597496 INFO  (SUITE-TriggerIntegrationTest-seed#[2F8A91C2FB18F026]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 3597498 INFO  (SUITE-TriggerIntegrationTest-seed#[2F8A91C2FB18F026]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53321/solr ready
   [junit4]   2> 3597537 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testEventFromRestoredState
   [junit4]   2> 3597538 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
   [junit4]   2> 3597538 DEBUG (zkCallback-6538-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 3597538 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 3597542 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 3597542 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3597543 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 3597550 INFO  (qtp2011984679-31564) [n:127.0.0.1:46803_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3597552 INFO  (qtp1561252900-31576) [n:127.0.0.1:54453_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3597552 DEBUG (qtp1561252900-31569) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3597553 INFO  (qtp1561252900-31569) [n:127.0.0.1:54453_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=5
   [junit4]   2> 3597554 DEBUG (zkCallback-6538-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 3597555 DEBUG (zkCallback-6538-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:46803_solr, 127.0.0.1:54453_solr]
   [junit4]   2> 3597555 DEBUG (zkCallback-6538-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerEFRS instantiated with properties: {event=nodeAdded, waitFor=10, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
   [junit4]   2> 3597555 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 3597558 INFO  (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 3597559 INFO  (qtp1561252900-31572) [n:127.0.0.1:54453_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3597560 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 3597560 DEBUG (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 3597561 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3597561 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 3597570 INFO  (qtp1561252900-31572) [n:127.0.0.1:54453_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=10
   [junit4]   2> 3597570 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 3597572 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3597572 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3597572 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 3597573 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@c9bab2d{/solr,null,AVAILABLE}
   [junit4]   2> 3597573 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6bffafaa{HTTP/1.1,[http/1.1]}{127.0.0.1:59596}
   [junit4]   2> 3597573 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.Server Started @3605291ms
   [junit4]   2> 3597573 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59596}
   [junit4]   2> 3597573 ERROR (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3597574 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.3.0
   [junit4]   2> 3597574 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3597574 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3597574 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-09T09:22:54.326Z
   [junit4]   2> 3597576 INFO  (zkConnectionManagerCallback-6551-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3597577 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3597587 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53321/solr
   [junit4]   2> 3597589 INFO  (zkConnectionManagerCallback-6555-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3597593 INFO  (zkConnectionManagerCallback-6557-thread-1-processing-n:127.0.0.1:59596_solr) [n:127.0.0.1:59596_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3597605 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:59596_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 3597609 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:59596_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3597612 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:59596_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59596_solr
   [junit4]   2> 3597614 INFO  (zkCallback-6538-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3597614 INFO  (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3597615 INFO  (zkCallback-6548-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3597616 INFO  (zkCallback-6556-thread-1-processing-n:127.0.0.1:59596_solr) [n:127.0.0.1:59596_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3597720 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:59596_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59596.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3597728 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:59596_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59596.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3597728 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:59596_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59596.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3597729 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:59596_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_2F8A91C2FB18F026-001/tempDir-001/node3/.
   [junit4]   2> 3598567 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3598567 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3598568 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:59596_solr at time 1684206904122354
   [junit4]   2> 3599566 INFO  (OverseerCollectionConfigSetProcessor-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 3599569 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3599570 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3600570 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3600571 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3601571 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3601572 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3602573 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3602573 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3603574 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3603574 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3604575 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3604575 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3605577 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3605577 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3606578 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3606578 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3607580 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3607581 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3608586 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3608586 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3608587 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerEFRS firing registered processor for nodes: [127.0.0.1:59596_solr] added at times [1684206904122354], now=1684216926569113
   [junit4]   2> 3608587 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"5fbc6fa3f9bf2T10z6iumiqzpg98s7zmcz3hrfe",
   [junit4]   2>   "source":"node_added_triggerEFRS",
   [junit4]   2>   "eventTime":1684206904122354,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1684206904122354],
   [junit4]   2>     "nodeNames":["127.0.0.1:59596_solr"]}}
   [junit4]   2> 3608588 DEBUG (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_triggerEFRS]
   [junit4]   2> 3608589 INFO  (ScheduledTrigger-13017-thread-2) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 3608590 DEBUG (AutoscalingActionExecutor-13018-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"5fbc6fa3f9bf2T10z6iumiqzpg98s7zmcz3hrfe",
   [junit4]   2>   "source":"node_added_triggerEFRS",
   [junit4]   2>   "eventTime":1684206904122354,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1684206904122354],
   [junit4]   2>     "_enqueue_time_":1684216927916853,
   [junit4]   2>     "nodeNames":["127.0.0.1:59596_solr"]}}
   [junit4]   2> 3608591 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 3608591 DEBUG (AutoscalingActionExecutor-13018-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_triggerEFRS after 5000ms
   [junit4]   2> 3608592 DEBUG (AutoscalingActionExecutor-13018-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 1 ms for event id=5fbc6fa3f9bf2T10z6iumiqzpg98s7zmcz3hrfe
   [junit4]   2> 3608592 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3608592 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3608592 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 3608592 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@57fa4646{/solr,null,AVAILABLE}
   [junit4]   2> 3608593 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1aececb2{HTTP/1.1,[http/1.1]}{127.0.0.1:42684}
   [junit4]   2> 3608593 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.Server Started @3616314ms
   [junit4]   2> 3608593 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42684}
   [junit4]   2> 3608593 ERROR (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3608593 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.3.0
   [junit4]   2> 3608593 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3608593 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3608594 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-09T09:23:05.346Z
   [junit4]   2> 3608596 INFO  (zkConnectionManagerCallback-6561-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3608597 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3608603 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53321/solr
   [junit4]   2> 3608604 INFO  (zkConnectionManagerCallback-6565-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3608607 INFO  (zkConnectionManagerCallback-6567-thread-1-processing-n:127.0.0.1:42684_solr) [n:127.0.0.1:42684_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3608616 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42684_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 3608619 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42684_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3608623 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42684_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42684_solr
   [junit4]   2> 3608628 INFO  (zkCallback-6566-thread-1-processing-n:127.0.0.1:42684_solr) [n:127.0.0.1:42684_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3608629 INFO  (zkCallback-6538-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3608636 INFO  (zkCallback-6556-thread-1-processing-n:127.0.0.1:59596_solr) [n:127.0.0.1:59596_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3608638 INFO  (zkCallback-6548-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3608638 INFO  (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3608765 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42684_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42684.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3608773 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42684_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42684.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3608773 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42684_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42684.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3608774 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42684_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_2F8A91C2FB18F026-001/tempDir-001/node4/.
   [junit4]   2> 3613593 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3613594 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3613594 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:42684_solr at time 1684221935289324
   [junit4]   2> 3614605 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3614605 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3615607 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3615607 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3616608 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3616608 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3617609 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3617609 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3618610 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3618610 DEBUG (ScheduledTrigger-13017-thread-1) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3618812 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@11d5320c{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 3618813 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=25941431
   [junit4]   2> 3618813 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 3618813 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3edf392e: rootName = solr_54453, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@6e61dd78
   [junit4]   2> 3618819 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 3618819 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@592f1d59: rootName = solr_54453, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@49341810
   [junit4]   2> 3618824 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 3618824 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2d959be1: rootName = solr_54453, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6c142174
   [junit4]   2> 3618827 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:54453_solr
   [junit4]   2> 3618828 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 3618829 INFO  (zkCallback-6556-thread-1-processing-n:127.0.0.1:59596_solr) [n:127.0.0.1:59596_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 3618829 INFO  (zkCallback-6548-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 3618829 INFO  (zkCallback-6538-thread-1-processing-n:127.0.0.1:54453_solr) [n:127.0.0.1:54453_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 3618829 INFO  (zkCallback-6566-thread-1-processing-n:127.0.0.1:42684_solr) [n:127.0.0.1:42684_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 3618829 INFO  (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 3618829 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 3618829 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.Overseer Overseer (id=72167970114371590-127.0.0.1:54453_solr-n_0000000000) closing
   [junit4]   2> 3618829 INFO  (OverseerStateUpdate-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:54453_solr
   [junit4]   2> 3618830 WARN  (OverseerAutoScalingTriggerThread-72167970114371590-127.0.0.1:54453_solr-n_0000000000) [n:127.0.0.1:54453_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 3618830 DEBUG (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 3618832 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4277e9d6{/solr,null,UNAVAILABLE}
   [junit4]   2> 3618833 INFO  (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46803_solr
   [junit4]   2> 3618834 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 3618837 INFO  (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.Overseer Overseer (id=72167970114371589-127.0.0.1:46803_solr-n_0000000001) starting
   [junit4]   2> 3618844 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 3618845 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 3618845 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:59596_solr, 127.0.0.1:42684_solr, 127.0.0.1:46803_solr]
   [junit4]   2> 3618845 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerEFRS instantiated with properties: {event=nodeAdded, waitFor=10, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
   [junit4]   2> 3618846 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:59596_solr, 127.0.0.1:42684_solr, 127.0.0.1:46803_solr]
   [junit4]   2> 3618846 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion -1
   [junit4]   2> 3618846 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 3618846 INFO  (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 3618847 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Adding node from marker path: 127.0.0.1:42684_solr
   [junit4]   2> 3618849 DEBUG (ScheduledTrigger-13038-thread-1) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3618849 DEBUG (ScheduledTrigger-13038-thread-1) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3618850 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 3618850 DEBUG (ScheduledTrigger-13038-thread-1) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3619852 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3619852 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3619852 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3620853 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3620853 DEBUG (ScheduledTrigger-13038-thread-4) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3620853 DEBUG (ScheduledTrigger-13038-thread-4) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3621854 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3621854 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3621854 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3622863 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3622863 DEBUG (ScheduledTrigger-13038-thread-4) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3622863 DEBUG (ScheduledTrigger-13038-thread-4) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3623864 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3623864 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 3623864 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3623864 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_triggerEFRS firing registered processor for nodes: [127.0.0.1:42684_solr] added at times [1684221935289324], now=1684232209056295
   [junit4]   2> 3623864 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"5fbca7a2d03ecT10z6iumiqzpg98s7zmcz3hrfg",
   [junit4]   2>   "source":"node_added_triggerEFRS",
   [junit4]   2>   "eventTime":1684221935289324,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1684221935289324],
   [junit4]   2>     "nodeNames":["127.0.0.1:42684_solr"]}}
   [junit4]   2> 3623865 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_triggerEFRS]
   [junit4]   2> 3623866 INFO  (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 3623866 DEBUG (AutoscalingActionExecutor-13039-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"5fbca7a2d03ecT10z6iumiqzpg98s7zmcz3hrfg",
   [junit4]   2>   "source":"node_added_triggerEFRS",
   [junit4]   2>   "eventTime":1684221935289324,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1684221935289324],
   [junit4]   2>     "_enqueue_time_":1684232210207458,
   [junit4]   2>     "nodeNames":["127.0.0.1:42684_solr"]}}
   [junit4]   2> 3623866 INFO  (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[2F8A91C2FB18F026]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testEventFromRestoredState
   [junit4]   2> 3623872 DEBUG (AutoscalingActionExecutor-13039-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
   [junit4]   2> 3623873 DEBUG (AutoscalingActionExecutor-13039-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_triggerEFRS after 5000ms
   [junit4]   2> 3623873 DEBUG (AutoscalingActionExecutor-13039-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 7 ms for event id=5fbca7a2d03ecT10z6iumiqzpg98s7zmcz3hrfg
   [junit4]   2> 3623907 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLostTrigger
   [junit4]   2> 3623908 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 5
   [junit4]   2> 3623909 DEBUG (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 3623909 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 3623911 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 3623912 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3623912 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 3623913 INFO  (qtp2141224647-31658) [n:127.0.0.1:42684_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3623919 INFO  (qtp2141224647-31658) [n:127.0.0.1:42684_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=6
   [junit4]   2> 3623923 INFO  (qtp2051169502-31629) [n:127.0.0.1:59596_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3623924 INFO  (qtp2141224647-31657) [n:127.0.0.1:42684_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3623936 INFO  (qtp2011984679-31570) [n:127.0.0.1:46803_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3623937 DEBUG (qtp2011984679-31574) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3623937 INFO  (qtp2011984679-31574) [n:127.0.0.1:46803_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=16
   [junit4]   2> 3623938 DEBUG (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
   [junit4]   2> 3623939 DEBUG (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:59596_solr, 127.0.0.1:42684_solr, 127.0.0.1:46803_solr]
   [junit4]   2> 3623940 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
   [junit4]   2> 3623942 INFO  (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 3623943 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3623943 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 3623944 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 3
   [junit4]   2> 3623944 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1aececb2{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 3623944 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2033013147
   [junit4]   2> 3623944 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 3623944 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@12b87d55: rootName = solr_42684, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@293e2e69
   [junit4]   2> 3623949 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 3623949 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@79041a3c: rootName = solr_42684, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@49341810
   [junit4]   2> 3623953 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 3623953 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4f79cf77: rootName = solr_42684, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6c142174
   [junit4]   2> 3623955 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:42684_solr
   [junit4]   2> 3623956 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 3623956 INFO  (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 3623956 INFO  (zkCallback-6556-thread-1-processing-n:127.0.0.1:59596_solr) [n:127.0.0.1:59596_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 3623956 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 3623957 INFO  (zkCallback-6566-thread-1-processing-n:127.0.0.1:42684_solr) [n:127.0.0.1:42684_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 3623957 INFO  (zkCallback-6548-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 3623958 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@57fa4646{/solr,null,UNAVAILABLE}
   [junit4]   2> 3623958 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 3624946 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
   [junit4]   2> 3624946 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:42684_solr
   [junit4]   2> 3625927 INFO  (OverseerCollectionConfigSetProcessor-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 3625948 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
   [junit4]   2> 3626949 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
   [junit4]   2> 3627950 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: 2
   [junit4]   2> 3627950 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:42684_solr]
   [junit4]   2> 3627950 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"5fbcd1f0d71d1T10z6iumiqzpg98s7zmcz3hrfi",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":1684233291395537,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1684233291395537],
   [junit4]   2>     "nodeNames":["127.0.0.1:42684_solr"]}}
   [junit4]   2> 3627950 DEBUG (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_lost_trigger]
   [junit4]   2> 3627951 INFO  (ScheduledTrigger-13038-thread-3) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 3627951 DEBUG (AutoscalingActionExecutor-13039-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"5fbcd1f0d71d1T10z6iumiqzpg98s7zmcz3hrfi",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":1684233291395537,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1684233291395537],
   [junit4]   2>     "_enqueue_time_":1684236296577071,
   [junit4]   2>     "nodeNames":["127.0.0.1:42684_solr"]}}
   [junit4]   2> 3627952 DEBUG (AutoscalingActionExecutor-13039-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger after 5000ms
   [junit4]   2> 3627953 DEBUG (AutoscalingActionExecutor-13039-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 1 ms for event id=5fbcd1f0d71d1T10z6iumiqzpg98s7zmcz3hrfi
   [junit4]   2> 3627960 INFO  (qtp2011984679-31574) [n:127.0.0.1:46803_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3627962 INFO  (qtp2051169502-31631) [n:127.0.0.1:59596_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3627962 DEBUG (qtp2011984679-31566) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3627963 INFO  (qtp2011984679-31566) [n:127.0.0.1:46803_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=9
   [junit4]   2> 3627963 DEBUG (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
   [junit4]   2> 3627964 DEBUG (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:59596_solr, 127.0.0.1:46803_solr]
   [junit4]   2> 3627964 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
   [junit4]   2> 3627964 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3627965 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
   [junit4]   2> 3629964 INFO  (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[2F8A91C2FB18F026]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNodeLostTrigger
   [junit4]   2> 3629988 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCooldown
   [junit4]   2> 3629989 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 8
   [junit4]   2> 3629989 DEBUG (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
   [junit4]   2> 3629989 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
   [junit4]   2> 3629992 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 3629992 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3629992 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
   [junit4]   2> 3629994 INFO  (qtp2011984679-31566) [n:127.0.0.1:46803_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3629996 INFO  (qtp2051169502-31634) [n:127.0.0.1:59596_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3629996 DEBUG (qtp2051169502-31631) [n:127.0.0.1:59596_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3629996 INFO  (qtp2051169502-31631) [n:127.0.0.1:59596_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 3629997 DEBUG (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9
   [junit4]   2> 3629998 DEBUG (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:59596_solr, 127.0.0.1:46803_solr]
   [junit4]   2> 3629998 DEBUG (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
   [junit4]   2> 3629998 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9
   [junit4]   2> 3630000 INFO  (qtp2011984679-31570) [n:127.0.0.1:46803_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3630001 INFO  (qtp2051169502-31631) [n:127.0.0.1:59596_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3630001 DEBUG (qtp2051169502-31633) [n:127.0.0.1:59596_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3630002 INFO  (qtp2051169502-31633) [n:127.0.0.1:59596_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 3630002 INFO  (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 3630002 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 3630002 DEBUG (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 10
   [junit4]   2> 3630002 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 3630003 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 3630003 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 3630003 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3630003 DEBUG (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:59596_solr, 127.0.0.1:46803_solr]
   [junit4]   2> 3630003 DEBUG (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
   [junit4]   2> 3630003 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3630003 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 10, lastZnodeVersion 9
   [junit4]   2> 3630003 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 3630003 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 10
   [junit4]   2> 3630004 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4f1ce331{/solr,null,AVAILABLE}
   [junit4]   2> 3630004 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7b3359a4{HTTP/1.1,[http/1.1]}{127.0.0.1:42574}
   [junit4]   2> 3630004 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.Server Started @3637733ms
   [junit4]   2> 3630004 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42574}
   [junit4]   2> 3630004 ERROR (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3630004 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 3630004 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.3.0
   [junit4]   2> 3630004 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3630005 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3630005 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-09T09:23:26.757Z
   [junit4]   2> 3630005 DEBUG (OverseerAutoScalingTriggerThread-72167970114371589-127.0.0.1:46803_solr-n_0000000001) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 10, lastZnodeVersion 10
   [junit4]   2> 3630006 INFO  (zkConnectionManagerCallback-6571-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3630007 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3630013 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53321/solr
   [junit4]   2> 3630014 INFO  (zkConnectionManagerCallback-6575-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3630017 INFO  (zkConnectionManagerCallback-6577-thread-1-processing-n:127.0.0.1:42574_solr) [n:127.0.0.1:42574_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3630026 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42574_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 3630030 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42574_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3630032 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42574_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42574_solr
   [junit4]   2> 3630034 INFO  (zkCallback-6556-thread-1-processing-n:127.0.0.1:59596_solr) [n:127.0.0.1:59596_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3630034 INFO  (zkCallback-6548-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3630034 INFO  (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3630035 INFO  (zkCallback-6576-thread-1-processing-n:127.0.0.1:42574_solr) [n:127.0.0.1:42574_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3630089 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42574_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42574.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3630097 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42574_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42574.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3630097 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42574_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42574.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b54b0fd
   [junit4]   2> 3630098 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:42574_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_2F8A91C2FB18F026-001/tempDir-001/node5/.
   [junit4]   2> 3631010 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 3631010 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3631010 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:42574_solr at time 1684239358022001
   [junit4]   2> 3632021 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 3632021 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3632021 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger firing registered processor for nodes: [127.0.0.1:42574_solr] added at times [1684239358022001], now=1684240369378553
   [junit4]   2> 3632022 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"5fbce88a6d171T10z6iumiqzpg98s7zmcz3hrfk",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":1684239358022001,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1684239358022001],
   [junit4]   2>     "nodeNames":["127.0.0.1:42574_solr"]}}
   [junit4]   2> 3632022 DEBUG (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_cooldown_trigger]
   [junit4]   2> 3632023 INFO  (ScheduledTrigger-13038-thread-2) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 3632023 DEBUG (AutoscalingActionExecutor-13039-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"5fbce88a6d171T10z6iumiqzpg98s7zmcz3hrfk",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":1684239358022001,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1684239358022001],
   [junit4]   2>     "_enqueue_time_":1684240369560845,
   [junit4]   2>     "nodeNames":["127.0.0.1:42574_solr"]}}
   [junit4]   2> 3632025 DEBUG (AutoscalingActionExecutor-13039-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_cooldown_trigger after 5000ms
   [junit4]   2> 3632025 DEBUG (AutoscalingActionExecutor-13039-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 2 ms for event id=5fbce88a6d171T10z6iumiqzpg98s7zmcz3hrfk
   [junit4]   2> 3633025 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T16:27:37-05:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 3633026 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3633026 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3633027 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 3633027 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@73f4c36b{/solr,null,AVAILABLE}
   [junit4]   2> 3633027 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6c76d43e{HTTP/1.1,[http/1.1]}{127.0.0.1:60769}
   [junit4]   2> 3633027 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.e.j.s.Server Started @3640757ms
   [junit4]   2> 3633027 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60769}
   [junit4]   2> 3633028 ERROR (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3633028 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.3.0
   [junit4]   2> 3633028 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3633028 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3633028 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-09T09:23:29.780Z
   [junit4]   2> 3633030 INFO  (zkConnectionManagerCallback-6581-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3633031 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3633040 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53321/solr
   [junit4]   2> 3633042 INFO  (zkConnectionManagerCallback-6585-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3633045 INFO  (zkConnectionManagerCallback-6587-thread-1-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3633056 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:60769_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 3633059 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:60769_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3633066 INFO  (TEST-TriggerIntegrationTest.testCooldown-seed#[2F8A91C2FB18F026]) [n:127.0.0.1:60769_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60769_solr
   [junit4]   2> 3633068 INFO  (zkCallback-6548-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3633069 INFO  (zkCallback-6536-thread-1-processing-n:127.0.0.1:46803_solr) [n:127.0.0.1:46803_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3633069 INFO  (zkCallback-6576-thread-1-processing-n:127.0.0.1:42574_solr) [n:127.0.0.1:42574_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 3633070 INFO  (zkCallback-6556-thread-1-proce

[...truncated too long message...]

nging
   [junit4]   2> 3797336 ERROR (SUITE-TriggerIntegrationTest-seed#[2F8A91C2FB18F026]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 3797337 INFO  (SUITE-TriggerIntegrationTest-seed#[2F8A91C2FB18F026]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53321 53321
   [junit4]   2> 3807460 INFO  (Thread-6705) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53321 53321
   [junit4]   2> 3807461 WARN  (Thread-6705) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	44	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	21	/solr/clusterprops.json
   [junit4]   2> 	21	/solr/aliases.json
   [junit4]   2> 	20	/solr/security.json
   [junit4]   2> 	10	/solr/configs/conf
   [junit4]   2> 	9	/solr/collections/testMetricTrigger/terms/shard1
   [junit4]   2> 	2	/solr/collections/testMetricTrigger/terms/shard2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	190	/solr/collections/collection1/state.json
   [junit4]   2> 	42	/solr/collections/testMetricTrigger/state.json
   [junit4]   2> 	21	/solr/clusterstate.json
   [junit4]   2> 	6	/solr/autoscaling.json
   [junit4]   2> 	3	/solr/collections/collection1/leader_elect/shard1/election/72167970114371629-core_node6-n_0000000002
   [junit4]   2> 	3	/solr/overseer_elect/election/72167970114371629-127.0.0.1:36480_solr-n_0000000013
   [junit4]   2> 	3	/solr/overseer_elect/election/72167970114371607-127.0.0.1:59068_solr-n_0000000006
   [junit4]   2> 	3	/solr/overseer_elect/election/72167970114371638-127.0.0.1:44363_solr-n_0000000016
   [junit4]   2> 	2	/solr/overseer_elect/election/72167970114371610-127.0.0.1:35067_solr-n_0000000007
   [junit4]   2> 	2	/solr/overseer_elect/election/72167970114371595-127.0.0.1:59596_solr-n_0000000002
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/72167970114371623-core_node12-n_0000000005
   [junit4]   2> 	2	/solr/overseer_elect/election/72167970114371616-127.0.0.1:47892_solr-n_0000000009
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	21	/solr/collections
   [junit4]   2> 	20	/solr/live_nodes
   [junit4]   2> 	6	/solr/overseer/queue-work
   [junit4]   2> 	6	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	6	/solr/overseer/queue
   [junit4]   2> 	6	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/autoscaling/events/node_lost_triggerMR
   [junit4]   2> 	2	/solr/autoscaling/events/node_added_triggerCTOOR
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_2F8A91C2FB18F026-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {id=FST50, x_s=FSTOrd50}, docValues:{_version_=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=158, maxMBSortInHeap=5.11387510729128, sim=RandomSimilarity(queryNorm=false): {}, locale=ar-IQ, timezone=Asia/Bahrain
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=3,threads=1,free=244507872,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestHighlightDedupGrouping, TestFieldCollectionResource, TestIntervalFaceting, TestReloadDeadlock, ReplicaListTransformerTest, MultiThreadedOCPTest, SchemaApiFailureTest, TestTrie, CollectionsAPISolrJTest, TestUseDocValuesAsStored2, OverseerRolesTest, RecoveryAfterSoftCommitTest, RollingRestartTest, BufferStoreTest, OpenExchangeRatesOrgProviderTest, RAMDirectoryFactoryTest, TestLeaderInitiatedRecoveryThread, IndexSchemaRuntimeFieldTest, TestFaceting, TestXmlQParser, ReplaceNodeNoTargetTest, AutoscalingHistoryHandlerTest, ConfigSetsAPITest, TestOrdValues, UniqFieldsUpdateProcessorFactoryTest, TestSolrCloudWithSecureImpersonation, SubstringBytesRefFilterTest, TestSegmentSorting, TestCloudSearcherWarming, CloudMLTQParserTest, SolrGangliaReporterTest, TestLegacyFieldCache, PKIAuthenticationIntegrationTest, TestMaxScoreQueryParser, TestIndexSearcher, TestHdfsUpdateLog, DeleteShardTest, SparseHLLTest, BaseCdcrDistributedZkTest, TestOmitPositions, SOLR749Test, ResourceLoaderTest, RequiredFieldsTest, SolrRequestParserTest, TlogReplayBufferedWhileIndexingTest, TestPivotHelperCode, TestSuggestSpellingConverter, PathHierarchyTokenizerFactoryTest, TestNestedDocsSort, BlobRepositoryCloudTest, TestClusterStateMutator, SolrCoreMetricManagerTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestFieldCacheVsDocValues, SpellingQueryConverterTest, PeerSyncWithIndexFingerprintCachingTest, TestTolerantUpdateProcessorRandomCloud, TestInitQParser, HdfsAutoAddReplicasIntegrationTest, TestBinaryField, TestCollectionsAPIViaSolrCloudCluster, HdfsChaosMonkeyNothingIsSafeTest, CoreSorterTest, TestSystemIdResolver, ClassificationUpdateProcessorFactoryTest, DistribJoinFromCollectionTest, DocExpirationUpdateProcessorFactoryTest, DistributedFacetSimpleRefinementLongTailTest, CustomHighlightComponentTest, TolerantUpdateProcessorTest, TestPKIAuthenticationPlugin, V2ApiIntegrationTest, TestStressUserVersions, TestDeleteCollectionOnDownNodes, CollectionReloadTest, SolrTestCaseJ4Test, TestManagedStopFilterFactory, CopyFieldTest, TestCollapseQParserPlugin, SolrIndexSplitterTest, TestCollationField, TestClassicSimilarityFactory, DeleteInactiveReplicaTest, TestShardHandlerFactory, SortSpecParsingTest, SystemLogListenerTest, TestExportWriter, SolrShardReporterTest, BooleanFieldTest, TestMacroExpander, ForceLeaderTest, TestTlogReplica, CdcrReplicationHandlerTest, ComputePlanActionTest, TestEmbeddedSolrServerAdminHandler, TestTolerantSearch, CacheHeaderTest, FileUtilsTest, TestRemoteStreaming, TestSizeLimitedDistributedMap, DistributedVersionInfoTest, VMParamsZkACLAndCredentialsProvidersTest, BlockJoinFacetRandomTest, TestDynamicFieldCollectionResource, QueryEqualityTest, TestSolrDeletionPolicy1, SolrInfoBeanTest, StatelessScriptUpdateProcessorFactoryTest, TestElisionMultitermQuery, TestSurroundQueryParser, OutputWriterTest, TestReRankQParserPlugin, TestCorePropertiesReload, TestComplexPhraseQParserPlugin, TestSchemaNameResource, QueryResultKeyTest, QueryElevationComponentTest, CdcrUpdateLogTest, DistributedMLTComponentTest, FacetPivotSmallTest, TestNamedUpdateProcessors, TestCSVResponseWriter, TestRangeQuery, TestRecovery, TestComputePlanAction, SolrCLIZkUtilsTest, TermsComponentTest, CdcrVersionReplicationTest, TestInPlaceUpdatesStandalone, HttpPartitionTest, TestPartialUpdateDeduplication, BigEndianAscendingWordSerializerTest, RequestLoggingTest, HdfsSyncSliceTest, SampleTest, CdcrBootstrapTest, JvmMetricsTest, BasicZkTest, TestImpersonationWithHadoopAuth, BJQParserTest, SolrIndexConfigTest, MetricTriggerTest, DistributedExpandComponentTest, PingRequestHandlerTest, CoreAdminRequestStatusTest, TestBulkSchemaAPI, SolrPluginUtilsTest, AtomicUpdateProcessorFactoryTest, HLLSerializationTest, TestZkAclsWithHadoopAuth, DateFieldTest, BasicDistributedZkTest, SpatialHeatmapFacetsTest, TestCoreBackup, TestReplicationHandlerBackup, DistanceUnitsTest, TestCoreContainer, BinaryUpdateRequestHandlerTest, TestBlobHandler, TestLargeCluster, DirectSolrConnectionTest, TestNodeLostTrigger, LegacyCloudClusterPropTest, ExplicitHLLTest, TestPrepRecovery, TestSerializedLuceneMatchVersion, SuggestComponentTest, AnalyticsQueryTest, TestPushWriter, TestReload, TestRestoreCore, TestConfigSetProperties, DistributedQueryElevationComponentTest, DirectUpdateHandlerOptimizeTest, TestSolrQueryResponse, HdfsWriteToMultipleCollectionsTest, TestBM25SimilarityFactory, TestSortableTextField, TestSubQueryTransformerDistrib, SearchHandlerTest, HdfsCollectionsAPIDistributedZkTest, SolrMetricReporterTest, TestQueryTypes, TestFreeTextSuggestions, SuggesterTSTTest, UnloadDistributedZkTest, TestSolrJ, TestExecutePlanAction, ZkStateWriterTest, BasicDistributedZk2Test, SyncSliceTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, ShardRoutingTest, RecoveryZkTest, TestReplicationHandler, ZkSolrClientTest, ShardRoutingCustomTest, TestDistributedSearch, TestRealTimeGet, DistributedTermsComponentTest, SolrCoreTest, SpellCheckComponentTest, TestGroupingSearch, PeerSyncTest, HighlighterTest, SoftAutoCommitTest, TimeZoneUtilsTest, ScriptEngineTest, DateMathParserTest, PreAnalyzedFieldTest, TestLRUCache, TestUtils, ZkNodePropsTest, UUIDFieldTest, CircularListTest, CursorPagingTest, DistributedIntervalFacetingTest, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestLuceneIndexBackCompat, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, ConnectionReuseTest, AddReplicaTest, AssignBackwardCompatibilityTest, ConcurrentCreateRoutedAliasTest, DeleteNodeTest, DeleteStatusTest, DistribDocExpirationUpdateProcessorTest, LIRRollingUpdatesTest, LeaderInitiatedRecoveryOnShardRestartTest, MigrateRouteKeyTest, MoveReplicaTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerStatusTest, PeerSyncReplicationTest, SolrXmlInZkTest, TestCloudInspectUtil, TestCloudJSONFacetJoinDomain, TestCloudPseudoReturnFields, TestClusterProperties, TestConfigSetsAPI, TestDownShardTolerantSearch, TestLeaderElectionWithEmptyReplica, TestPullReplica, TestRandomRequestDistribution, TestStressInPlaceUpdates, ZkShardTermsTest, CollectionsAPIAsyncDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, CustomCollectionTest, SimpleCollectionCreateDeleteTest, TestLocalFSCloudBackupRestore, TestReplicaProperties, AutoAddReplicasPlanActionTest, NodeLostTriggerTest, TriggerIntegrationTest]
   [junit4] Completed [600/774 (1!)] on J0 in 210.71s, 14 tests, 1 failure <<< FAILURES!

[...truncated 48802 lines...]

Mime
View raw message