Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B6C9C200BF0 for ; Fri, 30 Dec 2016 17:14:47 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id B5532160B32; Fri, 30 Dec 2016 16:14:47 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 4E948160B24 for ; Fri, 30 Dec 2016 17:14:45 +0100 (CET) Received: (qmail 33163 invoked by uid 500); 30 Dec 2016 16:14:44 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 33153 invoked by uid 99); 30 Dec 2016 16:14:43 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Dec 2016 16:14:43 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 52F6D18C361 for ; Fri, 30 Dec 2016 16:14:43 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2 X-Spam-Level: ** X-Spam-Status: No, score=2 tagged_above=-999 required=6.31 tests=[KAM_BADIPHTTP=2, SPF_PASS=-0.001, WEIRD_PORT=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id lKGrtzQdmbPL for ; Fri, 30 Dec 2016 16:14:25 +0000 (UTC) Received: from serv1.sd-datasolutions.de (serv1.sd-datasolutions.de [188.138.57.78]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 642E35F1B3 for ; Fri, 30 Dec 2016 16:14:25 +0000 (UTC) Received: from serv1 (localhost.localdomain [127.0.0.1]) by serv1.sd-datasolutions.de (Postfix) with ESMTP id F2D8E4C09A8; Fri, 30 Dec 2016 16:14:24 +0000 (UTC) Date: Fri, 30 Dec 2016 16:12:35 +0000 (UTC) From: Policeman Jenkins Server To: jpountz@gmail.com, romseygeek@apache.org, mkhl@apache.org, jbernste@apache.org, sarowe@apache.org, uwe@thetaphi.de, erick@apache.org, dev@lucene.apache.org Message-ID: <1915078483.389.1483114464996.JavaMail.jenkins@serv1> In-Reply-To: <721976738.371.1483001907926.JavaMail.jenkins@serv1> References: <721976738.371.1483001907926.JavaMail.jenkins@serv1> Subject: [JENKINS] Lucene-Solr-6.x-Windows (32bit/jdk1.8.0_112) - Build # 655 - Still Unstable! MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_388_1606394122.1483114464925" X-Jenkins-Job: Lucene-Solr-6.x-Windows X-Jenkins-Result: UNSTABLE archived-at: Fri, 30 Dec 2016 16:14:47 -0000 ------=_Part_388_1606394122.1483114464925 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Windows/655/ Java: 32bit/jdk1.8.0_112 -server -XX:+UseParallelGC 1 tests failed. FAILED: org.apache.solr.cloud.RecoveryZkTest.test Error Message: Mismatch in counts between replicas Stack Trace: java.lang.AssertionError: Mismatch in counts between replicas =09at __randomizedtesting.SeedInfo.seed([F18DFDDDE9A25A0A:79D9C207475E37F2]= :0) =09at org.junit.Assert.fail(Assert.java:93) =09at org.apache.solr.cloud.RecoveryZkTest.assertShardConsistency(RecoveryZ= kTest.java:143) =09at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:126) =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:62) =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:43) =09at java.lang.reflect.Method.invoke(Method.java:498) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomized= Runner.java:1713) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Random= izedRunner.java:907) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(Random= izedRunner.java:943) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(Rando= mizedRunner.java:957) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRu= leSetupTeardownChained.java:49) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleT= hreadAndTestName.java:48) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:367) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTa= sk(ThreadLeakControl.java:811) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(Threa= dLeakControl.java:462) =09at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran= domizedRunner.java:916) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Random= izedRunner.java:802) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Random= izedRunner.java:852) =09at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Random= izedRunner.java:863) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$= 1.evaluate(SystemPropertiesRestoreRule.java:57) =09at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBef= oreAfterRule.java:45) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStor= eClassName.java:41) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMeth= odsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRule= AssertionsRequired.java:53) =09at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFai= lure.java:47) =09at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(Test= RuleIgnoreAfterMaxFailures.java:64) =09at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIg= noreTestSuites.java:54) =09at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(St= atementAdapter.java:36) =09at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.= run(ThreadLeakControl.java:367) =09at java.lang.Thread.run(Thread.java:745) Build Log: [...truncated 11857 lines...] [junit4] Suite: org.apache.solr.cloud.RecoveryZkTest [junit4] 2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-6= .x-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.RecoveryZkTest_F18D= FDDDE9A25A0A-001\init-core-data-001 [junit4] 2> 1246425 INFO (SUITE-RecoveryZkTest-seed#[F18DFDDDE9A25A0A= ]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth= (false) via: @org.apache.solr.util.RandomizeSSL(reason=3D, value=3DNaN, ss= l=3DNaN, clientAuth=3DNaN) [junit4] 2> 1246427 INFO (SUITE-RecoveryZkTest-seed#[F18DFDDDE9A25A0A= ]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers= in C:\Users\jenkins\workspace\Lucene-Solr-6.x-Windows\solr\build\solr-core= \test\J1\temp\solr.cloud.RecoveryZkTest_F18DFDDDE9A25A0A-001\tempDir-001 [junit4] 2> 1246427 INFO (SUITE-RecoveryZkTest-seed#[F18DFDDDE9A25A0A= ]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 1246429 INFO (Thread-2924) [ ] o.a.s.c.ZkTestServer cl= ient port:0.0.0.0/0.0.0.0:0 [junit4] 2> 1246429 INFO (Thread-2924) [ ] o.a.s.c.ZkTestServer St= arting server [junit4] 2> 1246529 INFO (SUITE-RecoveryZkTest-seed#[F18DFDDDE9A25A0A= ]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:57989 [junit4] 2> 1246538 INFO (jetty-launcher-8998-thread-1) [ ] o.e.j.= s.Server jetty-9.3.14.v20161028 [junit4] 2> 1246538 INFO (jetty-launcher-8998-thread-2) [ ] o.e.j.= s.Server jetty-9.3.14.v20161028 [junit4] 2> 1246539 INFO (jetty-launcher-8998-thread-1) [ ] o.e.j.= s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1efeb5e{/solr,null= ,AVAILABLE} [junit4] 2> 1246539 INFO (jetty-launcher-8998-thread-2) [ ] o.e.j.= s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1878cb1{/solr,null= ,AVAILABLE} [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-2) [ ] o.e.j.= s.AbstractConnector Started ServerConnector@10520e2{HTTP/1.1,[http/1.1]}{12= 7.0.0.1:57994} [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-1) [ ] o.e.j.= s.AbstractConnector Started ServerConnector@1e7e789{HTTP/1.1,[http/1.1]}{12= 7.0.0.1:57993} [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-2) [ ] o.e.j.= s.Server Started @1250041ms [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-1) [ ] o.e.j.= s.Server Started @1250041ms [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-2) [ ] o.a.s.= c.s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D57= 994} [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-1) [ ] o.a.s.= c.s.e.JettySolrRunner Jetty properties: {hostContext=3D/solr, hostPort=3D57= 993} [junit4] 2> 1246542 ERROR (jetty-launcher-8998-thread-2) [ ] o.a.s.= s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be miss= ing or incomplete. [junit4] 2> 1246542 ERROR (jetty-launcher-8998-thread-1) [ ] o.a.s.= s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be miss= ing or incomplete. [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-2) [ ] o.a.s.= s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.4.= 0 [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-1) [ ] o.a.s.= s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.4.= 0 [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-2) [ ] o.a.s.= s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-1) [ ] o.a.s.= s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-2) [ ] o.a.s.= s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-1) [ ] o.a.s.= s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-2) [ ] o.a.s.= s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-12-30T15:27:08.287Z [junit4] 2> 1246542 INFO (jetty-launcher-8998-thread-1) [ ] o.a.s.= s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-12-30T15:27:08.287Z [junit4] 2> 1246548 INFO (jetty-launcher-8998-thread-2) [ ] o.a.s.= s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 1246548 INFO (jetty-launcher-8998-thread-1) [ ] o.a.s.= s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 1246556 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ = ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from = client sessionid 0x15950577d920001, likely client has closed socket [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOSe= rverCnxn.java:228) [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxnFactory.run= (NIOServerCnxnFactory.java:208) [junit4] 2> =09at java.lang.Thread.run(Thread.java:745) [junit4] 2> 1246560 INFO (jetty-launcher-8998-thread-2) [ ] o.a.s.= u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: s= ocketTimeout=3D340000&connTimeout=3D45000&retry=3Dtrue [junit4] 2> 1246561 INFO (jetty-launcher-8998-thread-1) [ ] o.a.s.= u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: s= ocketTimeout=3D340000&connTimeout=3D45000&retry=3Dtrue [junit4] 2> 1246562 INFO (jetty-launcher-8998-thread-2) [ ] o.a.s.= c.ZkContainer Zookeeper client=3D127.0.0.1:57989/solr [junit4] 2> 1246562 INFO (jetty-launcher-8998-thread-1) [ ] o.a.s.= c.ZkContainer Zookeeper client=3D127.0.0.1:57989/solr [junit4] 2> 1246564 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ = ] o.a.z.s.NIOServerCnxn caught end of stream exception [junit4] 2> EndOfStreamException: Unable to read additional data from = client sessionid 0x15950577d920003, likely client has closed socket [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOSe= rverCnxn.java:228) [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxnFactory.run= (NIOServerCnxnFactory.java:208) [junit4] 2> =09at java.lang.Thread.run(Thread.java:745) [junit4] 2> 1246591 INFO (jetty-launcher-8998-thread-2) [n:127.0.0.1:= 57994_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader= 127.0.0.1:57994_solr [junit4] 2> 1246592 INFO (jetty-launcher-8998-thread-1) [n:127.0.0.1:= 57993_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/li= ve_nodes/127.0.0.1:57993_solr [junit4] 2> 1246593 INFO (jetty-launcher-8998-thread-2) [n:127.0.0.1:= 57994_solr ] o.a.s.c.Overseer Overseer (id=3D97197203664273413-127.0.0.1= :57994_solr-n_0000000000) starting [junit4] 2> 1246594 INFO (zkCallback-9008-thread-1-processing-n:127.0= .0.1:57994_solr) [n:127.0.0.1:57994_solr ] o.a.s.c.c.ZkStateReader Updat= ed live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1246595 INFO (zkCallback-9009-thread-1-processing-n:127.0= .0.1:57993_solr) [n:127.0.0.1:57993_solr ] o.a.s.c.c.ZkStateReader Updat= ed live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1246602 INFO (jetty-launcher-8998-thread-2) [n:127.0.0.1:= 57994_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/li= ve_nodes/127.0.0.1:57994_solr [junit4] 2> 1246603 INFO (zkCallback-9008-thread-1-processing-n:127.0= .0.1:57994_solr) [n:127.0.0.1:57994_solr ] o.a.s.c.c.ZkStateReader Updat= ed live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1246604 INFO (zkCallback-9009-thread-1-processing-n:127.0= .0.1:57993_solr) [n:127.0.0.1:57993_solr ] o.a.s.c.c.ZkStateReader Updat= ed live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1246696 INFO (jetty-launcher-8998-thread-2) [n:127.0.0.1:= 57994_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions unde= rneath C:\Users\jenkins\workspace\Lucene-Solr-6.x-Windows\solr\build\solr-c= ore\test\J1\temp\solr.cloud.RecoveryZkTest_F18DFDDDE9A25A0A-001\tempDir-001= \node2\. [junit4] 2> 1246794 INFO (jetty-launcher-8998-thread-1) [n:127.0.0.1:= 57993_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions unde= rneath C:\Users\jenkins\workspace\Lucene-Solr-6.x-Windows\solr\build\solr-c= ore\test\J1\temp\solr.cloud.RecoveryZkTest_F18DFDDDE9A25A0A-001\tempDir-001= \node1\. [junit4] 2> 1247292 INFO (SUITE-RecoveryZkTest-seed#[F18DFDDDE9A25A0A= ]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper.= .. (0) -> (2) [junit4] 2> 1247294 INFO (SUITE-RecoveryZkTest-seed#[F18DFDDDE9A25A0A= ]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.= 0.1:57989/solr ready [junit4] 2> 1247314 INFO (TEST-RecoveryZkTest.test-seed#[F18DFDDDE9A2= 5A0A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test [junit4] 2> 1247317 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr = ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with par= ams replicationFactor=3D2&collection.configName=3Dconf&maxShardsPerNode=3D1= &name=3Drecoverytest&action=3DCREATE&numShards=3D1&wt=3Djavabin&version=3D2= and sendToOCPQueue=3Dtrue [junit4] 2> 1247319 INFO (OverseerThreadFactory-6927-thread-1-process= ing-n:127.0.0.1:57994_solr) [n:127.0.0.1:57994_solr ] o.a.s.c.CreateColl= ectionCmd Create collection recoverytest [junit4] 2> 1247426 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr = ] o.a.s.h.a.CoreAdminOperation core create command qt=3D/admin/cores&coll= ection.configName=3Dconf&newCollection=3Dtrue&name=3Drecoverytest_shard1_re= plica2&action=3DCREATE&numShards=3D1&collection=3Drecoverytest&shard=3Dshar= d1&wt=3Djavabin&version=3D2 [junit4] 2> 1247426 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = ] o.a.s.h.a.CoreAdminOperation core create command qt=3D/admin/cores&col= lection.configName=3Dconf&newCollection=3Dtrue&name=3Drecoverytest_shard1_r= eplica1&action=3DCREATE&numShards=3D1&collection=3Drecoverytest&shard=3Dsha= rd1&wt=3Djavabin&version=3D2 [junit4] 2> 1247535 INFO (zkCallback-9008-thread-1-processing-n:127.0= .0.1:57994_solr) [n:127.0.0.1:57994_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/recoverytest/state.json] for collection [recoverytest] has= occurred - updating... (live nodes size: [2]) [junit4] 2> 1247535 INFO (zkCallback-9009-thread-1-processing-n:127.0= .0.1:57993_solr) [n:127.0.0.1:57993_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/recoverytest/state.json] for collection [recoverytest] has= occurred - updating... (live nodes size: [2]) [junit4] 2> 1248441 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.c.SolrConfig= Using Lucene MatchVersion: 6.4.0 [junit4] 2> 1248441 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.c.SolrConfig = Using Lucene MatchVersion: 6.4.0 [junit4] 2> 1248449 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.s.IndexSchem= a [recoverytest_shard1_replica1] Schema name=3Dminimal [junit4] 2> 1248449 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.s.IndexSchema= [recoverytest_shard1_replica2] Schema name=3Dminimal [junit4] 2> 1248455 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.s.IndexSchem= a Loaded schema minimal/1.1 with uniqueid field id [junit4] 2> 1248455 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.s.IndexSchema= Loaded schema minimal/1.1 with uniqueid field id [junit4] 2> 1248464 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.c.CoreContai= ner Creating SolrCore 'recoverytest_shard1_replica1' using configuration fr= om collection recoverytest [junit4] 2> 1248464 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.c.CoreContain= er Creating SolrCore 'recoverytest_shard1_replica2' using configuration fro= m collection recoverytest [junit4] 2> 1248465 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.c.SolrCore [[= recoverytest_shard1_replica2] ] Opening new SolrCore at [C:\Users\jenkins\w= orkspace\Lucene-Solr-6.x-Windows\solr\build\solr-core\test\J1\temp\solr.clo= ud.RecoveryZkTest_F18DFDDDE9A25A0A-001\tempDir-001\node1\recoverytest_shard= 1_replica2], dataDir=3D[C:\Users\jenkins\workspace\Lucene-Solr-6.x-Windows\= solr\build\solr-core\test\J1\temp\solr.cloud.RecoveryZkTest_F18DFDDDE9A25A0= A-001\tempDir-001\node1\.\recoverytest_shard1_replica2\data\] [junit4] 2> 1248465 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.c.SolrCore [= [recoverytest_shard1_replica1] ] Opening new SolrCore at [C:\Users\jenkins\= workspace\Lucene-Solr-6.x-Windows\solr\build\solr-core\test\J1\temp\solr.cl= oud.RecoveryZkTest_F18DFDDDE9A25A0A-001\tempDir-001\node2\recoverytest_shar= d1_replica1], dataDir=3D[C:\Users\jenkins\workspace\Lucene-Solr-6.x-Windows= \solr\build\solr-core\test\J1\temp\solr.cloud.RecoveryZkTest_F18DFDDDE9A25A= 0A-001\tempDir-001\node2\.\recoverytest_shard1_replica1\data\] [junit4] 2> 1248482 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.u.UpdateHand= ler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 1248483 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.u.UpdateLog = Initializing UpdateLog: dataDir=3Dnull defaultSyncLevel=3DFLUSH numRecordsT= oKeep=3D100 maxNumLogsToKeep=3D10 numVersionBuckets=3D65536 [junit4] 2> 1248485 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.u.CommitTrac= ker Hard AutoCommit: disabled [junit4] 2> 1248485 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.u.CommitTrac= ker Soft AutoCommit: disabled [junit4] 2> 1248494 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.u.UpdateHandl= er Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 1248495 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.u.UpdateLog I= nitializing UpdateLog: dataDir=3Dnull defaultSyncLevel=3DFLUSH numRecordsTo= Keep=3D100 maxNumLogsToKeep=3D10 numVersionBuckets=3D65536 [junit4] 2> 1248498 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.u.CommitTrack= er Hard AutoCommit: disabled [junit4] 2> 1248498 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.u.CommitTrack= er Soft AutoCommit: disabled [junit4] 2> 1248499 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.s.SolrIndexS= earcher Opening [Searcher@d9daf4[recoverytest_shard1_replica1] main] [junit4] 2> 1248501 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.r.ManagedRes= ourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf [junit4] 2> 1248501 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.r.ManagedRes= ourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageI= O:path=3D/configs/conf [junit4] 2> 1248501 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.h.Replicatio= nHandler Commits will be reserved for 10000 [junit4] 2> 1248502 INFO (searcherExecutor-6932-thread-1-processing-n= :127.0.0.1:57994_solr x:recoverytest_shard1_replica1 s:shard1 c:recoverytes= t) [n:127.0.0.1:57994_solr c:recoverytest s:shard1 x:recoverytest_shard1_r= eplica1] o.a.s.c.SolrCore [recoverytest_shard1_replica1] Registered new sea= rcher Searcher@d9daf4[recoverytest_shard1_replica1] main{ExitableDirectoryR= eader(UninvertingDirectoryReader())} [junit4] 2> 1248502 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.u.UpdateLog = Could not find max version in index or recent updates, using new clock 1555= 155260797878272 [junit4] 2> 1248509 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.c.ShardLeade= rElectionContext Waiting until we see more replicas up for shard shard1: to= tal=3D2 found=3D1 timeoutin=3D9999ms [junit4] 2> 1248508 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.s.SolrIndexSe= archer Opening [Searcher@2f92e1[recoverytest_shard1_replica2] main] [junit4] 2> 1248513 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.r.ManagedReso= urceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf [junit4] 2> 1248513 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.r.ManagedReso= urceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO= :path=3D/configs/conf [junit4] 2> 1248513 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.h.Replication= Handler Commits will be reserved for 10000 [junit4] 2> 1248514 INFO (searcherExecutor-6933-thread-1-processing-n= :127.0.0.1:57993_solr x:recoverytest_shard1_replica2 s:shard1 c:recoverytes= t) [n:127.0.0.1:57993_solr c:recoverytest s:shard1 x:recoverytest_shard1_r= eplica2] o.a.s.c.SolrCore [recoverytest_shard1_replica2] Registered new sea= rcher Searcher@2f92e1[recoverytest_shard1_replica2] main{ExitableDirectoryR= eader(UninvertingDirectoryReader())} [junit4] 2> 1248514 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.u.UpdateLog C= ould not find max version in index or recent updates, using new clock 15551= 55260810461184 [junit4] 2> 1248613 INFO (zkCallback-9008-thread-3-processing-n:127.0= .0.1:57994_solr) [n:127.0.0.1:57994_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/recoverytest/state.json] for collection [recoverytest] has= occurred - updating... (live nodes size: [2]) [junit4] 2> 1248613 INFO (zkCallback-9009-thread-1-processing-n:127.0= .0.1:57993_solr) [n:127.0.0.1:57993_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/recoverytest/state.json] for collection [recoverytest] has= occurred - updating... (live nodes size: [2]) [junit4] 2> 1249010 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.c.ShardLeade= rElectionContext Enough replicas found to continue. [junit4] 2> 1249010 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.c.ShardLeade= rElectionContext I may be the new leader - try and sync [junit4] 2> 1249010 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.c.SyncStrate= gy Sync replicas to http://127.0.0.1:57994/solr/recoverytest_shard1_replica= 1/ [junit4] 2> 1249010 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.u.PeerSync P= eerSync: core=3Drecoverytest_shard1_replica1 url=3Dhttp://127.0.0.1:57994/s= olr START replicas=3D[http://127.0.0.1:57993/solr/recoverytest_shard1_repli= ca2/] nUpdates=3D100 [junit4] 2> 1249011 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.u.PeerSync P= eerSync: core=3Drecoverytest_shard1_replica1 url=3Dhttp://127.0.0.1:57994/s= olr DONE. We have no versions. sync failed. [junit4] 2> 1249012 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.c= .S.Request [recoverytest_shard1_replica2] webapp=3D/solr path=3D/get param= s=3D{distrib=3Dfalse&qt=3D/get&fingerprint=3Dfalse&getVersions=3D100&wt=3Dj= avabin&version=3D2} status=3D0 QTime=3D0 [junit4] 2> 1249013 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.c.SyncStrate= gy Leader's attempt to sync with shard failed, moving to the next candidate [junit4] 2> 1249013 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.c.ShardLeade= rElectionContext We failed sync, but we have no versions - we can't sync in= that case - we were active before, so become leader anyway [junit4] 2> 1249017 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.c.ShardLeade= rElectionContext I am the new leader: http://127.0.0.1:57994/solr/recoveryt= est_shard1_replica1/ shard1 [junit4] 2> 1249121 INFO (zkCallback-9008-thread-4-processing-n:127.0= .0.1:57994_solr) [n:127.0.0.1:57994_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/recoverytest/state.json] for collection [recoverytest] has= occurred - updating... (live nodes size: [2]) [junit4] 2> 1249121 INFO (zkCallback-9009-thread-1-processing-n:127.0= .0.1:57993_solr) [n:127.0.0.1:57993_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/recoverytest/state.json] for collection [recoverytest] has= occurred - updating... (live nodes size: [2]) [junit4] 2> 1249169 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.c.ZkControll= er I am the leader, no recovery necessary [junit4] 2> 1249174 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 x:recoverytest_shard1_replica1] o.a.s.s.HttpSolrCa= ll [admin] webapp=3Dnull path=3D/admin/cores params=3D{qt=3D/admin/cores&co= llection.configName=3Dconf&newCollection=3Dtrue&name=3Drecoverytest_shard1_= replica1&action=3DCREATE&numShards=3D1&collection=3Drecoverytest&shard=3Dsh= ard1&wt=3Djavabin&version=3D2} status=3D0 QTime=3D1746 [junit4] 2> 1249274 INFO (zkCallback-9008-thread-2-processing-n:127.0= .0.1:57994_solr) [n:127.0.0.1:57994_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/recoverytest/state.json] for collection [recoverytest] has= occurred - updating... (live nodes size: [2]) [junit4] 2> 1249274 INFO (zkCallback-9009-thread-1-processing-n:127.0= .0.1:57993_solr) [n:127.0.0.1:57993_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/recoverytest/state.json] for collection [recoverytest] has= occurred - updating... (live nodes size: [2]) [junit4] 2> 1249522 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 x:recoverytest_shard1_replica2] o.a.s.s.HttpSolrCal= l [admin] webapp=3Dnull path=3D/admin/cores params=3D{qt=3D/admin/cores&col= lection.configName=3Dconf&newCollection=3Dtrue&name=3Drecoverytest_shard1_r= eplica2&action=3DCREATE&numShards=3D1&collection=3Drecoverytest&shard=3Dsha= rd1&wt=3Djavabin&version=3D2} status=3D0 QTime=3D2095 [junit4] 2> 1249525 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr = ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for a= t most 30 seconds. Check all shard replicas [junit4] 2> 1249624 INFO (zkCallback-9008-thread-2-processing-n:127.0= .0.1:57994_solr) [n:127.0.0.1:57994_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/recoverytest/state.json] for collection [recoverytest] has= occurred - updating... (live nodes size: [2]) [junit4] 2> 1249624 INFO (zkCallback-9009-thread-1-processing-n:127.0= .0.1:57993_solr) [n:127.0.0.1:57993_solr ] o.a.s.c.c.ZkStateReader A clu= ster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged p= ath:/collections/recoverytest/state.json] for collection [recoverytest] has= occurred - updating... (live nodes size: [2]) [junit4] 2> 1250525 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr = ] o.a.s.s.HttpSolrCall [admin] webapp=3Dnull path=3D/admin/collections pa= rams=3D{replicationFactor=3D2&collection.configName=3Dconf&maxShardsPerNode= =3D1&name=3Drecoverytest&action=3DCREATE&numShards=3D1&wt=3Djavabin&version= =3D2} status=3D0 QTime=3D3207 [junit4] 2> 1250526 INFO (TEST-RecoveryZkTest.test-seed#[F18DFDDDE9A2= 5A0A]) [ ] o.a.s.c.RecoveryZkTest Indexing 700 documents [junit4] 2> 1250541 INFO (qtp4391016-37146) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-0 (1555155262925438977)]} 0 2 [junit4] 2> 1250541 INFO (qtp4391016-37158) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-0 (1555155262925438976)]} 0 4 [junit4] 2> 1250541 INFO (qtp16003036-37159) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-0 (1555155262= 925438977)]} 0 9 [junit4] 2> 1250541 INFO (qtp16003036-37154) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-0 (1555155262= 925438976)]} 0 10 [junit4] 2> 1250544 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-0 (-1555155262936973312)]} 0 0 [junit4] 2> 1250544 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-0 (-155515= 5262936973312)]} 0 2 [junit4] 2> 1250545 INFO (qtp4391016-37155) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-0 (-1555155262939070464)]} 0 0 [junit4] 2> 1250545 INFO (qtp16003036-37162) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-0 (-155515= 5262939070464)]} 0 1 [junit4] 2> 1250549 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-1 (1555155262942216192)]} 0 0 [junit4] 2> 1250549 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-1 (1555155262942216193)]} 0 0 [junit4] 2> 1250549 INFO (qtp16003036-37150) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-1 (1555155262= 942216192)]} 0 2 [junit4] 2> 1250549 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-1 (1555155262= 942216193)]} 0 1 [junit4] 2> 1250552 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-2 (1555155262946410497)]} 0 0 [junit4] 2> 1250552 INFO (qtp4391016-37146) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-2 (1555155262946410496)]} 0 0 [junit4] 2> 1250553 INFO (qtp16003036-37159) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-2 (1555155262= 946410497)]} 0 2 [junit4] 2> 1250553 INFO (qtp16003036-37156) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-2 (1555155262= 946410496)]} 0 2 [junit4] 2> 1250557 INFO (qtp4391016-37158) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-2 (-1555155262950604800)]} 0 0 [junit4] 2> 1250557 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-2 (-1555155262950604801)]} 0 0 [junit4] 2> 1250557 INFO (qtp16003036-37154) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-2 (-155515= 5262950604800)]} 0 2 [junit4] 2> 1250557 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-2 (-155515= 5262950604801)]} 0 2 [junit4] 2> 1250561 INFO (qtp4391016-37155) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-3 (1555155262955847681)]} 0 0 [junit4] 2> 1250562 INFO (qtp4391016-37155) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-3 (1555155262955847680)]} 0 0 [junit4] 2> 1250563 INFO (qtp16003036-37150) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-3 (1555155262= 955847681)]} 0 3 [junit4] 2> 1250563 INFO (qtp16003036-37162) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-3 (1555155262= 955847680)]} 0 3 [junit4] 2> 1250568 INFO (qtp4391016-37155) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-3 (-1555155262962139136)]} 0 0 [junit4] 2> 1250568 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-3 (-155515= 5262962139136)]} 0 2 [junit4] 2> 1250568 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-3 (-1555155262962139137)]} 0 0 [junit4] 2> 1250569 INFO (qtp16003036-37156) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-3 (-155515= 5262962139137)]} 0 2 [junit4] 2> 1250572 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-4 (1555155262965284864)]} 0 0 [junit4] 2> 1250572 INFO (qtp16003036-37159) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-4 (1555155262= 965284864)]} 0 3 [junit4] 2> 1250573 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-4 (1555155262968430592)]} 0 0 [junit4] 2> 1250573 INFO (qtp16003036-37154) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-4 (1555155262= 968430592)]} 0 1 [junit4] 2> 1250575 INFO (qtp4391016-37146) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-5 (1555155262970527744)]} 0 0 [junit4] 2> 1250575 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-5 (1555155262= 970527744)]} 0 2 [junit4] 2> 1250578 INFO (qtp4391016-37146) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-5 (1555155262971576320)]} 0 0 [junit4] 2> 1250578 INFO (qtp16003036-37150) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-5 (1555155262= 971576320)]} 0 2 [junit4] 2> 1250579 INFO (qtp4391016-37146) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-6 (1555155262974722048)]} 0 0 [junit4] 2> 1250579 INFO (qtp16003036-37162) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-6 (1555155262= 974722048)]} 0 2 [junit4] 2> 1250581 INFO (qtp4391016-37146) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-6 (1555155262975770624)]} 0 0 [junit4] 2> 1250581 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-6 (1555155262= 975770624)]} 0 1 [junit4] 2> 1250583 INFO (qtp4391016-37155) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-7 (1555155262978916352)]} 0 0 [junit4] 2> 1250584 INFO (qtp16003036-37156) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-7 (1555155262= 978916352)]} 0 2 [junit4] 2> 1250586 INFO (qtp4391016-37155) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-7 (1555155262979964928)]} 0 0 [junit4] 2> 1250586 INFO (qtp16003036-37159) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-7 (1555155262= 979964928)]} 0 3 [junit4] 2> 1250587 INFO (qtp4391016-37155) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-8 (1555155262982062080)]} 0 0 [junit4] 2> 1250587 INFO (qtp16003036-37154) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-8 (1555155262= 982062080)]} 0 2 [junit4] 2> 1250588 INFO (qtp4391016-37158) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-8 (1555155262984159232)]} 0 0 [junit4] 2> 1250588 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-8 (1555155262= 984159232)]} 0 1 [junit4] 2> 1250591 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-9 (1555155262987304961)]} 0 0 [junit4] 2> 1250591 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-9 (1555155262987304960)]} 0 0 [junit4] 2> 1250592 INFO (qtp16003036-37162) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-9 (1555155262= 987304961)]} 0 1 [junit4] 2> 1250592 INFO (qtp16003036-37150) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-9 (1555155262= 987304960)]} 0 1 [junit4] 2> 1250594 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-9 (-1555155262990450689)]} 0 0 [junit4] 2> 1250594 INFO (qtp4391016-37146) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-9 (-1555155262990450688)]} 0 0 [junit4] 2> 1250594 INFO (qtp16003036-37156) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-9 (-155515= 5262990450689)]} 0 1 [junit4] 2> 1250594 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-9 (-155515= 5262990450688)]} 0 1 [junit4] 2> 1250598 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-10 (1555155262994644993)]} 0 0 [junit4] 2> 1250598 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-10 (1555155262994644992)]} 0 0 [junit4] 2> 1250598 INFO (qtp16003036-37154) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-10 (155515526= 2994644993)]} 0 2 [junit4] 2> 1250598 INFO (qtp16003036-37159) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-10 (155515526= 2994644992)]} 0 2 [junit4] 2> 1250602 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-11 (1555155262997790721)]} 0 0 [junit4] 2> 1250602 INFO (qtp4391016-37158) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-11 (1555155262997790720)]} 0 0 [junit4] 2> 1250602 INFO (qtp16003036-37162) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-11 (155515526= 2997790721)]} 0 1 [junit4] 2> 1250602 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-11 (155515526= 2997790720)]} 0 1 [junit4] 2> 1250605 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-10 (-1555155263001985025)]} 0 0 [junit4] 2> 1250605 INFO (qtp4391016-37146) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-10 (-1555155263001985024)]} 0 0 [junit4] 2> 1250605 INFO (qtp16003036-37156) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-10 (-15551= 55263001985025)]} 0 1 [junit4] 2> 1250605 INFO (qtp16003036-37150) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-10 (-15551= 55263001985024)]} 0 1 [junit4] 2> 1250609 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-12 (1555155263005130752)]} 0 0 [junit4] 2> 1250609 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-12 (1555155263005130753)]} 0 0 [junit4] 2> 1250609 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-12 (155515526= 3005130752)]} 0 3 [junit4] 2> 1250609 INFO (qtp16003036-37154) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-12 (155515526= 3005130753)]} 0 2 [junit4] 2> 1250613 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-13 (1555155263009325057)]} 0 0 [junit4] 2> 1250613 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-13 (1555155263009325056)]} 0 0 [junit4] 2> 1250615 INFO (qtp16003036-37162) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-13 (155515526= 3009325057)]} 0 2 [junit4] 2> 1250615 INFO (qtp16003036-37159) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-13 (155515526= 3009325056)]} 0 3 [junit4] 2> 1250617 INFO (qtp4391016-37158) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-14 (1555155263014567936)]} 0 0 [junit4] 2> 1250618 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-14 (1555155263014567937)]} 0 0 [junit4] 2> 1250618 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-14 (155515526= 3014567936)]} 0 2 [junit4] 2> 1250618 INFO (qtp16003036-37156) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-14 (155515526= 3014567937)]} 0 2 [junit4] 2> 1250620 INFO (qtp4391016-37158) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-11 (-1555155263017713665)]} 0 0 [junit4] 2> 1250620 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-11 (-15551= 55263017713665)]} 0 1 [junit4] 2> 1250620 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-11 (-1555155263017713664)]} 0 0 [junit4] 2> 1250621 INFO (qtp16003036-37150) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-11 (-15551= 55263017713664)]} 0 2 [junit4] 2> 1250622 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-15 (1555155263019810816)]} 0 0 [junit4] 2> 1250622 INFO (qtp16003036-37154) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-15 (155515526= 3019810816)]} 0 1 [junit4] 2> 1250624 INFO (qtp4391016-37155) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-15 (1555155263020859392)]} 0 0 [junit4] 2> 1250624 INFO (qtp16003036-37150) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-15 (155515526= 3020859392)]} 0 1 [junit4] 2> 1250627 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-16 (1555155263024005121)]} 0 0 [junit4] 2> 1250627 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-16 (1555155263024005120)]} 0 0 [junit4] 2> 1250627 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-16 (155515526= 3024005121)]} 0 2 [junit4] 2> 1250627 INFO (qtp16003036-37159) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-16 (155515526= 3024005120)]} 0 2 [junit4] 2> 1250631 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-17 (1555155263028199424)]} 0 0 [junit4] 2> 1250631 INFO (qtp4391016-37158) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-17 (1555155263028199425)]} 0 0 [junit4] 2> 1250631 INFO (qtp16003036-37156) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-17 (155515526= 3028199424)]} 0 2 [junit4] 2> 1250631 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-17 (155515526= 3028199425)]} 0 2 [junit4] 2> 1250635 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-18 (1555155263033442304)]} 0 0 [junit4] 2> 1250635 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-18 (1555155263033442305)]} 0 0 [junit4] 2> 1250635 INFO (qtp16003036-37162) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-18 (155515526= 3033442304)]} 0 1 [junit4] 2> 1250635 INFO (qtp16003036-37154) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-18 (155515526= 3033442305)]} 0 1 [junit4] 2> 1250639 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-19 (1555155263037636608)]} 0 0 [junit4] 2> 1250639 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-19 (1555155263037636609)]} 0 0 [junit4] 2> 1250639 INFO (qtp16003036-37150) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-19 (155515526= 3037636608)]} 0 1 [junit4] 2> 1250639 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-19 (155515526= 3037636609)]} 0 1 [junit4] 2> 1250643 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-12 (-1555155263040782337)]} 0 0 [junit4] 2> 1250643 INFO (qtp4391016-37158) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-12 (-1555155263040782336)]} 0 0 [junit4] 2> 1250643 INFO (qtp16003036-37156) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-12 (-15551= 55263040782337)]} 0 2 [junit4] 2> 1250643 INFO (qtp16003036-37159) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-12 (-15551= 55263040782336)]} 0 2 [junit4] 2> 1250647 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-20 (1555155263046025216)]} 0 0 [junit4] 2> 1250647 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-20 (1555155263046025217)]} 0 0 [junit4] 2> 1250647 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-20 (155515526= 3046025216)]} 0 1 [junit4] 2> 1250647 INFO (qtp16003036-37162) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-20 (155515526= 3046025217)]} 0 1 [junit4] 2> 1250650 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-14 (-1555155263049170945)]} 0 0 [junit4] 2> 1250650 INFO (qtp4391016-37146) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-14 (-1555155263049170944)]} 0 0 [junit4] 2> 1250650 INFO (qtp16003036-37150) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-14 (-15551= 55263049170945)]} 0 1 [junit4] 2> 1250650 INFO (qtp16003036-37154) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-14 (-15551= 55263049170944)]} 0 1 [junit4] 2> 1250653 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-21 (1555155263052316672)]} 0 0 [junit4] 2> 1250653 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-21 (155515526= 3052316672)]} 0 1 [junit4] 2> 1250655 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-21 (1555155263053365248)]} 0 0 [junit4] 2> 1250655 INFO (qtp16003036-37156) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-21 (155515526= 3053365248)]} 0 1 [junit4] 2> 1250657 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-15 (-1555155263055462400)]} 0 0 [junit4] 2> 1250657 INFO (qtp16003036-37159) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-15 (-15551= 55263055462400)]} 0 2 [junit4] 2> 1250659 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-15 (-1555155263057559552)]} 0 0 [junit4] 2> 1250659 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-15 (-15551= 55263057559552)]} 0 2 [junit4] 2> 1250660 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-22 (1555155263059656704)]} 0 0 [junit4] 2> 1250660 INFO (qtp16003036-37162) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-22 (155515526= 3059656704)]} 0 1 [junit4] 2> 1250661 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-22 (1555155263060705280)]} 0 0 [junit4] 2> 1250661 INFO (qtp16003036-37150) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-22 (155515526= 3060705280)]} 0 1 [junit4] 2> 1250663 INFO (qtp4391016-37146) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-23 (1555155263062802433)]} 0 0 [junit4] 2> 1250663 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-23 (155515526= 3062802433)]} 0 1 [junit4] 2> 1250663 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-23 (1555155263062802432)]} 0 0 [junit4] 2> 1250663 INFO (qtp16003036-37154) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-23 (155515526= 3062802432)]} 0 1 [junit4] 2> 1250666 INFO (qtp4391016-37158) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-22 (-1555155263065948160)]} 0 0 [junit4] 2> 1250666 INFO (qtp16003036-37156) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-22 (-15551= 55263065948160)]} 0 1 [junit4] 2> 1250668 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-22 (-1555155263066996736)]} 0 0 [junit4] 2> 1250668 INFO (qtp16003036-37159) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-22 (-15551= 55263066996736)]} 0 2 [junit4] 2> 1250670 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-24 (1555155263069093888)]} 0 0 [junit4] 2> 1250670 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-24 (155515526= 3069093888)]} 0 2 [junit4] 2> 1250671 INFO (qtp4391016-37148) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-24 (1555155263071191040)]} 0 0 [junit4] 2> 1250671 INFO (qtp16003036-37162) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-24 (155515526= 3071191040)]} 0 1 [junit4] 2> 1250673 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-25 (1555155263073288193)]} 0 0 [junit4] 2> 1250673 INFO (qtp4391016-37146) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-25 (1555155263073288192)]} 0 0 [junit4] 2> 1250673 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-25 (155515526= 3073288193)]} 0 1 [junit4] 2> 1250673 INFO (qtp16003036-37150) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-25 (155515526= 3073288192)]} 0 1 [junit4] 2> 1250676 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-26 (1555155263076433920)]} 0 0 [junit4] 2> 1250676 INFO (qtp4391016-37158) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-26 (1555155263076433921)]} 0 0 [junit4] 2> 1250676 INFO (qtp16003036-37154) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-26 (155515526= 3076433920)]} 0 1 [junit4] 2> 1250676 INFO (qtp16003036-37156) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-26 (155515526= 3076433921)]} 0 1 [junit4] 2> 1250679 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-24 (-1555155263079579648)]} 0 0 [junit4] 2> 1250679 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-24 (-1555155263079579649)]} 0 0 [junit4] 2> 1250679 INFO (qtp16003036-37159) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-24 (-15551= 55263079579648)]} 0 1 [junit4] 2> 1250679 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-24 (-15551= 55263079579649)]} 0 1 [junit4] 2> 1250683 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-27 (1555155263083773953)]} 0 0 [junit4] 2> 1250683 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-27 (1555155263083773952)]} 0 0 [junit4] 2> 1250685 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-27 (155515526= 3083773953)]} 0 2 [junit4] 2> 1250685 INFO (qtp16003036-37162) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-27 (155515526= 3083773952)]} 0 2 [junit4] 2> 1250688 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-26 (-1555155263089016833)]} 0 0 [junit4] 2> 1250705 INFO (qtp16003036-37154) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-26 (-15551= 55263089016833)]} 0 18 [junit4] 2> 1250705 INFO (qtp4391016-37157) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-26 (-1555155263089016832)]} 0 0 [junit4] 2> 1250706 INFO (qtp16003036-37150) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-26 (-15551= 55263089016832)]} 0 19 [junit4] 2> 1250709 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-28 (1555155263111036929)]} 0 0 [junit4] 2> 1250709 INFO (qtp16003036-37159) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[1-28 (155515526= 3111036929)]} 0 2 [junit4] 2> 1250709 INFO (qtp4391016-37151) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[2-28 (1555155263111036928)]} 0 0 [junit4] 2> 1250709 INFO (qtp16003036-37156) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{add=3D[2-28 (155515526= 3111036928)]} 0 2 [junit4] 2> 1250712 INFO (qtp4391016-37155) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[1-27 (-1555155263114182656)]} 0 0 [junit4] 2> 1250712 INFO (qtp16003036-37152) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[1-27 (-15551= 55263114182656)]} 0 1 [junit4] 2> 1250713 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{delete=3D[2-27 (-1555155263115231232)]} 0 0 [junit4] 2> 1250713 INFO (qtp16003036-37160) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_shard1_replica1] webapp=3D/sol= r path=3D/update params=3D{wt=3Djavabin&version=3D2}{delete=3D[2-27 (-15551= 55263115231232)]} 0 2 [junit4] 2> 1250715 INFO (qtp4391016-37153) [n:127.0.0.1:57993_solr c= :recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_replica2] o.a.s.u= .p.LogUpdateProcessorFactory [recoverytest_shard1_replica2] webapp=3D/solr= path=3D/update params=3D{update.distrib=3DFROMLEADER&distrib.from=3Dhttp:/= /127.0.0.1:57994/solr/recoverytest_shard1_replica1/&wt=3Djavabin&version=3D= 2}{add=3D[1-29 (1555155263116279808)]} 0 0 [junit4] 2> 1250715 INFO (qtp16003036-37162) [n:127.0.0.1:57994_solr = c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_replica1] o.a.s.= u.p.LogUpdateProcessorFactory [recoverytest_sh [...truncated too long message...] client sessionid 0x15950577d920008, likely client has closed socket [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOSe= rverCnxn.java:228) [junit4] 2> =09at org.apache.zookeeper.server.NIOServerCnxnFactory.run= (NIOServerCnxnFactory.java:208) [junit4] 2> =09at java.lang.Thread.run(Thread.java:745) [junit4] 2> 1259263 INFO (jetty-launcher-8998-thread-2) [ ] o.e.j.= s.AbstractConnector Stopped ServerConnector@10fcd2a{HTTP/1.1,[http/1.1]}{12= 7.0.0.1:57993} [junit4] 2> 1259265 INFO (jetty-launcher-8998-thread-2) [ ] o.a.s.= c.CoreContainer Shutting down CoreContainer instance=3D4962765 [junit4] 2> 1259265 INFO (jetty-launcher-8998-thread-1) [ ] o.e.j.= s.AbstractConnector Stopped ServerConnector@10520e2{HTTP/1.1,[http/1.1]}{12= 7.0.0.1:0} [junit4] 2> 1259265 INFO (jetty-launcher-8998-thread-1) [ ] o.a.s.= c.CoreContainer Shutting down CoreContainer instance=3D10786801 [junit4] 2> 1259268 INFO (coreCloseExecutor-6956-thread-1) [n:127.0.0= .1:57993_solr c:recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_re= plica2] o.a.s.c.SolrCore [recoverytest_shard1_replica2] CLOSING SolrCore o= rg.apache.solr.core.SolrCore@1b53479 [junit4] 2> 1259269 INFO (coreCloseExecutor-6957-thread-1) [n:127.0.0= .1:57994_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_re= plica1] o.a.s.c.SolrCore [recoverytest_shard1_replica1] CLOSING SolrCore o= rg.apache.solr.core.SolrCore@1febae1 [junit4] 2> 1259270 INFO (coreCloseExecutor-6957-thread-1) [n:127.0.0= .1:57994_solr c:recoverytest s:shard1 r:core_node2 x:recoverytest_shard1_re= plica1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.r= ecoverytest.shard1.replica1 [junit4] 2> 1259273 INFO (coreCloseExecutor-6956-thread-1) [n:127.0.0= .1:57993_solr c:recoverytest s:shard1 r:core_node1 x:recoverytest_shard1_re= plica2] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.r= ecoverytest.shard1.replica2 [junit4] 2> 1259273 INFO (jetty-launcher-8998-thread-1) [ ] o.a.s.= c.Overseer Overseer (id=3D97197203664273413-127.0.0.1:57994_solr-n_00000000= 00) closing [junit4] 2> 1259273 INFO (OverseerStateUpdate-97197203664273413-127.0= .0.1:57994_solr-n_0000000000) [n:127.0.0.1:57994_solr ] o.a.s.c.Overseer= Overseer Loop exiting : 127.0.0.1:57994_solr [junit4] 2> 1259276 INFO (zkCallback-9020-thread-1-processing-n:127.0= .0.1:57993_solr) [n:127.0.0.1:57993_solr ] o.a.s.c.OverseerElectionConte= xt I am going to be the leader 127.0.0.1:57993_solr [junit4] 2> 1259279 WARN (zkCallback-9020-thread-2-processing-n:127.0= .0.1:57993_solr) [n:127.0.0.1:57993_solr ] o.a.s.c.c.ZkStateReader ZooKe= eper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode =3D Sess= ion expired for /live_nodes] [junit4] 2> 1260776 WARN (zkCallback-9008-thread-4-processing-n:127.0= .0.1:57994_solr) [n:127.0.0.1:57994_solr ] o.a.s.c.c.ZkStateReader ZooKe= eper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode =3D Sess= ion expired for /live_nodes] [junit4] 2> 1260776 INFO (jetty-launcher-8998-thread-1) [ ] o.a.s.= m.SolrMetricManager Closing metric reporters for: solr.node [junit4] 2> 1260777 INFO (jetty-launcher-8998-thread-1) [ ] o.e.j.= s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1878cb1{/solr,null= ,UNAVAILABLE} [junit4] 2> 1260778 INFO (jetty-launcher-8998-thread-2) [ ] o.a.s.= m.SolrMetricManager Closing metric reporters for: solr.node [junit4] 2> 1260778 INFO (jetty-launcher-8998-thread-2) [ ] o.e.j.= s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@124b198{/solr,null= ,UNAVAILABLE} [junit4] 2> 1260779 INFO (SUITE-RecoveryZkTest-seed#[F18DFDDDE9A25A0A= ]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57989 57989 [junit4] 2> 1260781 INFO (Thread-2924) [ ] o.a.s.c.ZkTestServer co= nnecting to 127.0.0.1:57989 57989 [junit4] 2> 1260782 WARN (Thread-2924) [ ] o.a.s.c.ZkTestServer Wa= tch limit violations:=20 [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2>=20 [junit4] 2> =094=09/solr/aliases.json [junit4] 2> =094=09/solr/clusterprops.json [junit4] 2> =093=09/solr/security.json [junit4] 2> =093=09/solr/configs/conf [junit4] 2>=20 [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2>=20 [junit4] 2> =094=09/solr/collections/recoverytest/state.json [junit4] 2> =094=09/solr/clusterstate.json [junit4] 2> =092=09/solr/overseer_elect/election/97197203664273413-127= .0.0.1:57994_solr-n_0000000000 [junit4] 2> =092=09/solr/collections/recoverytest/leader_elect/shard1/= election/97197203664273413-core_node2-n_0000000000 [junit4] 2>=20 [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2>=20 [junit4] 2> =0918=09/solr/overseer/queue [junit4] 2> =099=09/solr/overseer/collection-queue-work [junit4] 2> =094=09/solr/collections [junit4] 2> =093=09/solr/live_nodes [junit4] 2> =093=09/solr/overseer/queue-work [junit4] 2>=20 [junit4] 2> 1260782 INFO (SUITE-RecoveryZkTest-seed#[F18DFDDDE9A25A0A= ]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore [junit4] 2> NOTE: leaving temporary files on disk at: C:\Users\jenkins= \workspace\Lucene-Solr-6.x-Windows\solr\build\solr-core\test\J1\temp\solr.c= loud.RecoveryZkTest_F18DFDDDE9A25A0A-001 [junit4] 2> Dec 30, 2016 3:27:22 PM com.carrotsearch.randomizedtesting= .ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thre= ad(s). [junit4] 2> NOTE: test params are: codec=3DCheapBastard, sim=3DRandomS= imilarity(queryNorm=3Dtrue,coord=3Dcrazy): {}, locale=3Des-MX, timezone=3DE= tc/Zulu [junit4] 2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_112 (32= -bit)/cpus=3D3,threads=3D1,free=3D137940408,total=3D450101248 [junit4] 2> NOTE: All tests run in this JVM: [TestMiniSolrCloudCluster= , DistributedFacetPivotSmallAdvancedTest, CdcrUpdateLogTest, AliasIntegrati= onTest, TestSolrDynamicMBean, TestAtomicUpdateErrorCases, SuggesterTSTTest,= FileBasedSpellCheckerTest, TestIndexSearcher, TestConfigReload, TestXmlQPa= rser, CacheHeaderTest, TestIndexingPerformance, TestRandomFaceting, TestNum= ericTerms64, TestFieldTypeCollectionResource, TestReversedWildcardFilterFac= tory, ClassificationUpdateProcessorIntegrationTest, TestFilteredDocIdSet, S= olrCmdDistributorTest, TestCopyFieldCollectionResource, TestHighFrequencyDi= ctionaryFactory, TermVectorComponentTest, SolrGangliaReporterTest, CreateCo= llectionCleanupTest, TestAnalyzeInfixSuggestions, TestFoldingMultitermQuery= , TestMiniSolrCloudClusterSSL, TestSolrFieldCacheMBean, ReplicationFactorTe= st, OverseerModifyCollectionTest, TestBadConfig, DistributedExpandComponent= Test, CoreAdminRequestStatusTest, AnalyticsMergeStrategyTest, EchoParamsTes= t, TestFieldCacheReopen, DistributedQueryComponentOptimizationTest, AutoCom= mitTest, RAMDirectoryFactoryTest, TestSSLRandomization, TestLuceneMatchVers= ion, CloneFieldUpdateProcessorFactoryTest, SearchHandlerTest, HighlighterCo= nfigTest, SignatureUpdateProcessorFactoryTest, LeaderElectionIntegrationTes= t, FieldMutatingUpdateProcessorTest, TestInfoStreamLogging, TestQueryTypes,= RankQueryTest, BlockDirectoryTest, TestJoin, HdfsRecoverLeaseTest, QueryPa= rsingTest, RequestHandlersTest, TestDelegationWithHadoopAuth, SmileWriterTe= st, ConvertedLegacyTest, SparseHLLTest, QueryResultKeyTest, TestSolrDeletio= nPolicy2, TestReload, AtomicUpdatesTest, SolrCloudExampleTest, TestFastWrit= er, ZkSolrClientTest, LoggingHandlerTest, JavabinLoaderTest, CleanupOldInde= xTest, ChaosMonkeySafeLeaderTest, TestSolrCloudWithDelegationTokens, HdfsCo= llectionsAPIDistributedZkTest, MultiThreadedOCPTest, TestExactStatsCache, T= estConfigOverlay, BadIndexSchemaTest, BigEndianAscendingWordSerializerTest,= DistributedTermsComponentTest, TestStressLiveNodes, AsyncCallRequestStatus= ResponseTest, ZkStateReaderTest, TestSuggestSpellingConverter, SortByFuncti= onTest, DistributedFacetPivotWhiteBoxTest, TestValueSourceCache, TestWriter= Perf, DistributedFacetPivotLargeTest, HdfsUnloadDistributedZkTest, SolrInde= xSplitterTest, TestFieldCacheSort, CdcrReplicationHandlerTest, TestNamedUpd= ateProcessors, CollectionsAPIDistributedZkTest, BasicDistributedZk2Test, Hd= fsThreadLeakTest, SmileWriterTest, TestConfigSetProperties, UtilsToolTest, = TestTrie, NotRequiredUniqueKeyTest, SecurityConfHandlerTest, SimpleMLTQPars= erTest, TestRestoreCore, TestLeaderElectionZkExpiry, OverseerStatusTest, Te= stMergePolicyConfig, WordBreakSolrSpellCheckerTest, TestPivotHelperCode, Cu= rsorMarkTest, TestDFRSimilarityFactory, TestCloudSchemaless, RegexBoostProc= essorTest, TestCustomDocTransformer, SolrJmxReporterTest, FullSolrCloudDist= ribCmdsTest, TermVectorComponentDistributedTest, TestSolrCLIRunExample, Tes= tFuzzyAnalyzedSuggestions, TestSearchPerf, TestHashQParserPlugin, TestHdfsC= loudBackupRestore, HdfsChaosMonkeyNothingIsSafeTest, TestQuerySenderNoQuery= , CdcrVersionReplicationTest, TestSolrCloudWithSecureImpersonation, TestCor= ePropertiesReload, UpdateParamsTest, TestDFISimilarityFactory, TestSchemaNa= meResource, TestPHPSerializedResponseWriter, TestExceedMaxTermLength, Scrip= tEngineTest, TestMaxScoreQueryParser, TestDistributedMissingSort, StatsComp= onentTest, TestBulkSchemaAPI, BadCopyFieldTest, TestSolrQueryParser, SpellC= heckComponentTest, MBeansHandlerTest, TestCrossCoreJoin, TestRandomFlRTGClo= ud, RulesTest, TestDistribIDF, AddBlockUpdateTest, TestConfigSetsAPIZkFailu= re, SaslZkACLProviderTest, StatsReloadRaceTest, TestRecovery, TestPerFieldS= imilarityClassic, TestZkChroot, DistribJoinFromCollectionTest, TestConfig, = HLLSerializationTest, TestDocSet, TestSubQueryTransformer, SharedFSAutoRepl= icaFailoverTest, SpellCheckCollatorTest, SuggestComponentContextFilterQuery= Test, SolrIndexConfigTest, ShardRoutingCustomTest, ForceLeaderTest, BasicFu= nctionalityTest, SimpleCollectionCreateDeleteTest, BasicZkTest, RecoveryZkT= est] [junit4] Completed [345/675 (1!)] on J1 in 14.88s, 1 test, 1 failure <<<= FAILURES! [...truncated 55680 lines...] ------=_Part_388_1606394122.1483114464925 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org ------=_Part_388_1606394122.1483114464925--