Return-Path: X-Original-To: apmail-lucene-dev-archive@www.apache.org Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C5EB7101F1 for ; Thu, 1 Jan 2015 08:33:29 +0000 (UTC) Received: (qmail 33665 invoked by uid 500); 1 Jan 2015 08:33:29 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 33580 invoked by uid 500); 1 Jan 2015 08:33:29 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 33562 invoked by uid 99); 1 Jan 2015 08:33:27 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Jan 2015 08:33:27 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jenkins@thetaphi.de designates 188.138.97.18 as permitted sender) Received: from [188.138.97.18] (HELO serv1.sd-datasolutions.de) (188.138.97.18) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Jan 2015 08:32:54 +0000 Received: from localhost.localdomain ([127.0.0.1] helo=serv1) by serv1.sd-datasolutions.de with esmtp (Exim 4.76) (envelope-from ) id 1Y6bBc-0007d6-Fb; Thu, 01 Jan 2015 08:32:52 +0000 Date: Thu, 1 Jan 2015 08:32:24 +0000 (UTC) From: Policeman Jenkins Server To: uwe@thetaphi.de, thelabdude@apache.org, dev@lucene.apache.org Message-ID: <1628238303.65.1420101172479.JavaMail.jenkins@serv1.sd-datasolutions.de> In-Reply-To: <1557603861.53.1420058244050.JavaMail.jenkins@serv1.sd-datasolutions.de> References: <1557603861.53.1420058244050.JavaMail.jenkins@serv1.sd-datasolutions.de> Subject: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2028 - Still Failing! MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_64_1652086971.1420101144493" X-Jenkins-Job: Lucene-Solr-trunk-MacOSX X-Jenkins-Result: FAILURE X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_64_1652086971.1420101144493 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2028/ Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC (asserts: true) 2 tests failed. FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch Error Message: Test abandoned because suite timeout was reached. Stack Trace: java.lang.Exception: Test abandoned because suite timeout was reached. =09at __randomizedtesting.SeedInfo.seed([ACA3BF961C3082C4]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLea= derTest Error Message: Suite timeout exceeded (>=3D 7200000 msec). Stack Trace: java.lang.Exception: Suite timeout exceeded (>=3D 7200000 msec). =09at __randomizedtesting.SeedInfo.seed([ACA3BF961C3082C4]:0) Build Log: [...truncated 9425 lines...] [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest [junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-tru= nk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeade= rTest-ACA3BF961C3082C4-001/init-core-data-001 [junit4] 2> 2915835 T14355 oas.SolrTestCaseJ4.buildSSLConfig Randomize= d ssl (false) and clientAuth (false) [junit4] 2> 2915836 T14355 oas.BaseDistributedSearchTestCase.initHostC= ontext Setting hostContext system property: / [junit4] 2> 2915852 T14355 oas.SolrTestCaseJ4.setUp ###Starting testDi= stribSearch [junit4] 2> 2915853 T14355 oasc.ZkTestServer.run STARTING ZK TEST SERV= ER [junit4] 1> client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 2915855 T14356 oasc.ZkTestServer$ZKServerMain.runFromConfi= g Starting server [junit4] 2> 2915956 T14355 oasc.ZkTestServer.run start zk server on po= rt:53946 [junit4] 2> 2915957 T14355 oascc.SolrZkClient.createZkCredentialsToAdd= Automatically Using default ZkCredentialsProvider [junit4] 2> 2915958 T14355 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4] 2> 2915965 T14363 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@52e17cd5 name:ZooKeeperConnecti= on Watcher:127.0.0.1:53946 got event WatchedEvent state:SyncConnected type:= None path:null path:null type:None [junit4] 2> 2915966 T14355 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4] 2> 2915967 T14355 oascc.SolrZkClient.createZkACLProvider Usin= g default ZkACLProvider [junit4] 2> 2915967 T14355 oascc.SolrZkClient.makePath makePath: /solr [junit4] 2> 2915993 T14355 oascc.SolrZkClient.createZkCredentialsToAdd= Automatically Using default ZkCredentialsProvider [junit4] 2> 2915995 T14355 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4] 2> 2916002 T14366 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@4bb87f7f name:ZooKeeperConnecti= on Watcher:127.0.0.1:53946/solr got event WatchedEvent state:SyncConnected = type:None path:null path:null type:None [junit4] 2> 2916003 T14355 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4] 2> 2916003 T14355 oascc.SolrZkClient.createZkACLProvider Usin= g default ZkACLProvider [junit4] 2> 2916004 T14355 oascc.SolrZkClient.makePath makePath: /coll= ections/collection1 [junit4] 2> 2916019 T14355 oascc.SolrZkClient.makePath makePath: /coll= ections/collection1/shards [junit4] 2> 2916030 T14355 oascc.SolrZkClient.makePath makePath: /coll= ections/control_collection [junit4] 2> 2916041 T14355 oascc.SolrZkClient.makePath makePath: /coll= ections/control_collection/shards [junit4] 2> 2916052 T14355 oasc.AbstractZkTestCase.putConfig put /User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/= collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 2916054 T14355 oascc.SolrZkClient.makePath makePath: /conf= igs/conf1/solrconfig.xml [junit4] 2> 2916068 T14355 oasc.AbstractZkTestCase.putConfig put /User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/= collection1/conf/schema15.xml to /configs/conf1/schema.xml [junit4] 2> 2916069 T14355 oascc.SolrZkClient.makePath makePath: /conf= igs/conf1/schema.xml [junit4] 2> 2916079 T14355 oasc.AbstractZkTestCase.putConfig put /User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/= collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1= /solrconfig.snippet.randomindexconfig.xml [junit4] 2> 2916080 T14355 oascc.SolrZkClient.makePath makePath: /conf= igs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 2916090 T14355 oasc.AbstractZkTestCase.putConfig put /User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/= collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 2916092 T14355 oascc.SolrZkClient.makePath makePath: /conf= igs/conf1/stopwords.txt [junit4] 2> 2916101 T14355 oasc.AbstractZkTestCase.putConfig put /User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/= collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 2916103 T14355 oascc.SolrZkClient.makePath makePath: /conf= igs/conf1/protwords.txt [junit4] 2> 2916112 T14355 oasc.AbstractZkTestCase.putConfig put /User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/= collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 2916112 T14355 oascc.SolrZkClient.makePath makePath: /conf= igs/conf1/currency.xml [junit4] 2> 2916119 T14355 oasc.AbstractZkTestCase.putConfig put /User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/= collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 2916120 T14355 oascc.SolrZkClient.makePath makePath: /conf= igs/conf1/enumsConfig.xml [junit4] 2> 2916135 T14355 oasc.AbstractZkTestCase.putConfig put /User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/= collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-r= ates.json [junit4] 2> 2916136 T14355 oascc.SolrZkClient.makePath makePath: /conf= igs/conf1/open-exchange-rates.json [junit4] 2> 2916146 T14355 oasc.AbstractZkTestCase.putConfig put /User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/= collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOL= atin1Accent.txt [junit4] 2> 2916147 T14355 oascc.SolrZkClient.makePath makePath: /conf= igs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 2916156 T14355 oasc.AbstractZkTestCase.putConfig put /User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/= collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 2916157 T14355 oascc.SolrZkClient.makePath makePath: /conf= igs/conf1/old_synonyms.txt [junit4] 2> 2916169 T14355 oasc.AbstractZkTestCase.putConfig put /User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/= collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 2916170 T14355 oascc.SolrZkClient.makePath makePath: /conf= igs/conf1/synonyms.txt [junit4] 2> 2918430 T14355 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 2918439 T14355 oejs.AbstractConnector.doStart Started Sele= ctChannelConnector@127.0.0.1:53949 [junit4] 2> 2918441 T14355 oass.SolrDispatchFilter.init SolrDispatchFi= lter.init()sun.misc.Launcher$AppClassLoader@4554617c [junit4] 2> 2918442 T14355 oasc.SolrResourceLoader.locateSolrHome JNDI= not configured for solr (NoInitialContextEx) [junit4] 2> 2918443 T14355 oasc.SolrResourceLoader.locateSolrHome usin= g system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trun= k-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeader= Test-ACA3BF961C3082C4-001/tempDir-002 [junit4] 2> 2918444 T14355 oasc.SolrResourceLoader. new SolrReso= urceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOS= X/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-AC= A3BF961C3082C4-001/tempDir-002/' [junit4] 2> 2918503 T14355 oasc.ConfigSolr.fromFile Loading container = configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/b= uild/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C= 3082C4-001/tempDir-002/solr.xml [junit4] 2> 2918524 T14355 oasc.CoreContainer. New CoreContainer= 1170164933 [junit4] 2> 2918525 T14355 oasc.CoreContainer.load Loading cores into = CoreContainer [instanceDir=3D/Users/jenkins/workspace/Lucene-Solr-trunk-Mac= OSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-= ACA3BF961C3082C4-001/tempDir-002/] [junit4] 2> 2918525 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting socketTimeout to: 90000 [junit4] 2> 2918527 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting urlScheme to:=20 [junit4] 2> 2918527 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting connTimeout to: 15000 [junit4] 2> 2918527 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting maxConnectionsPerHost to: 20 [junit4] 2> 2918528 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting maxConnections to: 10000 [junit4] 2> 2918529 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting corePoolSize to: 0 [junit4] 2> 2918529 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting maximumPoolSize to: 2147483647 [junit4] 2> 2918529 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting maxThreadIdleTime to: 5 [junit4] 2> 2918530 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting sizeOfQueue to: -1 [junit4] 2> 2918530 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting fairnessPolicy to: false [junit4] 2> 2918531 T14355 oasu.UpdateShardHandler. Creating Upd= ateShardHandler HTTP client with params: socketTimeout=3D340000&connTimeout= =3D45000&retry=3Dfalse [junit4] 2> 2918532 T14355 oasl.LogWatcher.createWatcher SLF4J impl is= org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2918533 T14355 oasl.LogWatcher.newRegisteredLogWatcher Reg= istering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2918533 T14355 oasc.CoreContainer.load Host Name: 127.0.0.= 1 [junit4] 2> 2918534 T14355 oasc.ZkContainer.initZooKeeper Zookeeper cl= ient=3D127.0.0.1:53946/solr [junit4] 2> 2918534 T14355 oasc.ZkController.checkChrootPath zkHost in= cludes chroot [junit4] 2> 2918534 T14355 oascc.SolrZkClient.createZkCredentialsToAdd= Automatically Using default ZkCredentialsProvider [junit4] 2> 2918536 T14355 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4] 2> 2918539 T14378 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@2ed58da8 name:ZooKeeperConnecti= on Watcher:127.0.0.1:53946 got event WatchedEvent state:SyncConnected type:= None path:null path:null type:None [junit4] 2> 2918539 T14355 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4] 2> 2918540 T14355 oascc.SolrZkClient.createZkACLProvider Usin= g default ZkACLProvider [junit4] 2> 2918545 T14355 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4] 2> 2918549 T14381 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@3b336c6a name:ZooKeeperConnecti= on Watcher:127.0.0.1:53946/solr got event WatchedEvent state:SyncConnected = type:None path:null path:null type:None [junit4] 2> 2918549 T14355 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4] 2> 2918553 T14355 oascc.SolrZkClient.makePath makePath: /over= seer/queue [junit4] 2> 2918564 T14355 oascc.SolrZkClient.makePath makePath: /over= seer/collection-queue-work [junit4] 2> 2918573 T14355 oascc.SolrZkClient.makePath makePath: /over= seer/collection-map-running [junit4] 2> 2918584 T14355 oascc.SolrZkClient.makePath makePath: /over= seer/collection-map-completed [junit4] 2> 2918593 T14355 oascc.SolrZkClient.makePath makePath: /over= seer/collection-map-failure [junit4] 2> 2918602 T14355 oascc.SolrZkClient.makePath makePath: /live= _nodes [junit4] 2> 2918607 T14355 oasc.ZkController.createEphemeralLiveNode R= egister node as live in ZooKeeper:/live_nodes/127.0.0.1:53949_ [junit4] 2> 2918610 T14355 oascc.SolrZkClient.makePath makePath: /live= _nodes/127.0.0.1:53949_ [junit4] 2> 2918619 T14355 oascc.SolrZkClient.makePath makePath: /over= seer_elect [junit4] 2> 2918625 T14355 oascc.SolrZkClient.makePath makePath: /over= seer_elect/election [junit4] 2> 2918631 T14355 oasc.Overseer.close Overseer (id=3Dnull) cl= osing [junit4] 2> 2918638 T14355 oasc.OverseerElectionContext.runLeaderProce= ss I am going to be the leader 127.0.0.1:53949_ [junit4] 2> 2918638 T14355 oascc.SolrZkClient.makePath makePath: /over= seer_elect/leader [junit4] 2> 2918645 T14355 oasc.Overseer.start Overseer (id=3D93067262= 210670595-127.0.0.1:53949_-n_0000000000) starting [junit4] 2> 2918652 T14355 oascc.SolrZkClient.makePath makePath: /over= seer/queue-work [junit4] 2> 2918682 T14355 oasc.OverseerAutoReplicaFailoverThread. Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDe= lay=3D10000 autoReplicaFailoverWaitAfterExpiration=3D30000 autoReplicaFailo= verBadNodeExpiration=3D60000 [junit4] 2> 2918684 T14383 oasc.OverseerCollectionProcessor.run Proces= s current queue of collection creations [junit4] 2> 2918685 T14355 oascc.SolrZkClient.makePath makePath: /clus= terstate.json [junit4] 2> 2918693 T14355 oascc.SolrZkClient.makePath makePath: /alia= ses.json [junit4] 2> 2918700 T14355 oascc.ZkStateReader.createClusterStateWatch= ersAndUpdate Updating cluster state from ZooKeeper...=20 [junit4] 2> 2918715 T14382 oasc.Overseer$ClusterStateUpdater.run Start= ing to work on the main queue [junit4] 2> 2918722 T14385 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Ddown collection=3Dcontrol_collection [junit4] 2> 2918723 T14385 oasc.ZkController.publish numShards not fou= nd on descriptor - reading it from system property [junit4] 2> 2918725 T14381 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2918733 T14385 oasc.ZkController.waitForCoreNodeName look = for our core node name [junit4] 2> 2918735 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 0, message =3D { [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "base_url":"http://127.0.0.1:53949", [junit4] 2> =09 "node_name":"127.0.0.1:53949_", [junit4] 2> =09 "numShards":"1", [junit4] 2> =09 "state":"down", [junit4] 2> =09 "shard":null, [junit4] 2> =09 "collection":"control_collection", [junit4] 2> =09 "operation":"state"} current state version: 0 [junit4] 2> 2918737 T14382 oasco.ReplicaMutator.updateState Update sta= te numShards=3D1 message=3D{ [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "base_url":"http://127.0.0.1:53949", [junit4] 2> =09 "node_name":"127.0.0.1:53949_", [junit4] 2> =09 "numShards":"1", [junit4] 2> =09 "state":"down", [junit4] 2> =09 "shard":null, [junit4] 2> =09 "collection":"control_collection", [junit4] 2> =09 "operation":"state"} [junit4] 2> 2918738 T14382 oasco.ClusterStateMutator.createCollection = building a new cName: control_collection [junit4] 2> 2918738 T14382 oasco.ReplicaMutator.updateState Assigning = new node to shard shard=3Dshard1 [junit4] 2> 2918742 T14381 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2919734 T14385 oasc.ZkController.waitForShardId waiting to= find shard id in clusterstate for collection1 [junit4] 2> 2919735 T14385 oasc.ZkController.createCollectionZkNode Ch= eck for collection zkNode:control_collection [junit4] 2> 2919737 T14385 oasc.ZkController.createCollectionZkNode Co= llection zkNode exists [junit4] 2> 2919738 T14385 oascc.ZkStateReader.readConfigName Load col= lection config from:/collections/control_collection [junit4] 2> 2919743 T14385 oascc.ZkStateReader.readConfigName path=3D/= collections/control_collection configName=3Dconf1 specified config exists i= n ZooKeeper [junit4] 2> 2919744 T14385 oasc.SolrResourceLoader. new SolrReso= urceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOS= X/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-AC= A3BF961C3082C4-001/tempDir-002/collection1/' [junit4] 2> 2919745 T14385 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/s= olr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4= -001/tempDir-002/collection1/lib/.svn/' to classloader [junit4] 2> 2919746 T14385 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/s= olr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4= -001/tempDir-002/collection1/lib/classes/' to classloader [junit4] 2> 2919747 T14385 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/s= olr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4= -001/tempDir-002/collection1/lib/README' to classloader [junit4] 2> 2919785 T14385 oasc.ZkController.watchZKConfDir watch zkdi= r /configs/conf1 [junit4] 2> 2919791 T14385 oasc.Config. loaded config solrconfig= .xml with version 0=20 [junit4] 2> 2919803 T14385 oasc.SolrConfig.refreshRequestParams curren= t version of requestparams : -1 [junit4] 2> 2919807 T14385 oasc.SolrConfig. Using Lucene MatchVe= rsion: 6.0.0 [junit4] 2> 2919818 T14385 oasc.SolrConfig. Loaded SolrConfig: s= olrconfig.xml [junit4] 2> 2919821 T14385 oass.IndexSchema.readSchema Reading Solr Sc= hema from /configs/conf1/schema.xml [junit4] 2> 2919827 T14385 oass.IndexSchema.readSchema [collection1] S= chema name=3Dtest [junit4] 2> 2919963 T14385 oass.IndexSchema.readSchema default search = field in schema is text [junit4] 2> 2919965 T14385 oass.IndexSchema.readSchema unique key fiel= d: id [junit4] 2> 2919965 T14385 oass.FileExchangeRateProvider.reload Reload= ing exchange rates from file currency.xml [junit4] 2> 2919971 T14385 oass.FileExchangeRateProvider.reload Reload= ing exchange rates from file currency.xml [junit4] 2> 2920022 T14385 oasc.CoreContainer.create Creating SolrCore= 'collection1' using configuration from collection control_collection [junit4] 2> 2920022 T14385 oasc.SolrCore.initDirectoryFactory solr.Sta= ndardDirectoryFactory [junit4] 2> 2920022 T14385 oasc.SolrCore. [collection1] Opening = new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/buil= d/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C308= 2C4-001/tempDir-002/collection1/, dataDir=3D/Users/jenkins/workspace/Lucene= -Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkey= SafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/control/data/ [junit4] 2> 2920023 T14385 oasc.JmxMonitoredMap. JMX monitoring = is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMB= eanServer@8ad79f4 [junit4] 2> 2920025 T14385 oasc.CachingDirectoryFactory.get return new= directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build= /solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082= C4-001/tempDir-001/control/data [junit4] 2> 2920025 T14385 oasc.SolrCore.getNewIndexDir New index dire= ctory detected: old=3Dnull new=3D/Users/jenkins/workspace/Lucene-Solr-trunk= -MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderT= est-ACA3BF961C3082C4-001/tempDir-001/control/data/index/ [junit4] 2> 2920026 T14385 oasc.SolrCore.initIndex WARN [collection1] = Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/sol= r/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF9= 61C3082C4-001/tempDir-001/control/data/index' doesn't exist. Creating new i= ndex... [junit4] 2> 2920027 T14385 oasc.CachingDirectoryFactory.get return new= directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build= /solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082= C4-001/tempDir-001/control/data/index [junit4] 2> 2920027 T14385 oasu.RandomMergePolicy. RandomMergePo= licy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMerge= Policy: maxMergeAtOnce=3D16, maxMergeAtOnceExplicit=3D45, maxMergedSegmentM= B=3D87.568359375, floorSegmentMB=3D1.501953125, forceMergeDeletesPctAllowed= =3D27.55218996331614, segmentsPerTier=3D24.0, maxCFSSegmentSizeMB=3D8.79609= 3022207999E12, noCFSRatio=3D0.8881378966558299 [junit4] 2> 2920030 T14385 oasc.SolrDeletionPolicy.onCommit SolrDeleti= onPolicy.onCommit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLead= erTest-ACA3BF961C3082C4-001/tempDir-001/control/data/index,segFN=3Dsegments= _1,generation=3D1} [junit4] 2> 2920030 T14385 oasc.SolrDeletionPolicy.updateCommits newes= t commit generation =3D 1 [junit4] 2> 2920040 T14385 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "nodistrib" [junit4] 2> 2920041 T14385 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "dedupe" [junit4] 2> 2920042 T14385 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "d= edupe" [junit4] 2> 2920043 T14385 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "stored_sig" [junit4] 2> 2920043 T14385 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "s= tored_sig" [junit4] 2> 2920043 T14385 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 2920044 T14385 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2920045 T14385 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "d= istrib-dup-test-chain-implicit" [junit4] 2> 2920045 T14385 oasc.SolrCore.loadUpdateProcessorChains no = updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 2920046 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /update: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2920047 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2920047 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2920047 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2920048 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /config: org.apache.solr.handler.SolrConfigHandler [junit4] 2> 2920048 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /schema: org.apache.solr.handler.SchemaHandler [junit4] 2> 2920049 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /replication: org.apache.solr.handler.ReplicationHandler [junit4] 2> 2920049 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /get: org.apache.solr.handler.RealTimeGetHandler [junit4] 2> 2920050 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler [junit4] 2> 2920051 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler [junit4] 2> 2920051 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler [junit4] 2> 2920053 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler [junit4] 2> 2920053 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler [junit4] 2> 2920054 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /admin/properties: org.apache.solr.handler.admin.PropertiesRequest= Handler [junit4] 2> 2920054 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /admin/logging: org.apache.solr.handler.admin.LoggingHandler [junit4] 2> 2920055 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /admin/ping: org.apache.solr.handler.PingRequestHandler [junit4] 2> 2920055 T14385 oasc.RequestHandlers.initHandlersFromConfig= created standard: solr.StandardRequestHandler [junit4] 2> 2920056 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 2920057 T14385 oasc.RequestHandlers.initHandlersFromConfig= created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 2920064 T14385 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4] 2> 2920066 T14385 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4] 2> 2920067 T14385 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4] 2> 2920068 T14385 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4] 2> 2920069 T14385 oasc.SolrCore.initStatsCache Using default = statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 2920071 T14385 oasu.CommitTracker. Hard AutoCommit: = disabled [junit4] 2> 2920071 T14385 oasu.CommitTracker. Soft AutoCommit: = disabled [junit4] 2> 2920072 T14385 oasu.RandomMergePolicy. RandomMergePo= licy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMerge= Policy: maxMergeAtOnce=3D34, maxMergeAtOnceExplicit=3D49, maxMergedSegmentM= B=3D47.3642578125, floorSegmentMB=3D0.8271484375, forceMergeDeletesPctAllow= ed=3D23.156128234359365, segmentsPerTier=3D32.0, maxCFSSegmentSizeMB=3D8.79= 6093022207999E12, noCFSRatio=3D0.0 [junit4] 2> 2920075 T14385 oasc.SolrDeletionPolicy.onInit SolrDeletion= Policy.onInit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLead= erTest-ACA3BF961C3082C4-001/tempDir-001/control/data/index,segFN=3Dsegments= _1,generation=3D1} [junit4] 2> 2920075 T14385 oasc.SolrDeletionPolicy.updateCommits newes= t commit generation =3D 1 [junit4] 2> 2920075 T14385 oass.SolrIndexSearcher. Opening Searc= her@6c5a0de0[collection1] main [junit4] 2> 2920078 T14385 oascc.ZkStateReader.readConfigName Load col= lection config from:/collections/control_collection [junit4] 2> 2920082 T14385 oascc.ZkStateReader.readConfigName path=3D/= collections/control_collection configName=3Dconf1 specified config exists i= n ZooKeeper [junit4] 2> 2920082 T14385 oasr.ManagedResourceStorage.newStorageIO Se= tting up ZooKeeper-based storage for the RestManager with znodeBase: /confi= gs/conf1 [junit4] 2> 2920083 T14385 oasr.ManagedResourceStorage$ZooKeeperStorag= eIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 2920084 T14385 oasr.RestManager.init Initializing RestMana= ger with initArgs: {} [junit4] 2> 2920084 T14385 oasr.ManagedResourceStorage.load Reading _r= est_managed.json using ZooKeeperStorageIO:path=3D/configs/conf1 [junit4] 2> 2920086 T14385 oasr.ManagedResourceStorage$ZooKeeperStorag= eIO.openInputStream No data found for znode /configs/conf1/_rest_managed.js= on [junit4] 2> 2920086 T14385 oasr.ManagedResourceStorage.load Loaded nul= l at path _rest_managed.json using ZooKeeperStorageIO:path=3D/configs/conf1 [junit4] 2> 2920086 T14385 oasr.RestManager.init Initializing 0 regist= ered ManagedResources [junit4] 2> 2920086 T14385 oash.ReplicationHandler.inform Commits will= be reserved for 10000 [junit4] 2> 2920087 T14385 oasc.CoreContainer.registerCore registering= core: collection1 [junit4] 2> 2920088 T14386 oasc.SolrCore.registerSearcher [collection1= ] Registered new searcher Searcher@6c5a0de0[collection1] main{ExitableDirec= toryReader(UninvertingDirectoryReader())} [junit4] 2> 2920088 T14389 oasc.ZkController.register Register replica= - core:collection1 address:http://127.0.0.1:53949 collection:control_colle= ction shard:shard1 [junit4] 2> 2920089 T14355 oass.SolrDispatchFilter.init user.dir=3D/Us= ers/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0 [junit4] 2> 2920090 T14355 oass.SolrDispatchFilter.init SolrDispatchFi= lter.init() done [junit4] 2> 2920091 T14355 oascc.SolrZkClient.createZkCredentialsToAdd= Automatically Using default ZkCredentialsProvider [junit4] 2> 2920092 T14389 oascc.SolrZkClient.makePath makePath: /coll= ections/control_collection/leader_elect/shard1/election [junit4] 2> 2920093 T14355 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4] 2> 2920097 T14392 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@22de1753 name:ZooKeeperConnecti= on Watcher:127.0.0.1:53946/solr got event WatchedEvent state:SyncConnected = type:None path:null path:null type:None [junit4] 2> 2920098 T14355 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4] 2> 2920098 T14355 oascc.SolrZkClient.createZkACLProvider Usin= g default ZkACLProvider [junit4] 2> 2920101 T14355 oascc.ZkStateReader.createClusterStateWatch= ersAndUpdate Updating cluster state from ZooKeeper...=20 [junit4] 2> 2920107 T14389 oasc.ShardLeaderElectionContext.runLeaderPr= ocess Running the leader process for shard shard1 [junit4] 2> 2920110 T14355 oasc.ChaosMonkey.monkeyLog monkey: init - e= xpire sessions:false cause connection loss:false [junit4] 2> 2920111 T14355 oasc.AbstractFullDistribZkTestBase.createJe= ttys Creating collection1 with stateFormat=3D2 [junit4] 2> 2920111 T14355 oascc.SolrZkClient.createZkCredentialsToAdd= Automatically Using default ZkCredentialsProvider [junit4] 2> 2920112 T14381 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2920114 T14355 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4] 2> 2920117 T14389 oasc.ShardLeaderElectionContext.waitForRepl= icasToComeUp Enough replicas found to continue. [junit4] 2> 2920117 T14389 oasc.ShardLeaderElectionContext.runLeaderPr= ocess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C3653 name=3Dcollection1 org.apache.solr.c= ore.SolrCore@401a060f url=3Dhttp://127.0.0.1:53949/collection1 node=3D127.0= .0.1:53949_ C3653_STATE=3Dcoll:control_collection core:collection1 props:{c= ore=3Dcollection1, base_url=3Dhttp://127.0.0.1:53949, node_name=3D127.0.0.1= :53949_, state=3Ddown} [junit4] 2> 2920117 T14389 C3653 P53949 oasc.SyncStrategy.sync Sync re= plicas to http://127.0.0.1:53949/collection1/ [junit4] 2> 2920118 T14389 C3653 P53949 oasc.SyncStrategy.syncReplicas= Sync Success - now sync replicas to me [junit4] 2> 2920119 T14389 C3653 P53949 oasc.SyncStrategy.syncToMe htt= p://127.0.0.1:53949/collection1/ has no replicas [junit4] 2> 2920119 T14389 oasc.ShardLeaderElectionContext.runLeaderPr= ocess I am the new leader: http://127.0.0.1:53949/collection1/ shard1 [junit4] 2> 2920118 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 1, message =3D { [junit4] 2> =09 "operation":"leader", [junit4] 2> =09 "shard":"shard1", [junit4] 2> =09 "collection":"control_collection"} current state vers= ion: 1 [junit4] 2> 2920120 T14389 oascc.SolrZkClient.makePath makePath: /coll= ections/control_collection/leaders/shard1 [junit4] 2> 2920119 T14395 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@76d3574e name:ZooKeeperConnecti= on Watcher:127.0.0.1:53946/solr got event WatchedEvent state:SyncConnected = type:None path:null path:null type:None [junit4] 2> 2920122 T14355 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4] 2> 2920123 T14355 oascc.SolrZkClient.createZkACLProvider Usin= g default ZkACLProvider [junit4] 2> 2920133 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 1, message =3D { [junit4] 2> =09 "operation":"create", [junit4] 2> =09 "name":"collection1", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "stateFormat":2} current state version: 1 [junit4] 2> 2920134 T14382 oasco.ClusterStateMutator.createCollection = building a new cName: collection1 [junit4] 2> 2920136 T14392 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2920140 T14381 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2920166 T14396 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2920193 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 1, message =3D { [junit4] 2> =09 "operation":"leader", [junit4] 2> =09 "shard":"shard1", [junit4] 2> =09 "collection":"control_collection", [junit4] 2> =09 "base_url":"http://127.0.0.1:53949", [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "state":"active"} current state version: 2 [junit4] 2> 2920194 T14382 oasco.ZkStateWriter.writePendingUpdates goi= ng to create_collection /collections/collection1/state.json [junit4] 2> 2920198 T14392 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2920215 T14396 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2920219 T14392 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2920286 T14389 oasc.ZkController.register We are http://12= 7.0.0.1:53949/collection1/ and leader is http://127.0.0.1:53949/collection1= / [junit4] 2> 2920288 T14389 oasc.ZkController.register No LogReplay nee= ded for core=3Dcollection1 baseURL=3Dhttp://127.0.0.1:53949 [junit4] 2> 2920288 T14389 oasc.ZkController.checkRecovery I am the le= ader, no recovery necessary [junit4] 2> 2920288 T14389 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Dactive collection=3Dcontrol_collection [junit4] 2> 2920288 T14389 oasc.ZkController.publish numShards not fou= nd on descriptor - reading it from system property [junit4] 2> 2920291 T14381 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2920293 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 1, message =3D { [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "core_node_name":"core_node1", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "base_url":"http://127.0.0.1:53949", [junit4] 2> =09 "node_name":"127.0.0.1:53949_", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "state":"active", [junit4] 2> =09 "shard":"shard1", [junit4] 2> =09 "collection":"control_collection", [junit4] 2> =09 "operation":"state"} current state version: 4 [junit4] 2> 2920294 T14382 oasco.ReplicaMutator.updateState Update sta= te numShards=3D3 message=3D{ [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "core_node_name":"core_node1", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "base_url":"http://127.0.0.1:53949", [junit4] 2> =09 "node_name":"127.0.0.1:53949_", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "state":"active", [junit4] 2> =09 "shard":"shard1", [junit4] 2> =09 "collection":"control_collection", [junit4] 2> =09 "operation":"state"} [junit4] 2> 2920404 T14381 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2920405 T14392 oascc.ZkStateReader$2.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clus= terstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2921809 T14355 oasc.AbstractFullDistribZkTestBase.createJe= ttys create jetty 1 [junit4] 2> 2921810 T14355 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 2921816 T14355 oejs.AbstractConnector.doStart Started Sele= ctChannelConnector@127.0.0.1:53954 [junit4] 2> 2921818 T14355 oass.SolrDispatchFilter.init SolrDispatchFi= lter.init()sun.misc.Launcher$AppClassLoader@4554617c [junit4] 2> 2921819 T14355 oasc.SolrResourceLoader.locateSolrHome JNDI= not configured for solr (NoInitialContextEx) [junit4] 2> 2921819 T14355 oasc.SolrResourceLoader.locateSolrHome usin= g system property solr.solr.home: ../../../../../../../../../Users/jenkins/= workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.c= loud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003 [junit4] 2> 2921819 T14355 oasc.SolrResourceLoader. new SolrReso= urceLoader for directory: '../../../../../../../../../Users/jenkins/workspa= ce/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.Ch= aosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003/' [junit4] 2> 2921874 T14355 oasc.ConfigSolr.fromFile Loading container = configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/b= uild/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/L= ucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosM= onkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003/solr.xml [junit4] 2> 2921925 T14355 oasc.CoreContainer. New CoreContainer= 850377707 [junit4] 2> 2921926 T14355 oasc.CoreContainer.load Loading cores into = CoreContainer [instanceDir=3D../../../../../../../../../Users/jenkins/works= pace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.= ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003/] [junit4] 2> 2921927 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting socketTimeout to: 90000 [junit4] 2> 2921928 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting urlScheme to:=20 [junit4] 2> 2921928 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting connTimeout to: 15000 [junit4] 2> 2921929 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting maxConnectionsPerHost to: 20 [junit4] 2> 2921929 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting maxConnections to: 10000 [junit4] 2> 2921930 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting corePoolSize to: 0 [junit4] 2> 2921931 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting maximumPoolSize to: 2147483647 [junit4] 2> 2921931 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting maxThreadIdleTime to: 5 [junit4] 2> 2921932 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting sizeOfQueue to: -1 [junit4] 2> 2921932 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting fairnessPolicy to: false [junit4] 2> 2921933 T14355 oasu.UpdateShardHandler. Creating Upd= ateShardHandler HTTP client with params: socketTimeout=3D340000&connTimeout= =3D45000&retry=3Dfalse [junit4] 2> 2921934 T14355 oasl.LogWatcher.createWatcher SLF4J impl is= org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2921934 T14355 oasl.LogWatcher.newRegisteredLogWatcher Reg= istering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2921935 T14355 oasc.CoreContainer.load Host Name: 127.0.0.= 1 [junit4] 2> 2921936 T14355 oasc.ZkContainer.initZooKeeper Zookeeper cl= ient=3D127.0.0.1:53946/solr [junit4] 2> 2921937 T14355 oasc.ZkController.checkChrootPath zkHost in= cludes chroot [junit4] 2> 2921938 T14355 oascc.SolrZkClient.createZkCredentialsToAdd= Automatically Using default ZkCredentialsProvider [junit4] 2> 2921939 T14355 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4] 2> 2921944 T14408 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@4167548d name:ZooKeeperConnecti= on Watcher:127.0.0.1:53946 got event WatchedEvent state:SyncConnected type:= None path:null path:null type:None [junit4] 2> 2921944 T14355 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4] 2> 2921945 T14355 oascc.SolrZkClient.createZkACLProvider Usin= g default ZkACLProvider [junit4] 2> 2921950 T14355 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4] 2> 2921954 T14411 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@70150838 name:ZooKeeperConnecti= on Watcher:127.0.0.1:53946/solr got event WatchedEvent state:SyncConnected = type:None path:null path:null type:None [junit4] 2> 2921954 T14355 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4] 2> 2921973 T14355 oascc.ZkStateReader.createClusterStateWatch= ersAndUpdate Updating cluster state from ZooKeeper...=20 [junit4] 2> 2922992 T14355 oasc.ZkController.createEphemeralLiveNode R= egister node as live in ZooKeeper:/live_nodes/127.0.0.1:53954_ [junit4] 2> 2922994 T14355 oascc.SolrZkClient.makePath makePath: /live= _nodes/127.0.0.1:53954_ [junit4] 2> 2923005 T14355 oasc.Overseer.close Overseer (id=3Dnull) cl= osing [junit4] 2> 2923022 T14412 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Ddown collection=3Dcollection1 [junit4] 2> 2923022 T14412 oasc.ZkController.publish numShards not fou= nd on descriptor - reading it from system property [junit4] 2> 2923026 T14381 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2923029 T14412 oasc.ZkController.preRegister Registering w= atch for external collection collection1 [junit4] 2> 2923029 T14412 oascc.ZkStateReader.addZkWatch addZkWatch c= ollection1 [junit4] 2> 2923029 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 1, message =3D { [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "base_url":"http://127.0.0.1:53954", [junit4] 2> =09 "node_name":"127.0.0.1:53954_", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "state":"down", [junit4] 2> =09 "shard":null, [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "operation":"state"} current state version: 5 [junit4] 2> 2923031 T14412 oascc.ZkStateReader.addZkWatch Updating col= lection state at /collections/collection1/state.json from ZooKeeper...=20 [junit4] 2> 2923031 T14382 oasco.ReplicaMutator.updateState Update sta= te numShards=3D3 message=3D{ [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "base_url":"http://127.0.0.1:53954", [junit4] 2> =09 "node_name":"127.0.0.1:53954_", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "state":"down", [junit4] 2> =09 "shard":null, [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "operation":"state"} [junit4] 2> 2923032 T14382 oasco.ReplicaMutator.updateState Collection= already exists with numShards=3D3 [junit4] 2> 2923033 T14382 oasco.ReplicaMutator.updateState Assigning = new node to shard shard=3Dshard2 [junit4] 2> 2923035 T14412 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 0=20 [junit4] 2> 2923035 T14412 oasc.ZkController.waitForCoreNodeName look = for our core node name [junit4] 2> 2923036 T14382 oasco.ZkStateWriter.writePendingUpdates goi= ng to update_collection /collections/collection1/state.json version: 0 [junit4] 2> 2923038 T14411 oascc.ZkStateReader$7.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/coll= ections/collection1/state.json, has occurred - updating...=20 [junit4] 2> 2923039 T14411 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 1=20 [junit4] 2> 2924036 T14412 oasc.ZkController.waitForShardId waiting to= find shard id in clusterstate for collection1 [junit4] 2> 2924037 T14412 oasc.ZkController.createCollectionZkNode Ch= eck for collection zkNode:collection1 [junit4] 2> 2924039 T14412 oasc.ZkController.createCollectionZkNode Co= llection zkNode exists [junit4] 2> 2924040 T14412 oascc.ZkStateReader.readConfigName Load col= lection config from:/collections/collection1 [junit4] 2> 2924046 T14412 oascc.ZkStateReader.readConfigName path=3D/= collections/collection1 configName=3Dconf1 specified config exists in ZooKe= eper [junit4] 2> 2924046 T14412 oasc.SolrResourceLoader. new SolrReso= urceLoader for directory: '../../../../../../../../../Users/jenkins/workspa= ce/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.Ch= aosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-003/collection1/' [junit4] 2> 2924048 T14412 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/s= olr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4= -001/tempDir-003/collection1/lib/.svn/' to classloader [junit4] 2> 2924051 T14412 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/s= olr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4= -001/tempDir-003/collection1/lib/classes/' to classloader [junit4] 2> 2924051 T14412 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/s= olr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4= -001/tempDir-003/collection1/lib/README' to classloader [junit4] 2> 2924121 T14412 oasc.ZkController.watchZKConfDir watch zkdi= r /configs/conf1 [junit4] 2> 2924129 T14412 oasc.Config. loaded config solrconfig= .xml with version 0=20 [junit4] 2> 2924148 T14412 oasc.SolrConfig.refreshRequestParams curren= t version of requestparams : -1 [junit4] 2> 2924154 T14412 oasc.SolrConfig. Using Lucene MatchVe= rsion: 6.0.0 [junit4] 2> 2924165 T14412 oasc.SolrConfig. Loaded SolrConfig: s= olrconfig.xml [junit4] 2> 2924168 T14412 oass.IndexSchema.readSchema Reading Solr Sc= hema from /configs/conf1/schema.xml [junit4] 2> 2924174 T14412 oass.IndexSchema.readSchema [collection1] S= chema name=3Dtest [junit4] 2> 2924294 T14412 oass.IndexSchema.readSchema default search = field in schema is text [junit4] 2> 2924297 T14412 oass.IndexSchema.readSchema unique key fiel= d: id [junit4] 2> 2924299 T14412 oass.FileExchangeRateProvider.reload Reload= ing exchange rates from file currency.xml [junit4] 2> 2924314 T14412 oass.FileExchangeRateProvider.reload Reload= ing exchange rates from file currency.xml [junit4] 2> 2924392 T14412 oasc.CoreContainer.create Creating SolrCore= 'collection1' using configuration from collection collection1 [junit4] 2> 2924393 T14412 oasc.SolrCore.initDirectoryFactory solr.Sta= ndardDirectoryFactory [junit4] 2> 2924393 T14412 oasc.SolrCore. [collection1] Opening = new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-S= olr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySa= feLeaderTest-ACA3BF961C3082C4-001/tempDir-003/collection1/, dataDir=3D/User= s/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/t= emp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/j= etty1/ [junit4] 2> 2924393 T14412 oasc.JmxMonitoredMap. JMX monitoring = is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMB= eanServer@8ad79f4 [junit4] 2> 2924394 T14412 oasc.CachingDirectoryFactory.get return new= directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build= /solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082= C4-001/tempDir-001/jetty1 [junit4] 2> 2924395 T14412 oasc.SolrCore.getNewIndexDir New index dire= ctory detected: old=3Dnull new=3D/Users/jenkins/workspace/Lucene-Solr-trunk= -MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderT= est-ACA3BF961C3082C4-001/tempDir-001/jetty1/index/ [junit4] 2> 2924396 T14412 oasc.SolrCore.initIndex WARN [collection1] = Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/sol= r/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF9= 61C3082C4-001/tempDir-001/jetty1/index' doesn't exist. Creating new index..= . [junit4] 2> 2924396 T14412 oasc.CachingDirectoryFactory.get return new= directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build= /solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082= C4-001/tempDir-001/jetty1/index [junit4] 2> 2924397 T14412 oasu.RandomMergePolicy. RandomMergePo= licy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMerge= Policy: maxMergeAtOnce=3D16, maxMergeAtOnceExplicit=3D45, maxMergedSegmentM= B=3D87.568359375, floorSegmentMB=3D1.501953125, forceMergeDeletesPctAllowed= =3D27.55218996331614, segmentsPerTier=3D24.0, maxCFSSegmentSizeMB=3D8.79609= 3022207999E12, noCFSRatio=3D0.8881378966558299 [junit4] 2> 2924401 T14412 oasc.SolrDeletionPolicy.onCommit SolrDeleti= onPolicy.onCommit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLead= erTest-ACA3BF961C3082C4-001/tempDir-001/jetty1/index,segFN=3Dsegments_1,gen= eration=3D1} [junit4] 2> 2924401 T14412 oasc.SolrDeletionPolicy.updateCommits newes= t commit generation =3D 1 [junit4] 2> 2924408 T14412 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "nodistrib" [junit4] 2> 2924409 T14412 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "dedupe" [junit4] 2> 2924410 T14412 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "d= edupe" [junit4] 2> 2924410 T14412 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "stored_sig" [junit4] 2> 2924411 T14412 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "s= tored_sig" [junit4] 2> 2924411 T14412 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 2924412 T14412 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2924413 T14412 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "d= istrib-dup-test-chain-implicit" [junit4] 2> 2924413 T14412 oasc.SolrCore.loadUpdateProcessorChains no = updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 2924414 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /update: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2924414 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2924414 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2924415 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2924416 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /config: org.apache.solr.handler.SolrConfigHandler [junit4] 2> 2924416 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /schema: org.apache.solr.handler.SchemaHandler [junit4] 2> 2924418 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /replication: org.apache.solr.handler.ReplicationHandler [junit4] 2> 2924419 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /get: org.apache.solr.handler.RealTimeGetHandler [junit4] 2> 2924420 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler [junit4] 2> 2924425 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler [junit4] 2> 2924430 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler [junit4] 2> 2924431 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler [junit4] 2> 2924432 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler [junit4] 2> 2924433 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /admin/properties: org.apache.solr.handler.admin.PropertiesRequest= Handler [junit4] 2> 2924434 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /admin/logging: org.apache.solr.handler.admin.LoggingHandler [junit4] 2> 2924435 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /admin/ping: org.apache.solr.handler.PingRequestHandler [junit4] 2> 2924436 T14412 oasc.RequestHandlers.initHandlersFromConfig= created standard: solr.StandardRequestHandler [junit4] 2> 2924436 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 2924437 T14412 oasc.RequestHandlers.initHandlersFromConfig= created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 2924449 T14412 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4] 2> 2924454 T14412 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4] 2> 2924455 T14412 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4] 2> 2924456 T14412 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4] 2> 2924456 T14412 oasc.SolrCore.initStatsCache Using default = statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 2924459 T14412 oasu.CommitTracker. Hard AutoCommit: = disabled [junit4] 2> 2924460 T14412 oasu.CommitTracker. Soft AutoCommit: = disabled [junit4] 2> 2924460 T14412 oasu.RandomMergePolicy. RandomMergePo= licy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMerge= Policy: maxMergeAtOnce=3D34, maxMergeAtOnceExplicit=3D49, maxMergedSegmentM= B=3D47.3642578125, floorSegmentMB=3D0.8271484375, forceMergeDeletesPctAllow= ed=3D23.156128234359365, segmentsPerTier=3D32.0, maxCFSSegmentSizeMB=3D8.79= 6093022207999E12, noCFSRatio=3D0.0 [junit4] 2> 2924461 T14412 oasc.SolrDeletionPolicy.onInit SolrDeletion= Policy.onInit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLead= erTest-ACA3BF961C3082C4-001/tempDir-001/jetty1/index,segFN=3Dsegments_1,gen= eration=3D1} [junit4] 2> 2924462 T14412 oasc.SolrDeletionPolicy.updateCommits newes= t commit generation =3D 1 [junit4] 2> 2924462 T14412 oass.SolrIndexSearcher. Opening Searc= her@ea45e9[collection1] main [junit4] 2> 2924462 T14412 oascc.ZkStateReader.readConfigName Load col= lection config from:/collections/collection1 [junit4] 2> 2924465 T14412 oascc.ZkStateReader.readConfigName path=3D/= collections/collection1 configName=3Dconf1 specified config exists in ZooKe= eper [junit4] 2> 2924465 T14412 oasr.ManagedResourceStorage.newStorageIO Se= tting up ZooKeeper-based storage for the RestManager with znodeBase: /confi= gs/conf1 [junit4] 2> 2924467 T14412 oasr.ManagedResourceStorage$ZooKeeperStorag= eIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 2924467 T14412 oasr.RestManager.init Initializing RestMana= ger with initArgs: {} [junit4] 2> 2924467 T14412 oasr.ManagedResourceStorage.load Reading _r= est_managed.json using ZooKeeperStorageIO:path=3D/configs/conf1 [junit4] 2> 2924469 T14412 oasr.ManagedResourceStorage$ZooKeeperStorag= eIO.openInputStream No data found for znode /configs/conf1/_rest_managed.js= on [junit4] 2> 2924469 T14412 oasr.ManagedResourceStorage.load Loaded nul= l at path _rest_managed.json using ZooKeeperStorageIO:path=3D/configs/conf1 [junit4] 2> 2924469 T14412 oasr.RestManager.init Initializing 0 regist= ered ManagedResources [junit4] 2> 2924471 T14412 oash.ReplicationHandler.inform Commits will= be reserved for 10000 [junit4] 2> 2924472 T14413 oasc.SolrCore.registerSearcher [collection1= ] Registered new searcher Searcher@ea45e9[collection1] main{ExitableDirecto= ryReader(UninvertingDirectoryReader())} [junit4] 2> 2924473 T14412 oasc.CoreContainer.registerCore registering= core: collection1 [junit4] 2> 2924475 T14416 oasc.ZkController.register Register replica= - core:collection1 address:http://127.0.0.1:53954 collection:collection1 s= hard:shard2 [junit4] 2> 2924477 T14355 oass.SolrDispatchFilter.init user.dir=3D/Us= ers/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0 [junit4] 2> 2924478 T14355 oass.SolrDispatchFilter.init SolrDispatchFi= lter.init() done [junit4] 2> 2924479 T14416 oascc.SolrZkClient.makePath makePath: /coll= ections/collection1/leader_elect/shard2/election [junit4] 2> 2924499 T14416 oasc.ShardLeaderElectionContext.runLeaderPr= ocess Running the leader process for shard shard2 [junit4] 2> 2924505 T14416 oasc.ShardLeaderElectionContext.waitForRepl= icasToComeUp Enough replicas found to continue. [junit4] 2> 2924506 T14416 oasc.ShardLeaderElectionContext.runLeaderPr= ocess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C3654 name=3Dcollection1 org.apache.solr.c= ore.SolrCore@21720329 url=3Dhttp://127.0.0.1:53954/collection1 node=3D127.0= .0.1:53954_ C3654_STATE=3Dcoll:collection1 core:collection1 props:{core=3Dc= ollection1, base_url=3Dhttp://127.0.0.1:53954, node_name=3D127.0.0.1:53954_= , state=3Ddown} [junit4] 2> 2924506 T14416 C3654 P53954 oasc.SyncStrategy.sync Sync re= plicas to http://127.0.0.1:53954/collection1/ [junit4] 2> 2924507 T14416 C3654 P53954 oasc.SyncStrategy.syncReplicas= Sync Success - now sync replicas to me [junit4] 2> 2924508 T14416 C3654 P53954 oasc.SyncStrategy.syncToMe htt= p://127.0.0.1:53954/collection1/ has no replicas [junit4] 2> 2924509 T14416 oasc.ShardLeaderElectionContext.runLeaderPr= ocess I am the new leader: http://127.0.0.1:53954/collection1/ shard2 [junit4] 2> 2924509 T14416 oascc.SolrZkClient.makePath makePath: /coll= ections/collection1/leaders/shard2 [junit4] 2> 2924508 T14381 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2924513 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 1, message =3D { [junit4] 2> =09 "operation":"leader", [junit4] 2> =09 "shard":"shard2", [junit4] 2> =09 "collection":"collection1"} current state version: 5 [junit4] 2> 2924518 T14382 oasco.ZkStateWriter.writePendingUpdates goi= ng to update_collection /collections/collection1/state.json version: 1 [junit4] 2> 2924523 T14411 oascc.ZkStateReader$7.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/coll= ections/collection1/state.json, has occurred - updating...=20 [junit4] 2> 2924533 T14411 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 2=20 [junit4] 2> 2924567 T14381 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2924573 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 1, message =3D { [junit4] 2> =09 "operation":"leader", [junit4] 2> =09 "shard":"shard2", [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "base_url":"http://127.0.0.1:53954", [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "state":"active"} current state version: 5 [junit4] 2> 2924577 T14382 oasco.ZkStateWriter.writePendingUpdates goi= ng to update_collection /collections/collection1/state.json version: 2 [junit4] 2> 2924580 T14411 oascc.ZkStateReader$7.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/coll= ections/collection1/state.json, has occurred - updating...=20 [junit4] 2> 2924585 T14411 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 3=20 [junit4] 2> 2924623 T14416 oasc.ZkController.register We are http://12= 7.0.0.1:53954/collection1/ and leader is http://127.0.0.1:53954/collection1= / [junit4] 2> 2924625 T14416 oasc.ZkController.register No LogReplay nee= ded for core=3Dcollection1 baseURL=3Dhttp://127.0.0.1:53954 [junit4] 2> 2924625 T14416 oasc.ZkController.checkRecovery I am the le= ader, no recovery necessary [junit4] 2> 2924626 T14416 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Dactive collection=3Dcollection1 [junit4] 2> 2924626 T14416 oasc.ZkController.publish numShards not fou= nd on descriptor - reading it from system property [junit4] 2> 2924633 T14381 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2924640 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 1, message =3D { [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "core_node_name":"core_node1", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "base_url":"http://127.0.0.1:53954", [junit4] 2> =09 "node_name":"127.0.0.1:53954_", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "state":"active", [junit4] 2> =09 "shard":"shard2", [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "operation":"state"} current state version: 5 [junit4] 2> 2924643 T14382 oasco.ReplicaMutator.updateState Update sta= te numShards=3D3 message=3D{ [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "core_node_name":"core_node1", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "base_url":"http://127.0.0.1:53954", [junit4] 2> =09 "node_name":"127.0.0.1:53954_", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "state":"active", [junit4] 2> =09 "shard":"shard2", [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "operation":"state"} [junit4] 2> 2924650 T14382 oasco.ZkStateWriter.writePendingUpdates goi= ng to update_collection /collections/collection1/state.json version: 3 [junit4] 2> 2924657 T14411 oascc.ZkStateReader$7.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/coll= ections/collection1/state.json, has occurred - updating...=20 [junit4] 2> 2924658 T14416 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 4=20 [junit4] 2> 2924661 T14411 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 4=20 [junit4] 2> 2926761 T14355 oasc.AbstractFullDistribZkTestBase.createJe= ttys create jetty 2 [junit4] 2> 2926762 T14355 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 2926778 T14355 oejs.AbstractConnector.doStart Started Sele= ctChannelConnector@127.0.0.1:53957 [junit4] 2> 2926779 T14355 oass.SolrDispatchFilter.init SolrDispatchFi= lter.init()sun.misc.Launcher$AppClassLoader@4554617c [junit4] 2> 2926780 T14355 oasc.SolrResourceLoader.locateSolrHome JNDI= not configured for solr (NoInitialContextEx) [junit4] 2> 2926781 T14355 oasc.SolrResourceLoader.locateSolrHome usin= g system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trun= k-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeader= Test-ACA3BF961C3082C4-001/tempDir-004 [junit4] 2> 2926782 T14355 oasc.SolrResourceLoader. new SolrReso= urceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOS= X/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-AC= A3BF961C3082C4-001/tempDir-004/' [junit4] 2> 2926870 T14355 oasc.ConfigSolr.fromFile Loading container = configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/b= uild/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C= 3082C4-001/tempDir-004/solr.xml [junit4] 2> 2926900 T14355 oasc.CoreContainer. New CoreContainer= 1705032371 [junit4] 2> 2926904 T14355 oasc.CoreContainer.load Loading cores into = CoreContainer [instanceDir=3D/Users/jenkins/workspace/Lucene-Solr-trunk-Mac= OSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-= ACA3BF961C3082C4-001/tempDir-004/] [junit4] 2> 2926905 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting socketTimeout to: 90000 [junit4] 2> 2926906 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting urlScheme to:=20 [junit4] 2> 2926907 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting connTimeout to: 15000 [junit4] 2> 2926907 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting maxConnectionsPerHost to: 20 [junit4] 2> 2926908 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting maxConnections to: 10000 [junit4] 2> 2926909 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting corePoolSize to: 0 [junit4] 2> 2926909 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting maximumPoolSize to: 2147483647 [junit4] 2> 2926910 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting maxThreadIdleTime to: 5 [junit4] 2> 2926911 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting sizeOfQueue to: -1 [junit4] 2> 2926912 T14355 oashc.HttpShardHandlerFactory.getParameter = Setting fairnessPolicy to: false [junit4] 2> 2926912 T14355 oasu.UpdateShardHandler. Creating Upd= ateShardHandler HTTP client with params: socketTimeout=3D340000&connTimeout= =3D45000&retry=3Dfalse [junit4] 2> 2926914 T14355 oasl.LogWatcher.createWatcher SLF4J impl is= org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2926914 T14355 oasl.LogWatcher.newRegisteredLogWatcher Reg= istering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2926915 T14355 oasc.CoreContainer.load Host Name: 127.0.0.= 1 [junit4] 2> 2926916 T14355 oasc.ZkContainer.initZooKeeper Zookeeper cl= ient=3D127.0.0.1:53946/solr [junit4] 2> 2926916 T14355 oasc.ZkController.checkChrootPath zkHost in= cludes chroot [junit4] 2> 2926917 T14355 oascc.SolrZkClient.createZkCredentialsToAdd= Automatically Using default ZkCredentialsProvider [junit4] 2> 2926919 T14355 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4] 2> 2926924 T14428 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@4cd47ece name:ZooKeeperConnecti= on Watcher:127.0.0.1:53946 got event WatchedEvent state:SyncConnected type:= None path:null path:null type:None [junit4] 2> 2926925 T14355 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4] 2> 2926925 T14355 oascc.SolrZkClient.createZkACLProvider Usin= g default ZkACLProvider [junit4] 2> 2926931 T14355 oascc.ConnectionManager.waitForConnected Wa= iting for client to connect to ZooKeeper [junit4] 2> 2926944 T14431 oascc.ConnectionManager.process Watcher org= .apache.solr.common.cloud.ConnectionManager@253819cb name:ZooKeeperConnecti= on Watcher:127.0.0.1:53946/solr got event WatchedEvent state:SyncConnected = type:None path:null path:null type:None [junit4] 2> 2926944 T14355 oascc.ConnectionManager.waitForConnected Cl= ient is connected to ZooKeeper [junit4] 2> 2926988 T14355 oascc.ZkStateReader.createClusterStateWatch= ersAndUpdate Updating cluster state from ZooKeeper...=20 [junit4] 2> 2928038 T14355 oasc.ZkController.createEphemeralLiveNode R= egister node as live in ZooKeeper:/live_nodes/127.0.0.1:53957_ [junit4] 2> 2928040 T14355 oascc.SolrZkClient.makePath makePath: /live= _nodes/127.0.0.1:53957_ [junit4] 2> 2928059 T14355 oasc.Overseer.close Overseer (id=3Dnull) cl= osing [junit4] 2> 2928083 T14432 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Ddown collection=3Dcollection1 [junit4] 2> 2928083 T14432 oasc.ZkController.publish numShards not fou= nd on descriptor - reading it from system property [junit4] 2> 2928088 T14381 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2928091 T14432 oasc.ZkController.preRegister Registering w= atch for external collection collection1 [junit4] 2> 2928091 T14432 oascc.ZkStateReader.addZkWatch addZkWatch c= ollection1 [junit4] 2> 2928092 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 1, message =3D { [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "base_url":"http://127.0.0.1:53957", [junit4] 2> =09 "node_name":"127.0.0.1:53957_", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "state":"down", [junit4] 2> =09 "shard":null, [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "operation":"state"} current state version: 5 [junit4] 2> 2928097 T14432 oascc.ZkStateReader.addZkWatch Updating col= lection state at /collections/collection1/state.json from ZooKeeper...=20 [junit4] 2> 2928097 T14382 oasco.ReplicaMutator.updateState Update sta= te numShards=3D3 message=3D{ [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "roles":null, [junit4] 2> =09 "base_url":"http://127.0.0.1:53957", [junit4] 2> =09 "node_name":"127.0.0.1:53957_", [junit4] 2> =09 "numShards":"3", [junit4] 2> =09 "state":"down", [junit4] 2> =09 "shard":null, [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "operation":"state"} [junit4] 2> 2928099 T14382 oasco.ReplicaMutator.updateState Collection= already exists with numShards=3D3 [junit4] 2> 2928099 T14382 oasco.ReplicaMutator.updateState Assigning = new node to shard shard=3Dshard3 [junit4] 2> 2928102 T14432 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 4=20 [junit4] 2> 2928104 T14432 oasc.ZkController.waitForCoreNodeName look = for our core node name [junit4] 2> 2928105 T14382 oasco.ZkStateWriter.writePendingUpdates goi= ng to update_collection /collections/collection1/state.json version: 4 [junit4] 2> 2928107 T14431 oascc.ZkStateReader$7.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/coll= ections/collection1/state.json, has occurred - updating...=20 [junit4] 2> 2928107 T14411 oascc.ZkStateReader$7.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/coll= ections/collection1/state.json, has occurred - updating...=20 [junit4] 2> 2928113 T14431 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 5=20 [junit4] 2> 2928115 T14411 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 5=20 [junit4] 2> 2929105 T14432 oasc.ZkController.waitForShardId waiting to= find shard id in clusterstate for collection1 [junit4] 2> 2929106 T14432 oasc.ZkController.createCollectionZkNode Ch= eck for collection zkNode:collection1 [junit4] 2> 2929109 T14432 oasc.ZkController.createCollectionZkNode Co= llection zkNode exists [junit4] 2> 2929109 T14432 oascc.ZkStateReader.readConfigName Load col= lection config from:/collections/collection1 [junit4] 2> 2929114 T14432 oascc.ZkStateReader.readConfigName path=3D/= collections/collection1 configName=3Dconf1 specified config exists in ZooKe= eper [junit4] 2> 2929115 T14432 oasc.SolrResourceLoader. new SolrReso= urceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOS= X/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-AC= A3BF961C3082C4-001/tempDir-004/collection1/' [junit4] 2> 2929117 T14432 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/s= olr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4= -001/tempDir-004/collection1/lib/.svn/' to classloader [junit4] 2> 2929118 T14432 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/s= olr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4= -001/tempDir-004/collection1/lib/classes/' to classloader [junit4] 2> 2929119 T14432 oasc.SolrResourceLoader.replaceClassLoader = Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/s= olr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082C4= -001/tempDir-004/collection1/lib/README' to classloader [junit4] 2> 2929161 T14432 oasc.ZkController.watchZKConfDir watch zkdi= r /configs/conf1 [junit4] 2> 2929167 T14432 oasc.Config. loaded config solrconfig= .xml with version 0=20 [junit4] 2> 2929184 T14432 oasc.SolrConfig.refreshRequestParams curren= t version of requestparams : -1 [junit4] 2> 2929191 T14432 oasc.SolrConfig. Using Lucene MatchVe= rsion: 6.0.0 [junit4] 2> 2929207 T14432 oasc.SolrConfig. Loaded SolrConfig: s= olrconfig.xml [junit4] 2> 2929211 T14432 oass.IndexSchema.readSchema Reading Solr Sc= hema from /configs/conf1/schema.xml [junit4] 2> 2929221 T14432 oass.IndexSchema.readSchema [collection1] S= chema name=3Dtest [junit4] 2> 2929417 T14432 oass.IndexSchema.readSchema default search = field in schema is text [junit4] 2> 2929418 T14432 oass.IndexSchema.readSchema unique key fiel= d: id [junit4] 2> 2929419 T14432 oass.FileExchangeRateProvider.reload Reload= ing exchange rates from file currency.xml [junit4] 2> 2929428 T14432 oass.FileExchangeRateProvider.reload Reload= ing exchange rates from file currency.xml [junit4] 2> 2929513 T14432 oasc.CoreContainer.create Creating SolrCore= 'collection1' using configuration from collection collection1 [junit4] 2> 2929513 T14432 oasc.SolrCore.initDirectoryFactory solr.Sta= ndardDirectoryFactory [junit4] 2> 2929514 T14432 oasc.SolrCore. [collection1] Opening = new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/buil= d/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C308= 2C4-001/tempDir-004/collection1/, dataDir=3D/Users/jenkins/workspace/Lucene= -Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkey= SafeLeaderTest-ACA3BF961C3082C4-001/tempDir-001/jetty2/ [junit4] 2> 2929514 T14432 oasc.JmxMonitoredMap. JMX monitoring = is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMB= eanServer@8ad79f4 [junit4] 2> 2929516 T14432 oasc.CachingDirectoryFactory.get return new= directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build= /solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082= C4-001/tempDir-001/jetty2 [junit4] 2> 2929517 T14432 oasc.SolrCore.getNewIndexDir New index dire= ctory detected: old=3Dnull new=3D/Users/jenkins/workspace/Lucene-Solr-trunk= -MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderT= est-ACA3BF961C3082C4-001/tempDir-001/jetty2/index/ [junit4] 2> 2929518 T14432 oasc.SolrCore.initIndex WARN [collection1] = Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/sol= r/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF9= 61C3082C4-001/tempDir-001/jetty2/index' doesn't exist. Creating new index..= . [junit4] 2> 2929519 T14432 oasc.CachingDirectoryFactory.get return new= directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build= /solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-ACA3BF961C3082= C4-001/tempDir-001/jetty2/index [junit4] 2> 2929520 T14432 oasu.RandomMergePolicy. RandomMergePo= licy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMerge= Policy: maxMergeAtOnce=3D16, maxMergeAtOnceExplicit=3D45, maxMergedSegmentM= B=3D87.568359375, floorSegmentMB=3D1.501953125, forceMergeDeletesPctAllowed= =3D27.55218996331614, segmentsPerTier=3D24.0, maxCFSSegmentSizeMB=3D8.79609= 3022207999E12, noCFSRatio=3D0.8881378966558299 [junit4] 2> 2929527 T14432 oasc.SolrDeletionPolicy.onCommit SolrDeleti= onPolicy.onCommit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLead= erTest-ACA3BF961C3082C4-001/tempDir-001/jetty2/index,segFN=3Dsegments_1,gen= eration=3D1} [junit4] 2> 2929527 T14432 oasc.SolrDeletionPolicy.updateCommits newes= t commit generation =3D 1 [junit4] 2> 2929537 T14432 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "nodistrib" [junit4] 2> 2929539 T14432 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "dedupe" [junit4] 2> 2929539 T14432 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "d= edupe" [junit4] 2> 2929539 T14432 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "stored_sig" [junit4] 2> 2929540 T14432 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "s= tored_sig" [junit4] 2> 2929540 T14432 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 2929542 T14432 oasup.UpdateRequestProcessorChain.init crea= ting updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2929544 T14432 oasup.UpdateRequestProcessorChain.init inse= rting DistributedUpdateProcessorFactory into updateRequestProcessorChain "d= istrib-dup-test-chain-implicit" [junit4] 2> 2929544 T14432 oasc.SolrCore.loadUpdateProcessorChains no = updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 2929549 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /update: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2929550 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2929550 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2929551 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2929552 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /config: org.apache.solr.handler.SolrConfigHandler [junit4] 2> 2929553 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /schema: org.apache.solr.handler.SchemaHandler [junit4] 2> 2929558 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /replication: org.apache.solr.handler.ReplicationHandler [junit4] 2> 2929560 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /get: org.apache.solr.handler.RealTimeGetHandler [junit4] 2> 2929561 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler [junit4] 2> 2929570 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler [junit4] 2> 2929571 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler [junit4] 2> 2929572 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler [junit4] 2> 2929574 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler [junit4] 2> 2929575 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /admin/properties: org.apache.solr.handler.admin.PropertiesRequest= Handler [junit4] 2> 2929576 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /admin/logging: org.apache.solr.handler.admin.LoggingHandler [junit4] 2> 2929579 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /admin/ping: org.apache.solr.handler.PingRequestHandler [junit4] 2> 2929580 T14432 oasc.RequestHandlers.initHandlersFromConfig= created standard: solr.StandardRequestHandler [junit4] 2> 2929581 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 2929583 T14432 oasc.RequestHandlers.initHandlersFromConfig= created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 2929598 T14432 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4] 2> 2929602 T14432 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4] 2> 2929604 T14432 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4] 2> 2929607 T14432 oashl.XMLLoader.init xsltCacheLifetimeSecon= ds=3D60 [junit4] 2> 2929608 T14432 oasc.SolrCore.initStatsCache Using default = statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 2929611 T14432 oasu.CommitTracker. Hard AutoCommit: = disabled [junit4] 2> 2929611 T14432 oasu.CommitTracker. Soft AutoCommit: = disabled [junit4] 2> 2929613 T14432 oasu.RandomMergePolicy. RandomMergePo= licy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMerge= Policy: maxMergeAtOnce=3D34, maxMergeAtOnceExplicit=3D49, maxMergedSegmentM= B=3D47.3642578125, floorSegmentMB=3D0.8271484375, forceMergeDeletesPctAllow= ed=3D23.156128234359365, segmentsPerTier=3D32.0, maxCFSSegmentSizeMB=3D8.79= 6093022207999E12, noCFSRatio=3D0.0 [junit4] 2> 2929615 T14432 oasc.SolrDeletionPolicy.onInit SolrDeletion= Policy.onInit: commits: num=3D1 [junit4] 2> =09=09commit{dir=3D/Users/jenkins/workspace/Lucene-Solr-tr= unk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLead= erTest-ACA3BF961C3082C4-001/tempDir-001/jetty2/index,segFN=3Dsegments_1,gen= eration=3D1} [junit4] 2> 2929615 T14432 oasc.SolrDeletionPolicy.updateCommits newes= t commit generation =3D 1 [junit4] 2> 2929616 T14432 oass.SolrIndexSearcher. Opening Searc= her@2d426fab[collection1] main [junit4] 2> 2929617 T14432 oascc.ZkStateReader.readConfigName Load col= lection config from:/collections/collection1 [junit4] 2> 2929619 T14432 oascc.ZkStateReader.readConfigName path=3D/= collections/collection1 configName=3Dconf1 specified config exists in ZooKe= eper [junit4] 2> 2929620 T14432 oasr.ManagedResourceStorage.newStorageIO Se= tting up ZooKeeper-based storage for the RestManager with znodeBase: /confi= gs/conf1 [junit4] 2> 2929623 T14432 oasr.ManagedResourceStorage$ZooKeeperStorag= eIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 2929623 T14432 oasr.RestManager.init Initializing RestMana= ger with initArgs: {} [junit4] 2> 2929624 T14432 oasr.ManagedResourceStorage.load Reading _r= est_managed.json using ZooKeeperStorageIO:path=3D/configs/conf1 [junit4] 2> 2929626 T14432 oasr.ManagedResourceStorage$ZooKeeperStorag= eIO.openInputStream No data found for znode /configs/conf1/_rest_managed.js= on [junit4] 2> 2929627 T14432 oasr.ManagedResourceStorage.load Loaded nul= l at path _rest_managed.json using ZooKeeperStorageIO:path=3D/configs/conf1 [junit4] 2> 2929627 T14432 oasr.RestManager.init Initializing 0 regist= ered ManagedResources [junit4] 2> 2929628 T14432 oash.ReplicationHandler.inform Commits will= be reserved for 10000 [junit4] 2> 2929630 T14432 oasc.CoreContainer.registerCore registering= core: collection1 [junit4] 2> 2929631 T14433 oasc.SolrCore.registerSearcher [collection1= ] Registered new searcher Searcher@2d426fab[collection1] main{ExitableDirec= toryReader(UninvertingDirectoryReader())} [junit4] 2> 2929633 T14436 oasc.ZkController.register Register replica= - core:collection1 address:http://127.0.0.1:53957 collection:collection1 s= hard:shard3 [junit4] 2> 2929637 T14355 oass.SolrDispatchFilter.init user.dir=3D/Us= ers/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0 [junit4] 2> 2929639 T14355 oass.SolrDispatchFilter.init SolrDispatchFi= lter.init() done [junit4] 2> 2929643 T14436 oascc.SolrZkClient.makePath makePath: /coll= ections/collection1/leader_elect/shard3/election [junit4] 2> 2929659 T14436 oasc.ShardLeaderElectionContext.runLeaderPr= ocess Running the leader process for shard shard3 [junit4] 2> 2929668 T14381 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2929671 T14436 oasc.ShardLeaderElectionContext.waitForRepl= icasToComeUp Enough replicas found to continue. [junit4] 2> 2929671 T14436 oasc.ShardLeaderElectionContext.runLeaderPr= ocess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C3655 name=3Dcollection1 org.apache.solr.c= ore.SolrCore@1f72145c url=3Dhttp://127.0.0.1:53957/collection1 node=3D127.0= .0.1:53957_ C3655_STATE=3Dcoll:collection1 core:collection1 props:{core=3Dc= ollection1, base_url=3Dhttp://127.0.0.1:53957, node_name=3D127.0.0.1:53957_= , state=3Ddown} [junit4] 2> 2929672 T14436 C3655 P53957 oasc.SyncStrategy.sync Sync re= plicas to http://127.0.0.1:53957/collection1/ [junit4] 2> 2929673 T14436 C3655 P53957 oasc.SyncStrategy.syncReplicas= Sync Success - now sync replicas to me [junit4] 2> 2929675 T14436 C3655 P53957 oasc.SyncStrategy.syncToMe htt= p://127.0.0.1:53957/collection1/ has no replicas [junit4] 2> 2929675 T14436 oasc.ShardLeaderElectionContext.runLeaderPr= ocess I am the new leader: http://127.0.0.1:53957/collection1/ shard3 [junit4] 2> 2929675 T14436 oascc.SolrZkClient.makePath makePath: /coll= ections/collection1/leaders/shard3 [junit4] 2> 2929680 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 1, message =3D { [junit4] 2> =09 "operation":"leader", [junit4] 2> =09 "shard":"shard3", [junit4] 2> =09 "collection":"collection1"} current state version: 5 [junit4] 2> 2929691 T14382 oasco.ZkStateWriter.writePendingUpdates goi= ng to update_collection /collections/collection1/state.json version: 5 [junit4] 2> 2929695 T14411 oascc.ZkStateReader$7.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/coll= ections/collection1/state.json, has occurred - updating...=20 [junit4] 2> 2929700 T14411 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 6=20 [junit4] 2> 2929701 T14431 oascc.ZkStateReader$7.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/coll= ections/collection1/state.json, has occurred - updating...=20 [junit4] 2> 2929707 T14431 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 6=20 [junit4] 2> 2929719 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 1, message =3D { [junit4] 2> =09 "operation":"leader", [junit4] 2> =09 "shard":"shard3", [junit4] 2> =09 "collection":"collection1", [junit4] 2> =09 "base_url":"http://127.0.0.1:53957", [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "state":"active"} current state version: 5 [junit4] 2> 2929721 T14382 oasco.ZkStateWriter.writePendingUpdates goi= ng to update_collection /collections/collection1/state.json version: 6 [junit4] 2> 2929723 T14411 oascc.ZkStateReader$7.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/coll= ections/collection1/state.json, has occurred - updating...=20 [junit4] 2> 2929725 T14411 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 7=20 [junit4] 2> 2929730 T14431 oascc.ZkStateReader$7.process A cluster sta= te change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/coll= ections/collection1/state.json, has occurred - updating...=20 [junit4] 2> 2929733 T14431 oascc.ZkStateReader.updateWatchedCollection= Updating data for collection1 to ver 7=20 [junit4] 2> 2929743 T14381 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2929784 T14436 oasc.ZkController.register We are http://12= 7.0.0.1:53957/collection1/ and leader is http://127.0.0.1:53957/collection1= / [junit4] 2> 2929784 T14436 oasc.ZkController.register No LogReplay nee= ded for core=3Dcollection1 baseURL=3Dhttp://127.0.0.1:53957 [junit4] 2> 2929785 T14436 oasc.ZkController.checkRecovery I am the le= ader, no recovery necessary [junit4] 2> 2929785 T14436 oasc.ZkController.publish publishing core= =3Dcollection1 state=3Dactive collection=3Dcollection1 [junit4] 2> 2929785 T14436 oasc.ZkController.publish numShards not fou= nd on descriptor - reading it from system property [junit4] 2> 2929788 T14381 oasc.DistributedQueue$LatchWatcher.process = NodeChildrenChanged fired on path /overseer/queue state SyncConnected [junit4] 2> 2929792 T14382 oasc.Overseer$ClusterStateUpdater.run proce= ssMessage: queueSize: 1, message =3D { [junit4] 2> =09 "core":"collection1", [junit4] 2> =09 "core_node_name":"core_node2", [junit4] 2> =09 "rol [...truncated too long message...] l.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) [junit4] 2> =09 at java.util.concurrent.SynchronousQueue$Transf= erStack.awaitFulfill(SynchronousQueue.java:460) [junit4] 2> =09 at java.util.concurrent.SynchronousQueue$Transf= erStack.transfer(SynchronousQueue.java:362) [junit4] 2> =09 at java.util.concurrent.SynchronousQueue.poll(S= ynchronousQueue.java:941) [junit4] 2> =09 at java.util.concurrent.ThreadPoolExecutor.getT= ask(ThreadPoolExecutor.java:1066) [junit4] 2> =09 at java.util.concurrent.ThreadPoolExecutor.runW= orker(ThreadPoolExecutor.java:1127) [junit4] 2> =09 at java.util.concurrent.ThreadPoolExecutor$Work= er.run(ThreadPoolExecutor.java:617) [junit4] 2> =09 at java.lang.Thread.run(Thread.java:745) [junit4] 2> =09 36) Thread[id=3D14434, name=3DThread-6175, state=3DWA= ITING, group=3DTGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> =09 at java.lang.Object.wait(Native Method) [junit4] 2> =09 at java.lang.Object.wait(Object.java:502) [junit4] 2> =09 at org.apache.solr.core.CloserThread.run(CoreCo= ntainer.java:929) [junit4] 2> =09 37) Thread[id=3D14438, name=3Dqtp1677243178-14438 Sel= ector0, state=3DRUNNABLE, group=3DTGRP-ChaosMonkeySafeLeaderTest] [junit4] 2> =09 at sun.nio.ch.KQueueArrayWrapper.kevent0(Native= Method) [junit4] 2> =09 at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArr= ayWrapper.java:198) [junit4] 2> =09 at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueu= eSelectorImpl.java:103) [junit4] 2> =09 at sun.nio.ch.SelectorImpl.lockAndDoSelect(Sele= ctorImpl.java:86) [junit4] 2> =09 at sun.nio.ch.SelectorImpl.select(SelectorImpl.= java:97) [junit4] 2> =09 at org.eclipse.jetty.io.nio.SelectorManager$Sel= ectSet.doSelect(SelectorManager.java:569) [junit4] 2> =09 at org.eclipse.jetty.io.nio.SelectorManager$1.r= un(SelectorManager.java:290) [junit4] 2> =09 at org.eclipse.jetty.util.thread.QueuedThreadPo= ol.runJob(QueuedThreadPool.java:608) [junit4] 2> =09 at org.eclipse.jetty.util.thread.QueuedThreadPo= ol$3.run(QueuedThreadPool.java:543) [junit4] 2> =09 at java.lang.Thread.run(Thread.java:745) [junit4] 2> NOTE: test params are: codec=3DAsserting(Lucene50): {rnd_b= =3DPostingsFormat(name=3DLuceneFixedGap), _version_=3DPostingsFormat(name= =3DLuceneVarGapFixedInterval), a_t=3DLucene50(blocksize=3D128), a_i=3DPosti= ngsFormat(name=3DLuceneFixedGap), id=3DPostingsFormat(name=3DLuceneFixedGap= )}, docValues:{}, sim=3DDefaultSimilarity, locale=3Dde_CH, timezone=3DAmeri= ca/Shiprock [junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20 (= 64-bit)/cpus=3D2,threads=3D51,free=3D214109304,total=3D358612992 [junit4] 2> NOTE: All tests run in this JVM: [TestIntervalFaceting, Te= stCollationField, TestFastWriter, DeleteShardTest, CursorPagingTest, TestRa= ndomDVFaceting, DistributedIntervalFacetingTest, ClusterStateTest, TestQuer= yTypes, DocumentAnalysisRequestHandlerTest, HighlighterMaxOffsetTest, TestD= FRSimilarityFactory, ZkSolrClientTest, TestFieldSortValues, TestManagedSche= ma, RegexBoostProcessorTest, TestCollationFieldDocValues, CollectionsAPIDis= tributedZkTest, TestCopyFieldCollectionResource, IndexSchemaRuntimeFieldTes= t, TestSolr4Spatial, SoftAutoCommitTest, RecoveryZkTest, TestSolrDeletionPo= licy2, ZkCLITest, NumericFieldsTest, FastVectorHighlighterTest, TestExpandC= omponent, TestPostingsSolrHighlighter, TestOmitPositions, TestCloudInspectU= til, TestFieldCollectionResource, TestQuerySenderNoQuery, CacheHeaderTest, = TestManagedStopFilterFactory, IndexSchemaTest, DirectSolrSpellCheckerTest, = TestReloadAndDeleteDocs, CoreAdminHandlerTest, SSLMigrationTest, SpellCheck= ComponentTest, TestDefaultStatsCache, CloudExitableDirectoryReaderTest, Cha= osMonkeyNothingIsSafeTest, TestDefaultSimilarityFactory, SyncSliceTest, Tes= tSolrJ, RemoteQueryErrorTest, SolrRequestParserTest, TestChildDocTransforme= r, CurrencyFieldXmlFileTest, TestPHPSerializedResponseWriter, TestFiltering= , TestRawResponseWriter, TestDocSet, QueryResultKeyTest, ReplicationFactorT= est, DeleteReplicaTest, TestRealTimeGet, SimpleMLTQParserTest, RAMDirectory= FactoryTest, TestRecoveryHdfs, TestAnalyzedSuggestions, TestUpdate, ScriptE= ngineTest, DeleteInactiveReplicaTest, InfoHandlerTest, ReturnFieldsTest, Te= stDefaultSearchFieldResource, DistributedSuggestComponentTest, DirectUpdate= HandlerOptimizeTest, TestReplicationHandler, PolyFieldTest, TestManagedSche= maFieldResource, ZkControllerTest, ConnectionManagerTest, BasicDistributedZ= k2Test, TestSolrConfigHandlerCloud, TestClusterStateMutator, TestSurroundQu= eryParser, TestRequestStatusCollectionAPI, SolrXmlInZkTest, SpatialFilterTe= st, ExternalFileFieldSortTest, DisMaxRequestHandlerTest, DistributedQueryEl= evationComponentTest, CopyFieldTest, SolrCoreCheckLockOnStartupTest, TestMi= niSolrCloudCluster, TestTolerantSearch, OutOfBoxZkACLAndCredentialsProvider= sTest, TestCSVResponseWriter, StatelessScriptUpdateProcessorFactoryTest, Te= stFunctionQuery, HdfsChaosMonkeySafeLeaderTest, CoreContainerCoreInitFailur= esTest, ShowFileRequestHandlerTest, CursorMarkTest, EnumFieldTest, TestConf= igReload, TestElisionMultitermQuery, DocValuesMultiTest, URLClassifyProcess= orTest, TestShortCircuitedRequests, DocumentBuilderTest, TestStandardQParse= rs, CachingDirectoryFactoryTest, AtomicUpdatesTest, TestNRTOpen, TestPartia= lUpdateDeduplication, DistributedFacetPivotLongTailTest, SharedFSAutoReplic= aFailoverUtilsTest, TestCloudManagedSchemaConcurrent, SuggesterFSTTest, Clu= sterStateUpdateTest, TestExactSharedStatsCache, NoCacheHeaderTest, UpdateRe= questProcessorFactoryTest, TestCollectionAPI, TestQueryUtils, DocValuesMiss= ingTest, TestSolrConfigHandlerConcurrent, TestStressLucene, TestLFUCache, H= dfsWriteToMultipleCollectionsTest, TestIndexSearcher, SimplePostToolTest, T= estSolrDeletionPolicy1, TestLeaderElectionZkExpiry, TestTrie, MinimalSchema= Test, SOLR749Test, TestDynamicFieldCollectionResource, TestSolrXmlPersistor= , DistributedTermsComponentTest, HttpPartitionTest, TestFuzzyAnalyzedSugges= tions, TestManagedSchemaDynamicFieldResource, TestSolrDynamicMBean, Analysi= sErrorHandlingTest, SolrIndexSplitterTest, TestNonNRTOpen, TestManagedSynon= ymFilterFactory, ShardRoutingTest, TestValueSourceCache, SchemaVersionSpeci= ficBehaviorTest, BlockDirectoryTest, TestStressVersions, TestSort, HdfsBasi= cDistributedZk2Test, TestSystemIdResolver, PeerSyncTest, CoreAdminRequestSt= atusTest, TestBM25SimilarityFactory, TestSortingResponseWriter, Distributed= FacetPivotWhiteBoxTest, HdfsSyncSliceTest, LeaderFailoverAfterPartitionTest= , TestDocBasedVersionConstraints, TestLRUStatsCache, HardAutoCommitTest, Da= teFieldTest, AddSchemaFieldsUpdateProcessorFactoryTest, CoreAdminCreateDisc= overTest, ConvertedLegacyTest, DateMathParserTest, UUIDFieldTest, IgnoreCom= mitOptimizeUpdateProcessorFactoryTest, SearchHandlerTest, BadCopyFieldTest,= TestRecovery, TestInitQParser, SynonymTokenizerTest, TestLuceneMatchVersio= n, PreAnalyzedUpdateProcessorTest, TestAddFieldRealTimeGet, SuggesterWFSTTe= st, TestBinaryField, TestMaxScoreQueryParser, CustomCollectionTest, TestSol= rConfigHandler, OverseerRolesTest, FieldMutatingUpdateProcessorTest, SolrIn= foMBeanTest, TestCoreDiscovery, TestDistributedGrouping, AlternateDirectory= Test, TestUtils, UnloadDistributedZkTest, PreAnalyzedFieldTest, TestCursorM= arkWithoutUniqueKey, RollingRestartTest, DistributedFacetPivotSmallAdvanced= Test, TestOverriddenPrefixQueryForCustomFieldType, HdfsCollectionsAPIDistri= butedZkTest, AnalyticsMergeStrategyTest, TestConfig, ResponseHeaderTest, Di= stanceFunctionTest, TestOrdValues, SortByFunctionTest, TermsComponentTest, = TestFieldResource, TestJoin, RequiredFieldsTest, MergeStrategyTest, TestSea= rcherReuse, MBeansHandlerTest, TestExceedMaxTermLength, TestQuerySenderList= ener, TestClassNameShortening, BadComponentTest, TestDistribDocBasedVersion= , PathHierarchyTokenizerFactoryTest, DistributedDebugComponentTest, Parsing= FieldUpdateProcessorsTest, LegacyHTMLStripCharFilterTest, DistribDocExpirat= ionUpdateProcessorTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest] [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=3DChaosMonkeySa= feLeaderTest -Dtests.seed=3DACA3BF961C3082C4 -Dtests.slow=3Dtrue -Dtests.lo= cale=3Dde_CH -Dtests.timezone=3DAmerica/Shiprock -Dtests.asserts=3Dtrue -Dt= ests.file.encoding=3DUS-ASCII [junit4] ERROR 0.00s | ChaosMonkeySafeLeaderTest (suite) <<< [junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded = (>=3D 7200000 msec). [junit4] > =09at __randomizedtesting.SeedInfo.seed([ACA3BF961C3082C4]= :0) [junit4] Completed in 7224.98s, 1 test, 2 errors <<< FAILURES! [...truncated 697 lines...] BUILD FAILED /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The follow= ing error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The follow= ing error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The followi= ng error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The= following error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:187: The f= ollowing error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510= : The following error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1= 349: The following error occurred while executing this line: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:9= 56: There were test failures: 460 suites, 1857 tests, 1 suite-level error, = 1 error, 903 ignored (15 assumptions) Total time: 211 minutes 53 seconds Build step 'Invoke Ant' marked build as failure [description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:+UseCompress= edOops -XX:+UseG1GC (asserts: true) Archiving artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ------=_Part_64_1652086971.1420101144493 Content-Type: text/plain; charset=us-ascii --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org ------=_Part_64_1652086971.1420101144493--