lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b79) - Build # 4760 - Failure!
Date Thu, 21 Mar 2013 06:34:56 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4760/
Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseG1GC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:42736/tex/ln/onenodecollectioncore returned non ok status:404, message:Can not find: /tex/ln/onenodecollectioncore/update

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:42736/tex/ln/onenodecollectioncore returned non ok status:404, message:Can not find: /tex/ln/onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([BF7D1B87661AD8E5:3E9B959F1145B8D9]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9093 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   2> 0 T488 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /tex/ln
[junit4:junit4]   2> 5 T488 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363846916700
[junit4:junit4]   2> 5 T488 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 6 T489 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 7 T489 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 7 T489 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 7 T489 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 7 T489 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 8 T489 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 106 T488 oasc.ZkTestServer.run start zk server on port:57041
[junit4:junit4]   2> 106 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a89425f
[junit4:junit4]   2> 107 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 108 T494 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 108 T494 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 108 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34436
[junit4:junit4]   2> 109 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34436
[junit4:junit4]   2> 109 T492 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 229 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f0000 with negotiated timeout 10000 for client /127.0.0.1:34436
[junit4:junit4]   2> 229 T494 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f0000, negotiated timeout = 10000
[junit4:junit4]   2> 229 T495 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a89425f name:ZooKeeperConnection Watcher:127.0.0.1:57041 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 230 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 230 T488 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 234 T493 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8b9c6a5f0000
[junit4:junit4]   2> 234 T495 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 234 T490 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:34436 which had sessionid 0x13d8b9c6a5f0000
[junit4:junit4]   2> 234 T488 oaz.ZooKeeper.close Session: 0x13d8b9c6a5f0000 closed
[junit4:junit4]   2> 235 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@144ebf7e
[junit4:junit4]   2> 235 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 236 T496 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 236 T496 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 236 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34437
[junit4:junit4]   2> 237 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34437
[junit4:junit4]   2> 237 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f0001 with negotiated timeout 10000 for client /127.0.0.1:34437
[junit4:junit4]   2> 237 T496 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f0001, negotiated timeout = 10000
[junit4:junit4]   2> 238 T497 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@144ebf7e name:ZooKeeperConnection Watcher:127.0.0.1:57041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 238 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 238 T488 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 241 T488 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 244 T488 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 246 T488 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 249 T488 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 249 T488 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 254 T488 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 254 T488 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 257 T488 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 258 T488 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 260 T488 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 261 T488 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 263 T488 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 264 T488 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 267 T488 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 267 T488 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 270 T488 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 270 T488 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 273 T488 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 274 T488 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 276 T488 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 277 T488 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 279 T493 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8b9c6a5f0001
[junit4:junit4]   2> 280 T497 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 280 T488 oaz.ZooKeeper.close Session: 0x13d8b9c6a5f0001 closed
[junit4:junit4]   2> 280 T490 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:34437 which had sessionid 0x13d8b9c6a5f0001
[junit4:junit4]   2> 342 T488 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 389 T488 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60485
[junit4:junit4]   2> 389 T488 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 390 T488 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 390 T488 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363846916975
[junit4:junit4]   2> 391 T488 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363846916975/solr.xml
[junit4:junit4]   2> 391 T488 oasc.CoreContainer.<init> New CoreContainer 1960147537
[junit4:junit4]   2> 391 T488 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363846916975/'
[junit4:junit4]   2> 392 T488 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363846916975/'
[junit4:junit4]   2> 425 T488 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 425 T488 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 426 T488 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 426 T488 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 426 T488 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 427 T488 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 427 T488 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 427 T488 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 428 T488 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 428 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 437 T488 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 447 T488 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57041/solr
[junit4:junit4]   2> 447 T488 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 448 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@50ac8da7
[junit4:junit4]   2> 449 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 449 T507 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 450 T507 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 450 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34438
[junit4:junit4]   2> 451 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34438
[junit4:junit4]   2> 453 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f0002 with negotiated timeout 20000 for client /127.0.0.1:34438
[junit4:junit4]   2> 453 T507 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f0002, negotiated timeout = 20000
[junit4:junit4]   2> 453 T508 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50ac8da7 name:ZooKeeperConnection Watcher:127.0.0.1:57041 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 453 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 455 T493 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8b9c6a5f0002
[junit4:junit4]   2> 456 T508 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 456 T490 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:34438 which had sessionid 0x13d8b9c6a5f0002
[junit4:junit4]   2> 456 T488 oaz.ZooKeeper.close Session: 0x13d8b9c6a5f0002 closed
[junit4:junit4]   2> 457 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 461 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@a7cd86d
[junit4:junit4]   2> 461 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 462 T509 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 462 T509 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 462 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34439
[junit4:junit4]   2> 463 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34439
[junit4:junit4]   2> 464 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f0003 with negotiated timeout 20000 for client /127.0.0.1:34439
[junit4:junit4]   2> 464 T509 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f0003, negotiated timeout = 20000
[junit4:junit4]   2> 464 T510 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a7cd86d name:ZooKeeperConnection Watcher:127.0.0.1:57041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 465 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 470 T488 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 473 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 474 T488 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 478 T488 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 480 T488 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60485_tex%2Fln
[junit4:junit4]   2> 481 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60485_tex%2Fln Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60485_tex%2Fln
[junit4:junit4]   2> 481 T488 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60485_tex%2Fln
[junit4:junit4]   2> 485 T488 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 492 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 492 T488 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 495 T488 oasc.Overseer.start Overseer (id=89381071533047811-127.0.0.1:60485_tex%2Fln-n_0000000000) starting
[junit4:junit4]   2> 495 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 496 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 497 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 498 T488 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 501 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 502 T512 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 503 T488 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 505 T488 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 507 T488 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 510 T511 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 511 T513 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363846916975/collection1
[junit4:junit4]   2> 512 T513 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 512 T513 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 512 T513 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 514 T513 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363846916975/collection1/'
[junit4:junit4]   2> 514 T513 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363846916975/collection1/lib/README' to classloader
[junit4:junit4]   2> 514 T513 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363846916975/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 544 T513 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 573 T513 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 574 T513 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 580 T513 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 949 T513 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 955 T513 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 957 T513 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 975 T513 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 979 T513 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 982 T513 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 983 T513 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 984 T513 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 984 T513 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 986 T513 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 986 T513 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 986 T513 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 986 T513 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363846916975/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/control/data/
[junit4:junit4]   2> 986 T513 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b2f621e
[junit4:junit4]   2> 987 T513 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 988 T513 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/control/data forceNew: false
[junit4:junit4]   2> 988 T513 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/control/data/index/
[junit4:junit4]   2> 988 T513 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 988 T513 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/control/data/index forceNew: false
[junit4:junit4]   2> 990 T513 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@489437d8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4a0c6bc9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 990 T513 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 992 T513 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 992 T513 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 992 T513 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 993 T513 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 993 T513 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 993 T513 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 994 T513 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 994 T513 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 994 T513 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 998 T513 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1001 T513 oass.SolrIndexSearcher.<init> Opening Searcher@1decd4b9 main
[junit4:junit4]   2> 1001 T513 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/control/data/tlog
[junit4:junit4]   2> 1001 T513 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1002 T513 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1005 T514 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1decd4b9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1006 T513 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1006 T513 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2015 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2016 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60485_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60485/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 2017 T511 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2017 T511 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2024 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3008 T513 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 3008 T513 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60485/tex/ln collection:control_collection shard:shard1
[junit4:junit4]   2> 3009 T513 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 3018 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0003 type:delete cxid:0x82 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 3019 T513 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3020 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0003 type:create cxid:0x83 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3022 T513 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3022 T513 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3022 T513 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60485/tex/ln/collection1/
[junit4:junit4]   2> 3022 T513 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3023 T513 oasc.SyncStrategy.syncToMe http://127.0.0.1:60485/tex/ln/collection1/ has no replicas
[junit4:junit4]   2> 3023 T513 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60485/tex/ln/collection1/
[junit4:junit4]   2> 3023 T513 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 3027 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0003 type:create cxid:0x8e zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3532 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3654 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3681 T513 oasc.ZkController.register We are http://127.0.0.1:60485/tex/ln/collection1/ and leader is http://127.0.0.1:60485/tex/ln/collection1/
[junit4:junit4]   2> 3681 T513 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60485/tex/ln
[junit4:junit4]   2> 3682 T513 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3682 T513 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3682 T513 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3684 T513 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3685 T488 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3685 T488 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3686 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3690 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3690 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7560a5f1
[junit4:junit4]   2> 3691 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3691 T516 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3692 T516 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 3692 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34444
[junit4:junit4]   2> 3692 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34444
[junit4:junit4]   2> 3693 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f0004 with negotiated timeout 10000 for client /127.0.0.1:34444
[junit4:junit4]   2> 3693 T516 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f0004, negotiated timeout = 10000
[junit4:junit4]   2> 3693 T517 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7560a5f1 name:ZooKeeperConnection Watcher:127.0.0.1:57041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3693 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3695 T488 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3697 T488 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 3760 T488 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3762 T488 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45549
[junit4:junit4]   2> 3762 T488 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3763 T488 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3763 T488 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363846920392
[junit4:junit4]   2> 3763 T488 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363846920392/solr.xml
[junit4:junit4]   2> 3764 T488 oasc.CoreContainer.<init> New CoreContainer 1393488270
[junit4:junit4]   2> 3764 T488 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363846920392/'
[junit4:junit4]   2> 3764 T488 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363846920392/'
[junit4:junit4]   2> 3783 T488 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 3783 T488 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3784 T488 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 3784 T488 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3785 T488 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3785 T488 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3786 T488 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3786 T488 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3787 T488 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3787 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 3793 T488 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3804 T488 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57041/solr
[junit4:junit4]   2> 3804 T488 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3804 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@615e81e5
[junit4:junit4]   2> 3805 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3805 T527 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3806 T527 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 3806 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34445
[junit4:junit4]   2> 3807 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34445
[junit4:junit4]   2> 3808 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f0005 with negotiated timeout 20000 for client /127.0.0.1:34445
[junit4:junit4]   2> 3808 T527 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f0005, negotiated timeout = 20000
[junit4:junit4]   2> 3808 T528 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@615e81e5 name:ZooKeeperConnection Watcher:127.0.0.1:57041 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3808 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3810 T493 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8b9c6a5f0005
[junit4:junit4]   2> 3810 T528 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3810 T490 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:34445 which had sessionid 0x13d8b9c6a5f0005
[junit4:junit4]   2> 3810 T488 oaz.ZooKeeper.close Session: 0x13d8b9c6a5f0005 closed
[junit4:junit4]   2> 3811 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 3816 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1db63bae
[junit4:junit4]   2> 3817 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3817 T529 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3818 T529 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 3818 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34446
[junit4:junit4]   2> 3819 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34446
[junit4:junit4]   2> 3820 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f0006 with negotiated timeout 20000 for client /127.0.0.1:34446
[junit4:junit4]   2> 3820 T529 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f0006, negotiated timeout = 20000
[junit4:junit4]   2> 3820 T530 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1db63bae name:ZooKeeperConnection Watcher:127.0.0.1:57041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3820 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3821 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3823 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3825 T488 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4828 T488 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45549_tex%2Fln
[junit4:junit4]   2> 4829 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:delete cxid:0xd zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45549_tex%2Fln Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45549_tex%2Fln
[junit4:junit4]   2> 4830 T488 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45549_tex%2Fln
[junit4:junit4]   2> 4833 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4833 T530 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4833 T517 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4835 T510 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4839 T531 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363846920392/collection1
[junit4:junit4]   2> 4839 T531 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4840 T531 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4845 T531 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4847 T531 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363846920392/collection1/'
[junit4:junit4]   2> 4847 T531 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363846920392/collection1/lib/README' to classloader
[junit4:junit4]   2> 4848 T531 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363846920392/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4871 T531 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 4907 T531 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4908 T531 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4914 T531 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5163 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5163 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60485_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60485/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 5168 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5168 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5168 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5281 T531 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5288 T531 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5290 T531 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5305 T531 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5309 T531 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5312 T531 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5313 T531 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5313 T531 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5314 T531 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5315 T531 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5315 T531 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5315 T531 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5316 T531 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363846920392/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty1/
[junit4:junit4]   2> 5316 T531 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b2f621e
[junit4:junit4]   2> 5316 T531 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5317 T531 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty1 forceNew: false
[junit4:junit4]   2> 5318 T531 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty1/index/
[junit4:junit4]   2> 5318 T531 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5318 T531 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty1/index forceNew: false
[junit4:junit4]   2> 5319 T531 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@153991b7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c9f3b),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5320 T531 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5322 T531 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5322 T531 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5322 T531 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5323 T531 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5323 T531 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5324 T531 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5324 T531 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5324 T531 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5325 T531 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5327 T531 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5329 T531 oass.SolrIndexSearcher.<init> Opening Searcher@432e5b6d main
[junit4:junit4]   2> 5330 T531 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty1/tlog
[junit4:junit4]   2> 5330 T531 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5330 T531 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5335 T532 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@432e5b6d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5337 T531 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5337 T531 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6675 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6676 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45549_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45549/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 6676 T511 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 6677 T511 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6682 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6682 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6682 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7338 T531 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 7339 T531 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45549/tex/ln collection:collection1 shard:shard1
[junit4:junit4]   2> 7340 T531 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7348 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:delete cxid:0x4a zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 7348 T531 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 7349 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:create cxid:0x4b zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7351 T531 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 7351 T531 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 7351 T531 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45549/tex/ln/collection1/
[junit4:junit4]   2> 7351 T531 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 7351 T531 oasc.SyncStrategy.syncToMe http://127.0.0.1:45549/tex/ln/collection1/ has no replicas
[junit4:junit4]   2> 7352 T531 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45549/tex/ln/collection1/
[junit4:junit4]   2> 7352 T531 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7360 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:create cxid:0x56 zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8188 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8196 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8196 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8197 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8214 T531 oasc.ZkController.register We are http://127.0.0.1:45549/tex/ln/collection1/ and leader is http://127.0.0.1:45549/tex/ln/collection1/
[junit4:junit4]   2> 8214 T531 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45549/tex/ln
[junit4:junit4]   2> 8214 T531 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 8215 T531 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8215 T531 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8216 T531 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8218 T488 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 8218 T488 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8218 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8285 T488 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8287 T488 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:42736
[junit4:junit4]   2> 8288 T488 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8288 T488 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8288 T488 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363846924917
[junit4:junit4]   2> 8289 T488 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363846924917/solr.xml
[junit4:junit4]   2> 8289 T488 oasc.CoreContainer.<init> New CoreContainer 1570573583
[junit4:junit4]   2> 8289 T488 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363846924917/'
[junit4:junit4]   2> 8290 T488 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363846924917/'
[junit4:junit4]   2> 8308 T488 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 8309 T488 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8309 T488 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 8309 T488 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8310 T488 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8310 T488 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8310 T488 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8310 T488 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8311 T488 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8311 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 8318 T488 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8327 T488 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57041/solr
[junit4:junit4]   2> 8328 T488 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8328 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@762f8ef9
[junit4:junit4]   2> 8329 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8329 T543 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8330 T543 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 8330 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34447
[junit4:junit4]   2> 8330 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34447
[junit4:junit4]   2> 8331 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f0007 with negotiated timeout 20000 for client /127.0.0.1:34447
[junit4:junit4]   2> 8331 T543 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f0007, negotiated timeout = 20000
[junit4:junit4]   2> 8331 T544 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@762f8ef9 name:ZooKeeperConnection Watcher:127.0.0.1:57041 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8332 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8333 T493 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8b9c6a5f0007
[junit4:junit4]   2> 8334 T544 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8334 T490 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:34447 which had sessionid 0x13d8b9c6a5f0007
[junit4:junit4]   2> 8334 T488 oaz.ZooKeeper.close Session: 0x13d8b9c6a5f0007 closed
[junit4:junit4]   2> 8334 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 8337 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@37834eaf
[junit4:junit4]   2> 8338 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8339 T545 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8339 T545 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 8339 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34448
[junit4:junit4]   2> 8340 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34448
[junit4:junit4]   2> 8342 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f0008 with negotiated timeout 20000 for client /127.0.0.1:34448
[junit4:junit4]   2> 8342 T545 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f0008, negotiated timeout = 20000
[junit4:junit4]   2> 8343 T546 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37834eaf name:ZooKeeperConnection Watcher:127.0.0.1:57041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8343 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8345 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8347 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0008 type:create cxid:0x3 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8349 T488 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9352 T488 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42736_tex%2Fln
[junit4:junit4]   2> 9353 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0008 type:delete cxid:0xd zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:42736_tex%2Fln Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:42736_tex%2Fln
[junit4:junit4]   2> 9354 T488 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42736_tex%2Fln
[junit4:junit4]   2> 9356 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9356 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9356 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9358 T546 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9359 T517 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9359 T530 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9360 T510 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9365 T547 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363846924917/collection1
[junit4:junit4]   2> 9365 T547 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9366 T547 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9366 T547 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9368 T547 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363846924917/collection1/'
[junit4:junit4]   2> 9368 T547 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363846924917/collection1/lib/README' to classloader
[junit4:junit4]   2> 9369 T547 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363846924917/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9400 T547 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 9435 T547 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9437 T547 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9443 T547 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 9712 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9713 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45549_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45549/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 9716 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9716 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9717 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9716 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9798 T547 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 9804 T547 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 9806 T547 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 9823 T547 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9827 T547 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9830 T547 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9832 T547 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 9832 T547 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 9832 T547 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9833 T547 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 9834 T547 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 9834 T547 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 9834 T547 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363846924917/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty2/
[junit4:junit4]   2> 9834 T547 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b2f621e
[junit4:junit4]   2> 9835 T547 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 9836 T547 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty2 forceNew: false
[junit4:junit4]   2> 9836 T547 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty2/index/
[junit4:junit4]   2> 9836 T547 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 9836 T547 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty2/index forceNew: false
[junit4:junit4]   2> 9838 T547 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@196926f3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b075f51),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9838 T547 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 9841 T547 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 9841 T547 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 9842 T547 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 9842 T547 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 9843 T547 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 9843 T547 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 9843 T547 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 9844 T547 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 9844 T547 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 9847 T547 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 9849 T547 oass.SolrIndexSearcher.<init> Opening Searcher@3e6abf8f main
[junit4:junit4]   2> 9850 T547 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty2/tlog
[junit4:junit4]   2> 9850 T547 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 9851 T547 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 9855 T548 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e6abf8f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 9857 T547 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 9857 T547 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11222 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11222 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42736_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42736/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 11223 T511 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 11223 T511 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 11227 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11227 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11227 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11227 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11858 T547 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11859 T547 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:42736/tex/ln collection:collection1 shard:shard2
[junit4:junit4]   2> 11860 T547 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 11865 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0008 type:delete cxid:0x49 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 11866 T547 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 11867 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0008 type:create cxid:0x4a zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11869 T547 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 11869 T547 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 11870 T547 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:42736/tex/ln/collection1/
[junit4:junit4]   2> 11870 T547 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 11870 T547 oasc.SyncStrategy.syncToMe http://127.0.0.1:42736/tex/ln/collection1/ has no replicas
[junit4:junit4]   2> 11870 T547 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:42736/tex/ln/collection1/
[junit4:junit4]   2> 11871 T547 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 11874 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0008 type:create cxid:0x54 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12735 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12742 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12742 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12742 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12742 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12778 T547 oasc.ZkController.register We are http://127.0.0.1:42736/tex/ln/collection1/ and leader is http://127.0.0.1:42736/tex/ln/collection1/
[junit4:junit4]   2> 12778 T547 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42736/tex/ln
[junit4:junit4]   2> 12778 T547 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 12778 T547 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 12779 T547 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12781 T547 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12782 T488 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 12783 T488 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 12783 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12857 T488 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 12859 T488 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47900
[junit4:junit4]   2> 12860 T488 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 12860 T488 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 12861 T488 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363846929482
[junit4:junit4]   2> 12861 T488 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363846929482/solr.xml
[junit4:junit4]   2> 12861 T488 oasc.CoreContainer.<init> New CoreContainer 20743075
[junit4:junit4]   2> 12862 T488 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363846929482/'
[junit4:junit4]   2> 12862 T488 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363846929482/'
[junit4:junit4]   2> 12882 T488 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 12883 T488 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 12883 T488 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 12883 T488 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 12884 T488 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 12884 T488 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 12884 T488 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 12884 T488 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 12885 T488 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 12885 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 12892 T488 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 12903 T488 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57041/solr
[junit4:junit4]   2> 12903 T488 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 12904 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1efc62c4
[junit4:junit4]   2> 12905 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12905 T559 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12906 T559 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 12906 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34449
[junit4:junit4]   2> 12906 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34449
[junit4:junit4]   2> 12907 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f0009 with negotiated timeout 20000 for client /127.0.0.1:34449
[junit4:junit4]   2> 12907 T559 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f0009, negotiated timeout = 20000
[junit4:junit4]   2> 12907 T560 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1efc62c4 name:ZooKeeperConnection Watcher:127.0.0.1:57041 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12907 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12909 T493 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8b9c6a5f0009
[junit4:junit4]   2> 12909 T560 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12909 T490 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:34449 which had sessionid 0x13d8b9c6a5f0009
[junit4:junit4]   2> 12909 T488 oaz.ZooKeeper.close Session: 0x13d8b9c6a5f0009 closed
[junit4:junit4]   2> 12910 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 12913 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2ea6fa35
[junit4:junit4]   2> 12914 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12914 T561 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12915 T561 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 12915 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34450
[junit4:junit4]   2> 12915 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34450
[junit4:junit4]   2> 12916 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f000a with negotiated timeout 20000 for client /127.0.0.1:34450
[junit4:junit4]   2> 12916 T561 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f000a, negotiated timeout = 20000
[junit4:junit4]   2> 12916 T562 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ea6fa35 name:ZooKeeperConnection Watcher:127.0.0.1:57041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12916 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12917 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f000a type:create cxid:0x1 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12918 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f000a type:create cxid:0x3 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12920 T488 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 13923 T488 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47900_tex%2Fln
[junit4:junit4]   2> 13924 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f000a type:delete cxid:0xd zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:47900_tex%2Fln Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:47900_tex%2Fln
[junit4:junit4]   2> 13925 T488 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47900_tex%2Fln
[junit4:junit4]   2> 13927 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13927 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13927 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13927 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13928 T562 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13929 T530 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13929 T546 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13929 T510 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13929 T517 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13933 T563 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363846929482/collection1
[junit4:junit4]   2> 13934 T563 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 13934 T563 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 13935 T563 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 13936 T563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363846929482/collection1/'
[junit4:junit4]   2> 13936 T563 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363846929482/collection1/lib/README' to classloader
[junit4:junit4]   2> 13936 T563 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363846929482/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 13960 T563 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 13987 T563 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 13988 T563 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 13994 T563 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 14248 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14249 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:42736_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:42736/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":"shard2"}
[junit4:junit4]   2> 14252 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14252 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14252 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14253 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14252 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14320 T563 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 14326 T563 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 14329 T563 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 14346 T563 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14349 T563 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14352 T563 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14353 T563 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14353 T563 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14354 T563 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14354 T563 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14355 T563 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14355 T563 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 14355 T563 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363846929482/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty3/
[junit4:junit4]   2> 14355 T563 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b2f621e
[junit4:junit4]   2> 14356 T563 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 14357 T563 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty3 forceNew: false
[junit4:junit4]   2> 14357 T563 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty3/index/
[junit4:junit4]   2> 14357 T563 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 14357 T563 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty3/index forceNew: false
[junit4:junit4]   2> 14359 T563 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3bdee2ba lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a649a12),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 14359 T563 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 14361 T563 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 14361 T563 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 14361 T563 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 14362 T563 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 14362 T563 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 14363 T563 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 14363 T563 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 14363 T563 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 14364 T563 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 14366 T563 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 14368 T563 oass.SolrIndexSearcher.<init> Opening Searcher@1112eace main
[junit4:junit4]   2> 14368 T563 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty3/tlog
[junit4:junit4]   2> 14369 T563 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 14369 T563 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 14374 T564 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1112eace main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 14376 T563 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 14376 T563 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15759 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15760 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:47900_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:47900/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 15760 T511 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 15760 T511 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 15764 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15764 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15764 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15764 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15765 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16380 T563 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 16380 T563 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47900/tex/ln collection:collection1 shard:shard1
[junit4:junit4]   2> 16385 T563 oasc.ZkController.register We are http://127.0.0.1:47900/tex/ln/collection1/ and leader is http://127.0.0.1:45549/tex/ln/collection1/
[junit4:junit4]   2> 16385 T563 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47900/tex/ln
[junit4:junit4]   2> 16385 T563 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 16385 T563 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C35 name=collection1 org.apache.solr.core.SolrCore@9f4f40 url=http://127.0.0.1:47900/tex/ln/collection1 node=127.0.0.1:47900_tex%2Fln C35_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:47900_tex%2Fln, base_url=http://127.0.0.1:47900/tex/ln, state=down, collection=collection1, core=collection1}
[junit4:junit4]   2> 16385 T565 C35 P47900 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 16386 T565 C35 P47900 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 16386 T563 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16386 T565 C35 P47900 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 16386 T565 C35 P47900 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16387 T488 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 16388 T565 C35 P47900 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16388 T488 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 16388 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16467 T488 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 16469 T488 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36580
[junit4:junit4]   2> 16470 T488 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 16470 T488 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 16470 T488 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363846933094
[junit4:junit4]   2> 16471 T488 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363846933094/solr.xml
[junit4:junit4]   2> 16471 T488 oasc.CoreContainer.<init> New CoreContainer 670519924
[junit4:junit4]   2> 16471 T488 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363846933094/'
[junit4:junit4]   2> 16472 T488 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363846933094/'
[junit4:junit4]   2> 16489 T488 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 16490 T488 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 16490 T488 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 16490 T488 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 16491 T488 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 16491 T488 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 16491 T488 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 16492 T488 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 16492 T488 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 16492 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 16498 T488 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 16507 T488 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57041/solr
[junit4:junit4]   2> 16508 T488 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 16508 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@72f5c6c5
[junit4:junit4]   2> 16509 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16509 T576 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 16510 T576 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 16510 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34452
[junit4:junit4]   2> 16511 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34452
[junit4:junit4]   2> 16511 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f000b with negotiated timeout 20000 for client /127.0.0.1:34452
[junit4:junit4]   2> 16512 T576 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f000b, negotiated timeout = 20000
[junit4:junit4]   2> 16512 T577 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72f5c6c5 name:ZooKeeperConnection Watcher:127.0.0.1:57041 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16512 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16513 T493 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8b9c6a5f000b
[junit4:junit4]   2> 16514 T577 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 16514 T490 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:34452 which had sessionid 0x13d8b9c6a5f000b
[junit4:junit4]   2> 16514 T488 oaz.ZooKeeper.close Session: 0x13d8b9c6a5f000b closed
[junit4:junit4]   2> 16514 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 16518 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@f59ebca
[junit4:junit4]   2> 16519 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16519 T578 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 16520 T578 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 16520 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34453
[junit4:junit4]   2> 16520 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34453
[junit4:junit4]   2> 16521 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f000c with negotiated timeout 20000 for client /127.0.0.1:34453
[junit4:junit4]   2> 16521 T578 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f000c, negotiated timeout = 20000
[junit4:junit4]   2> 16521 T579 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f59ebca name:ZooKeeperConnection Watcher:127.0.0.1:57041/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16522 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16522 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f000c type:create cxid:0x1 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16524 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f000c type:create cxid:0x3 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16526 T488 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 17271 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17272 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:47900_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:47900/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 17277 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17277 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17277 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17277 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17277 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17277 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17398 T525 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {action=PREPRECOVERY&wt=javabin&nodeName=127.0.0.1:47900_tex%252Fln&state=recovering&version=2&core=collection1&checkLive=true&onlyIfLeader=true&coreNodeName=4} status=0 QTime=1000 
[junit4:junit4]   2> 17529 T488 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36580_tex%2Fln
[junit4:junit4]   2> 17529 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f000c type:delete cxid:0xf zxid:0xa7 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:36580_tex%2Fln Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:36580_tex%2Fln
[junit4:junit4]   2> 17530 T488 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36580_tex%2Fln
[junit4:junit4]   2> 17532 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17533 T530 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17533 T510 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17533 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17534 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17534 T579 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17534 T546 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17534 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17534 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17534 T517 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17535 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17536 T562 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17542 T580 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363846933094/collection1
[junit4:junit4]   2> 17542 T580 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 17543 T580 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 17543 T580 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 17544 T580 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363846933094/collection1/'
[junit4:junit4]   2> 17545 T580 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363846933094/collection1/lib/README' to classloader
[junit4:junit4]   2> 17545 T580 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363846933094/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 17570 T580 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 17597 T580 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 17598 T580 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 17604 T580 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 17936 T580 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 17950 T580 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 17952 T580 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 17968 T580 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17971 T580 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17974 T580 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17975 T580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 17976 T580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 17976 T580 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17977 T580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 17977 T580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 17977 T580 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 17978 T580 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363846933094/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty4/
[junit4:junit4]   2> 17978 T580 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b2f621e
[junit4:junit4]   2> 17978 T580 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 17979 T580 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty4 forceNew: false
[junit4:junit4]   2> 17979 T580 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty4/index/
[junit4:junit4]   2> 17979 T580 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 17980 T580 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty4/index forceNew: false
[junit4:junit4]   2> 17981 T580 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3407f6cd lockFactory=org.apache.lucene.store.NativeFSLockFactory@3f85406c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 17981 T580 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 17983 T580 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 17983 T580 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 17984 T580 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 17984 T580 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 17985 T580 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 17985 T580 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 17985 T580 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 17985 T580 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 17986 T580 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 17988 T580 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 17991 T580 oass.SolrIndexSearcher.<init> Opening Searcher@1238a282 main
[junit4:junit4]   2> 17991 T580 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty4/tlog
[junit4:junit4]   2> 17991 T580 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 17991 T580 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 17995 T581 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1238a282 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 17997 T580 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 17997 T580 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18783 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18784 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core_node_name":"5",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36580_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36580/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 18784 T511 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 18784 T511 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 18788 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18788 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18788 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18788 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18788 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18788 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18999 T580 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 18999 T580 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36580/tex/ln collection:collection1 shard:shard2
[junit4:junit4]   2> 19003 T580 oasc.ZkController.register We are http://127.0.0.1:36580/tex/ln/collection1/ and leader is http://127.0.0.1:42736/tex/ln/collection1/
[junit4:junit4]   2> 19003 T580 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36580/tex/ln
[junit4:junit4]   2> 19004 T580 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 19004 T580 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C36 name=collection1 org.apache.solr.core.SolrCore@401fea81 url=http://127.0.0.1:36580/tex/ln/collection1 node=127.0.0.1:36580_tex%2Fln C36_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:36580_tex%2Fln, base_url=http://127.0.0.1:36580/tex/ln, state=down, collection=collection1, core=collection1}
[junit4:junit4]   2> 19004 T582 C36 P36580 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 19005 T582 C36 P36580 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 19005 T580 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19005 T582 C36 P36580 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 19006 T582 C36 P36580 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19007 T582 C36 P36580 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19006 T488 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 19007 T488 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 19007 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19011 T488 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19012 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19017 T523 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363846920392/onenodecollectioncore
[junit4:junit4]   2> 19017 T523 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4]   2> 19018 T523 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   2> 19019 T523 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 19020 T523 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 19020 T523 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4]   2> 19022 T523 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4]   2> 19023 T523 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363846920392/onenodecollectioncore/'
[junit4:junit4]   2> 19051 T523 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 19083 T523 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 19084 T523 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 19089 T523 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2>  C35_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:47900_tex%2Fln, base_url=http://127.0.0.1:47900/tex/ln, state=recovering, collection=collection1, core=collection1, shard=shard1}
[junit4:junit4]   2> 19399 T565 C35 P47900 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45549/tex/ln/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 19400 T565 C35 P47900 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:47900/tex/ln START replicas=[http://127.0.0.1:45549/tex/ln/collection1/] nUpdates=100
[junit4:junit4]   2> 19400 T565 C35 P47900 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 19400 T565 C35 P47900 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 19401 T565 C35 P47900 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 19401 T565 C35 P47900 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 19401 T565 C35 P47900 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 19401 T565 C35 P47900 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45549/tex/ln/collection1/. core=collection1
[junit4:junit4]   2> 19401 T565 C35 P47900 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C37 name=collection1 org.apache.solr.core.SolrCore@3f5cb4f2 url=http://127.0.0.1:45549/tex/ln/collection1 node=127.0.0.1:45549_tex%2Fln C37_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:45549_tex%2Fln, base_url=http://127.0.0.1:45549/tex/ln, state=active, collection=collection1, core=collection1, shard=shard1, leader=true}
[junit4:junit4]   2> 19405 T524 C37 P45549 REQ /get {wt=javabin&getVersions=100&version=2&distrib=false&qt=/get} status=0 QTime=0 
[junit4:junit4]   2> 19406 T526 C37 P45549 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 19407 T526 C37 P45549 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@153991b7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c9f3b),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 19408 T526 C37 P45549 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 19408 T526 C37 P45549 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@153991b7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c9f3b),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@153991b7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@628c9f3b),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 19409 T526 C37 P45549 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 19409 T526 C37 P45549 oass.SolrIndexSearcher.<init> Opening Searcher@5edbda0f realtime
[junit4:junit4]   2> 19409 T526 C37 P45549 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 19410 T526 C37 P45549 /update {commit_end_point=true&wt=javabin&commit=true&softCommit=false&version=2&waitSearcher=true&openSearcher=false} {commit=} 0 4
[junit4:junit4]   2> 19410 T565 C35 P47900 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19411 T565 C35 P47900 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 19416 T524 C37 P45549 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19416 T524 C37 P45549 REQ /replication {wt=javabin&command=indexversion&version=2&qt=/replication} status=0 QTime=4 
[junit4:junit4]   2> 19417 T565 C35 P47900 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 19417 T565 C35 P47900 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 19417 T565 C35 P47900 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 19420 T526 C37 P45549 REQ /replication {wt=javabin&generation=2&command=filelist&version=2&qt=/replication} status=0 QTime=1 
[junit4:junit4]   2> 19420 T565 C35 P47900 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 19422 T565 C35 P47900 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty3/index.20130321072216116 forceNew: false
[junit4:junit4]   2> 19422 T565 C35 P47900 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/index6305963075tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d6812db) fullCopy=false
[junit4:junit4]   2> 19425 T525 C37 P45549 REQ /replication {checksum=true&wt=filestream&generation=2&command=filecontent&qt=/replication&file=segments_2} status=0 QTime=0 
[junit4:junit4]   2> 19426 T565 C35 P47900 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 19428 T565 C35 P47900 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 19428 T565 C35 P47900 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 19429 T565 C35 P47900 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3bdee2ba lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a649a12),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3bdee2ba lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a649a12),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 19430 T565 C35 P47900 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 19430 T565 C35 P47900 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 19430 T565 C35 P47900 oass.SolrIndexSearcher.<init> Opening Searcher@205eaf7b main
[junit4:junit4]   2> 19431 T564 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@205eaf7b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 19431 T523 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 19432 T565 C35 P47900 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 19432 T565 C35 P47900 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 19432 T565 C35 P47900 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 19432 T565 C35 P47900 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19434 T565 C35 P47900 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 19438 T523 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 19440 T523 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 19457 T523 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 19470 T523 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 19475 T523 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 19476 T523 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 19477 T523 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 19477 T523 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 19478 T523 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 19479 T523 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 19479 T523 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 19479 T523 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363846920392/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363846916700/onenodecollection/
[junit4:junit4]   2> 19480 T523 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b2f621e
[junit4:junit4]   2> 19480 T523 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 19481 T523 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363846916700/onenodecollection forceNew: false
[junit4:junit4]   2> 19482 T523 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363846916700/onenodecollection/index/
[junit4:junit4]   2> 19482 T523 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363846916700/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 19482 T523 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363846916700/onenodecollection/index forceNew: false
[junit4:junit4]   2> 19484 T523 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6f006420 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f411006),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 19484 T523 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 19486 T523 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 19486 T523 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 19487 T523 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 19487 T523 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 19488 T523 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 19488 T523 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 19488 T523 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 19489 T523 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 19489 T523 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 19492 T523 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 19494 T523 oass.SolrIndexSearcher.<init> Opening Searcher@569e6028 main
[junit4:junit4]   2> 19495 T523 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363846916700/onenodecollection/tlog
[junit4:junit4]   2> 19495 T523 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 19496 T523 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 19499 T586 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@569e6028 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 19501 T523 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4]   2> 20293 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20294 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core_node_name":"5",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36580_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36580/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":"shard2"}
[junit4:junit4]   2> 20298 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:47900_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:47900/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 20302 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45549_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45549/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":"none",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"onenodecollection",
[junit4:junit4]   2> 	  "core":"onenodecollectioncore",
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 20302 T511 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4]   2> 20303 T511 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 20318 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20318 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20318 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20318 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20318 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20318 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20503 T523 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4]   2> 20504 T523 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:45549/tex/ln collection:onenodecollection shard:shard1
[junit4:junit4]   2> 20505 T523 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   2> 20511 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:delete cxid:0xac zxid:0xc2 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4]   2> 20511 T523 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 20512 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:create cxid:0xad zxid:0xc3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 20513 T523 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 20514 T523 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 20514 T523 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45549/tex/ln/onenodecollectioncore/
[junit4:junit4]   2> 20514 T523 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 20514 T523 oasc.SyncStrategy.syncToMe http://127.0.0.1:45549/tex/ln/onenodecollectioncore/ has no replicas
[junit4:junit4]   2> 20515 T523 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45549/tex/ln/onenodecollectioncore/
[junit4:junit4]   2> 20515 T523 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   2> 20518 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:create cxid:0xb8 zxid:0xc7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 21011 T542 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {action=PREPRECOVERY&wt=javabin&nodeName=127.0.0.1:36580_tex%252Fln&state=recovering&version=2&core=collection1&checkLive=true&onlyIfLeader=true&coreNodeName=5} status=0 QTime=2000 
[junit4:junit4]   2> 21828 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21835 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21835 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21835 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21835 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21835 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21835 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21875 T523 oasc.ZkController.register We are http://127.0.0.1:45549/tex/ln/onenodecollectioncore/ and leader is http://127.0.0.1:45549/tex/ln/onenodecollectioncore/
[junit4:junit4]   2> 21876 T523 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:45549/tex/ln
[junit4:junit4]   2> 21876 T523 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 21876 T523 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4]   2> 21879 T523 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21880 T523 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {action=CREATE&wt=javabin&name=onenodecollectioncore&roles=none&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363846916700/onenodecollection&version=2&numShards=1&collection=onenodecollection} status=0 QTime=2863 
[junit4:junit4]   2> 21880 T488 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 21881 T488 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22883 T488 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C36_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:36580_tex%2Fln, base_url=http://127.0.0.1:36580/tex/ln, state=recovering, collection=collection1, core=collection1, shard=shard2}
[junit4:junit4]   2> 23013 T582 C36 P36580 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:42736/tex/ln/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 23013 T582 C36 P36580 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:36580/tex/ln START replicas=[http://127.0.0.1:42736/tex/ln/collection1/] nUpdates=100
[junit4:junit4]   2> 23013 T582 C36 P36580 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 23013 T582 C36 P36580 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 23014 T582 C36 P36580 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 23014 T582 C36 P36580 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 23014 T582 C36 P36580 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 23014 T582 C36 P36580 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:42736/tex/ln/collection1/. core=collection1
[junit4:junit4]   2> 23014 T582 C36 P36580 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C38 name=collection1 org.apache.solr.core.SolrCore@4f08b2ee url=http://127.0.0.1:42736/tex/ln/collection1 node=127.0.0.1:42736_tex%2Fln C38_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:42736_tex%2Fln, base_url=http://127.0.0.1:42736/tex/ln, state=active, collection=collection1, core=collection1, shard=shard2, leader=true}
[junit4:junit4]   2> 23019 T542 C38 P42736 REQ /get {wt=javabin&getVersions=100&version=2&distrib=false&qt=/get} status=0 QTime=1 
[junit4:junit4]   2> 23020 T540 C38 P42736 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 23021 T540 C38 P42736 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@196926f3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b075f51),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 23022 T540 C38 P42736 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 23022 T540 C38 P42736 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@196926f3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b075f51),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@196926f3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b075f51),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 23022 T540 C38 P42736 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 23023 T540 C38 P42736 oass.SolrIndexSearcher.<init> Opening Searcher@4e6678a8 realtime
[junit4:junit4]   2> 23023 T540 C38 P42736 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 23023 T540 C38 P42736 /update {commit_end_point=true&wt=javabin&commit=true&softCommit=false&version=2&waitSearcher=true&openSearcher=false} {commit=} 0 3
[junit4:junit4]   2> 23024 T582 C36 P36580 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 23024 T582 C36 P36580 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 23026 T539 C38 P42736 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 23026 T539 C38 P42736 REQ /replication {wt=javabin&command=indexversion&version=2&qt=/replication} status=0 QTime=1 
[junit4:junit4]   2> 23027 T582 C36 P36580 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 23027 T582 C36 P36580 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 23027 T582 C36 P36580 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 23029 T542 C38 P42736 REQ /replication {wt=javabin&generation=2&command=filelist&version=2&qt=/replication} status=0 QTime=0 
[junit4:junit4]   2> 23030 T582 C36 P36580 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 23031 T582 C36 P36580 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty4/index.20130321072219725 forceNew: false
[junit4:junit4]   2> 23031 T582 C36 P36580 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/index6305963077tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@13f1751b) fullCopy=false
[junit4:junit4]   2> 23035 T540 C38 P42736 REQ /replication {checksum=true&wt=filestream&generation=2&command=filecontent&qt=/replication&file=segments_2} status=0 QTime=1 
[junit4:junit4]   2> 23036 T582 C36 P36580 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 23038 T582 C36 P36580 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 23038 T582 C36 P36580 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 23039 T582 C36 P36580 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3407f6cd lockFactory=org.apache.lucene.store.NativeFSLockFactory@3f85406c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3407f6cd lockFactory=org.apache.lucene.store.NativeFSLockFactory@3f85406c),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 23039 T582 C36 P36580 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 23039 T582 C36 P36580 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 23040 T582 C36 P36580 oass.SolrIndexSearcher.<init> Opening Searcher@775b2da6 main
[junit4:junit4]   2> 23041 T581 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@775b2da6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 23041 T582 C36 P36580 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 23041 T582 C36 P36580 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 23041 T582 C36 P36580 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 23042 T582 C36 P36580 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 23043 T582 C36 P36580 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 23343 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23344 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:45549_tex%2Fln_onenodecollectioncore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45549_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45549/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":"none",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"onenodecollection",
[junit4:junit4]   2> 	  "core":"onenodecollectioncore",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 23348 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core_node_name":"5",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:36580_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:36580/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":"shard2"}
[junit4:junit4]   2> 23357 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23357 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23358 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23358 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23358 T517 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23358 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23885 T488 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23886 T488 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4]   2> 23887 T488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 23899 T488 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57041 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@af0a665
[junit4:junit4]   2> 23900 T488 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 23900 T589 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:57041. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 23901 T589 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:57041, initiating session
[junit4:junit4]   2> 23901 T490 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:34464
[junit4:junit4]   2> 23901 T490 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:34464
[junit4:junit4]   2> 23902 T492 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8b9c6a5f000d with negotiated timeout 10000 for client /127.0.0.1:34464
[junit4:junit4]   2> 23902 T589 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:57041, sessionid = 0x13d8b9c6a5f000d, negotiated timeout = 10000
[junit4:junit4]   2> 23903 T590 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@af0a665 name:ZooKeeperConnection Watcher:127.0.0.1:57041 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 23903 T488 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 23950 T493 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8b9c6a5f000d
[junit4:junit4]   2> 23951 T590 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 23951 T490 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:34464 which had sessionid 0x13d8b9c6a5f000d
[junit4:junit4]   2> 23951 T488 oaz.ZooKeeper.close Session: 0x13d8b9c6a5f000d closed
[junit4:junit4]   2> 23952 T493 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8b9c6a5f0004
[junit4:junit4]   2> 23968 T517 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 23968 T488 oaz.ZooKeeper.close Session: 0x13d8b9c6a5f0004 closed
[junit4:junit4]   2> 23968 T490 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:34444 which had sessionid 0x13d8b9c6a5f0004
[junit4:junit4]   2> 23971 T488 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 60485
[junit4:junit4]   2> 23971 T488 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1960147537
[junit4:junit4]   2> 24864 T511 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 24865 T511 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60485_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60485/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 24918 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24918 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24918 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24918 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24918 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 25989 T488 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 25989 T488 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 25993 T488 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@97b554d
[junit4:junit4]   2> 25998 T488 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 25998 T488 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 25999 T488 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 25999 T488 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 25999 T488 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 26000 T488 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/control/data/index
[junit4:junit4]   2> 26000 T488 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/control/data/index
[junit4:junit4]   2> 26000 T488 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/control/data
[junit4:junit4]   2> 26001 T488 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/control/data
[junit4:junit4]   2> 26001 T511 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89381071533047811-127.0.0.1:60485_tex%2Fln-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 26002 T493 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8b9c6a5f0003
[junit4:junit4]   2> 26003 T510 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 26003 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 26003 T488 oaz.ZooKeeper.close Session: 0x13d8b9c6a5f0003 closed
[junit4:junit4]   2> 26003 T510 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 26004 T546 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 26003 T490 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:34439 which had sessionid 0x13d8b9c6a5f0003
[junit4:junit4]   2> 26004 T510 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 26004 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 26004 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:delete cxid:0xc6 zxid:0xe3 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 26004 T579 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 26004 T510 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 26005 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 26005 T530 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 26006 T562 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 26008 T530 oasc.Overseer.start Overseer (id=89381071533047814-127.0.0.1:45549_tex%2Fln-n_0000000001) starting
[junit4:junit4]   2> 26008 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:create cxid:0xcb zxid:0xe5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 26009 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:create cxid:0xcc zxid:0xe6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 26010 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:create cxid:0xce zxid:0xe7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 26011 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0006 type:create cxid:0xd0 zxid:0xe8 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 26012 T592 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 26012 T530 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 26013 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 26014 T591 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 26016 T591 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 26019 T591 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60485_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60485/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 26024 T488 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/tex/ln,null}
[junit4:junit4]   2> 26077 T488 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 45549
[junit4:junit4]   2> 26078 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 26078 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 26078 T488 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1393488270
[junit4:junit4]   2> 26078 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 26078 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 27586 T591 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 27587 T591 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:45549_tex%2Fln_onenodecollectioncore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45549_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45549/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":"none",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "collection":"onenodecollection",
[junit4:junit4]   2> 	  "core":"onenodecollectioncore",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 27593 T591 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:45549_tex%2Fln",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:45549/tex/ln",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 27600 T530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 27600 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 27600 T546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 27600 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 29082 T488 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 29083 T488 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 29085 T488 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4]   2> 29088 T488 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3f5cb4f2
[junit4:junit4]   2> 29093 T488 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 29093 T488 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 29094 T488 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 29094 T488 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 29095 T488 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 29095 T488 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty1
[junit4:junit4]   2> 29096 T488 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty1
[junit4:junit4]   2> 29096 T488 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty1/index
[junit4:junit4]   2> 29096 T488 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363846916700/jetty1/index
[junit4:junit4]   2> 29097 T488 oasc.SolrCore.close [onenodecollectioncore]  CLOSING SolrCore org.apache.solr.core.SolrCore@3e041954
[junit4:junit4]   2> 29101 T488 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 29101 T488 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 29101 T488 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 29102 T488 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 29102 T488 oasc.SolrCore.closeSearcher [onenodecollectioncore] Closing main searcher on request.
[junit4:junit4]   2> 29103 T488 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363846916700/onenodecollection
[junit4:junit4]   2> 29103 T488 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363846916700/onenodecollection
[junit4:junit4]   2> 29103 T488 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363846916700/onenodecollection/index
[junit4:junit4]   2> 29103 T488 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363846916700/onenodecollection/index
[junit4:junit4]   2> 29104 T591 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89381071533047814-127.0.0.1:45549_tex%2Fln-n_0000000001) am no longer a leader.
[junit4:junit4]   2> 29104 T493 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8b9c6a5f0006
[junit4:junit4]   2> 29105 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 29105 T490 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:34446 which had sessionid 0x13d8b9c6a5f0006
[junit4:junit4]   2> 29105 T488 oaz.ZooKeeper.close Session: 0x13d8b9c6a5f0006 closed
[junit4:junit4]   2> 29106 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0008 type:delete cxid:0x7c zxid:0xf9 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 29106 T562 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 29106 T562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 29106 T546 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 29107 T579 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 29108 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f000a type:delete cxid:0x61 zxid:0xfb txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 29108 T562 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 29108 T546 oasc.Overseer.start Overseer (id=89381071533047816-127.0.0.1:42736_tex%2Fln-n_0000000002) starting
[junit4:junit4]   2> 29109 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f000a type:create cxid:0x62 zxid:0xfc txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 29109 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0008 type:create cxid:0x81 zxid:0xfd txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 29109 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0008 type:create cxid:0x82 zxid:0xfe txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 29110 T562 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4]   2> 29110 T562 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4]   2> 29110 T562 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 29110 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0008 type:create cxid:0x84 zxid:0x100 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 29110 T562 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47900/tex/ln/collection1/
[junit4:junit4]   2> 29111 T562 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 29111 T562 oasc.SyncStrategy.syncToMe http://127.0.0.1:47900/tex/ln/collection1/ has no replicas
[junit4:junit4]   2> 29111 T562 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47900/tex/ln/collection1/
[junit4:junit4]   2> 29111 T562 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 29111 T493 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8b9c6a5f0008 type:create cxid:0x86 zxid:0x101 txntype:-1 reqpat

[...truncated too long message...]

1>           "router":"compositeId"}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=BF7D1B87661AD8E5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=be_BY -Dtests.timezone=Europe/San_Marino -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR   32.5s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: org.apache.solr.common.SolrException: Server at http://127.0.0.1:42736/tex/ln/onenodecollectioncore returned non ok status:404, message:Can not find: /tex/ln/onenodecollectioncore/update
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([BF7D1B87661AD8E5:3E9B959F1145B8D9]:0)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 32509 T488 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 32515 T487 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4]   2> 32597 T562 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 32598 T562 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 32598 T562 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 33305 T491 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 33699 T579 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 33699 T579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 33700 T579 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 33700 T579 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=11), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=11)), sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=be_BY, timezone=Europe/San_Marino
[junit4:junit4]   2> NOTE: Linux 3.2.0-39-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=2,free=37824936,total=121634816
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SuggesterTSTTest, TestWordDelimiterFilterFactory, TestPostingsSolrHighlighter, TestJmxIntegration, TestSolr4Spatial, OutputWriterTest, TestRangeQuery, DefaultValueUpdateProcessorTest, TestDistributedGrouping, SolrIndexConfigTest, FullSolrCloudDistribCmdsTest, CoreContainerCoreInitFailuresTest, TermVectorComponentDistributedTest, RequiredFieldsTest, TestSolrXMLSerializer, TestFieldTypeResource, NumericFieldsTest, ClusterStateTest, CopyFieldTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 33.80s, 1 test, 1 error <<< FAILURES!

[...truncated 730 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 1 error, 13 ignored (7 assumptions)

Total time: 37 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.8.0-ea-b79 -XX:+UseG1GC
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message