lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3776 - Still Failing
Date Fri, 01 Mar 2013 23:49:54 GMT
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3776/

1 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
No registered leader was found, collection:collection1 slice:shard1

Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found, collection:collection1 slice:shard1
	at __randomizedtesting.SeedInfo.seed([ACB34515E623C529:2D55CB0D917CA515]:0)
	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:430)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:295)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:116)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9483 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   2> 0 T3696 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /eqzex/o
[junit4:junit4]   2> 7 T3696 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964
[junit4:junit4]   2> 8 T3696 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 9 T3697 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 12 T3697 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 12 T3697 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 13 T3697 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 13 T3697 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 14 T3697 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 110 T3696 oasc.ZkTestServer.run start zk server on port:23019
[junit4:junit4]   2> 110 T3696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23019 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@390b0eea
[junit4:junit4]   2> 111 T3696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 111 T3702 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23019. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 112 T3702 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23019, initiating session
[junit4:junit4]   2> 112 T3698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:23020
[junit4:junit4]   2> 113 T3698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:23020
[junit4:junit4]   2> 113 T3700 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 116 T3700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d2857268b0000 with negotiated timeout 10000 for client /140.211.11.196:23020
[junit4:junit4]   2> 116 T3702 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23019, sessionid = 0x13d2857268b0000, negotiated timeout = 10000
[junit4:junit4]   2> 117 T3703 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@390b0eea name:ZooKeeperConnection Watcher:127.0.0.1:23019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 117 T3696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 118 T3696 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 121 T3701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d2857268b0000
[junit4:junit4]   2> 122 T3703 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 122 T3698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:23020 which had sessionid 0x13d2857268b0000
[junit4:junit4]   2> 122 T3696 oaz.ZooKeeper.close Session: 0x13d2857268b0000 closed
[junit4:junit4]   2> 123 T3696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23019/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@72a94669
[junit4:junit4]   2> 124 T3696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 124 T3704 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23019. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 125 T3704 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23019, initiating session
[junit4:junit4]   2> 125 T3698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:23021
[junit4:junit4]   2> 125 T3698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:23021
[junit4:junit4]   2> 136 T3700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d2857268b0001 with negotiated timeout 10000 for client /140.211.11.196:23021
[junit4:junit4]   2> 136 T3704 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23019, sessionid = 0x13d2857268b0001, negotiated timeout = 10000
[junit4:junit4]   2> 136 T3705 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72a94669 name:ZooKeeperConnection Watcher:127.0.0.1:23019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 136 T3696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 137 T3696 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 145 T3696 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 148 T3696 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 150 T3696 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 159 T3696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 160 T3696 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 173 T3696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 174 T3696 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 278 T3696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 279 T3696 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 282 T3696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 283 T3696 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 286 T3696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 286 T3696 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 294 T3696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 295 T3696 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 297 T3696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 298 T3696 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 301 T3696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 302 T3696 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 309 T3696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 310 T3696 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 312 T3701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d2857268b0001
[junit4:junit4]   2> 313 T3705 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 313 T3698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:23021 which had sessionid 0x13d2857268b0001
[junit4:junit4]   2> 313 T3696 oaz.ZooKeeper.close Session: 0x13d2857268b0001 closed
[junit4:junit4]   2> 500 T3696 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 506 T3696 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:23022
[junit4:junit4]   2> 507 T3696 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 507 T3696 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 508 T3696 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362181433270
[junit4:junit4]   2> 508 T3696 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362181433270/solr.xml
[junit4:junit4]   2> 509 T3696 oasc.CoreContainer.<init> New CoreContainer 1595407899
[junit4:junit4]   2> 510 T3696 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362181433270/'
[junit4:junit4]   2> 510 T3696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362181433270/'
[junit4:junit4]   2> 575 T3696 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 575 T3696 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 576 T3696 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 576 T3696 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 577 T3696 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 577 T3696 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 578 T3696 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 578 T3696 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 579 T3696 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 579 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 603 T3696 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 623 T3696 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23019/solr
[junit4:junit4]   2> 624 T3696 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 625 T3696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23019 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a73298c
[junit4:junit4]   2> 626 T3696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 626 T3715 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23019. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 627 T3715 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23019, initiating session
[junit4:junit4]   2> 627 T3698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:23023
[junit4:junit4]   2> 627 T3698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:23023
[junit4:junit4]   2> 629 T3700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d2857268b0002 with negotiated timeout 20000 for client /140.211.11.196:23023
[junit4:junit4]   2> 629 T3715 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23019, sessionid = 0x13d2857268b0002, negotiated timeout = 20000
[junit4:junit4]   2> 630 T3716 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a73298c name:ZooKeeperConnection Watcher:127.0.0.1:23019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 630 T3696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 631 T3701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d2857268b0002
[junit4:junit4]   2> 641 T3716 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 641 T3698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:23023 which had sessionid 0x13d2857268b0002
[junit4:junit4]   2> 641 T3696 oaz.ZooKeeper.close Session: 0x13d2857268b0002 closed
[junit4:junit4]   2> 642 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 658 T3696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23019/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@bb2a42d
[junit4:junit4]   2> 660 T3696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 660 T3717 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23019. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 661 T3717 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23019, initiating session
[junit4:junit4]   2> 661 T3698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:23024
[junit4:junit4]   2> 661 T3698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:23024
[junit4:junit4]   2> 663 T3700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d2857268b0003 with negotiated timeout 20000 for client /140.211.11.196:23024
[junit4:junit4]   2> 663 T3717 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23019, sessionid = 0x13d2857268b0003, negotiated timeout = 20000
[junit4:junit4]   2> 663 T3718 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bb2a42d name:ZooKeeperConnection Watcher:127.0.0.1:23019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 664 T3696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 666 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 673 T3696 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 676 T3696 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23022_eqzex%2Fo
[junit4:junit4]   2> 677 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:23022_eqzex%2Fo Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:23022_eqzex%2Fo
[junit4:junit4]   2> 678 T3696 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:23022_eqzex%2Fo
[junit4:junit4]   2> 688 T3696 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 700 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 701 T3696 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 704 T3696 oasc.Overseer.start Overseer (id=89271922391187459-127.0.0.1:23022_eqzex%2Fo-n_0000000000) starting
[junit4:junit4]   2> 705 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 706 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 715 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 716 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 722 T3720 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 723 T3696 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 726 T3696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 728 T3719 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 733 T3721 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362181433270/collection1
[junit4:junit4]   2> 734 T3721 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 734 T3721 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 734 T3721 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 736 T3721 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362181433270/collection1/'
[junit4:junit4]   2> 737 T3721 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362181433270/collection1/lib/README' to classloader
[junit4:junit4]   2> 737 T3721 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362181433270/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 793 T3721 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 856 T3721 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 957 T3721 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 968 T3721 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1625 T3721 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1638 T3721 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1642 T3721 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1654 T3721 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1659 T3721 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1663 T3721 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1664 T3721 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1664 T3721 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1665 T3721 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1665 T3721 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1666 T3721 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1666 T3721 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362181433270/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data/
[junit4:junit4]   2> 1666 T3721 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@33046e2c
[junit4:junit4]   2> 1667 T3721 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1668 T3721 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data forceNew:false
[junit4:junit4]   2> 1668 T3721 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data
[junit4:junit4]   2> 1668 T3721 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data/index/
[junit4:junit4]   2> 1669 T3721 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1670 T3721 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data/index forceNew:false
[junit4:junit4]   2> 1673 T3721 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3da33949 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7cc50827),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1673 T3721 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1674 T3721 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data/index
[junit4:junit4]   2> 1676 T3721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1677 T3721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1677 T3721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1678 T3721 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1679 T3721 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1679 T3721 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1679 T3721 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1680 T3721 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1680 T3721 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1693 T3721 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1699 T3721 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data
[junit4:junit4]   2> 1700 T3721 oass.SolrIndexSearcher.<init> Opening Searcher@3e999eb0 main
[junit4:junit4]   2> 1700 T3721 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data/tlog
[junit4:junit4]   2> 1701 T3721 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1701 T3721 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1705 T3721 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data
[junit4:junit4]   2> 1706 T3722 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e999eb0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1708 T3721 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1708 T3721 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1709 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2231 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2232 T3719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:23022_eqzex%2Fo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:23022/eqzex/o"}
[junit4:junit4]   2> 2232 T3719 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2232 T3719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2233 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2275 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2725 T3721 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2725 T3721 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:23022/eqzex/o collection:control_collection shard:shard1
[junit4:junit4]   2> 2726 T3721 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2741 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2742 T3721 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2743 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2753 T3721 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2753 T3721 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2753 T3721 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:23022/eqzex/o/collection1/
[junit4:junit4]   2> 2754 T3721 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2754 T3721 oasc.SyncStrategy.syncToMe http://127.0.0.1:23022/eqzex/o/collection1/ has no replicas
[junit4:junit4]   2> 2754 T3721 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:23022/eqzex/o/collection1/
[junit4:junit4]   2> 2754 T3721 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2758 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3787 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3818 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3839 T3721 oasc.ZkController.register We are http://127.0.0.1:23022/eqzex/o/collection1/ and leader is http://127.0.0.1:23022/eqzex/o/collection1/
[junit4:junit4]   2> 3839 T3721 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:23022/eqzex/o
[junit4:junit4]   2> 3839 T3721 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3840 T3721 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3840 T3721 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3841 T3721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3842 T3696 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3843 T3696 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3843 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3853 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3854 T3696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23019/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@27f6e896
[junit4:junit4]   2> 3855 T3696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3855 T3723 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23019. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3856 T3723 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23019, initiating session
[junit4:junit4]   2> 3856 T3698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:23025
[junit4:junit4]   2> 3856 T3698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:23025
[junit4:junit4]   2> 3857 T3723 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23019, sessionid = 0x13d2857268b0004, negotiated timeout = 10000
[junit4:junit4]   2> 3857 T3700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d2857268b0004 with negotiated timeout 10000 for client /140.211.11.196:23025
[junit4:junit4]   2> 3858 T3724 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27f6e896 name:ZooKeeperConnection Watcher:127.0.0.1:23019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3858 T3696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3859 T3696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3860 T3696 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 3989 T3696 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3993 T3696 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:23026
[junit4:junit4]   2> 3993 T3696 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3994 T3696 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3994 T3696 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362181436816
[junit4:junit4]   2> 3994 T3696 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362181436816/solr.xml
[junit4:junit4]   2> 3995 T3696 oasc.CoreContainer.<init> New CoreContainer 89862877
[junit4:junit4]   2> 3995 T3696 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362181436816/'
[junit4:junit4]   2> 3996 T3696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362181436816/'
[junit4:junit4]   2> 4042 T3696 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 4042 T3696 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4043 T3696 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4043 T3696 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4044 T3696 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4044 T3696 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4044 T3696 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4045 T3696 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4045 T3696 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4045 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4060 T3696 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4074 T3696 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23019/solr
[junit4:junit4]   2> 4075 T3696 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4075 T3696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23019 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2419cd85
[junit4:junit4]   2> 4076 T3696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4076 T3734 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23019. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4077 T3734 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23019, initiating session
[junit4:junit4]   2> 4077 T3698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:23027
[junit4:junit4]   2> 4077 T3698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:23027
[junit4:junit4]   2> 4080 T3734 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23019, sessionid = 0x13d2857268b0005, negotiated timeout = 20000
[junit4:junit4]   2> 4080 T3700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d2857268b0005 with negotiated timeout 20000 for client /140.211.11.196:23027
[junit4:junit4]   2> 4080 T3735 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2419cd85 name:ZooKeeperConnection Watcher:127.0.0.1:23019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4080 T3696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4081 T3701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d2857268b0005
[junit4:junit4]   2> 4094 T3735 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4094 T3698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:23027 which had sessionid 0x13d2857268b0005
[junit4:junit4]   2> 4094 T3696 oaz.ZooKeeper.close Session: 0x13d2857268b0005 closed
[junit4:junit4]   2> 4095 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 4102 T3696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23019/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@60eb2458
[junit4:junit4]   2> 4103 T3696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4104 T3736 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23019. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4104 T3736 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23019, initiating session
[junit4:junit4]   2> 4104 T3698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:23028
[junit4:junit4]   2> 4105 T3698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:23028
[junit4:junit4]   2> 4106 T3736 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23019, sessionid = 0x13d2857268b0006, negotiated timeout = 20000
[junit4:junit4]   2> 4106 T3700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d2857268b0006 with negotiated timeout 20000 for client /140.211.11.196:23028
[junit4:junit4]   2> 4106 T3737 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60eb2458 name:ZooKeeperConnection Watcher:127.0.0.1:23019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4107 T3696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4107 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4109 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4117 T3696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5120 T3696 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23026_eqzex%2Fo
[junit4:junit4]   2> 5121 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0006 type:delete cxid:0x9 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:23026_eqzex%2Fo Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:23026_eqzex%2Fo
[junit4:junit4]   2> 5122 T3696 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:23026_eqzex%2Fo
[junit4:junit4]   2> 5125 T3724 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5125 T3737 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5125 T3718 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5125 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5141 T3738 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362181436816/collection1
[junit4:junit4]   2> 5142 T3738 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5142 T3738 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5143 T3738 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5144 T3738 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362181436816/collection1/'
[junit4:junit4]   2> 5144 T3738 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362181436816/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5145 T3738 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362181436816/collection1/lib/README' to classloader
[junit4:junit4]   2> 5181 T3738 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 5224 T3738 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5325 T3738 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5331 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5332 T3719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:23022_eqzex%2Fo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:23022/eqzex/o"}
[junit4:junit4]   2> 5334 T3738 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5347 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5347 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5347 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5772 T3738 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5782 T3738 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5785 T3738 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5795 T3738 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5799 T3738 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5803 T3738 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5803 T3738 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5804 T3738 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5804 T3738 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5805 T3738 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5805 T3738 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5805 T3738 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362181436816/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1/
[junit4:junit4]   2> 5805 T3738 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@33046e2c
[junit4:junit4]   2> 5806 T3738 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5806 T3738 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1 forceNew:false
[junit4:junit4]   2> 5807 T3738 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1
[junit4:junit4]   2> 5807 T3738 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1/index/
[junit4:junit4]   2> 5807 T3738 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5808 T3738 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1/index forceNew:false
[junit4:junit4]   2> 5810 T3738 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5373a54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f1c931a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5810 T3738 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5811 T3738 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1/index
[junit4:junit4]   2> 5812 T3738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5813 T3738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5813 T3738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5814 T3738 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5814 T3738 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5815 T3738 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5815 T3738 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5815 T3738 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5816 T3738 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5825 T3738 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5833 T3738 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1
[junit4:junit4]   2> 5834 T3738 oass.SolrIndexSearcher.<init> Opening Searcher@1474905f main
[junit4:junit4]   2> 5834 T3738 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1/tlog
[junit4:junit4]   2> 5835 T3738 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5835 T3738 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5841 T3739 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1474905f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5843 T3738 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5844 T3738 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6851 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6852 T3719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:23026_eqzex%2Fo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:23026/eqzex/o"}
[junit4:junit4]   2> 6852 T3719 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 6852 T3719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6897 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6897 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6897 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7848 T3738 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 7848 T3738 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:23026/eqzex/o collection:collection1 shard:shard1
[junit4:junit4]   2> 7849 T3738 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7873 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0006 type:delete cxid:0x46 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 7874 T3738 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 7875 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0006 type:create cxid:0x47 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7887 T3738 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 7888 T3738 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 7888 T3738 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:23026/eqzex/o/collection1/
[junit4:junit4]   2> 7888 T3738 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 7888 T3738 oasc.SyncStrategy.syncToMe http://127.0.0.1:23026/eqzex/o/collection1/ has no replicas
[junit4:junit4]   2> 7889 T3738 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:23026/eqzex/o/collection1/
[junit4:junit4]   2> 7889 T3738 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7899 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0006 type:create cxid:0x51 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8424 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8439 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8439 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8440 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8462 T3738 oasc.ZkController.register We are http://127.0.0.1:23026/eqzex/o/collection1/ and leader is http://127.0.0.1:23026/eqzex/o/collection1/
[junit4:junit4]   2> 8462 T3738 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:23026/eqzex/o
[junit4:junit4]   2> 8462 T3738 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 8463 T3738 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8463 T3738 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8465 T3738 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8466 T3696 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 8467 T3696 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8467 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8603 T3696 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8606 T3696 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:23029
[junit4:junit4]   2> 8607 T3696 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8607 T3696 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8607 T3696 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362181441437
[junit4:junit4]   2> 8608 T3696 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362181441437/solr.xml
[junit4:junit4]   2> 8608 T3696 oasc.CoreContainer.<init> New CoreContainer 925454529
[junit4:junit4]   2> 8609 T3696 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362181441437/'
[junit4:junit4]   2> 8609 T3696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362181441437/'
[junit4:junit4]   2> 8653 T3696 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 8654 T3696 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8654 T3696 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 8654 T3696 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8655 T3696 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8655 T3696 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8655 T3696 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8656 T3696 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8656 T3696 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8657 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 8673 T3696 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8689 T3696 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23019/solr
[junit4:junit4]   2> 8689 T3696 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8690 T3696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23019 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7f125b80
[junit4:junit4]   2> 8691 T3696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8691 T3749 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23019. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8691 T3749 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23019, initiating session
[junit4:junit4]   2> 8692 T3698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:23030
[junit4:junit4]   2> 8692 T3698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:23030
[junit4:junit4]   2> 8695 T3700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d2857268b0007 with negotiated timeout 20000 for client /140.211.11.196:23030
[junit4:junit4]   2> 8695 T3749 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23019, sessionid = 0x13d2857268b0007, negotiated timeout = 20000
[junit4:junit4]   2> 8695 T3750 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f125b80 name:ZooKeeperConnection Watcher:127.0.0.1:23019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8695 T3696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8696 T3701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d2857268b0007
[junit4:junit4]   2> 8712 T3750 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8712 T3696 oaz.ZooKeeper.close Session: 0x13d2857268b0007 closed
[junit4:junit4]   2> 8712 T3698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:23030 which had sessionid 0x13d2857268b0007
[junit4:junit4]   2> 8712 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 8721 T3696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23019/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@16b96a5c
[junit4:junit4]   2> 8722 T3696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8722 T3751 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23019. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8722 T3751 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23019, initiating session
[junit4:junit4]   2> 8723 T3698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:23031
[junit4:junit4]   2> 8723 T3698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:23031
[junit4:junit4]   2> 8725 T3700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d2857268b0008 with negotiated timeout 20000 for client /140.211.11.196:23031
[junit4:junit4]   2> 8725 T3751 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23019, sessionid = 0x13d2857268b0008, negotiated timeout = 20000
[junit4:junit4]   2> 8725 T3752 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16b96a5c name:ZooKeeperConnection Watcher:127.0.0.1:23019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8725 T3696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8726 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8727 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8737 T3696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9739 T3696 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23029_eqzex%2Fo
[junit4:junit4]   2> 9740 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0008 type:delete cxid:0x9 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:23029_eqzex%2Fo Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:23029_eqzex%2Fo
[junit4:junit4]   2> 9742 T3696 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:23029_eqzex%2Fo
[junit4:junit4]   2> 9744 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9744 T3718 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9744 T3752 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9744 T3724 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9744 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9745 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9745 T3737 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9759 T3753 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362181441437/collection1
[junit4:junit4]   2> 9759 T3753 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9759 T3753 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9760 T3753 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9761 T3753 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362181441437/collection1/'
[junit4:junit4]   2> 9762 T3753 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362181441437/collection1/lib/README' to classloader
[junit4:junit4]   2> 9763 T3753 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362181441437/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9819 T3753 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 9882 T3753 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9944 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9945 T3719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:23026_eqzex%2Fo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:23026/eqzex/o"}
[junit4:junit4]   2> 9960 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9960 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9960 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9983 T3753 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9983 T3752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9993 T3753 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10674 T3753 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10689 T3753 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10693 T3753 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10706 T3753 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10711 T3753 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10716 T3753 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10717 T3753 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10717 T3753 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10718 T3753 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10719 T3753 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10719 T3753 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10719 T3753 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362181441437/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty2/
[junit4:junit4]   2> 10719 T3753 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@33046e2c
[junit4:junit4]   2> 10720 T3753 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 10721 T3753 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty2 forceNew:false
[junit4:junit4]   2> 10721 T3753 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty2
[junit4:junit4]   2> 10721 T3753 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty2/index/
[junit4:junit4]   2> 10722 T3753 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10723 T3753 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty2/index forceNew:false
[junit4:junit4]   2> 10726 T3753 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@23ad6d5b lockFactory=org.apache.lucene.store.NativeFSLockFactory@7fcdf4b6),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10726 T3753 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10727 T3753 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty2/index
[junit4:junit4]   2> 10729 T3753 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10730 T3753 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10730 T3753 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10731 T3753 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10732 T3753 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10732 T3753 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10733 T3753 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10733 T3753 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10734 T3753 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10749 T3753 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10756 T3753 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty2
[junit4:junit4]   2> 10756 T3753 oass.SolrIndexSearcher.<init> Opening Searcher@5fb42527 main
[junit4:junit4]   2> 10757 T3753 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty2/tlog
[junit4:junit4]   2> 10758 T3753 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10758 T3753 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10766 T3754 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5fb42527 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10769 T3753 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 10769 T3753 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11464 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11465 T3719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:23029_eqzex%2Fo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:23029/eqzex/o"}
[junit4:junit4]   2> 11465 T3719 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 11465 T3719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 11480 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11480 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11480 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11480 T3752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11772 T3753 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11772 T3753 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:23029/eqzex/o collection:collection1 shard:shard2
[junit4:junit4]   2> 11773 T3753 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 11790 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0008 type:delete cxid:0x45 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 11792 T3753 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 11793 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0008 type:create cxid:0x46 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11803 T3753 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 11803 T3753 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 11803 T3753 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:23029/eqzex/o/collection1/
[junit4:junit4]   2> 11804 T3753 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 11804 T3753 oasc.SyncStrategy.syncToMe http://127.0.0.1:23029/eqzex/o/collection1/ has no replicas
[junit4:junit4]   2> 11804 T3753 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:23029/eqzex/o/collection1/
[junit4:junit4]   2> 11805 T3753 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 11807 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0008 type:create cxid:0x4f zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12985 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13029 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13029 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13029 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13029 T3752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13042 T3753 oasc.ZkController.register We are http://127.0.0.1:23029/eqzex/o/collection1/ and leader is http://127.0.0.1:23029/eqzex/o/collection1/
[junit4:junit4]   2> 13042 T3753 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:23029/eqzex/o
[junit4:junit4]   2> 13042 T3753 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 13042 T3753 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 13042 T3753 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 13044 T3753 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13044 T3696 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 13045 T3696 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 13046 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13179 T3696 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 13182 T3696 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:23338
[junit4:junit4]   2> 13183 T3696 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 13183 T3696 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 13184 T3696 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362181446012
[junit4:junit4]   2> 13184 T3696 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362181446012/solr.xml
[junit4:junit4]   2> 13184 T3696 oasc.CoreContainer.<init> New CoreContainer 1952573731
[junit4:junit4]   2> 13185 T3696 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362181446012/'
[junit4:junit4]   2> 13185 T3696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362181446012/'
[junit4:junit4]   2> 13230 T3696 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 13231 T3696 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 13231 T3696 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 13232 T3696 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 13232 T3696 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 13232 T3696 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 13233 T3696 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 13233 T3696 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 13233 T3696 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 13234 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 13248 T3696 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 13262 T3696 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23019/solr
[junit4:junit4]   2> 13263 T3696 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 13264 T3696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23019 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7c10e630
[junit4:junit4]   2> 13264 T3696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13265 T3764 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23019. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 13266 T3764 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23019, initiating session
[junit4:junit4]   2> 13266 T3698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:54654
[junit4:junit4]   2> 13266 T3698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:54654
[junit4:junit4]   2> 13268 T3700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d2857268b0009 with negotiated timeout 20000 for client /140.211.11.196:54654
[junit4:junit4]   2> 13268 T3764 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23019, sessionid = 0x13d2857268b0009, negotiated timeout = 20000
[junit4:junit4]   2> 13269 T3765 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c10e630 name:ZooKeeperConnection Watcher:127.0.0.1:23019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13269 T3696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13270 T3701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d2857268b0009
[junit4:junit4]   2> 13288 T3765 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 13289 T3698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:54654 which had sessionid 0x13d2857268b0009
[junit4:junit4]   2> 13288 T3696 oaz.ZooKeeper.close Session: 0x13d2857268b0009 closed
[junit4:junit4]   2> 13289 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 13297 T3696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23019/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4f64ac43
[junit4:junit4]   2> 13298 T3696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13298 T3766 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23019. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 13298 T3766 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23019, initiating session
[junit4:junit4]   2> 13299 T3698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10231
[junit4:junit4]   2> 13299 T3698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10231
[junit4:junit4]   2> 13300 T3700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d2857268b000a with negotiated timeout 20000 for client /140.211.11.196:10231
[junit4:junit4]   2> 13300 T3766 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23019, sessionid = 0x13d2857268b000a, negotiated timeout = 20000
[junit4:junit4]   2> 13301 T3767 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f64ac43 name:ZooKeeperConnection Watcher:127.0.0.1:23019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13301 T3696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13302 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b000a type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13308 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b000a type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13309 T3696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 14312 T3696 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23338_eqzex%2Fo
[junit4:junit4]   2> 14313 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b000a type:delete cxid:0x9 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:23338_eqzex%2Fo Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:23338_eqzex%2Fo
[junit4:junit4]   2> 14315 T3696 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:23338_eqzex%2Fo
[junit4:junit4]   2> 14317 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14317 T3752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14317 T3767 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14317 T3724 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14317 T3718 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14317 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14318 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14330 T3752 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14330 T3737 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14337 T3768 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362181446012/collection1
[junit4:junit4]   2> 14337 T3768 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 14337 T3768 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 14338 T3768 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 14339 T3768 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362181446012/collection1/'
[junit4:junit4]   2> 14339 T3768 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362181446012/collection1/lib/README' to classloader
[junit4:junit4]   2> 14340 T3768 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362181446012/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 14376 T3768 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 14418 T3768 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14518 T3768 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14524 T3768 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 14542 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14543 T3719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:23029_eqzex%2Fo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:23029/eqzex/o"}
[junit4:junit4]   2> 14559 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14559 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14559 T3767 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14559 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14559 T3752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14986 T3768 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 14996 T3768 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 14999 T3768 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15009 T3768 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15013 T3768 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15017 T3768 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15017 T3768 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15018 T3768 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15018 T3768 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15019 T3768 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15019 T3768 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15019 T3768 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362181446012/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3/
[junit4:junit4]   2> 15019 T3768 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@33046e2c
[junit4:junit4]   2> 15020 T3768 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15021 T3768 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3 forceNew:false
[junit4:junit4]   2> 15021 T3768 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3
[junit4:junit4]   2> 15021 T3768 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3/index/
[junit4:junit4]   2> 15022 T3768 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15022 T3768 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3/index forceNew:false
[junit4:junit4]   2> 15024 T3768 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16f9d258 lockFactory=org.apache.lucene.store.NativeFSLockFactory@136ca363),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15024 T3768 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15025 T3768 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3/index
[junit4:junit4]   2> 15027 T3768 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15027 T3768 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15028 T3768 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15028 T3768 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15029 T3768 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15029 T3768 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15029 T3768 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15030 T3768 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15030 T3768 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15039 T3768 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15043 T3768 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3
[junit4:junit4]   2> 15044 T3768 oass.SolrIndexSearcher.<init> Opening Searcher@6ce51af6 main
[junit4:junit4]   2> 15044 T3768 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3/tlog
[junit4:junit4]   2> 15045 T3768 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15045 T3768 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15050 T3769 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6ce51af6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15052 T3768 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 15052 T3768 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16064 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16065 T3719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:23338_eqzex%2Fo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:23338/eqzex/o"}
[junit4:junit4]   2> 16066 T3719 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 16066 T3719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 16083 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16083 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16083 T3752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16083 T3767 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16083 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17056 T3768 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 17056 T3768 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:23338/eqzex/o collection:collection1 shard:shard1
[junit4:junit4]   2> 17059 T3768 oasc.ZkController.register We are http://127.0.0.1:23338/eqzex/o/collection1/ and leader is http://127.0.0.1:23026/eqzex/o/collection1/
[junit4:junit4]   2> 17060 T3768 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:23338/eqzex/o
[junit4:junit4]   2> 17060 T3768 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 17060 T3768 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C247 name=collection1 org.apache.solr.core.SolrCore@b731199 url=http://127.0.0.1:23338/eqzex/o/collection1 node=127.0.0.1:23338_eqzex%2Fo C247_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:23338_eqzex%2Fo, base_url=http://127.0.0.1:23338/eqzex/o}
[junit4:junit4]   2> 17062 T3770 C247 P23338 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 17062 T3768 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17062 T3770 C247 P23338 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 17063 T3770 C247 P23338 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 17063 T3770 C247 P23338 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17063 T3696 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   2> 17064 T3696 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 17064 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 17075 T3770 C247 P23338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 17081 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17082 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 17095 T3728 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362181436816/onenodecollectioncore
[junit4:junit4]   2> 17096 T3728 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4]   2> 17097 T3728 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   2> 17097 T3728 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 17098 T3728 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 17099 T3728 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4]   2> 17111 T3728 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4]   2> 17113 T3728 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362181436816/onenodecollectioncore/'
[junit4:junit4]   2> 17194 T3728 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 17255 T3728 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 17356 T3728 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 17366 T3728 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 17588 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17589 T3719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:23338_eqzex%2Fo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:23338/eqzex/o"}
[junit4:junit4]   2> 17603 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17603 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17603 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17603 T3767 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17603 T3752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17929 T3728 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 17937 T3728 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 17940 T3728 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 17950 T3728 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17954 T3728 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17958 T3728 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17959 T3728 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 17959 T3728 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 17959 T3728 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17960 T3728 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 17960 T3728 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 17961 T3728 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362181436816/onenodecollectioncore/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection/
[junit4:junit4]   2> 17961 T3728 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@33046e2c
[junit4:junit4]   2> 17962 T3728 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 17963 T3728 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection forceNew:false
[junit4:junit4]   2> 17963 T3728 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection
[junit4:junit4]   2> 17963 T3728 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection/index/
[junit4:junit4]   2> 17964 T3728 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 17964 T3728 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection/index forceNew:false
[junit4:junit4]   2> 17966 T3728 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@283a222a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ede4586),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 17967 T3728 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 17968 T3728 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection/index
[junit4:junit4]   2> 17969 T3728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 17970 T3728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 17970 T3728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 17971 T3728 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 17971 T3728 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 17972 T3728 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 17972 T3728 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 17972 T3728 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 17973 T3728 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 17985 T3728 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 17989 T3728 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection
[junit4:junit4]   2> 17990 T3728 oass.SolrIndexSearcher.<init> Opening Searcher@4d14be1d main
[junit4:junit4]   2> 17990 T3728 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection/tlog
[junit4:junit4]   2> 17991 T3728 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 17991 T3728 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 17994 T3728 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection
[junit4:junit4]   2> 17995 T3771 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@4d14be1d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 17996 T3728 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4]   2> 19107 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19108 T3719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":"none",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"onenodecollectioncore",
[junit4:junit4]   2> 	  "collection":"onenodecollection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:23026_eqzex%2Fo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:23026/eqzex/o"}
[junit4:junit4]   2> 19109 T3719 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4]   2> 19109 T3719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 19123 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19123 T3767 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19123 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19123 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19123 T3752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19999 T3728 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4]   2> 19999 T3728 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:23026/eqzex/o collection:onenodecollection shard:shard1
[junit4:junit4]   2> 20000 T3728 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   2> 20017 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0006 type:delete cxid:0xa1 zxid:0xad txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4]   2> 20018 T3728 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 20019 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0006 type:create cxid:0xa2 zxid:0xae txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 20021 T3728 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 20021 T3728 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 20021 T3728 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:23026/eqzex/o/onenodecollectioncore/
[junit4:junit4]   2> 20022 T3728 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 20022 T3728 oasc.SyncStrategy.syncToMe http://127.0.0.1:23026/eqzex/o/onenodecollectioncore/ has no replicas
[junit4:junit4]   2> 20022 T3728 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:23026/eqzex/o/onenodecollectioncore/
[junit4:junit4]   2> 20022 T3728 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   2> 20025 T3701 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d2857268b0006 type:create cxid:0xac zxid:0xb2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2>  C247_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:23338_eqzex%2Fo, base_url=http://127.0.0.1:23338/eqzex/o}
[junit4:junit4]   2> 20090 T3770 C247 P23338 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:23026/eqzex/o/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 20090 T3770 C247 P23338 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:23338/eqzex/o START replicas=[http://127.0.0.1:23026/eqzex/o/collection1/] nUpdates=100
[junit4:junit4]   2> 20090 T3770 C247 P23338 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 20091 T3770 C247 P23338 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 20091 T3770 C247 P23338 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 20091 T3770 C247 P23338 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 20091 T3770 C247 P23338 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 20092 T3770 C247 P23338 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:23026/eqzex/o/collection1/. core=collection1
[junit4:junit4]   2> 20092 T3770 C247 P23338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C248 name=collection1 org.apache.solr.core.SolrCore@93e1bc6 url=http://127.0.0.1:23026/eqzex/o/collection1 node=127.0.0.1:23026_eqzex%2Fo C248_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:23026_eqzex%2Fo, base_url=http://127.0.0.1:23026/eqzex/o, leader=true}
[junit4:junit4]   2> 20097 T3729 C248 P23026 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 20109 T3730 C248 P23026 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 20110 T3730 C248 P23026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1
[junit4:junit4]   2> 20111 T3730 C248 P23026 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5373a54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f1c931a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 20112 T3730 C248 P23026 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 20112 T3730 C248 P23026 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5373a54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f1c931a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5373a54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f1c931a),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 20112 T3730 C248 P23026 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 20113 T3730 C248 P23026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1
[junit4:junit4]   2> 20113 T3730 C248 P23026 oass.SolrIndexSearcher.<init> Opening Searcher@3ddfcb51 realtime
[junit4:junit4]   2> 20114 T3730 C248 P23026 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 20114 T3730 C248 P23026 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4]   2> 20115 T3770 C247 P23338 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 20115 T3770 C247 P23338 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 20117 T3731 C248 P23026 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 20118 T3731 C248 P23026 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 20118 T3770 C247 P23338 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 20119 T3770 C247 P23338 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 20119 T3770 C247 P23338 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 20121 T3731 C248 P23026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1
[junit4:junit4]   2> 20122 T3731 C248 P23026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1/index
[junit4:junit4]   2> 20122 T3731 C248 P23026 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1 
[junit4:junit4]   2> 20123 T3770 C247 P23338 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 20123 T3770 C247 P23338 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3/index.20130302004413079 forceNew:false
[junit4:junit4]   2> 20123 T3770 C247 P23338 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3
[junit4:junit4]   2> 20124 T3770 C247 P23338 oash.SnapPuller.fetchLatestIndex Starting download to BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@75741285 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3918a7aa) fullCopy=false
[junit4:junit4]   2> 20126 T3731 C248 P23026 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 20127 T3770 C247 P23338 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3/index
[junit4:junit4]   2> 20128 T3770 C247 P23338 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 20128 T3770 C247 P23338 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3
[junit4:junit4]   2> 20128 T3770 C247 P23338 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3
[junit4:junit4]   2> 20128 T3770 C247 P23338 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 20129 T3770 C247 P23338 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 20129 T3770 C247 P23338 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3
[junit4:junit4]   2> 20130 T3770 C247 P23338 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16f9d258 lockFactory=org.apache.lucene.store.NativeFSLockFactory@136ca363),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16f9d258 lockFactory=org.apache.lucene.store.NativeFSLockFactory@136ca363),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 20130 T3770 C247 P23338 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 20131 T3770 C247 P23338 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 20131 T3770 C247 P23338 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3
[junit4:junit4]   2> 20131 T3770 C247 P23338 oass.SolrIndexSearcher.<init> Opening Searcher@12b2016d main
[junit4:junit4]   2> 20132 T3769 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@12b2016d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 20133 T3769 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3/index
[junit4:junit4]   2> 20133 T3770 C247 P23338 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@75741285 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3918a7aa)
[junit4:junit4]   2> 20133 T3770 C247 P23338 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3/index.20130302004413079
[junit4:junit4]   2> 20133 T3770 C247 P23338 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3/index
[junit4:junit4]   2> 20133 T3770 C247 P23338 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 20134 T3770 C247 P23338 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 20134 T3770 C247 P23338 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 20134 T3770 C247 P23338 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 20135 T3770 C247 P23338 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 20628 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20645 T3719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:23338_eqzex%2Fo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:23338/eqzex/o"}
[junit4:junit4]   2> 20655 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20655 T3767 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20655 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20655 T3752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20655 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20690 T3728 oasc.ZkController.register We are http://127.0.0.1:23026/eqzex/o/onenodecollectioncore/ and leader is http://127.0.0.1:23026/eqzex/o/onenodecollectioncore/
[junit4:junit4]   2> 20690 T3728 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:23026/eqzex/o
[junit4:junit4]   2> 20690 T3728 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 20691 T3728 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4]   2> 20693 T3728 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20694 T3696 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 20695 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21696 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22160 T3719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22161 T3719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":"none",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"onenodecollectioncore",
[junit4:junit4]   2> 	  "collection":"onenodecollection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:23026_eqzex%2Fo",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:23026/eqzex/o"}
[junit4:junit4]   2> 22227 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 22227 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 22227 T3752 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 22227 T3737 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 22227 T3767 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 22698 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22700 T3696 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4]   2> 22700 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C249 name=onenodecollectioncore org.apache.solr.core.SolrCore@4a693d50 url=http://127.0.0.1:23026/eqzex/o/onenodecollectioncore node=127.0.0.1:23026_eqzex%2Fo C249_STATE=coll:onenodecollection core:onenodecollectioncore props:{shard=shard1, roles=none, state=active, core=onenodecollectioncore, collection=onenodecollection, node_name=127.0.0.1:23026_eqzex%2Fo, base_url=http://127.0.0.1:23026/eqzex/o, leader=true}
[junit4:junit4]   2> 22730 T3732 C249 P23026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection
[junit4:junit4]   2> 22732 T3732 C249 P23026 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@283a222a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ede4586),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 22733 T3732 C249 P23026 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 22735 T3732 C249 P23026 /update {wt=javabin&version=2} {add=[1 (1428350782077403136)]} 0 6
[junit4:junit4]   2> 22744 T3732 C249 P23026 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22748 T3732 C249 P23026 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@283a222a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ede4586),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@283a222a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ede4586),segFN=segments_2,generation=2,filenames=[_0.fnm, _0_Memory_0.ram, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_SimpleText_0.dat, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0.nvd, _0_MockVariableIntBlock_0.pos, segments_2, _0.fdx, _0.si, _0.fdt, _0_MockVariableIntBlock_0.tii]
[junit4:junit4]   2> 22749 T3732 C249 P23026 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0_Memory_0.ram, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_SimpleText_0.dat, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0.nvd, _0_MockVariableIntBlock_0.pos, segments_2, _0.fdx, _0.si, _0.fdt, _0_MockVariableIntBlock_0.tii]
[junit4:junit4]   2> 22749 T3732 C249 P23026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection
[junit4:junit4]   2> 22751 T3732 C249 P23026 oass.SolrIndexSearcher.<init> Opening Searcher@2c1c85db main
[junit4:junit4]   2> 22752 T3732 C249 P23026 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22753 T3771 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@2c1c85db main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4]   2> 22753 T3771 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1362181432964/onenodecollection/index
[junit4:junit4]   2> 22754 T3732 C249 P23026 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4]   2> 22758 T3732 C249 P23026 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0 
[junit4:junit4]   2> 22760 T3696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 22775 T3732 C249 P23026 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0 
[junit4:junit4]   2> ASYNC  NEW_CORE C250 name=collection1 org.apache.solr.core.SolrCore@34e7293 url=http://127.0.0.1:23022/eqzex/o/collection1 node=127.0.0.1:23022_eqzex%2Fo C250_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:23022_eqzex%2Fo, base_url=http://127.0.0.1:23022/eqzex/o, leader=true}
[junit4:junit4]   2> 22785 T3708 C250 P23022 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data
[junit4:junit4]   2> 22788 T3708 C250 P23022 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3da33949 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7cc50827),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 22789 T3708 C250 P23022 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 22793 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[1 (1428350782135074816)]} 0 9
[junit4:junit4]   2>  C247_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:23338_eqzex%2Fo, base_url=http://127.0.0.1:23338/eqzex/o}
[junit4:junit4]   2> 22833 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1428350782167580672)]} 0 4
[junit4:junit4]   2> 22834 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1428350782167580672)]} 0 19
[junit4:junit4]   2> ASYNC  NEW_CORE C251 name=collection1 org.apache.solr.core.SolrCore@15e8538 url=http://127.0.0.1:23029/eqzex/o/collection1 node=127.0.0.1:23029_eqzex%2Fo C251_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:23029_eqzex%2Fo, base_url=http://127.0.0.1:23029/eqzex/o, leader=true}
[junit4:junit4]   2> 22835 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[1]} 0 24
[junit4:junit4]   2> 22838 T3708 C250 P23022 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22846 T3708 C250 P23022 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3da33949 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7cc50827),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3da33949 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7cc50827),segFN=segments_2,generation=2,filenames=[_0.fnm, _0_Memory_0.ram, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_SimpleText_0.dat, _0_Memory_1.ram, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0.nvd, _0_MockVariableIntBlock_0.pos, segments_2, _0.fdx, _0.si, _0_MockVariableIntBlock_0.tii, _0.fdt]
[junit4:junit4]   2> 22847 T3708 C250 P23022 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0_Memory_0.ram, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_SimpleText_0.dat, _0_Memory_1.ram, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0.nvd, _0_MockVariableIntBlock_0.pos, segments_2, _0.fdx, _0.si, _0_MockVariableIntBlock_0.tii, _0.fdt]
[junit4:junit4]   2> 22847 T3708 C250 P23022 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data
[junit4:junit4]   2> 22850 T3708 C250 P23022 oass.SolrIndexSearcher.<init> Opening Searcher@31fabefc main
[junit4:junit4]   2> 22850 T3708 C250 P23022 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22851 T3722 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@31fabefc main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4]   2> 22852 T3722 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/control/data/index
[junit4:junit4]   2> 22852 T3708 C250 P23022 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 14
[junit4:junit4]   2> 22855 T3744 C251 P23029 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22856 T3744 C251 P23029 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty2
[junit4:junit4]   2> 22859 T3744 C251 P23029 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@23ad6d5b lockFactory=org.apache.lucene.store.NativeFSLockFactory@7fcdf4b6),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 22860 T3744 C251 P23029 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 22862 T3744 C251 P23029 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@23ad6d5b lockFactory=org.apache.lucene.store.NativeFSLockFactory@7fcdf4b6),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@23ad6d5b lockFactory=org.apache.lucene.store.NativeFSLockFactory@7fcdf4b6),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 22862 T3744 C251 P23029 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 22863 T3744 C251 P23029 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty2
[junit4:junit4]   2> 22864 T3744 C251 P23029 oass.SolrIndexSearcher.<init> Opening Searcher@1f8e8a4d main
[junit4:junit4]   2> 22864 T3744 C251 P23029 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22866 T3754 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f8e8a4d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 22866 T3754 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty2/index
[junit4:junit4]   2> 22867 T3744 C251 P23029 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:23026/eqzex/o/collection1/, StdNode: http://127.0.0.1:23338/eqzex/o/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 22870 T3758 C247 P23338 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22870 T3733 C248 P23026 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22877 T3758 C247 P23338 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16f9d258 lockFactory=org.apache.lucene.store.NativeFSLockFactory@136ca363),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16f9d258 lockFactory=org.apache.lucene.store.NativeFSLockFactory@136ca363),segFN=segments_3,generation=3,filenames=[_0.fnm, _0_Memory_0.ram, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_SimpleText_0.dat, _0_Memory_1.ram, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, _0_MockVariableIntBlock_0.tii, _0.fdt, segments_3]
[junit4:junit4]   2> 22878 T3758 C247 P23338 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.fnm, _0_Memory_0.ram, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_SimpleText_0.dat, _0_Memory_1.ram, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, _0_MockVariableIntBlock_0.tii, _0.fdt, segments_3]
[junit4:junit4]   2> 22879 T3758 C247 P23338 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3
[junit4:junit4]   2> 22881 T3758 C247 P23338 oass.SolrIndexSearcher.<init> Opening Searcher@259bff1e main
[junit4:junit4]   2> 22881 T3733 C248 P23026 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5373a54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f1c931a),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5373a54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f1c931a),segFN=segments_3,generation=3,filenames=[_0.fnm, _0_Memory_0.ram, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_SimpleText_0.dat, _0_Memory_1.ram, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, _0_MockVariableIntBlock_0.tii, _0.fdt, segments_3]
[junit4:junit4]   2> 22881 T3758 C247 P23338 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22882 T3769 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@259bff1e main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4]   2> 22882 T3733 C248 P23026 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.fnm, _0_Memory_0.ram, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0.nvm, _0_SimpleText_0.dat, _0_Memory_1.ram, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.fdx, _0.si, _0_MockVariableIntBlock_0.tii, _0.fdt, segments_3]
[junit4:junit4]   2> 22883 T3769 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty3/index
[junit4:junit4]   2> 22883 T3758 C247 P23338 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 14
[junit4:junit4]   2> 22883 T3733 C248 P23026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1
[junit4:junit4]   2> 22886 T3733 C248 P23026 oass.SolrIndexSearcher.<init> Opening Searcher@1ec507c6 main
[junit4:junit4]   2> 22887 T3733 C248 P23026 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1/index
[junit4:junit4]   2> 22888 T3733 C248 P23026 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22888 T3739 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ec507c6 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4]   2> 22889 T3739 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1362181432963/jetty1/index
[junit4:junit4]   2> 22889 T3733 C248 P23026 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 19
[junit4:junit4]   2> 22890 T3744 C251 P23029 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 35
[junit4:junit4]   2> 22891 T3696 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 22892 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22893 T3696 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> 22897 T3708 C250 P23022 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=1 
[junit4:junit4]   2> 22898 T3696 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23019/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@198167f2
[junit4:junit4]   2> 22899 T3696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 22899 T3778 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23019. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 22900 T3778 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23019, initiating session
[junit4:junit4]   2> 22900 T3698 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:39848
[junit4:junit4]   2> 22901 T3698 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:39848
[junit4:junit4]   2> 22905 T3700 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d2857268b000b with negotiated timeout 10000 for client /140.211.11.196:39848
[junit4:junit4]   2> 22905 T3778 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23019, sessionid = 0x13d2857268b000b, negotiated timeout = 10000
[junit4:junit4]   2> 22906 T3779 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@198167f2 name:ZooKeeperConnection Watcher:127.0.0.1:23019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 22906 T3696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 22907 T3696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 22909 T3701 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d2857268b000b
[junit4:junit4]   2> 22910 T3779 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 22910 T3698 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:39848 which had sessionid 0x13d2857268b000b
[junit4:junit4]   2> 22910 T3696 oaz.ZooKeeper.close Session: 0x13d2857268b000b closed
[junit4:junit4]   2> 22912 T3727 C248 P23026 REQ /select {q=*:*&distrib=false&wt=javabin&version=2} hits=1 status=0 QTime=0 
[junit4:junit4]   2> 22914 T3745 C251 P23029 REQ /select {q=*:*&distrib=false&wt=javabin&version=2} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 22920 T3746 C251 P23029 REQ /select {NOW=1362181455873&shard.url=127.0.0.1:23029/eqzex/o/collection1/&fl=id,score&start=0&q=*:*&distrib=false&wt=javabin&isShard=true&fsv=true&version=2&rows=10} hits=0 status=0 QTime=0 
[junit4:junit4]   2> 22920 T3730 C248 P23026 REQ /select {NOW=1362181455873&shard.url=127.0.0.1:23026/eqzex/o/collection1/|127.0.0.1:23338/eqzex/o/collection1/&fl=id,score&start=0&q=*:*&distrib=false&wt=javabin&isShard=true&fsv=true&version=2&rows=10} hits=1 status=0 QTime=0 
[junit4:junit4]   2> 22924 T3730 C248 P23026 REQ /select {NOW=1362181455873&shard.url=127.0.0.1:23026/eqzex/o/collection1/|127.0.0.1:23338/eqzex/o/collection1/&ids=1&q=*:*&distrib=false&wt=javabin&isShard=true&version=2} status=0 QTime=0 
[junit4:junit4]   2> 22925 T3744 C251 P23029 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=8 
[junit4:junit4]   2> 22933 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[2 (1428350782287118336)]} 0 4
[junit4:junit4]   2> 22941 T3747 C251 P23029 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1428350782295506944)]} 0 4
[junit4:junit4]   2> 22942 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[2]} 0 7
[junit4:junit4]   2> 22947 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[3 (1428350782303895552)]} 0 2
[junit4:junit4]   2> 22953 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[3 (1428350782309138432)]} 0 3
[junit4:junit4]   2> 22958 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[4 (1428350782315429888)]} 0 2
[junit4:junit4]   2> 22976 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1428350782323818496)]} 0 4
[junit4:junit4]   2> 22977 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1428350782323818496)]} 0 13
[junit4:junit4]   2> 22978 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[4]} 0 17
[junit4:junit4]   2> 22983 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[5 (1428350782341644288)]} 0 2
[junit4:junit4]   2> 22993 T3747 C251 P23029 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1428350782351081472)]} 0 3
[junit4:junit4]   2> 22993 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[5]} 0 6
[junit4:junit4]   2> 22999 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[6 (1428350782358421504)]} 0 2
[junit4:junit4]   2> 23004 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[6 (1428350782363664384)]} 0 2
[junit4:junit4]   2> 23009 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[7 (1428350782368907264)]} 0 2
[junit4:junit4]   2> 23018 T3747 C251 P23029 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1428350782377295872)]} 0 3
[junit4:junit4]   2> 23019 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[7]} 0 7
[junit4:junit4]   2> 23024 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[8 (1428350782384635904)]} 0 2
[junit4:junit4]   2> 23035 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1428350782389878784)]} 0 3
[junit4:junit4]   2> 23036 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[8 (1428350782389878784)]} 0 9
[junit4:junit4]   2> 23041 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[9 (1428350782402461696)]} 0 2
[junit4:junit4]   2> 23046 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[9 (1428350782407704576)]} 0 2
[junit4:junit4]   2> 23051 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[10 (1428350782412947456)]} 0 2
[junit4:junit4]   2> 23062 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1428350782418190336)]} 0 3
[junit4:junit4]   2> 23063 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[10 (1428350782418190336)]} 0 9
[junit4:junit4]   2> 23069 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[11 (1428350782430773248)]} 0 3
[junit4:junit4]   2> 23080 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1428350782437064704)]} 0 3
[junit4:junit4]   2> 23081 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[11 (1428350782437064704)]} 0 9
[junit4:junit4]   2> 23087 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[12 (1428350782449647616)]} 0 3
[junit4:junit4]   2> 23097 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1428350782455939072)]} 0 3
[junit4:junit4]   2> 23098 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[12 (1428350782455939072)]} 0 8
[junit4:junit4]   2> 23103 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[13 (1428350782467473408)]} 0 2
[junit4:junit4]   2> 23117 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1428350782475862016)]} 0 2
[junit4:junit4]   2> 23118 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[13 (1428350782475862016)]} 0 9
[junit4:junit4]   2> 23119 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[13]} 0 13
[junit4:junit4]   2> 23124 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[14 (1428350782489493504)]} 0 2
[junit4:junit4]   2> 23139 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1428350782497882112)]} 0 3
[junit4:junit4]   2> 23140 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1428350782497882112)]} 0 10
[junit4:junit4]   2> 23141 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[14]} 0 14
[junit4:junit4]   2> 23146 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[15 (1428350782511513600)]} 0 3
[junit4:junit4]   2> 23157 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1428350782517805056)]} 0 3
[junit4:junit4]   2> 23158 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[15 (1428350782517805056)]} 0 9
[junit4:junit4]   2> 23164 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[16 (1428350782530387968)]} 0 3
[junit4:junit4]   2> 23181 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1428350782540873728)]} 0 4
[junit4:junit4]   2> 23182 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[16 (1428350782540873728)]} 0 12
[junit4:junit4]   2> 23183 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[16]} 0 16
[junit4:junit4]   2> 23197 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[17 (1428350782559748096)]} 0 11
[junit4:junit4]   2> 23210 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[17 (1428350782573379584)]} 0 10
[junit4:junit4]   2> 23215 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[100 (1428350782584913920)]} 0 2
[junit4:junit4]   2> 23227 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[100 (1428350782591205376)]} 0 3
[junit4:junit4]   2> 23228 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[100 (1428350782591205376)]} 0 9
[junit4:junit4]   2> 23233 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[101 (1428350782603788288)]} 0 2
[junit4:junit4]   2> 23245 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[101 (1428350782610079744)]} 0 3
[junit4:junit4]   2> 23246 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[101 (1428350782610079744)]} 0 9
[junit4:junit4]   2> 23276 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[102 (1428350782647828480)]} 0 3
[junit4:junit4]   2> 23291 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[102 (1428350782657265664)]} 0 3
[junit4:junit4]   2> 23292 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[102 (1428350782657265664)]} 0 10
[junit4:junit4]   2> 23293 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[102]} 0 13
[junit4:junit4]   2> 23298 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[103 (1428350782671945728)]} 0 2
[junit4:junit4]   2> 23306 T3747 C251 P23029 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[103 (1428350782680334336)]} 0 2
[junit4:junit4]   2> 23307 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[103]} 0 6
[junit4:junit4]   2> 23312 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[104 (1428350782686625792)]} 0 2
[junit4:junit4]   2> 23317 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[104 (1428350782691868672)]} 0 2
[junit4:junit4]   2> 23322 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[105 (1428350782697111552)]} 0 2
[junit4:junit4]   2> 23326 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[105 (1428350782701305856)]} 0 1
[junit4:junit4]   2> 23329 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[106 (1428350782704451584)]} 0 1
[junit4:junit4]   2> 23334 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[106 (1428350782708645888)]} 0 2
[junit4:junit4]   2> 23338 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[107 (1428350782713888768)]} 0 1
[junit4:junit4]   2> 23347 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[107 (1428350782719131648)]} 0 2
[junit4:junit4]   2> 23348 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[107 (1428350782719131648)]} 0 7
[junit4:junit4]   2> 23353 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[108 (1428350782729617408)]} 0 2
[junit4:junit4]   2> 23361 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[108 (1428350782732763136)]} 0 2
[junit4:junit4]   2> 23362 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[108 (1428350782732763136)]} 0 7
[junit4:junit4]   2> 23367 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[109 (1428350782744297472)]} 0 2
[junit4:junit4]   2> 23375 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[109 (1428350782749540352)]} 0 1
[junit4:junit4]   2> 23376 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[109 (1428350782749540352)]} 0 6
[junit4:junit4]   2> 23381 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[110 (1428350782758977536)]} 0 2
[junit4:junit4]   2> 23388 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[110 (1428350782763171840)]} 0 1
[junit4:junit4]   2> 23389 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[110 (1428350782763171840)]} 0 6
[junit4:junit4]   2> 23395 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[111 (1428350782773657600)]} 0 2
[junit4:junit4]   2> 23404 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[111 (1428350782778900480)]} 0 2
[junit4:junit4]   2> 23405 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[111 (1428350782778900480)]} 0 7
[junit4:junit4]   2> 23409 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[112 (1428350782789386240)]} 0 1
[junit4:junit4]   2> 23414 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[112 (1428350782793580544)]} 0 2
[junit4:junit4]   2> 23419 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[113 (1428350782798823424)]} 0 1
[junit4:junit4]   2> 23430 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[113 (1428350782807212032)]} 0 1
[junit4:junit4]   2> 23431 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[113 (1428350782807212032)]} 0 6
[junit4:junit4]   2> 23432 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[113]} 0 10
[junit4:junit4]   2> 23436 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[114 (1428350782817697792)]} 0 1
[junit4:junit4]   2> 23447 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[114 (1428350782825037824)]} 0 1
[junit4:junit4]   2> 23448 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[114 (1428350782825037824)]} 0 6
[junit4:junit4]   2> 23449 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[114]} 0 10
[junit4:junit4]   2> 23453 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[115 (1428350782834475008)]} 0 2
[junit4:junit4]   2> 23461 T3747 C251 P23029 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[115 (1428350782841815040)]} 0 2
[junit4:junit4]   2> 23465 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[115]} 0 10
[junit4:junit4]   2> 23473 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[116 (1428350782855446528)]} 0 2
[junit4:junit4]   2> 23477 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[116 (1428350782859640832)]} 0 1
[junit4:junit4]   2> 23482 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[117 (1428350782863835136)]} 0 2
[junit4:junit4]   2> 23488 T3747 C251 P23029 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[117 (1428350782871175168)]} 0 1
[junit4:junit4]   2> 23489 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[117]} 0 5
[junit4:junit4]   2> 23493 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[118 (1428350782876418048)]} 0 1
[junit4:junit4]   2> 23504 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[118 (1428350782883758080)]} 0 1
[junit4:junit4]   2> 23505 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[118 (1428350782883758080)]} 0 6
[junit4:junit4]   2> 23506 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[118]} 0 10
[junit4:junit4]   2> 23511 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[119 (1428350782895292416)]} 0 2
[junit4:junit4]   2> 23516 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[119 (1428350782900535296)]} 0 1
[junit4:junit4]   2> 23521 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[120 (1428350782905778176)]} 0 2
[junit4:junit4]   2> 23528 T3747 C251 P23029 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[120 (1428350782914166784)]} 0 1
[junit4:junit4]   2> 23529 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[120]} 0 5
[junit4:junit4]   2> 23534 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[121 (1428350782919409664)]} 0 2
[junit4:junit4]   2> 23539 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[121 (1428350782924652544)]} 0 2
[junit4:junit4]   2> 23543 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[122 (1428350782928846848)]} 0 1
[junit4:junit4]   2> 23550 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[122 (1428350782933041152)]} 0 1
[junit4:junit4]   2> 23551 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[122 (1428350782933041152)]} 0 5
[junit4:junit4]   2> 23555 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[123 (1428350782941429760)]} 0 1
[junit4:junit4]   2> 23563 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[123 (1428350782945624064)]} 0 1
[junit4:junit4]   2> 23564 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[123 (1428350782945624064)]} 0 6
[junit4:junit4]   2> 23568 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[124 (1428350782955061248)]} 0 1
[junit4:junit4]   2> 23578 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[124 (1428350782962401280)]} 0 1
[junit4:junit4]   2> 23579 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[124 (1428350782962401280)]} 0 5
[junit4:junit4]   2> 23579 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[124]} 0 8
[junit4:junit4]   2> 23583 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[125 (1428350782970789888)]} 0 1
[junit4:junit4]   2> 23590 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[125 (1428350782974984192)]} 0 1
[junit4:junit4]   2> 23591 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[125 (1428350782974984192)]} 0 5
[junit4:junit4]   2> 23595 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[126 (1428350782983372800)]} 0 1
[junit4:junit4]   2> 23599 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[126 (1428350782987567104)]} 0 1
[junit4:junit4]   2> 23603 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[127 (1428350782991761408)]} 0 1
[junit4:junit4]   2> 23607 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[127 (1428350782995955712)]} 0 1
[junit4:junit4]   2> 23611 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[128 (1428350783000150016)]} 0 1
[junit4:junit4]   2> 23615 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[128 (1428350783004344320)]} 0 1
[junit4:junit4]   2> 23619 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[129 (1428350783008538624)]} 0 1
[junit4:junit4]   2> 23626 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[129 (1428350783012732928)]} 0 1
[junit4:junit4]   2> 23627 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[129 (1428350783012732928)]} 0 5
[junit4:junit4]   2> 23631 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[130 (1428350783021121536)]} 0 1
[junit4:junit4]   2> 23638 T3747 C251 P23029 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[130 (1428350783028461568)]} 0 1
[junit4:junit4]   2> 23639 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[130]} 0 5
[junit4:junit4]   2> 23642 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[131 (1428350783032655872)]} 0 1
[junit4:junit4]   2> 23646 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[131 (1428350783036850176)]} 0 1
[junit4:junit4]   2> 23650 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[132 (1428350783041044480)]} 0 1
[junit4:junit4]   2> 23660 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[132 (1428350783048384512)]} 0 1
[junit4:junit4]   2> 23661 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[132 (1428350783048384512)]} 0 5
[junit4:junit4]   2> 23662 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[132]} 0 9
[junit4:junit4]   2> 23666 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[133 (1428350783057821696)]} 0 1
[junit4:junit4]   2> 23673 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[133 (1428350783062016000)]} 0 1
[junit4:junit4]   2> 23674 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[133 (1428350783062016000)]} 0 5
[junit4:junit4]   2> 23678 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[134 (1428350783070404608)]} 0 1
[junit4:junit4]   2> 23682 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[134 (1428350783074598912)]} 0 1
[junit4:junit4]   2> 23686 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[135 (1428350783078793216)]} 0 1
[junit4:junit4]   2> 23696 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[135 (1428350783086133248)]} 0 1
[junit4:junit4]   2> 23697 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[135 (1428350783086133248)]} 0 5
[junit4:junit4]   2> 23697 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[135]} 0 8
[junit4:junit4]   2> 23701 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[136 (1428350783094521856)]} 0 1
[junit4:junit4]   2> 23705 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[136 (1428350783098716160)]} 0 1
[junit4:junit4]   2> 23709 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[137 (1428350783102910464)]} 0 1
[junit4:junit4]   2> 23713 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[137 (1428350783107104768)]} 0 1
[junit4:junit4]   2> 23718 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[138 (1428350783112347648)]} 0 2
[junit4:junit4]   2> 23728 T3757 C247 P23338 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[138 (1428350783119687680)]} 0 1
[junit4:junit4]   2> 23729 T3733 C248 P23026 /update {distrib.from=http://127.0.0.1:23029/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[138 (1428350783119687680)]} 0 5
[junit4:junit4]   2> 23730 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[138]} 0 9
[junit4:junit4]   2> 23733 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[139 (1428350783128076288)]} 0 1
[junit4:junit4]   2> 23740 T3747 C251 P23029 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[139 (1428350783135416320)]} 0 1
[junit4:junit4]   2> 23741 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[139]} 0 5
[junit4:junit4]   2> 23745 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[140 (1428350783140659200)]} 0 1
[junit4:junit4]   2> 23753 T3747 C251 P23029 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[140 (1428350783150096384)]} 0 1
[junit4:junit4]   2> 23754 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[140]} 0 5
[junit4:junit4]   2> 23758 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[141 (1428350783154290688)]} 0 1
[junit4:junit4]   2> 23761 T3744 C251 P23029 /update {wt=javabin&version=2} {add=[141 (1428350783157436416)]} 0 1
[junit4:junit4]   2> 23764 T3708 C250 P23022 /update {wt=javabin&version=2} {add=[142 (1428350783160582144)]} 0 1
[junit4:junit4]   2> 23769 T3747 C251 P23029 /update {distrib.from=http://127.0.0.1:23026/eqzex/o/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[142 (1428350783165825024)]} 0 1
[junit4:junit4]   2> 23769 T3782 C248 P23026 /update {wt=javabin&version=2} {add=[142]} 

[...truncated too long message...]

lector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/89271922391187466-4-n_0000000001
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:153)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:150)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:150)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:243)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 
[junit4:junit4]   2> 88200 T3767 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 88200 T3767 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 88200 T3767 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 88200 T3767 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 88200 T3767 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 88201 T3767 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:236)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:233)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:233)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 
[junit4:junit4]   2> 88201 T3767 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {foo_b=PostingsFormat(name=Memory doPackFST= false), n_f1=PostingsFormat(name=Memory doPackFST= true), foo_d=Pulsing41(freqCutoff=8 minBlockSize=88 maxBlockSize=256), foo_f=PostingsFormat(name=Memory doPackFST= false), n_tl1=PostingsFormat(name=Memory doPackFST= true), n_d1=MockVariableIntBlock(baseBlockSize=38), rnd_b=Pulsing41(freqCutoff=8 minBlockSize=88 maxBlockSize=256), intDefault=PostingsFormat(name=Memory doPackFST= true), n_td1=PostingsFormat(name=Memory doPackFST= true), timestamp=MockVariableIntBlock(baseBlockSize=38), id=Pulsing41(freqCutoff=8 minBlockSize=88 maxBlockSize=256), range_facet_sl=Pulsing41(freqCutoff=8 minBlockSize=88 maxBlockSize=256), range_facet_si=MockVariableIntBlock(baseBlockSize=38), oddField_s=Pulsing41(freqCutoff=8 minBlockSize=88 maxBlockSize=256), multiDefault=MockVariableIntBlock(baseBlockSize=38), n_tf1=MockVariableIntBlock(baseBlockSize=38), n_dt1=PostingsFormat(name=Memory doPackFST= true), range_facet_l=MockVariableIntBlock(baseBlockSize=38), n_ti1=Pulsing41(freqCutoff=8 minBlockSize=88 maxBlockSize=256), text=PostingsFormat(name=Memory doPackFST= false), _version_=PostingsFormat(name=Memory doPackFST= true), SubjectTerms_mfacet=PostingsFormat(name=Memory doPackFST= true), a_t=MockVariableIntBlock(baseBlockSize=38), n_tdt1=PostingsFormat(name=Memory doPackFST= true), other_tl1=PostingsFormat(name=Memory doPackFST= true), n_l1=MockVariableIntBlock(baseBlockSize=38), a_si=PostingsFormat(name=Memory doPackFST= true)}, docValues:{timestamp=DocValuesFormat(name=SimpleText)}, sim=DefaultSimilarity, locale=ar_MA, timezone=Europe/Stockholm
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_09 (64-bit)/cpus=16,threads=2,free=247289536,total=514850816
[junit4:junit4]   2> NOTE: All tests run in this JVM: [RecoveryZkTest, CurrencyFieldXmlFileTest, FullSolrCloudDistribCmdsTest, TestSuggestSpellingConverter, AnalysisAfterCoreReloadTest, DistributedQueryElevationComponentTest, SolrInfoMBeanTest, TestTrie, TestSolrJ, TestZkChroot, TestSort, CurrencyFieldOpenExchangeTest, BinaryUpdateRequestHandlerTest, TestFastOutputStream, ShardRoutingTest, TestSolrDeletionPolicy1, TestRecovery, ConvertedLegacyTest, ChaosMonkeyNothingIsSafeTest, TestLuceneMatchVersion, TestStressVersions, SignatureUpdateProcessorFactoryTest, TestBM25SimilarityFactory, TestPerFieldSimilarity, TestWriterPerf, SolrIndexSplitterTest, OverseerTest, ExternalFileFieldSortTest, TestElisionMultitermQuery, DirectSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, SynonymTokenizerTest, AlternateDirectoryTest, FastVectorHighlighterTest, TestQueryTypes, BasicZkTest, TestFastLRUCache, TimeZoneUtilsTest, StatelessScriptUpdateProcessorFactoryTest, PeerSyncTest, TestReversedWildcardFilterFactory, TestSolrQueryParser, UniqFieldsUpdateProcessorFactoryTest, ChaosMonkeySafeLeaderTest, HighlighterConfigTest, JSONWriterTest, RequestHandlersTest, BasicFunctionalityTest, TestSolrDeletionPolicy2, TestDistributedSearch, FieldAnalysisRequestHandlerTest, TestXIncludeConfig, CollectionsAPIDistributedZkTest, QueryEqualityTest, TestLRUCache, JsonLoaderTest, CircularListTest, SliceStateTest, DirectUpdateHandlerTest, URLClassifyProcessorTest, TestMultiCoreConfBootstrap, IndexReaderFactoryTest, TermsComponentTest, TestReplicationHandler, LeaderElectionTest, DistributedSpellCheckComponentTest, TestRealTimeGet, TestDistributedGrouping, SpellCheckCollatorTest, TestExtendedDismaxParser, SoftAutoCommitTest, ZkSolrClientTest, WordBreakSolrSpellCheckerTest, TestHashPartitioner, DistributedTermsComponentTest, StatsComponentTest, IndexBasedSpellCheckerTest, TestRangeQuery, LukeRequestHandlerTest, TestBinaryResponseWriter, TestJmxIntegration, TestFunctionQuery, DirectSolrConnectionTest, TestWordDelimiterFilterFactory, TestCSVLoader, MoreLikeThisHandlerTest, MBeansHandlerTest, IndexSchemaTest, QueryParsingTest, XmlUpdateRequestHandlerTest, TermVectorComponentTest, DocumentAnalysisRequestHandlerTest, TestValueSourceCache, DebugComponentTest, TestOmitPositions, CopyFieldTest, TestQueryUtils, SuggesterTSTTest, CSVRequestHandlerTest, TestSearchPerf, TestFoldingMultitermQuery, TestPropInject, NoCacheHeaderTest, PrimitiveFieldTypeTest, SOLR749Test, TestPropInjectDefaults, TestCollationField, TestQuerySenderNoQuery, TestJmxMonitoredMap, EchoParamsTest, TestPluginEnable, TestLMJelinekMercerSimilarityFactory, TestCodecSupport, PrimUtilsTest, ResourceLoaderTest, TestSystemIdResolver, DOMUtilTest, UUIDFieldTest, SystemInfoHandlerTest, ZkNodePropsTest, TestDocumentBuilder, TestCharFilters, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 89.16s, 1 test, 1 error <<< FAILURES!

[...truncated 93 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1207: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:870: There were test failures: 259 suites, 1085 tests, 1 error, 23 ignored (4 assumptions)

Total time: 52 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message