lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Uwe Schindler <...@thetaphi.de>
Subject Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.6.0_37) - Build # 2985 - Failure!
Date Fri, 30 Nov 2012 21:27:03 GMT
Oooh! I missed that one. We are back in the usual crazy mail floods from Solr...



Policeman Jenkins Server <jenkins@sd-datasolutions.de> schrieb:

>Build:
>http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Linux/2985/
>Java: 32bit/jdk1.6.0_37 -server -XX:+UseParallelGC
>
>1 tests failed.
>FAILED: 
>junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest
>
>Error Message:
>ERROR: SolrIndexSearcher opens=1927 closes=1926
>
>Stack Trace:
>java.lang.AssertionError: ERROR: SolrIndexSearcher opens=1927
>closes=1926
>	at __randomizedtesting.SeedInfo.seed([1AD86F62C49580DB]:0)
>	at org.junit.Assert.fail(Assert.java:93)
>	at
>org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:243)
>	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:97)
>	at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
>	at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>	at java.lang.reflect.Method.invoke(Method.java:597)
>	at
>com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>	at
>com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>	at
>com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
>	at
>com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>	at
>com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>	at
>org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>	at
>org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>	at
>com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>	at
>com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>	at
>com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>	at
>com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>	at
>org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>	at
>org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>	at
>org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>	at
>org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>	at
>com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>	at
>com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>	at java.lang.Thread.run(Thread.java:662)
>
>
>
>
>Build Log:
>[...truncated 8541 lines...]
>[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
>[junit4:junit4]   2> 3 T570 oas.SolrTestCaseJ4.setUp ###Starting
>testDistribSearch
>[junit4:junit4]   2> Creating dataDir:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1354310023722
>[junit4:junit4]   2> 4 T570 oasc.ZkTestServer.run STARTING ZK TEST
>SERVER
>[junit4:junit4]   2> 4 T571
>oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
>[junit4:junit4]   2> 5 T571 oazs.ZooKeeperServer.setTickTime tickTime
>set to 1000
>[junit4:junit4]   2> 5 T571 oazs.ZooKeeperServer.setMinSessionTimeout
>minSessionTimeout set to -1
>[junit4:junit4]   2> 5 T571 oazs.ZooKeeperServer.setMaxSessionTimeout
>maxSessionTimeout set to -1
>[junit4:junit4]   2> 6 T571 oazs.NIOServerCnxnFactory.configure binding
>to port 0.0.0.0/0.0.0.0:0
>[junit4:junit4]   2> 6 T571 oazsp.FileTxnSnapLog.save Snapshotting: 0x0
>to
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/zookeeper/server1/data/version-2/snapshot.0
>[junit4:junit4]   2> 104 T570 oasc.ZkTestServer.run start zk server on
>port:55724
>[junit4:junit4]   2> 105 T570 oaz.ZooKeeper.<init> Initiating client
>connection, connectString=127.0.0.1:55724 sessionTimeout=10000
>watcher=org.apache.solr.common.cloud.ConnectionManager@1b6ba3a
>[junit4:junit4]   2> 107 T576 oaz.ClientCnxn$SendThread.logStartConnect
>Opening socket connection to server
>localhost.localdomain/127.0.0.1:55724. Will not attempt to authenticate
>using SASL (access denied (javax.security.auth.AuthPermission
>getLoginConfiguration))
>[junit4:junit4]   2> 106 T570 oascc.ConnectionManager.waitForConnected
>Waiting for client to connect to ZooKeeper
>[junit4:junit4]   2> 107 T576 oaz.ClientCnxn$SendThread.primeConnection
>Socket connection established to localhost.localdomain/127.0.0.1:55724,
>initiating session
>[junit4:junit4]   2> 107 T572 oazs.NIOServerCnxnFactory.run Accepted
>socket connection from /127.0.0.1:50354
>[junit4:junit4]   2> 108 T572
>oazs.ZooKeeperServer.processConnectRequest Client attempting to
>establish new session at /127.0.0.1:50354
>[junit4:junit4]   2> 108 T574 oazsp.FileTxnLog.append Creating new log
>file: log.1
>[junit4:junit4]   2> 147 T574 oazs.ZooKeeperServer.finishSessionInit
>Established session 0x13b532afa2d0000 with negotiated timeout 10000 for
>client /127.0.0.1:50354
>[junit4:junit4]   2> 147 T576 oaz.ClientCnxn$SendThread.onConnected
>Session establishment complete on server
>localhost.localdomain/127.0.0.1:55724, sessionid = 0x13b532afa2d0000,
>negotiated timeout = 10000
>[junit4:junit4]   2> 147 T577 oascc.ConnectionManager.process Watcher
>org.apache.solr.common.cloud.ConnectionManager@1b6ba3a
>name:ZooKeeperConnection Watcher:127.0.0.1:55724 got event WatchedEvent
>state:SyncConnected type:None path:null path:null type:None
>[junit4:junit4]   2> 147 T570 oascc.ConnectionManager.waitForConnected
>Client is connected to ZooKeeper
>[junit4:junit4]   2> 148 T570 oascc.SolrZkClient.makePath makePath:
>/solr
>[junit4:junit4]   2> 151 T575 oazs.PrepRequestProcessor.pRequest2Txn
>Processed session termination for sessionid: 0x13b532afa2d0000
>[junit4:junit4]   2> 152 T577 oaz.ClientCnxn$EventThread.run
>EventThread shut down
>[junit4:junit4]   2> 152 T572 oazs.NIOServerCnxn.closeSock Closed
>socket connection for client /127.0.0.1:50354 which had sessionid
>0x13b532afa2d0000
>[junit4:junit4]   2> 152 T570 oaz.ZooKeeper.close Session:
>0x13b532afa2d0000 closed
>[junit4:junit4]   2> 153 T570 oaz.ZooKeeper.<init> Initiating client
>connection, connectString=127.0.0.1:55724/solr sessionTimeout=10000
>watcher=org.apache.solr.common.cloud.ConnectionManager@1dd2ed5
>[junit4:junit4]   2> 153 T570 oascc.ConnectionManager.waitForConnected
>Waiting for client to connect to ZooKeeper
>[junit4:junit4]   2> 154 T578 oaz.ClientCnxn$SendThread.logStartConnect
>Opening socket connection to server
>localhost.localdomain/127.0.0.1:55724. Will not attempt to authenticate
>using SASL (access denied (javax.security.auth.AuthPermission
>getLoginConfiguration))
>[junit4:junit4]   2> 154 T578 oaz.ClientCnxn$SendThread.primeConnection
>Socket connection established to localhost.localdomain/127.0.0.1:55724,
>initiating session
>[junit4:junit4]   2> 154 T572 oazs.NIOServerCnxnFactory.run Accepted
>socket connection from /127.0.0.1:50355
>[junit4:junit4]   2> 154 T572
>oazs.ZooKeeperServer.processConnectRequest Client attempting to
>establish new session at /127.0.0.1:50355
>[junit4:junit4]   2> 155 T574 oazs.ZooKeeperServer.finishSessionInit
>Established session 0x13b532afa2d0001 with negotiated timeout 10000 for
>client /127.0.0.1:50355
>[junit4:junit4]   2> 155 T578 oaz.ClientCnxn$SendThread.onConnected
>Session establishment complete on server
>localhost.localdomain/127.0.0.1:55724, sessionid = 0x13b532afa2d0001,
>negotiated timeout = 10000
>[junit4:junit4]   2> 155 T579 oascc.ConnectionManager.process Watcher
>org.apache.solr.common.cloud.ConnectionManager@1dd2ed5
>name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event
>WatchedEvent state:SyncConnected type:None path:null path:null
>type:None
>[junit4:junit4]   2> 156 T570 oascc.ConnectionManager.waitForConnected
>Client is connected to ZooKeeper
>[junit4:junit4]   2> 156 T570 oascc.SolrZkClient.makePath makePath:
>/collections/collection1
>[junit4:junit4]   2> 159 T570 oascc.SolrZkClient.makePath makePath:
>/collections/collection1/shards
>[junit4:junit4]   2> 161 T570 oascc.SolrZkClient.makePath makePath:
>/collections/control_collection
>[junit4:junit4]   2> 163 T570 oascc.SolrZkClient.makePath makePath:
>/collections/control_collection/shards
>[junit4:junit4]   2> 166 T570 oasc.AbstractZkTestCase.putConfig put
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml
>to /configs/conf1/solrconfig.xml
>[junit4:junit4]   2> 167 T570 oascc.SolrZkClient.makePath makePath:
>/configs/conf1/solrconfig.xml
>[junit4:junit4]   2> 171 T570 oasc.AbstractZkTestCase.putConfig put
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml
>to /configs/conf1/schema.xml
>[junit4:junit4]   2> 171 T570 oascc.SolrZkClient.makePath makePath:
>/configs/conf1/schema.xml
>[junit4:junit4]   2> 174 T570 oasc.AbstractZkTestCase.putConfig put
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml
>to /configs/conf1/solrconfig.xml
>[junit4:junit4]   2> 175 T570 oascc.SolrZkClient.makePath makePath:
>/configs/conf1/solrconfig.xml
>[junit4:junit4]   2> 178 T570 oasc.AbstractZkTestCase.putConfig put
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt
>to /configs/conf1/stopwords.txt
>[junit4:junit4]   2> 179 T570 oascc.SolrZkClient.makePath makePath:
>/configs/conf1/stopwords.txt
>[junit4:junit4]   2> 181 T570 oasc.AbstractZkTestCase.putConfig put
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt
>to /configs/conf1/protwords.txt
>[junit4:junit4]   2> 181 T570 oascc.SolrZkClient.makePath makePath:
>/configs/conf1/protwords.txt
>[junit4:junit4]   2> 183 T570 oasc.AbstractZkTestCase.putConfig put
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml
>to /configs/conf1/currency.xml
>[junit4:junit4]   2> 184 T570 oascc.SolrZkClient.makePath makePath:
>/configs/conf1/currency.xml
>[junit4:junit4]   2> 186 T570 oasc.AbstractZkTestCase.putConfig put
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json
>to /configs/conf1/open-exchange-rates.json
>[junit4:junit4]   2> 186 T570 oascc.SolrZkClient.makePath makePath:
>/configs/conf1/open-exchange-rates.json
>[junit4:junit4]   2> 188 T570 oasc.AbstractZkTestCase.putConfig put
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
>to /configs/conf1/mapping-ISOLatin1Accent.txt
>[junit4:junit4]   2> 189 T570 oascc.SolrZkClient.makePath makePath:
>/configs/conf1/mapping-ISOLatin1Accent.txt
>[junit4:junit4]   2> 191 T570 oasc.AbstractZkTestCase.putConfig put
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt
>to /configs/conf1/old_synonyms.txt
>[junit4:junit4]   2> 192 T570 oascc.SolrZkClient.makePath makePath:
>/configs/conf1/old_synonyms.txt
>[junit4:junit4]   2> 194 T570 oasc.AbstractZkTestCase.putConfig put
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt
>to /configs/conf1/synonyms.txt
>[junit4:junit4]   2> 194 T570 oascc.SolrZkClient.makePath makePath:
>/configs/conf1/synonyms.txt
>[junit4:junit4]   2> 196 T575 oazs.PrepRequestProcessor.pRequest2Txn
>Processed session termination for sessionid: 0x13b532afa2d0001
>[junit4:junit4]   2> 197 T579 oaz.ClientCnxn$EventThread.run
>EventThread shut down
>[junit4:junit4]   2> 197 T572 oazs.NIOServerCnxn.closeSock Closed
>socket connection for client /127.0.0.1:50355 which had sessionid
>0x13b532afa2d0001
>[junit4:junit4]   2> 197 T570 oaz.ZooKeeper.close Session:
>0x13b532afa2d0001 closed
>[junit4:junit4]   2> 245 T570 oejs.Server.doStart jetty-8.1.7.v20120910
>[junit4:junit4]   2> 248 T570 oejs.AbstractConnector.doStart Started
>SelectChannelConnector@0.0.0.0:53088
>[junit4:junit4]   2> 248 T570 oasc.SolrResourceLoader.locateSolrHome
>JNDI not configured for solr (NoInitialContextEx)
>[junit4:junit4]   2> 249 T570 oasc.SolrResourceLoader.locateSolrHome
>using system property solr.solr.home:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354310023915
>[junit4:junit4]   2> 249 T570 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for deduced Solr Home:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354310023915/'
>[junit4:junit4]   2> 261 T570 oass.SolrDispatchFilter.init
>SolrDispatchFilter.init()
>[junit4:junit4]   2> 261 T570 oasc.SolrResourceLoader.locateSolrHome
>JNDI not configured for solr (NoInitialContextEx)
>[junit4:junit4]   2> 262 T570 oasc.SolrResourceLoader.locateSolrHome
>using system property solr.solr.home:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354310023915
>[junit4:junit4]   2> 262 T570 oasc.CoreContainer$Initializer.initialize
>looking for solr.xml:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354310023915/solr.xml
>[junit4:junit4]   2> 262 T570 oasc.CoreContainer.<init> New
>CoreContainer 4731330
>[junit4:junit4]   2> 263 T570 oasc.CoreContainer.load Loading
>CoreContainer using Solr Home:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354310023915/'
>[junit4:junit4]   2> 263 T570 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for directory:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354310023915/'
>[junit4:junit4]   2> 275 T570 oasc.CoreContainer.load Registering Log
>Listener
>[junit4:junit4]   2> 284 T3 oasc.CoreContainer.finalize SEVERE
>CoreContainer was not shutdown prior to finalize(), indicates a bug --
>POSSIBLE RESOURCE LEAK!!!  instance=26125433
>[junit4:junit4]   2> 288 T570 oasc.CoreContainer.initZooKeeper
>Zookeeper client=127.0.0.1:55724/solr
>[junit4:junit4]   2> 289 T570 oaz.ZooKeeper.<init> Initiating client
>connection, connectString=127.0.0.1:55724/solr sessionTimeout=8000
>watcher=org.apache.solr.common.cloud.ConnectionManager@fec5e5
>[junit4:junit4]   2> 290 T589 oaz.ClientCnxn$SendThread.logStartConnect
>Opening socket connection to server
>localhost.localdomain/127.0.0.1:55724. Will not attempt to authenticate
>using SASL (access denied (javax.security.auth.AuthPermission
>getLoginConfiguration))
>[junit4:junit4]   2> 290 T570 oascc.ConnectionManager.waitForConnected
>Waiting for client to connect to ZooKeeper
>[junit4:junit4]   2> 290 T589 oaz.ClientCnxn$SendThread.primeConnection
>Socket connection established to localhost.localdomain/127.0.0.1:55724,
>initiating session
>[junit4:junit4]   2> 290 T572 oazs.NIOServerCnxnFactory.run Accepted
>socket connection from /127.0.0.1:50356
>[junit4:junit4]   2> 291 T572
>oazs.ZooKeeperServer.processConnectRequest Client attempting to
>establish new session at /127.0.0.1:50356
>[junit4:junit4]   2> 293 T574 oazs.ZooKeeperServer.finishSessionInit
>Established session 0x13b532afa2d0002 with negotiated timeout 8000 for
>client /127.0.0.1:50356
>[junit4:junit4]   2> 293 T589 oaz.ClientCnxn$SendThread.onConnected
>Session establishment complete on server
>localhost.localdomain/127.0.0.1:55724, sessionid = 0x13b532afa2d0002,
>negotiated timeout = 8000
>[junit4:junit4]   2> 293 T590 oascc.ConnectionManager.process Watcher
>org.apache.solr.common.cloud.ConnectionManager@fec5e5
>name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event
>WatchedEvent state:SyncConnected type:None path:null path:null
>type:None
>[junit4:junit4]   2> 293 T570 oascc.ConnectionManager.waitForConnected
>Client is connected to ZooKeeper
>[junit4:junit4]   2> 295 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0002
>type:create cxid:0x2 zxid:0x19 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 295 T570 oascc.SolrZkClient.makePath makePath:
>/live_nodes
>[junit4:junit4]   2> 297 T570 oasc.ZkController.createEphemeralLiveNode
>Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53088_solr
>[junit4:junit4]   2> 298 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0002
>type:delete cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error
>Path:/solr/live_nodes/127.0.0.1:53088_solr Error:KeeperErrorCode =
>NoNode for /solr/live_nodes/127.0.0.1:53088_solr
>[junit4:junit4]   2> 298 T570 oascc.SolrZkClient.makePath makePath:
>/live_nodes/127.0.0.1:53088_solr
>[junit4:junit4]   2> 300 T570
>oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
>[junit4:junit4]   2> 301 T570
>oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
>http://
>[junit4:junit4]   2> 301 T570
>oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
>[junit4:junit4]   2> 301 T570
>oashc.HttpShardHandlerFactory.getParameter Setting
>maxConnectionsPerHost to: 20
>[junit4:junit4]   2> 302 T570
>oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>[junit4:junit4]   2> 302 T570
>oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to:
>2147483647
>[junit4:junit4]   2> 303 T570
>oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime
>to: 5
>[junit4:junit4]   2> 303 T570
>oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>[junit4:junit4]   2> 303 T570
>oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to:
>false
>[junit4:junit4]   2> 304 T570 oascsi.HttpClientUtil.createClient
>Creating new http client,
>config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
>[junit4:junit4]   2> 307 T570 oascc.SolrZkClient.makePath makePath:
>/overseer_elect/election
>[junit4:junit4]   2> 311 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0002
>type:delete cxid:0x15 zxid:0x20 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for
>/solr/overseer_elect/leader
>[junit4:junit4]   2> 312 T570 oascc.SolrZkClient.makePath makePath:
>/overseer_elect/leader
>[junit4:junit4]   2> 314 T570 oasc.Overseer.start Overseer
>(id=88756061714841602-127.0.0.1:53088_solr-n_0000000000) starting
>[junit4:junit4]   2> 314 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0002
>type:create cxid:0x1a zxid:0x22 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 316 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0002
>type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 316 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0002
>type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 317 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0002
>type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 318 T592 oasc.OverseerCollectionProcessor.run
>Process current queue of collection messages
>[junit4:junit4]   2> 318 T570 oascc.SolrZkClient.makePath makePath:
>/clusterstate.json
>[junit4:junit4]   2> 320 T570
>oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating
>cluster state from ZooKeeper... 
>[junit4:junit4]   2> 322 T591 oasc.Overseer$ClusterStateUpdater.run
>Starting to work on the main queue
>[junit4:junit4]   2> 328 T593 oasc.CoreContainer.create Creating
>SolrCore 'collection1' using instanceDir:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354310023915/collection1
>[junit4:junit4]   2> 328 T593 oasc.ZkController.createCollectionZkNode
>Check for collection zkNode:control_collection
>[junit4:junit4]   2> 329 T593 oasc.ZkController.createCollectionZkNode
>Collection zkNode exists
>[junit4:junit4]   2> 329 T593 oasc.ZkController.readConfigName Load
>collection config from:/collections/control_collection
>[junit4:junit4]   2> 330 T593 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for directory:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354310023915/collection1/'
>[junit4:junit4]   2> 330 T593
>oasc.SolrResourceLoader.replaceClassLoader Adding
>'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354310023915/collection1/lib/README'
>to classloader
>[junit4:junit4]   2> 330 T593
>oasc.SolrResourceLoader.replaceClassLoader Adding
>'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354310023915/collection1/lib/classes/'
>to classloader
>[junit4:junit4]   2> 358 T593 oasc.SolrConfig.<init> Using Lucene
>MatchVersion: LUCENE_50
>[junit4:junit4]   2> 396 T593 oasc.SolrConfig.<init> Loaded SolrConfig:
>solrconfig.xml
>[junit4:junit4]   2> 397 T593 oass.IndexSchema.readSchema Reading Solr
>Schema
>[junit4:junit4]   2> 402 T593 oass.IndexSchema.readSchema Schema
>name=test
>[junit4:junit4]   2> 1076 T593 oass.OpenExchangeRatesOrgProvider.init
>Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>[junit4:junit4]   2> 1082 T593 oass.IndexSchema.readSchema default
>search field in schema is text
>[junit4:junit4]   2> 1085 T593 oass.IndexSchema.readSchema unique key
>field: id
>[junit4:junit4]   2> 1097 T593 oass.FileExchangeRateProvider.reload
>Reloading exchange rates from file currency.xml
>[junit4:junit4]   2> 1100 T593 oass.FileExchangeRateProvider.reload
>Reloading exchange rates from file currency.xml
>[junit4:junit4]   2> 1103 T593 oass.OpenExchangeRatesOrgProvider.reload
>Reloading exchange rates from open-exchange-rates.json
>[junit4:junit4]   2> 1104 T593 oass.OpenExchangeRatesOrgProvider.reload
>Reloading exchange rates from open-exchange-rates.json
>[junit4:junit4]   2> 1105 T593 oasc.SolrCore.<init> [collection1]
>Opening new SolrCore at
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1354310023915/collection1/,
>dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data/
>[junit4:junit4]   2> 1105 T593 oasc.JmxMonitoredMap.<init> JMX
>monitoring is enabled. Adding Solr mbeans to JMX Server:
>com.sun.jmx.mbeanserver.JmxMBeanServer@302e67
>[junit4:junit4]   2> 1106 T593 oasc.SolrCore.initDirectoryFactory
>solr.NRTCachingDirectoryFactory
>[junit4:junit4]   2> 1106 T593
>oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType
>configured for
>NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f5e413;
>maxCacheMB=48.0 maxMergeSizeMB=4.0) assuming 'simple'
>[junit4:junit4]   2> 1106 T593 oasc.CachingDirectoryFactory.get return
>new directory for
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data
>forceNew:false
>[junit4:junit4]   2> 1107 T593 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data
>[junit4:junit4]   2> 1107 T593 oasc.SolrCore.getNewIndexDir New index
>directory detected: old=null
>new=./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data/index/
>[junit4:junit4]   2> 1107 T593 oasc.SolrCore.initIndex WARNING
>[collection1] Solr index directory
>'./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data/index'
>doesn't exist. Creating new index...
>[junit4:junit4]   2> 1107 T593 oasc.CachingDirectoryFactory.get return
>new directory for
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data/index
>forceNew:false
>[junit4:junit4]   2> 1110 T593 oasc.SolrDeletionPolicy.onCommit
>SolrDeletionPolicy.onCommit: commits:num=1
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@ef6b9;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2> 1111 T593 oasc.SolrDeletionPolicy.updateCommits
>newest commit = 1[segments_1]
>[junit4:junit4]   2> 1111 T593 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data/index
>[junit4:junit4]   2> 1111 T593 oasc.SolrCore.initWriters created xml:
>solr.XMLResponseWriter
>[junit4:junit4]   2> 1112 T593 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "dedupe"
>[junit4:junit4]   2> 1112 T593 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "dedupe-allfields"
>[junit4:junit4]   2> 1113 T593 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "stored_sig"
>[junit4:junit4]   2> 1113 T593 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "uniq-fields"
>[junit4:junit4]   2> 1113 T593 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>[junit4:junit4]   2> 1113 T593
>oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
>solr.ReplicationHandler
>[junit4:junit4]   2> 1114 T593
>oasc.RequestHandlers.initHandlersFromConfig created /replication:
>solr.ReplicationHandler
>[junit4:junit4]   2> 1114 T593
>oasc.RequestHandlers.initHandlersFromConfig created standard:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 1115 T593
>oasc.RequestHandlers.initHandlersFromConfig created /get:
>solr.RealTimeGetHandler
>[junit4:junit4]   2> 1115 T593
>oasc.RequestHandlers.initHandlersFromConfig created dismax:
>solr.SearchHandler
>[junit4:junit4]   2> 1116 T593
>oasc.RequestHandlers.initHandlersFromConfig created mock:
>org.apache.solr.core.MockQuerySenderListenerReqHandler
>[junit4:junit4]   2> 1116 T593
>oasc.RequestHandlers.initHandlersFromConfig created /admin/:
>org.apache.solr.handler.admin.AdminHandlers
>[junit4:junit4]   2> 1117 T593
>oasc.RequestHandlers.initHandlersFromConfig created defaults:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 1117 T593
>oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 1117 T593
>oasc.RequestHandlers.initHandlersFromConfig created lazy:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 1117 T593
>oasc.RequestHandlers.initHandlersFromConfig created /update:
>solr.UpdateRequestHandler
>[junit4:junit4]   2> 1118 T593
>oasc.RequestHandlers.initHandlersFromConfig created /terms:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 1118 T593
>oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 1119 T593
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckCompRH_Direct:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 1119 T593
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckWithWordbreak:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 1120 T593
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckWithWordbreak_Direct:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 1120 T593
>oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 1121 T593
>oasc.RequestHandlers.initHandlersFromConfig created tvrh:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 1121 T593
>oasc.RequestHandlers.initHandlersFromConfig created /mlt:
>solr.MoreLikeThisHandler
>[junit4:junit4]   2> 1122 T593
>oasc.RequestHandlers.initHandlersFromConfig created /debug/dump:
>solr.DumpRequestHandler
>[junit4:junit4]   2> 1124 T593 oashl.XMLLoader.init
>xsltCacheLifetimeSeconds=60
>[junit4:junit4]   2> 1125 T593 oasc.SolrCore.initDeprecatedSupport
>WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please
>update your config to use the ShowFileRequestHandler.
>[junit4:junit4]   2> 1126 T593 oasc.SolrCore.initDeprecatedSupport
>WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML,
>OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT,
>OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML,
>MAPPING-ISOLATIN1ACCENT.TXT]
>[junit4:junit4]   2> 1128 T593 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data
>[junit4:junit4]   2> 1129 T593 oass.SolrIndexSearcher.<init> Opening
>Searcher@3c575f main
>[junit4:junit4]   2> 1129 T593 oasu.CommitTracker.<init> Hard
>AutoCommit: disabled
>[junit4:junit4]   2> 1129 T593 oasu.CommitTracker.<init> Soft
>AutoCommit: disabled
>[junit4:junit4]   2> 1130 T593 oashc.SpellCheckComponent.inform
>Initializing spell checkers
>[junit4:junit4]   2> 1133 T593 oass.DirectSolrSpellChecker.init init:
>{name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
>[junit4:junit4]   2> 1159 T594 oasc.SolrCore.registerSearcher
>[collection1] Registered new searcher Searcher@3c575f
>main{StandardDirectoryReader(segments_1:1)}
>[junit4:junit4]   2> 1162 T593 oasc.ZkController.publish numShards not
>found on descriptor - reading it from system property
>[junit4:junit4]   2> 1162 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0002
>type:create cxid:0x53 zxid:0x28 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for
>/solr/overseer/queue
>[junit4:junit4]   2> 1164 T593 oasc.CoreContainer.registerCore
>registering core: collection1
>[junit4:junit4]   2> 1164 T593 oasc.ZkController.register Register
>shard - core:collection1 address:http://127.0.0.1:53088/solr
>shardId:control_shard
>[junit4:junit4]   2> 1165 T593 oascc.SolrZkClient.makePath makePath:
>/collections/control_collection/leader_elect/control_shard/election
>[junit4:junit4]   2> 1170 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0002
>type:delete cxid:0x62 zxid:0x2f txntype:-1 reqpath:n/a Error
>Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode
>= NoNode for /solr/collections/control_collection/leaders
>[junit4:junit4]   2> 1170 T593
>oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader
>process.
>[junit4:junit4]   2> 1170 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0002
>type:create cxid:0x63 zxid:0x30 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 1450 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 1451 T591
>oasc.Overseer$ClusterStateUpdater.updateState Update state
>numShards=null message={
>[junit4:junit4]   2> 	  "operation":"state",
>[junit4:junit4]   2> 	  "numShards":null,
>[junit4:junit4]   2> 	  "shard":"control_shard",
>[junit4:junit4]   2> 	  "roles":null,
>[junit4:junit4]   2> 	  "state":"down",
>[junit4:junit4]   2> 	  "core":"collection1",
>[junit4:junit4]   2> 	  "collection":"control_collection",
>[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53088_solr",
>[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53088/solr"}
>[junit4:junit4]   2> 1451 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0002
>type:create cxid:0x6a zxid:0x32 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for
>/solr/overseer/queue-work
>[junit4:junit4]   2> 1457 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (1)
>[junit4:junit4]   2> 1672 T593
>oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas
>found to continue.
>[junit4:junit4]   2> 1673 T593
>oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new
>leader - try and sync
>[junit4:junit4]   2> 1673 T593 oasc.SyncStrategy.sync Sync replicas to
>http://127.0.0.1:53088/solr/collection1/
>[junit4:junit4]   2> 1673 T593 oasc.SyncStrategy.syncReplicas Sync
>Success - now sync replicas to me
>[junit4:junit4]   2> 1673 T593 oasc.SyncStrategy.syncToMe
>http://127.0.0.1:53088/solr/collection1/ has no replicas
>[junit4:junit4]   2> 1673 T593
>oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
>http://127.0.0.1:53088/solr/collection1/
>[junit4:junit4]   2> 1673 T593 oascc.SolrZkClient.makePath makePath:
>/collections/control_collection/leaders/control_shard
>[junit4:junit4]   2> 1677 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0002
>type:create cxid:0x89 zxid:0x3d txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 1962 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 1966 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (1)
>[junit4:junit4]   2> 1980 T593 oasc.ZkController.register We are
>http://127.0.0.1:53088/solr/collection1/ and leader is
>http://127.0.0.1:53088/solr/collection1/
>[junit4:junit4]   2> 1980 T593 oasc.ZkController.register No LogReplay
>needed for core=collection1 baseURL=http://127.0.0.1:53088/solr
>[junit4:junit4]   2> 1980 T593 oasc.ZkController.checkRecovery I am the
>leader, no recovery necessary
>[junit4:junit4]   2> 1980 T593 oasc.ZkController.publish numShards not
>found on descriptor - reading it from system property
>[junit4:junit4]   2> 1982 T593 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 1983 T570 oass.SolrDispatchFilter.init
>user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>[junit4:junit4]   2> 1983 T570 oass.SolrDispatchFilter.init
>SolrDispatchFilter.init() done
>[junit4:junit4]   2> 1984 T570 oascsi.HttpClientUtil.createClient
>Creating new http client,
>config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
>[junit4:junit4]   2> 1987 T570 oascsi.HttpClientUtil.createClient
>Creating new http client, config:
>[junit4:junit4]   2> 1989 T570 oaz.ZooKeeper.<init> Initiating client
>connection, connectString=127.0.0.1:55724/solr sessionTimeout=10000
>watcher=org.apache.solr.common.cloud.ConnectionManager@1bf3ff
>[junit4:junit4]   2> 1990 T570 oascc.ConnectionManager.waitForConnected
>Waiting for client to connect to ZooKeeper
>[junit4:junit4]   2> 1990 T595
>oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to
>server localhost.localdomain/127.0.0.1:55724. Will not attempt to
>authenticate using SASL (access denied
>(javax.security.auth.AuthPermission getLoginConfiguration))
>[junit4:junit4]   2> 1990 T595
>oaz.ClientCnxn$SendThread.primeConnection Socket connection established
>to localhost.localdomain/127.0.0.1:55724, initiating session
>[junit4:junit4]   2> 1991 T572 oazs.NIOServerCnxnFactory.run Accepted
>socket connection from /127.0.0.1:50359
>[junit4:junit4]   2> 1991 T572
>oazs.ZooKeeperServer.processConnectRequest Client attempting to
>establish new session at /127.0.0.1:50359
>[junit4:junit4]   2> 1992 T574 oazs.ZooKeeperServer.finishSessionInit
>Established session 0x13b532afa2d0003 with negotiated timeout 10000 for
>client /127.0.0.1:50359
>[junit4:junit4]   2> 1992 T595 oaz.ClientCnxn$SendThread.onConnected
>Session establishment complete on server
>localhost.localdomain/127.0.0.1:55724, sessionid = 0x13b532afa2d0003,
>negotiated timeout = 10000
>[junit4:junit4]   2> 1992 T596 oascc.ConnectionManager.process Watcher
>org.apache.solr.common.cloud.ConnectionManager@1bf3ff
>name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event
>WatchedEvent state:SyncConnected type:None path:null path:null
>type:None
>[junit4:junit4]   2> 1992 T570 oascc.ConnectionManager.waitForConnected
>Client is connected to ZooKeeper
>[junit4:junit4]   2> 1993 T570
>oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating
>cluster state from ZooKeeper... 
>[junit4:junit4]   2> 1995 T570 oasc.ChaosMonkey.monkeyLog monkey: init
>- expire sessions:true cause connection loss:true
>[junit4:junit4]   2> 2042 T570 oejs.Server.doStart
>jetty-8.1.7.v20120910
>[junit4:junit4]   2> 2045 T570 oejs.AbstractConnector.doStart Started
>SelectChannelConnector@0.0.0.0:39991
>[junit4:junit4]   2> 2045 T570 oasc.SolrResourceLoader.locateSolrHome
>JNDI not configured for solr (NoInitialContextEx)
>[junit4:junit4]   2> 2046 T570 oasc.SolrResourceLoader.locateSolrHome
>using system property solr.solr.home:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354310025713
>[junit4:junit4]   2> 2046 T570 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for deduced Solr Home:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354310025713/'
>[junit4:junit4]   2> 2057 T570 oass.SolrDispatchFilter.init
>SolrDispatchFilter.init()
>[junit4:junit4]   2> 2058 T570 oasc.SolrResourceLoader.locateSolrHome
>JNDI not configured for solr (NoInitialContextEx)
>[junit4:junit4]   2> 2058 T570 oasc.SolrResourceLoader.locateSolrHome
>using system property solr.solr.home:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354310025713
>[junit4:junit4]   2> 2058 T570
>oasc.CoreContainer$Initializer.initialize looking for solr.xml:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354310025713/solr.xml
>[junit4:junit4]   2> 2059 T570 oasc.CoreContainer.<init> New
>CoreContainer 25708254
>[junit4:junit4]   2> 2059 T570 oasc.CoreContainer.load Loading
>CoreContainer using Solr Home:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354310025713/'
>[junit4:junit4]   2> 2059 T570 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for directory:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354310025713/'
>[junit4:junit4]   2> 2072 T570 oasc.CoreContainer.load Registering Log
>Listener
>[junit4:junit4]   2> 2081 T570 oasc.CoreContainer.initZooKeeper
>Zookeeper client=127.0.0.1:55724/solr
>[junit4:junit4]   2> 2081 T570 oaz.ZooKeeper.<init> Initiating client
>connection, connectString=127.0.0.1:55724/solr sessionTimeout=8000
>watcher=org.apache.solr.common.cloud.ConnectionManager@18bb9dd
>[junit4:junit4]   2> 2082 T570 oascc.ConnectionManager.waitForConnected
>Waiting for client to connect to ZooKeeper
>[junit4:junit4]   2> 2082 T606
>oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to
>server localhost.localdomain/127.0.0.1:55724. Will not attempt to
>authenticate using SASL (access denied
>(javax.security.auth.AuthPermission getLoginConfiguration))
>[junit4:junit4]   2> 2083 T606
>oaz.ClientCnxn$SendThread.primeConnection Socket connection established
>to localhost.localdomain/127.0.0.1:55724, initiating session
>[junit4:junit4]   2> 2083 T572 oazs.NIOServerCnxnFactory.run Accepted
>socket connection from /127.0.0.1:50360
>[junit4:junit4]   2> 2083 T572
>oazs.ZooKeeperServer.processConnectRequest Client attempting to
>establish new session at /127.0.0.1:50360
>[junit4:junit4]   2> 2084 T574 oazs.ZooKeeperServer.finishSessionInit
>Established session 0x13b532afa2d0004 with negotiated timeout 8000 for
>client /127.0.0.1:50360
>[junit4:junit4]   2> 2084 T606 oaz.ClientCnxn$SendThread.onConnected
>Session establishment complete on server
>localhost.localdomain/127.0.0.1:55724, sessionid = 0x13b532afa2d0004,
>negotiated timeout = 8000
>[junit4:junit4]   2> 2085 T607 oascc.ConnectionManager.process Watcher
>org.apache.solr.common.cloud.ConnectionManager@18bb9dd
>name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event
>WatchedEvent state:SyncConnected type:None path:null path:null
>type:None
>[junit4:junit4]   2> 2085 T570 oascc.ConnectionManager.waitForConnected
>Client is connected to ZooKeeper
>[junit4:junit4]   2> 2086 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0004
>type:create cxid:0x1 zxid:0x46 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 2087 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0004
>type:create cxid:0x2 zxid:0x47 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 2088 T570
>oasc.ZkController.createEphemeralLiveNode Register node as live in
>ZooKeeper:/live_nodes/127.0.0.1:39991_solr
>[junit4:junit4]   2> 2089 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0004
>type:delete cxid:0x4 zxid:0x48 txntype:-1 reqpath:n/a Error
>Path:/solr/live_nodes/127.0.0.1:39991_solr Error:KeeperErrorCode =
>NoNode for /solr/live_nodes/127.0.0.1:39991_solr
>[junit4:junit4]   2> 2089 T570 oascc.SolrZkClient.makePath makePath:
>/live_nodes/127.0.0.1:39991_solr
>[junit4:junit4]   2> 2091 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (1)
>[junit4:junit4]   2> 2092 T596 oascc.ZkStateReader$3.process Updating
>live nodes... (2)
>[junit4:junit4]   2> 2092 T590 oascc.ZkStateReader$3.process Updating
>live nodes... (2)
>[junit4:junit4]   2> 2092 T570
>oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
>[junit4:junit4]   2> 2093 T570
>oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
>http://
>[junit4:junit4]   2> 2093 T570
>oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
>[junit4:junit4]   2> 2093 T570
>oashc.HttpShardHandlerFactory.getParameter Setting
>maxConnectionsPerHost to: 20
>[junit4:junit4]   2> 2094 T570
>oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>[junit4:junit4]   2> 2094 T570
>oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to:
>2147483647
>[junit4:junit4]   2> 2094 T570
>oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime
>to: 5
>[junit4:junit4]   2> 2095 T570
>oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>[junit4:junit4]   2> 2095 T570
>oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to:
>false
>[junit4:junit4]   2> 2096 T570 oascsi.HttpClientUtil.createClient
>Creating new http client,
>config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
>[junit4:junit4]   2> 2100 T570
>oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating
>cluster state from ZooKeeper... 
>[junit4:junit4]   2> 2106 T608 oasc.CoreContainer.create Creating
>SolrCore 'collection1' using instanceDir:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354310025713/collection1
>[junit4:junit4]   2> 2106 T608 oasc.ZkController.createCollectionZkNode
>Check for collection zkNode:collection1
>[junit4:junit4]   2> 2106 T608 oasc.ZkController.createCollectionZkNode
>Collection zkNode exists
>[junit4:junit4]   2> 2107 T608 oasc.ZkController.readConfigName Load
>collection config from:/collections/collection1
>[junit4:junit4]   2> 2107 T608 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for directory:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354310025713/collection1/'
>[junit4:junit4]   2> 2108 T608
>oasc.SolrResourceLoader.replaceClassLoader Adding
>'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354310025713/collection1/lib/README'
>to classloader
>[junit4:junit4]   2> 2108 T608
>oasc.SolrResourceLoader.replaceClassLoader Adding
>'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354310025713/collection1/lib/classes/'
>to classloader
>[junit4:junit4]   2> 2139 T608 oasc.SolrConfig.<init> Using Lucene
>MatchVersion: LUCENE_50
>[junit4:junit4]   2> 2183 T608 oasc.SolrConfig.<init> Loaded
>SolrConfig: solrconfig.xml
>[junit4:junit4]   2> 2184 T608 oass.IndexSchema.readSchema Reading Solr
>Schema
>[junit4:junit4]   2> 2188 T608 oass.IndexSchema.readSchema Schema
>name=test
>[junit4:junit4]   2> 2469 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 2469 T591
>oasc.Overseer$ClusterStateUpdater.updateState Update state
>numShards=null message={
>[junit4:junit4]   2> 	  "operation":"state",
>[junit4:junit4]   2> 	  "numShards":null,
>[junit4:junit4]   2> 	  "shard":"control_shard",
>[junit4:junit4]   2> 	  "roles":null,
>[junit4:junit4]   2> 	  "state":"active",
>[junit4:junit4]   2> 	  "core":"collection1",
>[junit4:junit4]   2> 	  "collection":"control_collection",
>[junit4:junit4]   2> 	  "node_name":"127.0.0.1:53088_solr",
>[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:53088/solr"}
>[junit4:junit4]   2> 2472 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (2)
>[junit4:junit4]   2> 2472 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (2)
>[junit4:junit4]   2> 2472 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (2)
>[junit4:junit4]   2> 2535 T608 oass.OpenExchangeRatesOrgProvider.init
>Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>[junit4:junit4]   2> 2541 T608 oass.IndexSchema.readSchema default
>search field in schema is text
>[junit4:junit4]   2> 2544 T608 oass.IndexSchema.readSchema unique key
>field: id
>[junit4:junit4]   2> 2556 T608 oass.FileExchangeRateProvider.reload
>Reloading exchange rates from file currency.xml
>[junit4:junit4]   2> 2559 T608 oass.FileExchangeRateProvider.reload
>Reloading exchange rates from file currency.xml
>[junit4:junit4]   2> 2562 T608 oass.OpenExchangeRatesOrgProvider.reload
>Reloading exchange rates from open-exchange-rates.json
>[junit4:junit4]   2> 2564 T608 oass.OpenExchangeRatesOrgProvider.reload
>Reloading exchange rates from open-exchange-rates.json
>[junit4:junit4]   2> 2565 T608 oasc.SolrCore.<init> [collection1]
>Opening new SolrCore at
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1354310025713/collection1/,
>dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1/
>[junit4:junit4]   2> 2565 T608 oasc.JmxMonitoredMap.<init> JMX
>monitoring is enabled. Adding Solr mbeans to JMX Server:
>com.sun.jmx.mbeanserver.JmxMBeanServer@302e67
>[junit4:junit4]   2> 2566 T608 oasc.SolrCore.initDirectoryFactory
>solr.NRTCachingDirectoryFactory
>[junit4:junit4]   2> 2566 T608
>oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType
>configured for
>NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fc3ba1;
>maxCacheMB=48.0 maxMergeSizeMB=4.0) assuming 'simple'
>[junit4:junit4]   2> 2567 T608 oasc.CachingDirectoryFactory.get return
>new directory for
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1
>forceNew:false
>[junit4:junit4]   2> 2567 T608 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1
>[junit4:junit4]   2> 2567 T608 oasc.SolrCore.getNewIndexDir New index
>directory detected: old=null
>new=./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1/index/
>[junit4:junit4]   2> 2567 T608 oasc.SolrCore.initIndex WARNING
>[collection1] Solr index directory
>'./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1/index'
>doesn't exist. Creating new index...
>[junit4:junit4]   2> 2567 T608 oasc.CachingDirectoryFactory.get return
>new directory for
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1/index
>forceNew:false
>[junit4:junit4]   2> 2570 T608 oasc.SolrDeletionPolicy.onCommit
>SolrDeletionPolicy.onCommit: commits:num=1
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@16dc0ec;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2> 2571 T608 oasc.SolrDeletionPolicy.updateCommits
>newest commit = 1[segments_1]
>[junit4:junit4]   2> 2571 T608 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1/index
>[junit4:junit4]   2> 2571 T608 oasc.SolrCore.initWriters created xml:
>solr.XMLResponseWriter
>[junit4:junit4]   2> 2572 T608 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "dedupe"
>[junit4:junit4]   2> 2573 T608 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "dedupe-allfields"
>[junit4:junit4]   2> 2573 T608 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "stored_sig"
>[junit4:junit4]   2> 2573 T608 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "uniq-fields"
>[junit4:junit4]   2> 2574 T608 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>[junit4:junit4]   2> 2574 T608
>oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
>solr.ReplicationHandler
>[junit4:junit4]   2> 2574 T608
>oasc.RequestHandlers.initHandlersFromConfig created /replication:
>solr.ReplicationHandler
>[junit4:junit4]   2> 2575 T608
>oasc.RequestHandlers.initHandlersFromConfig created standard:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 2575 T608
>oasc.RequestHandlers.initHandlersFromConfig created /get:
>solr.RealTimeGetHandler
>[junit4:junit4]   2> 2576 T608
>oasc.RequestHandlers.initHandlersFromConfig created dismax:
>solr.SearchHandler
>[junit4:junit4]   2> 2576 T608
>oasc.RequestHandlers.initHandlersFromConfig created mock:
>org.apache.solr.core.MockQuerySenderListenerReqHandler
>[junit4:junit4]   2> 2577 T608
>oasc.RequestHandlers.initHandlersFromConfig created /admin/:
>org.apache.solr.handler.admin.AdminHandlers
>[junit4:junit4]   2> 2577 T608
>oasc.RequestHandlers.initHandlersFromConfig created defaults:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 2577 T608
>oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 2578 T608
>oasc.RequestHandlers.initHandlersFromConfig created lazy:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 2578 T608
>oasc.RequestHandlers.initHandlersFromConfig created /update:
>solr.UpdateRequestHandler
>[junit4:junit4]   2> 2579 T608
>oasc.RequestHandlers.initHandlersFromConfig created /terms:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 2580 T608
>oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 2580 T608
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckCompRH_Direct:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 2581 T608
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckWithWordbreak:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 2581 T608
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckWithWordbreak_Direct:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 2582 T608
>oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 2582 T608
>oasc.RequestHandlers.initHandlersFromConfig created tvrh:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 2583 T608
>oasc.RequestHandlers.initHandlersFromConfig created /mlt:
>solr.MoreLikeThisHandler
>[junit4:junit4]   2> 2584 T608
>oasc.RequestHandlers.initHandlersFromConfig created /debug/dump:
>solr.DumpRequestHandler
>[junit4:junit4]   2> 2585 T608 oashl.XMLLoader.init
>xsltCacheLifetimeSeconds=60
>[junit4:junit4]   2> 2587 T608 oasc.SolrCore.initDeprecatedSupport
>WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please
>update your config to use the ShowFileRequestHandler.
>[junit4:junit4]   2> 2588 T608 oasc.SolrCore.initDeprecatedSupport
>WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML,
>OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT,
>OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML,
>MAPPING-ISOLATIN1ACCENT.TXT]
>[junit4:junit4]   2> 2590 T608 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1
>[junit4:junit4]   2> 2590 T608 oass.SolrIndexSearcher.<init> Opening
>Searcher@11fc71 main
>[junit4:junit4]   2> 2591 T608 oasu.CommitTracker.<init> Hard
>AutoCommit: disabled
>[junit4:junit4]   2> 2591 T608 oasu.CommitTracker.<init> Soft
>AutoCommit: disabled
>[junit4:junit4]   2> 2591 T608 oashc.SpellCheckComponent.inform
>Initializing spell checkers
>[junit4:junit4]   2> 2595 T608 oass.DirectSolrSpellChecker.init init:
>{name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
>[junit4:junit4]   2> 2622 T609 oasc.SolrCore.registerSearcher
>[collection1] Registered new searcher Searcher@11fc71
>main{StandardDirectoryReader(segments_1:1)}
>[junit4:junit4]   2> 2626 T608 oasc.ZkController.publish numShards not
>found on descriptor - reading it from system property
>[junit4:junit4]   2> 2976 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 2976 T591
>oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2
>message={
>[junit4:junit4]   2> 	  "operation":"state",
>[junit4:junit4]   2> 	  "numShards":"2",
>[junit4:junit4]   2> 	  "shard":null,
>[junit4:junit4]   2> 	  "roles":null,
>[junit4:junit4]   2> 	  "state":"down",
>[junit4:junit4]   2> 	  "core":"collection1",
>[junit4:junit4]   2> 	  "collection":"collection1",
>[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39991_solr",
>[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39991/solr"}
>[junit4:junit4]   2> 2977 T591
>oasc.Overseer$ClusterStateUpdater.createCollection Create collection
>collection1 with numShards 2
>[junit4:junit4]   2> 2977 T591
>oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to
>shard shard=shard1
>[junit4:junit4]   2> 2980 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (2)
>[junit4:junit4]   2> 2980 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (2)
>[junit4:junit4]   2> 2980 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (2)
>[junit4:junit4]   2> 3127 T608 oasc.CoreContainer.registerCore
>registering core: collection1
>[junit4:junit4]   2> 3128 T608 oasc.ZkController.register Register
>shard - core:collection1 address:http://127.0.0.1:39991/solr
>shardId:shard1
>[junit4:junit4]   2> 3128 T608 oascc.SolrZkClient.makePath makePath:
>/collections/collection1/leader_elect/shard1/election
>[junit4:junit4]   2> 3134 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0004
>type:delete cxid:0x45 zxid:0x58 txntype:-1 reqpath:n/a Error
>Path:/solr/collections/collection1/leaders Error:KeeperErrorCode =
>NoNode for /solr/collections/collection1/leaders
>[junit4:junit4]   2> 3134 T608
>oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader
>process.
>[junit4:junit4]   2> 3135 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0004
>type:create cxid:0x46 zxid:0x59 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 3136 T608
>oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas
>found to continue.
>[junit4:junit4]   2> 3136 T608
>oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new
>leader - try and sync
>[junit4:junit4]   2> 3136 T608 oasc.SyncStrategy.sync Sync replicas to
>http://127.0.0.1:39991/solr/collection1/
>[junit4:junit4]   2> 3137 T608 oasc.SyncStrategy.syncReplicas Sync
>Success - now sync replicas to me
>[junit4:junit4]   2> 3137 T608 oasc.SyncStrategy.syncToMe
>http://127.0.0.1:39991/solr/collection1/ has no replicas
>[junit4:junit4]   2> 3137 T608
>oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
>http://127.0.0.1:39991/solr/collection1/
>[junit4:junit4]   2> 3137 T608 oascc.SolrZkClient.makePath makePath:
>/collections/collection1/leaders/shard1
>[junit4:junit4]   2> 3140 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0004
>type:create cxid:0x50 zxid:0x5d txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 3484 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 3490 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (2)
>[junit4:junit4]   2> 3490 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (2)
>[junit4:junit4]   2> 3490 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (2)
>[junit4:junit4]   2> 3492 T608 oasc.ZkController.register We are
>http://127.0.0.1:39991/solr/collection1/ and leader is
>http://127.0.0.1:39991/solr/collection1/
>[junit4:junit4]   2> 3492 T608 oasc.ZkController.register No LogReplay
>needed for core=collection1 baseURL=http://127.0.0.1:39991/solr
>[junit4:junit4]   2> 3492 T608 oasc.ZkController.checkRecovery I am the
>leader, no recovery necessary
>[junit4:junit4]   2> 3492 T608 oasc.ZkController.publish numShards not
>found on descriptor - reading it from system property
>[junit4:junit4]   2> 3494 T608 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 3494 T570 oass.SolrDispatchFilter.init
>user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>[junit4:junit4]   2> 3495 T570 oass.SolrDispatchFilter.init
>SolrDispatchFilter.init() done
>[junit4:junit4]   2> 3495 T570 oascsi.HttpClientUtil.createClient
>Creating new http client,
>config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
>[junit4:junit4]   2> 3557 T570 oejs.Server.doStart
>jetty-8.1.7.v20120910
>[junit4:junit4]   2> 3559 T570 oejs.AbstractConnector.doStart Started
>SelectChannelConnector@0.0.0.0:49698
>[junit4:junit4]   2> 3560 T570 oasc.SolrResourceLoader.locateSolrHome
>JNDI not configured for solr (NoInitialContextEx)
>[junit4:junit4]   2> 3560 T570 oasc.SolrResourceLoader.locateSolrHome
>using system property solr.solr.home:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354310027216
>[junit4:junit4]   2> 3561 T570 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for deduced Solr Home:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354310027216/'
>[junit4:junit4]   2> 3577 T570 oass.SolrDispatchFilter.init
>SolrDispatchFilter.init()
>[junit4:junit4]   2> 3578 T570 oasc.SolrResourceLoader.locateSolrHome
>JNDI not configured for solr (NoInitialContextEx)
>[junit4:junit4]   2> 3578 T570 oasc.SolrResourceLoader.locateSolrHome
>using system property solr.solr.home:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354310027216
>[junit4:junit4]   2> 3579 T570
>oasc.CoreContainer$Initializer.initialize looking for solr.xml:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354310027216/solr.xml
>[junit4:junit4]   2> 3579 T570 oasc.CoreContainer.<init> New
>CoreContainer 3480126
>[junit4:junit4]   2> 3580 T570 oasc.CoreContainer.load Loading
>CoreContainer using Solr Home:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354310027216/'
>[junit4:junit4]   2> 3580 T570 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for directory:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354310027216/'
>[junit4:junit4]   2> 3592 T570 oasc.CoreContainer.load Registering Log
>Listener
>[junit4:junit4]   2> 3601 T570 oasc.CoreContainer.initZooKeeper
>Zookeeper client=127.0.0.1:55724/solr
>[junit4:junit4]   2> 3602 T570 oaz.ZooKeeper.<init> Initiating client
>connection, connectString=127.0.0.1:55724/solr sessionTimeout=8000
>watcher=org.apache.solr.common.cloud.ConnectionManager@1bc2555
>[junit4:junit4]   2> 3603 T619
>oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to
>server localhost.localdomain/127.0.0.1:55724. Will not attempt to
>authenticate using SASL (access denied
>(javax.security.auth.AuthPermission getLoginConfiguration))
>[junit4:junit4]   2> 3603 T570 oascc.ConnectionManager.waitForConnected
>Waiting for client to connect to ZooKeeper
>[junit4:junit4]   2> 3604 T619
>oaz.ClientCnxn$SendThread.primeConnection Socket connection established
>to localhost.localdomain/127.0.0.1:55724, initiating session
>[junit4:junit4]   2> 3604 T572 oazs.NIOServerCnxnFactory.run Accepted
>socket connection from /127.0.0.1:50362
>[junit4:junit4]   2> 3604 T572
>oazs.ZooKeeperServer.processConnectRequest Client attempting to
>establish new session at /127.0.0.1:50362
>[junit4:junit4]   2> 3605 T574 oazs.ZooKeeperServer.finishSessionInit
>Established session 0x13b532afa2d0005 with negotiated timeout 8000 for
>client /127.0.0.1:50362
>[junit4:junit4]   2> 3605 T619 oaz.ClientCnxn$SendThread.onConnected
>Session establishment complete on server
>localhost.localdomain/127.0.0.1:55724, sessionid = 0x13b532afa2d0005,
>negotiated timeout = 8000
>[junit4:junit4]   2> 3605 T620 oascc.ConnectionManager.process Watcher
>org.apache.solr.common.cloud.ConnectionManager@1bc2555
>name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event
>WatchedEvent state:SyncConnected type:None path:null path:null
>type:None
>[junit4:junit4]   2> 3606 T570 oascc.ConnectionManager.waitForConnected
>Client is connected to ZooKeeper
>[junit4:junit4]   2> 3606 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0005
>type:create cxid:0x1 zxid:0x68 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 3607 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0005
>type:create cxid:0x2 zxid:0x69 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 3608 T570
>oasc.ZkController.createEphemeralLiveNode Register node as live in
>ZooKeeper:/live_nodes/127.0.0.1:49698_solr
>[junit4:junit4]   2> 3609 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0005
>type:delete cxid:0x4 zxid:0x6a txntype:-1 reqpath:n/a Error
>Path:/solr/live_nodes/127.0.0.1:49698_solr Error:KeeperErrorCode =
>NoNode for /solr/live_nodes/127.0.0.1:49698_solr
>[junit4:junit4]   2> 3609 T570 oascc.SolrZkClient.makePath makePath:
>/live_nodes/127.0.0.1:49698_solr
>[junit4:junit4]   2> 3611 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (2)
>[junit4:junit4]   2> 3611 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (2)
>[junit4:junit4]   2> 3611 T607 oascc.ZkStateReader$3.process Updating
>live nodes... (3)
>[junit4:junit4]   2> 3612 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 3612 T590 oascc.ZkStateReader$3.process Updating
>live nodes... (3)
>[junit4:junit4]   2> 3612 T596 oascc.ZkStateReader$3.process Updating
>live nodes... (3)
>[junit4:junit4]   2> 3612 T570
>oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
>[junit4:junit4]   2> 3613 T570
>oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
>http://
>[junit4:junit4]   2> 3613 T570
>oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
>[junit4:junit4]   2> 3613 T570
>oashc.HttpShardHandlerFactory.getParameter Setting
>maxConnectionsPerHost to: 20
>[junit4:junit4]   2> 3614 T570
>oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>[junit4:junit4]   2> 3614 T570
>oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to:
>2147483647
>[junit4:junit4]   2> 3615 T570
>oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime
>to: 5
>[junit4:junit4]   2> 3615 T570
>oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>[junit4:junit4]   2> 3615 T570
>oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to:
>false
>[junit4:junit4]   2> 3616 T570 oascsi.HttpClientUtil.createClient
>Creating new http client,
>config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
>[junit4:junit4]   2> 3622 T570
>oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating
>cluster state from ZooKeeper... 
>[junit4:junit4]   2> 3628 T621 oasc.CoreContainer.create Creating
>SolrCore 'collection1' using instanceDir:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354310027216/collection1
>[junit4:junit4]   2> 3628 T621 oasc.ZkController.createCollectionZkNode
>Check for collection zkNode:collection1
>[junit4:junit4]   2> 3628 T621 oasc.ZkController.createCollectionZkNode
>Collection zkNode exists
>[junit4:junit4]   2> 3629 T621 oasc.ZkController.readConfigName Load
>collection config from:/collections/collection1
>[junit4:junit4]   2> 3630 T621 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for directory:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354310027216/collection1/'
>[junit4:junit4]   2> 3630 T621
>oasc.SolrResourceLoader.replaceClassLoader Adding
>'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354310027216/collection1/lib/README'
>to classloader
>[junit4:junit4]   2> 3630 T621
>oasc.SolrResourceLoader.replaceClassLoader Adding
>'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354310027216/collection1/lib/classes/'
>to classloader
>[junit4:junit4]   2> 3672 T621 oasc.SolrConfig.<init> Using Lucene
>MatchVersion: LUCENE_50
>[junit4:junit4]   2> 3729 T621 oasc.SolrConfig.<init> Loaded
>SolrConfig: solrconfig.xml
>[junit4:junit4]   2> 3730 T621 oass.IndexSchema.readSchema Reading Solr
>Schema
>[junit4:junit4]   2> 3734 T621 oass.IndexSchema.readSchema Schema
>name=test
>[junit4:junit4]   2> 3994 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 3995 T591
>oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2
>message={
>[junit4:junit4]   2> 	  "operation":"state",
>[junit4:junit4]   2> 	  "numShards":"2",
>[junit4:junit4]   2> 	  "shard":"shard1",
>[junit4:junit4]   2> 	  "roles":null,
>[junit4:junit4]   2> 	  "state":"active",
>[junit4:junit4]   2> 	  "core":"collection1",
>[junit4:junit4]   2> 	  "collection":"collection1",
>[junit4:junit4]   2> 	  "node_name":"127.0.0.1:39991_solr",
>[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:39991/solr"}
>[junit4:junit4]   2> 3999 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 3999 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 3999 T620 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 3999 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 4080 T621 oass.OpenExchangeRatesOrgProvider.init
>Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>[junit4:junit4]   2> 4086 T621 oass.IndexSchema.readSchema default
>search field in schema is text
>[junit4:junit4]   2> 4088 T621 oass.IndexSchema.readSchema unique key
>field: id
>[junit4:junit4]   2> 4100 T621 oass.FileExchangeRateProvider.reload
>Reloading exchange rates from file currency.xml
>[junit4:junit4]   2> 4103 T621 oass.FileExchangeRateProvider.reload
>Reloading exchange rates from file currency.xml
>[junit4:junit4]   2> 4106 T621 oass.OpenExchangeRatesOrgProvider.reload
>Reloading exchange rates from open-exchange-rates.json
>[junit4:junit4]   2> 4107 T621 oass.OpenExchangeRatesOrgProvider.reload
>Reloading exchange rates from open-exchange-rates.json
>[junit4:junit4]   2> 4108 T621 oasc.SolrCore.<init> [collection1]
>Opening new SolrCore at
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1354310027216/collection1/,
>dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2/
>[junit4:junit4]   2> 4108 T621 oasc.JmxMonitoredMap.<init> JMX
>monitoring is enabled. Adding Solr mbeans to JMX Server:
>com.sun.jmx.mbeanserver.JmxMBeanServer@302e67
>[junit4:junit4]   2> 4109 T621 oasc.SolrCore.initDirectoryFactory
>solr.NRTCachingDirectoryFactory
>[junit4:junit4]   2> 4109 T621
>oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType
>configured for
>NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@183613e;
>maxCacheMB=48.0 maxMergeSizeMB=4.0) assuming 'simple'
>[junit4:junit4]   2> 4110 T621 oasc.CachingDirectoryFactory.get return
>new directory for
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2
>forceNew:false
>[junit4:junit4]   2> 4110 T621 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2
>[junit4:junit4]   2> 4110 T621 oasc.SolrCore.getNewIndexDir New index
>directory detected: old=null
>new=./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2/index/
>[junit4:junit4]   2> 4110 T621 oasc.SolrCore.initIndex WARNING
>[collection1] Solr index directory
>'./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2/index'
>doesn't exist. Creating new index...
>[junit4:junit4]   2> 4111 T621 oasc.CachingDirectoryFactory.get return
>new directory for
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2/index
>forceNew:false
>[junit4:junit4]   2> 4115 T621 oasc.SolrDeletionPolicy.onCommit
>SolrDeletionPolicy.onCommit: commits:num=1
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@b0d5f5;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2> 4115 T621 oasc.SolrDeletionPolicy.updateCommits
>newest commit = 1[segments_1]
>[junit4:junit4]   2> 4115 T621 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2/index
>[junit4:junit4]   2> 4116 T621 oasc.SolrCore.initWriters created xml:
>solr.XMLResponseWriter
>[junit4:junit4]   2> 4117 T621 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "dedupe"
>[junit4:junit4]   2> 4117 T621 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "dedupe-allfields"
>[junit4:junit4]   2> 4117 T621 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "stored_sig"
>[junit4:junit4]   2> 4117 T621 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "uniq-fields"
>[junit4:junit4]   2> 4118 T621 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>[junit4:junit4]   2> 4118 T621
>oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
>solr.ReplicationHandler
>[junit4:junit4]   2> 4118 T621
>oasc.RequestHandlers.initHandlersFromConfig created /replication:
>solr.ReplicationHandler
>[junit4:junit4]   2> 4119 T621
>oasc.RequestHandlers.initHandlersFromConfig created standard:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 4119 T621
>oasc.RequestHandlers.initHandlersFromConfig created /get:
>solr.RealTimeGetHandler
>[junit4:junit4]   2> 4120 T621
>oasc.RequestHandlers.initHandlersFromConfig created dismax:
>solr.SearchHandler
>[junit4:junit4]   2> 4121 T621
>oasc.RequestHandlers.initHandlersFromConfig created mock:
>org.apache.solr.core.MockQuerySenderListenerReqHandler
>[junit4:junit4]   2> 4121 T621
>oasc.RequestHandlers.initHandlersFromConfig created /admin/:
>org.apache.solr.handler.admin.AdminHandlers
>[junit4:junit4]   2> 4122 T621
>oasc.RequestHandlers.initHandlersFromConfig created defaults:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 4122 T621
>oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 4122 T621
>oasc.RequestHandlers.initHandlersFromConfig created lazy:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 4123 T621
>oasc.RequestHandlers.initHandlersFromConfig created /update:
>solr.UpdateRequestHandler
>[junit4:junit4]   2> 4123 T621
>oasc.RequestHandlers.initHandlersFromConfig created /terms:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 4124 T621
>oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 4124 T621
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckCompRH_Direct:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 4125 T621
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckWithWordbreak:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 4125 T621
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckWithWordbreak_Direct:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 4126 T621
>oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 4127 T621
>oasc.RequestHandlers.initHandlersFromConfig created tvrh:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 4127 T621
>oasc.RequestHandlers.initHandlersFromConfig created /mlt:
>solr.MoreLikeThisHandler
>[junit4:junit4]   2> 4128 T621
>oasc.RequestHandlers.initHandlersFromConfig created /debug/dump:
>solr.DumpRequestHandler
>[junit4:junit4]   2> 4130 T621 oashl.XMLLoader.init
>xsltCacheLifetimeSeconds=60
>[junit4:junit4]   2> 4131 T621 oasc.SolrCore.initDeprecatedSupport
>WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please
>update your config to use the ShowFileRequestHandler.
>[junit4:junit4]   2> 4132 T621 oasc.SolrCore.initDeprecatedSupport
>WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML,
>OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT,
>OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML,
>MAPPING-ISOLATIN1ACCENT.TXT]
>[junit4:junit4]   2> 4134 T621 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2
>[junit4:junit4]   2> 4134 T621 oass.SolrIndexSearcher.<init> Opening
>Searcher@181c776 main
>[junit4:junit4]   2> 4135 T621 oasu.CommitTracker.<init> Hard
>AutoCommit: disabled
>[junit4:junit4]   2> 4135 T621 oasu.CommitTracker.<init> Soft
>AutoCommit: disabled
>[junit4:junit4]   2> 4136 T621 oashc.SpellCheckComponent.inform
>Initializing spell checkers
>[junit4:junit4]   2> 4138 T621 oass.DirectSolrSpellChecker.init init:
>{name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
>[junit4:junit4]   2> 4163 T622 oasc.SolrCore.registerSearcher
>[collection1] Registered new searcher Searcher@181c776
>main{StandardDirectoryReader(segments_1:1)}
>[junit4:junit4]   2> 4166 T621 oasc.ZkController.publish numShards not
>found on descriptor - reading it from system property
>[junit4:junit4]   2> 4503 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 4503 T591
>oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2
>message={
>[junit4:junit4]   2> 	  "operation":"state",
>[junit4:junit4]   2> 	  "numShards":"2",
>[junit4:junit4]   2> 	  "shard":null,
>[junit4:junit4]   2> 	  "roles":null,
>[junit4:junit4]   2> 	  "state":"down",
>[junit4:junit4]   2> 	  "core":"collection1",
>[junit4:junit4]   2> 	  "collection":"collection1",
>[junit4:junit4]   2> 	  "node_name":"127.0.0.1:49698_solr",
>[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:49698/solr"}
>[junit4:junit4]   2> 4504 T591
>oasc.Overseer$ClusterStateUpdater.updateState Collection already exists
>with numShards=2
>[junit4:junit4]   2> 4504 T591
>oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to
>shard shard=shard2
>[junit4:junit4]   2> 4507 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 4507 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 4507 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 4507 T620 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 4667 T621 oasc.CoreContainer.registerCore
>registering core: collection1
>[junit4:junit4]   2> 4668 T621 oasc.ZkController.register Register
>shard - core:collection1 address:http://127.0.0.1:49698/solr
>shardId:shard2
>[junit4:junit4]   2> 4668 T621 oascc.SolrZkClient.makePath makePath:
>/collections/collection1/leader_elect/shard2/election
>[junit4:junit4]   2> 4673 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0005
>type:delete cxid:0x44 zxid:0x79 txntype:-1 reqpath:n/a Error
>Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode
>= NoNode for /solr/collections/collection1/leaders/shard2
>[junit4:junit4]   2> 4674 T621
>oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader
>process.
>[junit4:junit4]   2> 4674 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0005
>type:create cxid:0x45 zxid:0x7a txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 4676 T621
>oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas
>found to continue.
>[junit4:junit4]   2> 4676 T621
>oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new
>leader - try and sync
>[junit4:junit4]   2> 4676 T621 oasc.SyncStrategy.sync Sync replicas to
>http://127.0.0.1:49698/solr/collection1/
>[junit4:junit4]   2> 4676 T621 oasc.SyncStrategy.syncReplicas Sync
>Success - now sync replicas to me
>[junit4:junit4]   2> 4676 T621 oasc.SyncStrategy.syncToMe
>http://127.0.0.1:49698/solr/collection1/ has no replicas
>[junit4:junit4]   2> 4677 T621
>oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
>http://127.0.0.1:49698/solr/collection1/
>[junit4:junit4]   2> 4677 T621 oascc.SolrZkClient.makePath makePath:
>/collections/collection1/leaders/shard2
>[junit4:junit4]   2> 4679 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0005
>type:create cxid:0x4e zxid:0x7d txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 5011 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 5019 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 5019 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 5019 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 5019 T620 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 5032 T621 oasc.ZkController.register We are
>http://127.0.0.1:49698/solr/collection1/ and leader is
>http://127.0.0.1:49698/solr/collection1/
>[junit4:junit4]   2> 5032 T621 oasc.ZkController.register No LogReplay
>needed for core=collection1 baseURL=http://127.0.0.1:49698/solr
>[junit4:junit4]   2> 5032 T621 oasc.ZkController.checkRecovery I am the
>leader, no recovery necessary
>[junit4:junit4]   2> 5032 T621 oasc.ZkController.publish numShards not
>found on descriptor - reading it from system property
>[junit4:junit4]   2> 5034 T621 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 5034 T570 oass.SolrDispatchFilter.init
>user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>[junit4:junit4]   2> 5035 T570 oass.SolrDispatchFilter.init
>SolrDispatchFilter.init() done
>[junit4:junit4]   2> 5035 T570 oascsi.HttpClientUtil.createClient
>Creating new http client,
>config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
>[junit4:junit4]   2> 5105 T570 oejs.Server.doStart
>jetty-8.1.7.v20120910
>[junit4:junit4]   2> 5108 T570 oejs.AbstractConnector.doStart Started
>SelectChannelConnector@0.0.0.0:60865
>[junit4:junit4]   2> 5109 T570 oasc.SolrResourceLoader.locateSolrHome
>JNDI not configured for solr (NoInitialContextEx)
>[junit4:junit4]   2> 5109 T570 oasc.SolrResourceLoader.locateSolrHome
>using system property solr.solr.home:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354310028756
>[junit4:junit4]   2> 5110 T570 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for deduced Solr Home:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354310028756/'
>[junit4:junit4]   2> 5126 T570 oass.SolrDispatchFilter.init
>SolrDispatchFilter.init()
>[junit4:junit4]   2> 5127 T570 oasc.SolrResourceLoader.locateSolrHome
>JNDI not configured for solr (NoInitialContextEx)
>[junit4:junit4]   2> 5128 T570 oasc.SolrResourceLoader.locateSolrHome
>using system property solr.solr.home:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354310028756
>[junit4:junit4]   2> 5128 T570
>oasc.CoreContainer$Initializer.initialize looking for solr.xml:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354310028756/solr.xml
>[junit4:junit4]   2> 5129 T570 oasc.CoreContainer.<init> New
>CoreContainer 21662488
>[junit4:junit4]   2> 5129 T570 oasc.CoreContainer.load Loading
>CoreContainer using Solr Home:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354310028756/'
>[junit4:junit4]   2> 5130 T570 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for directory:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354310028756/'
>[junit4:junit4]   2> 5147 T570 oasc.CoreContainer.load Registering Log
>Listener
>[junit4:junit4]   2> 5161 T570 oasc.CoreContainer.initZooKeeper
>Zookeeper client=127.0.0.1:55724/solr
>[junit4:junit4]   2> 5161 T570 oaz.ZooKeeper.<init> Initiating client
>connection, connectString=127.0.0.1:55724/solr sessionTimeout=8000
>watcher=org.apache.solr.common.cloud.ConnectionManager@17f8b39
>[junit4:junit4]   2> 5163 T632
>oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to
>server localhost.localdomain/127.0.0.1:55724. Will not attempt to
>authenticate using SASL (access denied
>(javax.security.auth.AuthPermission getLoginConfiguration))
>[junit4:junit4]   2> 5163 T570 oascc.ConnectionManager.waitForConnected
>Waiting for client to connect to ZooKeeper
>[junit4:junit4]   2> 5163 T632
>oaz.ClientCnxn$SendThread.primeConnection Socket connection established
>to localhost.localdomain/127.0.0.1:55724, initiating session
>[junit4:junit4]   2> 5163 T572 oazs.NIOServerCnxnFactory.run Accepted
>socket connection from /127.0.0.1:50364
>[junit4:junit4]   2> 5164 T572
>oazs.ZooKeeperServer.processConnectRequest Client attempting to
>establish new session at /127.0.0.1:50364
>[junit4:junit4]   2> 5164 T574 oazs.ZooKeeperServer.finishSessionInit
>Established session 0x13b532afa2d0006 with negotiated timeout 8000 for
>client /127.0.0.1:50364
>[junit4:junit4]   2> 5164 T632 oaz.ClientCnxn$SendThread.onConnected
>Session establishment complete on server
>localhost.localdomain/127.0.0.1:55724, sessionid = 0x13b532afa2d0006,
>negotiated timeout = 8000
>[junit4:junit4]   2> 5165 T633 oascc.ConnectionManager.process Watcher
>org.apache.solr.common.cloud.ConnectionManager@17f8b39
>name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event
>WatchedEvent state:SyncConnected type:None path:null path:null
>type:None
>[junit4:junit4]   2> 5165 T570 oascc.ConnectionManager.waitForConnected
>Client is connected to ZooKeeper
>[junit4:junit4]   2> 5166 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0006
>type:create cxid:0x1 zxid:0x88 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 5167 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0006
>type:create cxid:0x2 zxid:0x89 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 5167 T570
>oasc.ZkController.createEphemeralLiveNode Register node as live in
>ZooKeeper:/live_nodes/127.0.0.1:60865_solr
>[junit4:junit4]   2> 5168 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0006
>type:delete cxid:0x4 zxid:0x8a txntype:-1 reqpath:n/a Error
>Path:/solr/live_nodes/127.0.0.1:60865_solr Error:KeeperErrorCode =
>NoNode for /solr/live_nodes/127.0.0.1:60865_solr
>[junit4:junit4]   2> 5169 T570 oascc.SolrZkClient.makePath makePath:
>/live_nodes/127.0.0.1:60865_solr
>[junit4:junit4]   2> 5171 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 5171 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (3)
>[junit4:junit4]   2> 5172 T620 oascc.ZkStateReader$3.process Updating
>live nodes... (4)
>[junit4:junit4]   2> 5172 T607 oascc.ZkStateReader$3.process Updating
>live nodes... (4)
>[junit4:junit4]   2> 5172 T620 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 5172 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 5173 T596 oascc.ZkStateReader$3.process Updating
>live nodes... (4)
>[junit4:junit4]   2> 5173 T570
>oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
>[junit4:junit4]   2> 5173 T590 oascc.ZkStateReader$3.process Updating
>live nodes... (4)
>[junit4:junit4]   2> 5174 T570
>oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
>http://
>[junit4:junit4]   2> 5174 T570
>oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
>[junit4:junit4]   2> 5175 T570
>oashc.HttpShardHandlerFactory.getParameter Setting
>maxConnectionsPerHost to: 20
>[junit4:junit4]   2> 5175 T570
>oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>[junit4:junit4]   2> 5176 T570
>oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to:
>2147483647
>[junit4:junit4]   2> 5176 T570
>oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime
>to: 5
>[junit4:junit4]   2> 5177 T570
>oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>[junit4:junit4]   2> 5177 T570
>oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to:
>false
>[junit4:junit4]   2> 5178 T570 oascsi.HttpClientUtil.createClient
>Creating new http client,
>config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
>[junit4:junit4]   2> 5185 T570
>oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating
>cluster state from ZooKeeper... 
>[junit4:junit4]   2> 5191 T634 oasc.CoreContainer.create Creating
>SolrCore 'collection1' using instanceDir:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354310028756/collection1
>[junit4:junit4]   2> 5193 T634 oasc.ZkController.createCollectionZkNode
>Check for collection zkNode:collection1
>[junit4:junit4]   2> 5194 T634 oasc.ZkController.createCollectionZkNode
>Collection zkNode exists
>[junit4:junit4]   2> 5194 T634 oasc.ZkController.readConfigName Load
>collection config from:/collections/collection1
>[junit4:junit4]   2> 5195 T634 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for directory:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354310028756/collection1/'
>[junit4:junit4]   2> 5195 T634
>oasc.SolrResourceLoader.replaceClassLoader Adding
>'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354310028756/collection1/lib/README'
>to classloader
>[junit4:junit4]   2> 5195 T634
>oasc.SolrResourceLoader.replaceClassLoader Adding
>'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354310028756/collection1/lib/classes/'
>to classloader
>[junit4:junit4]   2> 5223 T634 oasc.SolrConfig.<init> Using Lucene
>MatchVersion: LUCENE_50
>[junit4:junit4]   2> 5268 T634 oasc.SolrConfig.<init> Loaded
>SolrConfig: solrconfig.xml
>[junit4:junit4]   2> 5270 T634 oass.IndexSchema.readSchema Reading Solr
>Schema
>[junit4:junit4]   2> 5274 T634 oass.IndexSchema.readSchema Schema
>name=test
>[junit4:junit4]   2> 5524 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 5525 T591
>oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2
>message={
>[junit4:junit4]   2> 	  "operation":"state",
>[junit4:junit4]   2> 	  "numShards":"2",
>[junit4:junit4]   2> 	  "shard":"shard2",
>[junit4:junit4]   2> 	  "roles":null,
>[junit4:junit4]   2> 	  "state":"active",
>[junit4:junit4]   2> 	  "core":"collection1",
>[junit4:junit4]   2> 	  "collection":"collection1",
>[junit4:junit4]   2> 	  "node_name":"127.0.0.1:49698_solr",
>[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:49698/solr"}
>[junit4:junit4]   2> 5527 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 5528 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 5528 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 5528 T620 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 5528 T633 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 5612 T634 oass.OpenExchangeRatesOrgProvider.init
>Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>[junit4:junit4]   2> 5618 T634 oass.IndexSchema.readSchema default
>search field in schema is text
>[junit4:junit4]   2> 5620 T634 oass.IndexSchema.readSchema unique key
>field: id
>[junit4:junit4]   2> 5632 T634 oass.FileExchangeRateProvider.reload
>Reloading exchange rates from file currency.xml
>[junit4:junit4]   2> 5635 T634 oass.FileExchangeRateProvider.reload
>Reloading exchange rates from file currency.xml
>[junit4:junit4]   2> 5638 T634 oass.OpenExchangeRatesOrgProvider.reload
>Reloading exchange rates from open-exchange-rates.json
>[junit4:junit4]   2> 5639 T634 oass.OpenExchangeRatesOrgProvider.reload
>Reloading exchange rates from open-exchange-rates.json
>[junit4:junit4]   2> 5640 T634 oasc.SolrCore.<init> [collection1]
>Opening new SolrCore at
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1354310028756/collection1/,
>dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3/
>[junit4:junit4]   2> 5640 T634 oasc.JmxMonitoredMap.<init> JMX
>monitoring is enabled. Adding Solr mbeans to JMX Server:
>com.sun.jmx.mbeanserver.JmxMBeanServer@302e67
>[junit4:junit4]   2> 5641 T634 oasc.SolrCore.initDirectoryFactory
>solr.NRTCachingDirectoryFactory
>[junit4:junit4]   2> 5641 T634
>oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType
>configured for
>NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@f00b24;
>maxCacheMB=48.0 maxMergeSizeMB=4.0) assuming 'simple'
>[junit4:junit4]   2> 5641 T634 oasc.CachingDirectoryFactory.get return
>new directory for
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3
>forceNew:false
>[junit4:junit4]   2> 5642 T634 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3
>[junit4:junit4]   2> 5642 T634 oasc.SolrCore.getNewIndexDir New index
>directory detected: old=null
>new=./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3/index/
>[junit4:junit4]   2> 5642 T634 oasc.SolrCore.initIndex WARNING
>[collection1] Solr index directory
>'./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3/index'
>doesn't exist. Creating new index...
>[junit4:junit4]   2> 5642 T634 oasc.CachingDirectoryFactory.get return
>new directory for
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3/index
>forceNew:false
>[junit4:junit4]   2> 5645 T634 oasc.SolrDeletionPolicy.onCommit
>SolrDeletionPolicy.onCommit: commits:num=1
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@165ab10;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2> 5645 T634 oasc.SolrDeletionPolicy.updateCommits
>newest commit = 1[segments_1]
>[junit4:junit4]   2> 5646 T634 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3/index
>[junit4:junit4]   2> 5646 T634 oasc.SolrCore.initWriters created xml:
>solr.XMLResponseWriter
>[junit4:junit4]   2> 5647 T634 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "dedupe"
>[junit4:junit4]   2> 5647 T634 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "dedupe-allfields"
>[junit4:junit4]   2> 5648 T634 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "stored_sig"
>[junit4:junit4]   2> 5648 T634 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "uniq-fields"
>[junit4:junit4]   2> 5648 T634 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>[junit4:junit4]   2> 5648 T634
>oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
>solr.ReplicationHandler
>[junit4:junit4]   2> 5649 T634
>oasc.RequestHandlers.initHandlersFromConfig created /replication:
>solr.ReplicationHandler
>[junit4:junit4]   2> 5649 T634
>oasc.RequestHandlers.initHandlersFromConfig created standard:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 5650 T634
>oasc.RequestHandlers.initHandlersFromConfig created /get:
>solr.RealTimeGetHandler
>[junit4:junit4]   2> 5651 T634
>oasc.RequestHandlers.initHandlersFromConfig created dismax:
>solr.SearchHandler
>[junit4:junit4]   2> 5651 T634
>oasc.RequestHandlers.initHandlersFromConfig created mock:
>org.apache.solr.core.MockQuerySenderListenerReqHandler
>[junit4:junit4]   2> 5652 T634
>oasc.RequestHandlers.initHandlersFromConfig created /admin/:
>org.apache.solr.handler.admin.AdminHandlers
>[junit4:junit4]   2> 5652 T634
>oasc.RequestHandlers.initHandlersFromConfig created defaults:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 5652 T634
>oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 5652 T634
>oasc.RequestHandlers.initHandlersFromConfig created lazy:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 5653 T634
>oasc.RequestHandlers.initHandlersFromConfig created /update:
>solr.UpdateRequestHandler
>[junit4:junit4]   2> 5654 T634
>oasc.RequestHandlers.initHandlersFromConfig created /terms:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 5654 T634
>oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 5655 T634
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckCompRH_Direct:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 5655 T634
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckWithWordbreak:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 5656 T634
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckWithWordbreak_Direct:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 5657 T634
>oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 5657 T634
>oasc.RequestHandlers.initHandlersFromConfig created tvrh:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 5658 T634
>oasc.RequestHandlers.initHandlersFromConfig created /mlt:
>solr.MoreLikeThisHandler
>[junit4:junit4]   2> 5658 T634
>oasc.RequestHandlers.initHandlersFromConfig created /debug/dump:
>solr.DumpRequestHandler
>[junit4:junit4]   2> 5660 T634 oashl.XMLLoader.init
>xsltCacheLifetimeSeconds=60
>[junit4:junit4]   2> 5662 T634 oasc.SolrCore.initDeprecatedSupport
>WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please
>update your config to use the ShowFileRequestHandler.
>[junit4:junit4]   2> 5663 T634 oasc.SolrCore.initDeprecatedSupport
>WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML,
>OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT,
>OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML,
>MAPPING-ISOLATIN1ACCENT.TXT]
>[junit4:junit4]   2> 5665 T634 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3
>[junit4:junit4]   2> 5665 T634 oass.SolrIndexSearcher.<init> Opening
>Searcher@2308d2 main
>[junit4:junit4]   2> 5666 T634 oasu.CommitTracker.<init> Hard
>AutoCommit: disabled
>[junit4:junit4]   2> 5666 T634 oasu.CommitTracker.<init> Soft
>AutoCommit: disabled
>[junit4:junit4]   2> 5666 T634 oashc.SpellCheckComponent.inform
>Initializing spell checkers
>[junit4:junit4]   2> 5669 T634 oass.DirectSolrSpellChecker.init init:
>{name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
>[junit4:junit4]   2> 5695 T635 oasc.SolrCore.registerSearcher
>[collection1] Registered new searcher Searcher@2308d2
>main{StandardDirectoryReader(segments_1:1)}
>[junit4:junit4]   2> 5698 T634 oasc.ZkController.publish numShards not
>found on descriptor - reading it from system property
>[junit4:junit4]   2> 6032 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 6033 T591
>oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2
>message={
>[junit4:junit4]   2> 	  "operation":"state",
>[junit4:junit4]   2> 	  "numShards":"2",
>[junit4:junit4]   2> 	  "shard":null,
>[junit4:junit4]   2> 	  "roles":null,
>[junit4:junit4]   2> 	  "state":"down",
>[junit4:junit4]   2> 	  "core":"collection1",
>[junit4:junit4]   2> 	  "collection":"collection1",
>[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60865_solr",
>[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60865/solr"}
>[junit4:junit4]   2> 6033 T591
>oasc.Overseer$ClusterStateUpdater.updateState Collection already exists
>with numShards=2
>[junit4:junit4]   2> 6033 T591
>oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to
>shard shard=shard1
>[junit4:junit4]   2> 6036 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 6036 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 6036 T633 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 6036 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 6037 T620 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 6200 T634 oasc.CoreContainer.registerCore
>registering core: collection1
>[junit4:junit4]   2> 6200 T634 oasc.ZkController.register Register
>shard - core:collection1 address:http://127.0.0.1:60865/solr
>shardId:shard1
>[junit4:junit4]   2> 6203 T634 oasc.ZkController.register We are
>http://127.0.0.1:60865/solr/collection1/ and leader is
>http://127.0.0.1:39991/solr/collection1/
>[junit4:junit4]   2> 6203 T634 oasc.ZkController.register No LogReplay
>needed for core=collection1 baseURL=http://127.0.0.1:60865/solr
>[junit4:junit4]   2> 6204 T634 oasc.ZkController.checkRecovery Core
>needs to recover:collection1
>[junit4:junit4]   2> 6204 T634 oasu.DefaultSolrCoreState.doRecovery
>Running recovery - first canceling any ongoing recovery
>[junit4:junit4]   2> ASYNC  NEW_CORE C27 name=collection1
>org.apache.solr.core.SolrCore@11389e7
>url=http://127.0.0.1:60865/solr/collection1 node=127.0.0.1:60865_solr
>[junit4:junit4]   2> 6204 T636 C27 P60865 oasc.RecoveryStrategy.run
>Starting recovery process.  core=collection1
>recoveringAfterStartup=true
>[junit4:junit4]   2> 6204 T634 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 6205 T636 C27 P60865
>oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
>[junit4:junit4]   2> 6205 T636 C27 P60865 oasc.ZkController.publish
>numShards not found on descriptor - reading it from system property
>[junit4:junit4]   2> 6205 T570 oass.SolrDispatchFilter.init
>user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>[junit4:junit4]   2> 6206 T636 C27 P60865
>oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from
>http://127.0.0.1:39991/solr/collection1/ core=collection1 -
>recoveringAfterStartup=true
>[junit4:junit4]   2> 6206 T570 oass.SolrDispatchFilter.init
>SolrDispatchFilter.init() done
>[junit4:junit4]   2> 6206 T636 C27 P60865 oasu.PeerSync.sync PeerSync:
>core=collection1 url=http://127.0.0.1:60865/solr START
>replicas=[http://127.0.0.1:39991/solr/collection1/] nUpdates=100
>[junit4:junit4]   2> 6206 T636 C27 P60865 oasu.PeerSync.sync WARNING no
>frame of reference to tell of we've missed updates
>[junit4:junit4]   2> 6206 T570 oascsi.HttpClientUtil.createClient
>Creating new http client,
>config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
>[junit4:junit4]   2> 6207 T636 C27 P60865
>oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful -
>trying replication. core=collection1
>[junit4:junit4]   2> 6207 T636 C27 P60865
>oasc.RecoveryStrategy.doRecovery Starting Replication Recovery.
>core=collection1
>[junit4:junit4]   2> 6207 T636 C27 P60865
>oascsi.HttpClientUtil.createClient Creating new http client,
>config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
>[junit4:junit4]   2> ASYNC  NEW_CORE C28 name=collection1
>org.apache.solr.core.SolrCore@1815b02
>url=http://127.0.0.1:39991/solr/collection1 node=127.0.0.1:39991_solr
>[junit4:junit4]   2> 6211 T603 C28 P39991 REQ /get
>{distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0
>QTime=0 
>[junit4:junit4]   2> 6258 T570 oejs.Server.doStart
>jetty-8.1.7.v20120910
>[junit4:junit4]   2> 6260 T570 oejs.AbstractConnector.doStart Started
>SelectChannelConnector@0.0.0.0:41029
>[junit4:junit4]   2> 6261 T570 oasc.SolrResourceLoader.locateSolrHome
>JNDI not configured for solr (NoInitialContextEx)
>[junit4:junit4]   2> 6261 T570 oasc.SolrResourceLoader.locateSolrHome
>using system property solr.solr.home:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354310029929
>[junit4:junit4]   2> 6262 T570 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for deduced Solr Home:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354310029929/'
>[junit4:junit4]   2> 6273 T570 oass.SolrDispatchFilter.init
>SolrDispatchFilter.init()
>[junit4:junit4]   2> 6273 T570 oasc.SolrResourceLoader.locateSolrHome
>JNDI not configured for solr (NoInitialContextEx)
>[junit4:junit4]   2> 6274 T570 oasc.SolrResourceLoader.locateSolrHome
>using system property solr.solr.home:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354310029929
>[junit4:junit4]   2> 6274 T570
>oasc.CoreContainer$Initializer.initialize looking for solr.xml:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354310029929/solr.xml
>[junit4:junit4]   2> 6274 T570 oasc.CoreContainer.<init> New
>CoreContainer 17784358
>[junit4:junit4]   2> 6275 T570 oasc.CoreContainer.load Loading
>CoreContainer using Solr Home:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354310029929/'
>[junit4:junit4]   2> 6275 T570 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for directory:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354310029929/'
>[junit4:junit4]   2> 6287 T570 oasc.CoreContainer.load Registering Log
>Listener
>[junit4:junit4]   2> 6297 T570 oasc.CoreContainer.initZooKeeper
>Zookeeper client=127.0.0.1:55724/solr
>[junit4:junit4]   2> 6298 T570 oaz.ZooKeeper.<init> Initiating client
>connection, connectString=127.0.0.1:55724/solr sessionTimeout=8000
>watcher=org.apache.solr.common.cloud.ConnectionManager@17dfa7c
>[junit4:junit4]   2> 6299 T647
>oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to
>server localhost.localdomain/127.0.0.1:55724. Will not attempt to
>authenticate using SASL (access denied
>(javax.security.auth.AuthPermission getLoginConfiguration))
>[junit4:junit4]   2> 6299 T570 oascc.ConnectionManager.waitForConnected
>Waiting for client to connect to ZooKeeper
>[junit4:junit4]   2> 6299 T647
>oaz.ClientCnxn$SendThread.primeConnection Socket connection established
>to localhost.localdomain/127.0.0.1:55724, initiating session
>[junit4:junit4]   2> 6300 T572 oazs.NIOServerCnxnFactory.run Accepted
>socket connection from /127.0.0.1:50367
>[junit4:junit4]   2> 6300 T572
>oazs.ZooKeeperServer.processConnectRequest Client attempting to
>establish new session at /127.0.0.1:50367
>[junit4:junit4]   2> 6301 T574 oazs.ZooKeeperServer.finishSessionInit
>Established session 0x13b532afa2d0007 with negotiated timeout 8000 for
>client /127.0.0.1:50367
>[junit4:junit4]   2> 6301 T647 oaz.ClientCnxn$SendThread.onConnected
>Session establishment complete on server
>localhost.localdomain/127.0.0.1:55724, sessionid = 0x13b532afa2d0007,
>negotiated timeout = 8000
>[junit4:junit4]   2> 6301 T648 oascc.ConnectionManager.process Watcher
>org.apache.solr.common.cloud.ConnectionManager@17dfa7c
>name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event
>WatchedEvent state:SyncConnected type:None path:null path:null
>type:None
>[junit4:junit4]   2> 6301 T570 oascc.ConnectionManager.waitForConnected
>Client is connected to ZooKeeper
>[junit4:junit4]   2> 6302 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0007
>type:create cxid:0x1 zxid:0x99 txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 6303 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0007
>type:create cxid:0x2 zxid:0x9a txntype:-1 reqpath:n/a Error
>Path:/solr/overseer Error:KeeperErrorCode = NodeExists for
>/solr/overseer
>[junit4:junit4]   2> 6304 T570
>oasc.ZkController.createEphemeralLiveNode Register node as live in
>ZooKeeper:/live_nodes/127.0.0.1:41029_solr
>[junit4:junit4]   2> 6305 T575 oazs.PrepRequestProcessor.pRequest Got
>user-level KeeperException when processing sessionid:0x13b532afa2d0007
>type:delete cxid:0x4 zxid:0x9b txntype:-1 reqpath:n/a Error
>Path:/solr/live_nodes/127.0.0.1:41029_solr Error:KeeperErrorCode =
>NoNode for /solr/live_nodes/127.0.0.1:41029_solr
>[junit4:junit4]   2> 6305 T570 oascc.SolrZkClient.makePath makePath:
>/live_nodes/127.0.0.1:41029_solr
>[junit4:junit4]   2> 6307 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 6307 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (4)
>[junit4:junit4]   2> 6307 T620 oascc.ZkStateReader$3.process Updating
>live nodes... (5)
>[junit4:junit4]   2> 6307 T633 oascc.ZkStateReader$3.process Updating
>live nodes... (5)
>[junit4:junit4]   2> 6307 T620 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 6308 T633 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 6308 T607 oascc.ZkStateReader$3.process Updating
>live nodes... (5)
>[junit4:junit4]   2> 6308 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 6309 T590 oascc.ZkStateReader$3.process Updating
>live nodes... (5)
>[junit4:junit4]   2> 6309 T596 oascc.ZkStateReader$3.process Updating
>live nodes... (5)
>[junit4:junit4]   2> 6309 T570
>oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
>[junit4:junit4]   2> 6309 T570
>oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
>http://
>[junit4:junit4]   2> 6310 T570
>oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
>[junit4:junit4]   2> 6310 T570
>oashc.HttpShardHandlerFactory.getParameter Setting
>maxConnectionsPerHost to: 20
>[junit4:junit4]   2> 6310 T570
>oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>[junit4:junit4]   2> 6311 T570
>oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to:
>2147483647
>[junit4:junit4]   2> 6311 T570
>oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime
>to: 5
>[junit4:junit4]   2> 6311 T570
>oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>[junit4:junit4]   2> 6312 T570
>oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to:
>false
>[junit4:junit4]   2> 6312 T570 oascsi.HttpClientUtil.createClient
>Creating new http client,
>config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
>[junit4:junit4]   2> 6317 T570
>oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating
>cluster state from ZooKeeper... 
>[junit4:junit4]   2> 6322 T649 oasc.CoreContainer.create Creating
>SolrCore 'collection1' using instanceDir:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354310029929/collection1
>[junit4:junit4]   2> 6323 T649 oasc.ZkController.createCollectionZkNode
>Check for collection zkNode:collection1
>[junit4:junit4]   2> 6323 T649 oasc.ZkController.createCollectionZkNode
>Collection zkNode exists
>[junit4:junit4]   2> 6324 T649 oasc.ZkController.readConfigName Load
>collection config from:/collections/collection1
>[junit4:junit4]   2> 6325 T649 oasc.SolrResourceLoader.<init> new
>SolrResourceLoader for directory:
>'/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354310029929/collection1/'
>[junit4:junit4]   2> 6325 T649
>oasc.SolrResourceLoader.replaceClassLoader Adding
>'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354310029929/collection1/lib/README'
>to classloader
>[junit4:junit4]   2> 6325 T649
>oasc.SolrResourceLoader.replaceClassLoader Adding
>'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354310029929/collection1/lib/classes/'
>to classloader
>[junit4:junit4]   2> 6353 T649 oasc.SolrConfig.<init> Using Lucene
>MatchVersion: LUCENE_50
>[junit4:junit4]   2> 6393 T649 oasc.SolrConfig.<init> Loaded
>SolrConfig: solrconfig.xml
>[junit4:junit4]   2> 6394 T649 oass.IndexSchema.readSchema Reading Solr
>Schema
>[junit4:junit4]   2> 6399 T649 oass.IndexSchema.readSchema Schema
>name=test
>[junit4:junit4]   2> 6540 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 6541 T591
>oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2
>message={
>[junit4:junit4]   2> 	  "operation":"state",
>[junit4:junit4]   2> 	  "numShards":"2",
>[junit4:junit4]   2> 	  "shard":"shard1",
>[junit4:junit4]   2> 	  "roles":null,
>[junit4:junit4]   2> 	  "state":"recovering",
>[junit4:junit4]   2> 	  "core":"collection1",
>[junit4:junit4]   2> 	  "collection":"collection1",
>[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60865_solr",
>[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60865/solr"}
>[junit4:junit4]   2> 6544 T648 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 6544 T633 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 6545 T620 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 6544 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 6545 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 6545 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 6761 T649 oass.OpenExchangeRatesOrgProvider.init
>Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>[junit4:junit4]   2> 6770 T649 oass.IndexSchema.readSchema default
>search field in schema is text
>[junit4:junit4]   2> 6774 T649 oass.IndexSchema.readSchema unique key
>field: id
>[junit4:junit4]   2> 6787 T649 oass.FileExchangeRateProvider.reload
>Reloading exchange rates from file currency.xml
>[junit4:junit4]   2> 6791 T649 oass.FileExchangeRateProvider.reload
>Reloading exchange rates from file currency.xml
>[junit4:junit4]   2> 6794 T649 oass.OpenExchangeRatesOrgProvider.reload
>Reloading exchange rates from open-exchange-rates.json
>[junit4:junit4]   2> 6795 T649 oass.OpenExchangeRatesOrgProvider.reload
>Reloading exchange rates from open-exchange-rates.json
>[junit4:junit4]   2> 6796 T649 oasc.SolrCore.<init> [collection1]
>Opening new SolrCore at
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1354310029929/collection1/,
>dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4/
>[junit4:junit4]   2> 6796 T649 oasc.JmxMonitoredMap.<init> JMX
>monitoring is enabled. Adding Solr mbeans to JMX Server:
>com.sun.jmx.mbeanserver.JmxMBeanServer@302e67
>[junit4:junit4]   2> 6796 T649 oasc.SolrCore.initDirectoryFactory
>solr.NRTCachingDirectoryFactory
>[junit4:junit4]   2> 6797 T649
>oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType
>configured for
>NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@190be;
>maxCacheMB=48.0 maxMergeSizeMB=4.0) assuming 'simple'
>[junit4:junit4]   2> 6797 T649 oasc.CachingDirectoryFactory.get return
>new directory for
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4
>forceNew:false
>[junit4:junit4]   2> 6797 T649 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4
>[junit4:junit4]   2> 6797 T649 oasc.SolrCore.getNewIndexDir New index
>directory detected: old=null
>new=./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4/index/
>[junit4:junit4]   2> 6798 T649 oasc.SolrCore.initIndex WARNING
>[collection1] Solr index directory
>'./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4/index'
>doesn't exist. Creating new index...
>[junit4:junit4]   2> 6798 T649 oasc.CachingDirectoryFactory.get return
>new directory for
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4/index
>forceNew:false
>[junit4:junit4]   2> 6801 T649 oasc.SolrDeletionPolicy.onCommit
>SolrDeletionPolicy.onCommit: commits:num=1
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e0ea77;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2> 6801 T649 oasc.SolrDeletionPolicy.updateCommits
>newest commit = 1[segments_1]
>[junit4:junit4]   2> 6802 T649 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4/index
>[junit4:junit4]   2> 6802 T649 oasc.SolrCore.initWriters created xml:
>solr.XMLResponseWriter
>[junit4:junit4]   2> 6803 T649 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "dedupe"
>[junit4:junit4]   2> 6803 T649 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "dedupe-allfields"
>[junit4:junit4]   2> 6804 T649 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "stored_sig"
>[junit4:junit4]   2> 6804 T649 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "uniq-fields"
>[junit4:junit4]   2> 6804 T649 oasup.UpdateRequestProcessorChain.init
>inserting DistributedUpdateProcessorFactory into
>updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>[junit4:junit4]   2> 6804 T649
>oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
>solr.ReplicationHandler
>[junit4:junit4]   2> 6805 T649
>oasc.RequestHandlers.initHandlersFromConfig created /replication:
>solr.ReplicationHandler
>[junit4:junit4]   2> 6805 T649
>oasc.RequestHandlers.initHandlersFromConfig created standard:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 6806 T649
>oasc.RequestHandlers.initHandlersFromConfig created /get:
>solr.RealTimeGetHandler
>[junit4:junit4]   2> 6806 T649
>oasc.RequestHandlers.initHandlersFromConfig created dismax:
>solr.SearchHandler
>[junit4:junit4]   2> 6807 T649
>oasc.RequestHandlers.initHandlersFromConfig created mock:
>org.apache.solr.core.MockQuerySenderListenerReqHandler
>[junit4:junit4]   2> 6807 T649
>oasc.RequestHandlers.initHandlersFromConfig created /admin/:
>org.apache.solr.handler.admin.AdminHandlers
>[junit4:junit4]   2> 6808 T649
>oasc.RequestHandlers.initHandlersFromConfig created defaults:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 6808 T649
>oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 6808 T649
>oasc.RequestHandlers.initHandlersFromConfig created lazy:
>solr.StandardRequestHandler
>[junit4:junit4]   2> 6809 T649
>oasc.RequestHandlers.initHandlersFromConfig created /update:
>solr.UpdateRequestHandler
>[junit4:junit4]   2> 6809 T649
>oasc.RequestHandlers.initHandlersFromConfig created /terms:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 6810 T649
>oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 6811 T649
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckCompRH_Direct:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 6811 T649
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckWithWordbreak:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 6812 T649
>oasc.RequestHandlers.initHandlersFromConfig created
>spellCheckWithWordbreak_Direct:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 6812 T649
>oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 6813 T649
>oasc.RequestHandlers.initHandlersFromConfig created tvrh:
>org.apache.solr.handler.component.SearchHandler
>[junit4:junit4]   2> 6814 T649
>oasc.RequestHandlers.initHandlersFromConfig created /mlt:
>solr.MoreLikeThisHandler
>[junit4:junit4]   2> 6814 T649
>oasc.RequestHandlers.initHandlersFromConfig created /debug/dump:
>solr.DumpRequestHandler
>[junit4:junit4]   2> 6816 T649 oashl.XMLLoader.init
>xsltCacheLifetimeSeconds=60
>[junit4:junit4]   2> 6817 T649 oasc.SolrCore.initDeprecatedSupport
>WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please
>update your config to use the ShowFileRequestHandler.
>[junit4:junit4]   2> 6819 T649 oasc.SolrCore.initDeprecatedSupport
>WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML,
>OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT,
>OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML,
>MAPPING-ISOLATIN1ACCENT.TXT]
>[junit4:junit4]   2> 6820 T649 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4
>[junit4:junit4]   2> 6821 T649 oass.SolrIndexSearcher.<init> Opening
>Searcher@1aeb521 main
>[junit4:junit4]   2> 6821 T649 oasu.CommitTracker.<init> Hard
>AutoCommit: disabled
>[junit4:junit4]   2> 6822 T649 oasu.CommitTracker.<init> Soft
>AutoCommit: disabled
>[junit4:junit4]   2> 6822 T649 oashc.SpellCheckComponent.inform
>Initializing spell checkers
>[junit4:junit4]   2> 6825 T649 oass.DirectSolrSpellChecker.init init:
>{name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
>[junit4:junit4]   2> 6854 T650 oasc.SolrCore.registerSearcher
>[collection1] Registered new searcher Searcher@1aeb521
>main{StandardDirectoryReader(segments_1:1)}
>[junit4:junit4]   2> 6857 T649 oasc.ZkController.publish numShards not
>found on descriptor - reading it from system property
>[junit4:junit4]   2> 7050 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 7050 T591
>oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2
>message={
>[junit4:junit4]   2> 	  "operation":"state",
>[junit4:junit4]   2> 	  "numShards":"2",
>[junit4:junit4]   2> 	  "shard":null,
>[junit4:junit4]   2> 	  "roles":null,
>[junit4:junit4]   2> 	  "state":"down",
>[junit4:junit4]   2> 	  "core":"collection1",
>[junit4:junit4]   2> 	  "collection":"collection1",
>[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41029_solr",
>[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41029/solr"}
>[junit4:junit4]   2> 7050 T591
>oasc.Overseer$ClusterStateUpdater.updateState Collection already exists
>with numShards=2
>[junit4:junit4]   2> 7050 T591
>oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to
>shard shard=shard2
>[junit4:junit4]   2> 7054 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 7054 T648 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 7054 T633 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 7054 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 7054 T620 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 7054 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 7358 T649 oasc.CoreContainer.registerCore
>registering core: collection1
>[junit4:junit4]   2> 7358 T649 oasc.ZkController.register Register
>shard - core:collection1 address:http://127.0.0.1:41029/solr
>shardId:shard2
>[junit4:junit4]   2> 7361 T649 oasc.ZkController.register We are
>http://127.0.0.1:41029/solr/collection1/ and leader is
>http://127.0.0.1:49698/solr/collection1/
>[junit4:junit4]   2> 7361 T649 oasc.ZkController.register No LogReplay
>needed for core=collection1 baseURL=http://127.0.0.1:41029/solr
>[junit4:junit4]   2> 7361 T649 oasc.ZkController.checkRecovery Core
>needs to recover:collection1
>[junit4:junit4]   2> 7361 T649 oasu.DefaultSolrCoreState.doRecovery
>Running recovery - first canceling any ongoing recovery
>[junit4:junit4]   2> ASYNC  NEW_CORE C29 name=collection1
>org.apache.solr.core.SolrCore@121658c
>url=http://127.0.0.1:41029/solr/collection1 node=127.0.0.1:41029_solr
>[junit4:junit4]   2> 7362 T651 C29 P41029 oasc.RecoveryStrategy.run
>Starting recovery process.  core=collection1
>recoveringAfterStartup=true
>[junit4:junit4]   2> 7362 T651 C29 P41029
>oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
>[junit4:junit4]   2> 7362 T649 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 7363 T651 C29 P41029 oasc.ZkController.publish
>numShards not found on descriptor - reading it from system property
>[junit4:junit4]   2> 7363 T651 C29 P41029
>oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from
>http://127.0.0.1:49698/solr/collection1/ core=collection1 -
>recoveringAfterStartup=true
>[junit4:junit4]   2> 7363 T570 oass.SolrDispatchFilter.init
>user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>[junit4:junit4]   2> 7364 T651 C29 P41029 oasu.PeerSync.sync PeerSync:
>core=collection1 url=http://127.0.0.1:41029/solr START
>replicas=[http://127.0.0.1:49698/solr/collection1/] nUpdates=100
>[junit4:junit4]   2> 7364 T651 C29 P41029 oasu.PeerSync.sync WARNING no
>frame of reference to tell of we've missed updates
>[junit4:junit4]   2> 7364 T570 oass.SolrDispatchFilter.init
>SolrDispatchFilter.init() done
>[junit4:junit4]   2> 7364 T651 C29 P41029
>oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful -
>trying replication. core=collection1
>[junit4:junit4]   2> 7364 T651 C29 P41029
>oasc.RecoveryStrategy.doRecovery Starting Replication Recovery.
>core=collection1
>[junit4:junit4]   2> 7364 T570 oascsi.HttpClientUtil.createClient
>Creating new http client,
>config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
>[junit4:junit4]   2> 7365 T651 C29 P41029
>oascsi.HttpClientUtil.createClient Creating new http client,
>config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
>[junit4:junit4]   2> ASYNC  NEW_CORE C30 name=collection1
>org.apache.solr.core.SolrCore@3de69c
>url=http://127.0.0.1:49698/solr/collection1 node=127.0.0.1:49698_solr
>[junit4:junit4]   2> 7368 T615 C30 P49698 REQ /get
>{distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0
>QTime=0 
>[junit4:junit4]   2> 7370 T570 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 7371 T570
>oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for
>recoveries to finish - collection: collection1 failOnTimeout:true
>timeout (sec):540
>[junit4:junit4]   2> 7371 T570 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 7558 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 7559 T591
>oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2
>message={
>[junit4:junit4]   2> 	  "operation":"state",
>[junit4:junit4]   2> 	  "numShards":"2",
>[junit4:junit4]   2> 	  "shard":"shard2",
>[junit4:junit4]   2> 	  "roles":null,
>[junit4:junit4]   2> 	  "state":"recovering",
>[junit4:junit4]   2> 	  "core":"collection1",
>[junit4:junit4]   2> 	  "collection":"collection1",
>[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41029_solr",
>[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41029/solr"}
>[junit4:junit4]   2> 7563 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 7563 T648 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 7563 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 7563 T620 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 7563 T633 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 7564 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 8373 T570 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2>  C27_STATE=coll:collection1 core:collection1
>props:{shard=shard1, roles=null, state=recovering, core=collection1,
>collection=collection1, node_name=127.0.0.1:60865_solr,
>base_url=http://127.0.0.1:60865/solr}
>[junit4:junit4]   2> 9213 T636 C27 P60865
>oasc.RecoveryStrategy.doRecovery Begin buffering updates.
>core=collection1
>[junit4:junit4]   2> 9214 T636 C27 P60865 oasu.UpdateLog.bufferUpdates
>Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
>[junit4:junit4]   2> 9214 T636 C27 P60865
>oasc.RecoveryStrategy.replicate Attempting to replicate from
>http://127.0.0.1:39991/solr/collection1/. core=collection1
>[junit4:junit4]   2> 9214 T636 C27 P60865
>oascsi.HttpClientUtil.createClient Creating new http client,
>config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
>[junit4:junit4]   2> 9219 T605 C28 P39991
>oasu.DirectUpdateHandler2.commit start
>commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
>[junit4:junit4]   2> 9220 T605 C28 P39991
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1
>[junit4:junit4]   2> 9221 T605 C28 P39991
>oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@16dc0ec;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2> 9222 T605 C28 P39991
>oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
>[junit4:junit4]   2> 9223 T605 C28 P39991
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1
>[junit4:junit4]   2> 9223 T605 C28 P39991 oass.SolrIndexSearcher.<init>
>Opening Searcher@b3a369 realtime
>[junit4:junit4]   2> 9224 T605 C28 P39991
>oasu.DirectUpdateHandler2.commit end_commit_flush
>[junit4:junit4]   2> 9224 T605 C28 P39991 /update
>{waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2}
>{commit=} 0 5
>[junit4:junit4]   2> 9225 T636 C27 P60865
>oash.ReplicationHandler.inform Commits will be reserved for  10000
>[junit4:junit4]   2> 9226 T636 C27 P60865 oash.SnapPuller.<init>  No
>value set for 'pollInterval'. Timer Task not started.
>[junit4:junit4]   2> 9227 T604 C28 P39991
>oash.ReplicationHandler.inform Commits will be reserved for  10000
>[junit4:junit4]   2> 9228 T604 C28 P39991 REQ /replication
>{command=indexversion&wt=javabin&qt=/replication&version=2} status=0
>QTime=1 
>[junit4:junit4]   2> 9228 T636 C27 P60865
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3
>[junit4:junit4]   2> 9230 T636 C27 P60865
>oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@165ab10;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2> 9237 T636 C27 P60865
>oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
>[junit4:junit4]   2> 9237 T636 C27 P60865
>oasu.DirectUpdateHandler2.commit start
>commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
>[junit4:junit4]   2> 9246 T636 C27 P60865
>oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit:
>commits:num=2
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@165ab10;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@165ab10;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
>[junit4:junit4]   2> 9246 T636 C27 P60865
>oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
>[junit4:junit4]   2> 9247 T636 C27 P60865
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3
>[junit4:junit4]   2> 9247 T636 C27 P60865 oass.SolrIndexSearcher.<init>
>Opening Searcher@124aab main
>[junit4:junit4]   2> 9248 T636 C27 P60865
>oasu.DirectUpdateHandler2.commit end_commit_flush
>[junit4:junit4]   2> 9249 T635 oasc.SolrCore.registerSearcher
>[collection1] Registered new searcher Searcher@124aab
>main{StandardDirectoryReader(segments_2:2)}
>[junit4:junit4]   2> 9249 T635 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3/index
>[junit4:junit4]   2> 9249 T636 C27 P60865 oasc.RecoveryStrategy.replay
>No replay needed. core=collection1
>[junit4:junit4]   2> 9249 T636 C27 P60865
>oasc.RecoveryStrategy.doRecovery Replication Recovery was successful -
>registering as Active. core=collection1
>[junit4:junit4]   2> 9250 T636 C27 P60865 oasc.ZkController.publish
>numShards not found on descriptor - reading it from system property
>[junit4:junit4]   2> 9251 T636 C27 P60865
>oasc.RecoveryStrategy.doRecovery Finished recovery process.
>core=collection1
>[junit4:junit4]   2> 9376 T570 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 9573 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 9574 T591
>oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2
>message={
>[junit4:junit4]   2> 	  "operation":"state",
>[junit4:junit4]   2> 	  "numShards":"2",
>[junit4:junit4]   2> 	  "shard":"shard1",
>[junit4:junit4]   2> 	  "roles":null,
>[junit4:junit4]   2> 	  "state":"active",
>[junit4:junit4]   2> 	  "core":"collection1",
>[junit4:junit4]   2> 	  "collection":"collection1",
>[junit4:junit4]   2> 	  "node_name":"127.0.0.1:60865_solr",
>[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:60865/solr"}
>[junit4:junit4]   2> 9577 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 9577 T633 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 9577 T620 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 9577 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 9577 T648 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 9577 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2>  C29_STATE=coll:collection1 core:collection1
>props:{shard=shard2, roles=null, state=recovering, core=collection1,
>collection=collection1, node_name=127.0.0.1:41029_solr,
>base_url=http://127.0.0.1:41029/solr}
>[junit4:junit4]   2> 10371 T651 C29 P41029
>oasc.RecoveryStrategy.doRecovery Begin buffering updates.
>core=collection1
>[junit4:junit4]   2> 10372 T651 C29 P41029 oasu.UpdateLog.bufferUpdates
>Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
>[junit4:junit4]   2> 10372 T651 C29 P41029
>oasc.RecoveryStrategy.replicate Attempting to replicate from
>http://127.0.0.1:49698/solr/collection1/. core=collection1
>[junit4:junit4]   2> 10372 T651 C29 P41029
>oascsi.HttpClientUtil.createClient Creating new http client,
>config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
>[junit4:junit4]   2> 10376 T615 C30 P49698
>oasu.DirectUpdateHandler2.commit start
>commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
>[junit4:junit4]   2> 10377 T615 C30 P49698
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2
>[junit4:junit4]   2> 10378 T570 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 10379 T615 C30 P49698
>oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@b0d5f5;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2> 10380 T615 C30 P49698
>oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
>[junit4:junit4]   2> 10380 T615 C30 P49698
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2
>[junit4:junit4]   2> 10381 T615 C30 P49698
>oass.SolrIndexSearcher.<init> Opening Searcher@7cc0bc realtime
>[junit4:junit4]   2> 10381 T615 C30 P49698
>oasu.DirectUpdateHandler2.commit end_commit_flush
>[junit4:junit4]   2> 10382 T615 C30 P49698 /update
>{waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2}
>{commit=} 0 6
>[junit4:junit4]   2> 10383 T651 C29 P41029
>oash.ReplicationHandler.inform Commits will be reserved for  10000
>[junit4:junit4]   2> 10383 T651 C29 P41029 oash.SnapPuller.<init>  No
>value set for 'pollInterval'. Timer Task not started.
>[junit4:junit4]   2> 10385 T616 C30 P49698
>oash.ReplicationHandler.inform Commits will be reserved for  10000
>[junit4:junit4]   2> 10385 T616 C30 P49698 REQ /replication
>{command=indexversion&wt=javabin&qt=/replication&version=2} status=0
>QTime=1 
>[junit4:junit4]   2> 10386 T651 C29 P41029
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4
>[junit4:junit4]   2> 10387 T651 C29 P41029
>oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e0ea77;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2> 10387 T651 C29 P41029
>oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
>[junit4:junit4]   2> 10388 T651 C29 P41029
>oasu.DirectUpdateHandler2.commit start
>commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
>[junit4:junit4]   2> 10396 T651 C29 P41029
>oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit:
>commits:num=2
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e0ea77;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e0ea77;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
>[junit4:junit4]   2> 10396 T651 C29 P41029
>oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
>[junit4:junit4]   2> 10396 T651 C29 P41029
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4
>[junit4:junit4]   2> 10397 T651 C29 P41029
>oass.SolrIndexSearcher.<init> Opening Searcher@1164b09 main
>[junit4:junit4]   2> 10397 T651 C29 P41029
>oasu.DirectUpdateHandler2.commit end_commit_flush
>[junit4:junit4]   2> 10398 T650 oasc.SolrCore.registerSearcher
>[collection1] Registered new searcher Searcher@1164b09
>main{StandardDirectoryReader(segments_2:2)}
>[junit4:junit4]   2> 10398 T650 oasc.CachingDirectoryFactory.close
>Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4/index
>[junit4:junit4]   2> 10399 T651 C29 P41029 oasc.RecoveryStrategy.replay
>No replay needed. core=collection1
>[junit4:junit4]   2> 10399 T651 C29 P41029
>oasc.RecoveryStrategy.doRecovery Replication Recovery was successful -
>registering as Active. core=collection1
>[junit4:junit4]   2> 10399 T651 C29 P41029 oasc.ZkController.publish
>numShards not found on descriptor - reading it from system property
>[junit4:junit4]   2> 10401 T651 C29 P41029
>oasc.RecoveryStrategy.doRecovery Finished recovery process.
>core=collection1
>[junit4:junit4]   2> 10584 T591 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> 10585 T591
>oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2
>message={
>[junit4:junit4]   2> 	  "operation":"state",
>[junit4:junit4]   2> 	  "numShards":"2",
>[junit4:junit4]   2> 	  "shard":"shard2",
>[junit4:junit4]   2> 	  "roles":null,
>[junit4:junit4]   2> 	  "state":"active",
>[junit4:junit4]   2> 	  "core":"collection1",
>[junit4:junit4]   2> 	  "collection":"collection1",
>[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41029_solr",
>[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41029/solr"}
>[junit4:junit4]   2> 10599 T590 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 10599 T620 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 10599 T607 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 10599 T633 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 10599 T648 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 10599 T596 oascc.ZkStateReader$2.process A cluster
>state change has occurred - updating... (5)
>[junit4:junit4]   2> 11380 T570 oascc.ZkStateReader.updateClusterState
>Updating cloud state from ZooKeeper... 
>[junit4:junit4]   2> ASYNC  NEW_CORE C31 name=collection1
>org.apache.solr.core.SolrCore@1269c4f
>url=http://127.0.0.1:53088/solr/collection1 node=127.0.0.1:53088_solr
>[junit4:junit4]   2> 11392 T588 C31 P53088
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data
>[junit4:junit4]   2> 11395 T588 C31 P53088
>oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@ef6b9;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2> 11395 T588 C31 P53088
>oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
>[junit4:junit4]   2> 11397 T588 C31 P53088
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data
>[junit4:junit4]   2> 11398 T588 C31 P53088
>oass.SolrIndexSearcher.<init> Opening Searcher@18ddf9a realtime
>[junit4:junit4]   2> 11398 T588 C31 P53088 /update
>{wt=javabin&version=2} {deleteByQuery=*:* (-1420096999369211904)} 0 12
>[junit4:junit4]   2> 11401 T617 C30 P49698
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty2
>[junit4:junit4]   2> 11404 T604 C28 P39991
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty1
>[junit4:junit4]   2>  C29_STATE=coll:collection1 core:collection1
>props:{shard=shard2, roles=null, state=active, core=collection1,
>collection=collection1, node_name=127.0.0.1:41029_solr,
>base_url=http://127.0.0.1:41029/solr}
>[junit4:junit4]   2> 11410 T645 C29 P41029
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty4
>[junit4:junit4]   2> 11411 T645 C29 P41029
>oass.SolrIndexSearcher.<init> Opening Searcher@153bd20 realtime
>[junit4:junit4]   2> 11411 T645 C29 P41029 REQ /update
>{update.distrib=FROMLEADER&_version_=-1420096999383891968&update.from=http://127.0.0.1:49698/solr/collection1/&wt=javabin&version=2}
>status=0 QTime=2 
>[junit4:junit4]   2>  C27_STATE=coll:collection1 core:collection1
>props:{shard=shard1, roles=null, state=active, core=collection1,
>collection=collection1, node_name=127.0.0.1:60865_solr,
>base_url=http://127.0.0.1:60865/solr}
>[junit4:junit4]   2> 11412 T629 C27 P60865
>oasc.CachingDirectoryFactory.close Releasing
>directory:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/jetty3
>[junit4:junit4]   2> 11413 T629 C27 P60865
>oass.SolrIndexSearcher.<init> Opening Searcher@6cc113 realtime
>[junit4:junit4]   2> 11413 T629 C27 P60865 REQ /update
>{update.distrib=FROMLEADER&_version_=-1420096999387037696&update.from=http://127.0.0.1:39991/solr/collection1/&wt=javabin&version=2}
>status=0 QTime=2 
>[junit4:junit4]   2> 11414 T604 C28 P39991 REQ /update
>{update.distrib=TOLEADER&wt=javabin&version=2} status=0 QTime=11 
>[junit4:junit4]   2> 11415 T617 C30 P49698 /update
>{wt=javabin&version=2} {deleteByQuery=*:* (-1420096999383891968)} 0 15
>[junit4:junit4]   2> 11420 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[1 (1420096999402766336)]} 0 2
>[junit4:junit4]   2> 11427 T631 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11428 T605 C28 P39991 /update
>{wt=javabin&version=2} {add=[1 (1420096999406960640)]} 0 6
>[junit4:junit4]   2> 11431 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[2 (1420096999415349248)]} 0 1
>[junit4:junit4]   2> 11438 T646 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=2 
>[junit4:junit4]   2> 11438 T615 C30 P49698 /update
>{wt=javabin&version=2} {add=[2 (1420096999418494976)]} 0 5
>[junit4:junit4]   2> 11441 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[3 (1420096999426883584)]} 0 0
>[junit4:junit4]   2> 11448 T643 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11449 T618 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11449 T602 C28 P39991 /update
>{wt=javabin&version=2} {add=[3]} 0 6
>[junit4:junit4]   2> 11452 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[4 (1420096999438417920)]} 0 1
>[junit4:junit4]   2> 11458 T630 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11459 T604 C28 P39991 /update
>{wt=javabin&version=2} {add=[4 (1420096999440515072)]} 0 5
>[junit4:junit4]   2> 11462 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[5 (1420096999447855104)]} 0 1
>[junit4:junit4]   2> 11467 T645 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11468 T616 C30 P49698 /update
>{wt=javabin&version=2} {add=[5 (1420096999451000832)]} 0 4
>[junit4:junit4]   2> 11471 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[6 (1420096999457292288)]} 0 1
>[junit4:junit4]   2> 11476 T643 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11477 T617 C30 P49698 /update
>{wt=javabin&version=2} {add=[6 (1420096999460438016)]} 0 4
>[junit4:junit4]   2> 11480 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[7 (1420096999466729472)]} 0 1
>[junit4:junit4]   2> 11487 T644 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11487 T615 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11488 T603 C28 P39991 /update
>{wt=javabin&version=2} {add=[7]} 0 6
>[junit4:junit4]   2> 11491 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[8 (1420096999478263808)]} 0 1
>[junit4:junit4]   2> 11498 T628 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11498 T605 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11499 T618 C30 P49698 /update
>{wt=javabin&version=2} {add=[8]} 0 6
>[junit4:junit4]   2> 11502 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[9 (1420096999489798144)]} 0 1
>[junit4:junit4]   2> 11507 T645 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11507 T616 C30 P49698 /update
>{wt=javabin&version=2} {add=[9 (1420096999492943872)]} 0 3
>[junit4:junit4]   2> 11517 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[10 (1420096999499235328)]} 0 8
>[junit4:junit4]   2> 11523 T631 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=0 
>[junit4:junit4]   2> 11523 T602 C28 P39991 /update
>{wt=javabin&version=2} {add=[10 (1420096999508672512)]} 0 4
>[junit4:junit4]   2> 11527 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[11 (1420096999514963968)]} 0 2
>[junit4:junit4]   2> 11535 T630 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=2 
>[junit4:junit4]   2> 11535 T604 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11536 T617 C30 P49698 /update
>{wt=javabin&version=2} {add=[11]} 0 7
>[junit4:junit4]   2> 11539 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[12 (1420096999528595456)]} 0 1
>[junit4:junit4]   2> 11546 T628 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11546 T603 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11547 T615 C30 P49698 /update
>{wt=javabin&version=2} {add=[12]} 0 6
>[junit4:junit4]   2> 11550 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[13 (1420096999540129792)]} 0 1
>[junit4:junit4]   2> 11557 T629 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11558 T605 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11558 T618 C30 P49698 /update
>{wt=javabin&version=2} {add=[13]} 0 6
>[junit4:junit4]   2> 11561 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[14 (1420096999552712704)]} 0 1
>[junit4:junit4]   2> 11572 T631 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=0 
>[junit4:junit4]   2> 11573 T602 C28 P39991 /update
>{wt=javabin&version=2} {add=[14 (1420096999554809856)]} 0 10
>[junit4:junit4]   2> 11576 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[15 (1420096999567392768)]} 0 1
>[junit4:junit4]   2> 11581 T630 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11581 T604 C28 P39991 /update
>{wt=javabin&version=2} {add=[15 (1420096999570538496)]} 0 3
>[junit4:junit4]   2> 11584 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[16 (1420096999576829952)]} 0 0
>[junit4:junit4]   2> 11612 T628 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=7 
>[junit4:junit4]   2> 11613 T603 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=25 
>[junit4:junit4]   2> 11613 T616 C30 P49698 /update
>{wt=javabin&version=2} {add=[16]} 0 27
>[junit4:junit4]   2> 11617 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[17 (1420096999610384384)]} 0 1
>[junit4:junit4]   2> 11628 T646 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=2 
>[junit4:junit4]   2> 11628 T617 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=6 
>[junit4:junit4]   2> 11628 T605 C28 P39991 /update
>{wt=javabin&version=2} {add=[17]} 0 8
>[junit4:junit4]   2> 11632 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[100 (1420096999626113024)]} 0 1
>[junit4:junit4]   2> 11647 T629 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=10 
>[junit4:junit4]   2> 11647 T602 C28 P39991 /update
>{wt=javabin&version=2} {add=[100 (1420096999629258752)]} 0 13
>[junit4:junit4]   2> 11650 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[101 (1420096999646035968)]} 0 0
>[junit4:junit4]   2> 11657 T631 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=0 
>[junit4:junit4]   2> 11658 T604 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=3 
>[junit4:junit4]   2> 11658 T618 C30 P49698 /update
>{wt=javabin&version=2} {add=[101]} 0 5
>[junit4:junit4]   2> 11670 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[102 (1420096999657570304)]} 0 10
>[junit4:junit4]   2> 11675 T630 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11676 T603 C28 P39991 /update
>{wt=javabin&version=2} {add=[102 (1420096999669104640)]} 0 4
>[junit4:junit4]   2> 11679 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[103 (1420096999675396096)]} 0 1
>[junit4:junit4]   2> 11684 T643 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11685 T616 C30 P49698 /update
>{wt=javabin&version=2} {add=[103 (1420096999678541824)]} 0 4
>[junit4:junit4]   2> 11687 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[104 (1420096999684833280)]} 0 0
>[junit4:junit4]   2> 11695 T644 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11695 T615 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11696 T605 C28 P39991 /update
>{wt=javabin&version=2} {add=[104]} 0 7
>[junit4:junit4]   2> 11699 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[105 (1420096999696367616)]} 0 1
>[junit4:junit4]   2> 11714 T645 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=6 
>[junit4:junit4]   2> 11715 T617 C30 P49698 /update
>{wt=javabin&version=2} {add=[105 (1420096999699513344)]} 0 14
>[junit4:junit4]   2> 11717 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[106 (1420096999716290560)]} 0 0
>[junit4:junit4]   2> 11725 T646 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11726 T618 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=5 
>[junit4:junit4]   2> 11726 T602 C28 P39991 /update
>{wt=javabin&version=2} {add=[106]} 0 7
>[junit4:junit4]   2> 11729 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[107 (1420096999727824896)]} 0 1
>[junit4:junit4]   2> 11735 T628 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=0 
>[junit4:junit4]   2> 11736 T604 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11736 T616 C30 P49698 /update
>{wt=javabin&version=2} {add=[107]} 0 5
>[junit4:junit4]   2> 11739 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[108 (1420096999739359232)]} 0 0
>[junit4:junit4]   2> 11746 T629 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11746 T603 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=3 
>[junit4:junit4]   2> 11747 T615 C30 P49698 /update
>{wt=javabin&version=2} {add=[108]} 0 6
>[junit4:junit4]   2> 11749 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[109 (1420096999749844992)]} 0 0
>[junit4:junit4]   2> 11756 T631 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11756 T605 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=3 
>[junit4:junit4]   2> 11757 T617 C30 P49698 /update
>{wt=javabin&version=2} {add=[109]} 0 6
>[junit4:junit4]   2> 11759 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[110 (1420096999760330752)]} 0 0
>[junit4:junit4]   2> 11766 T630 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11766 T602 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=3 
>[junit4:junit4]   2> 11767 T618 C30 P49698 /update
>{wt=javabin&version=2} {add=[110]} 0 6
>[junit4:junit4]   2> 11770 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[111 (1420096999770816512)]} 0 1
>[junit4:junit4]   2> 11776 T628 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11776 T604 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=3 
>[junit4:junit4]   2> 11777 T616 C30 P49698 /update
>{wt=javabin&version=2} {add=[111]} 0 6
>[junit4:junit4]   2> 11783 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[112 (1420096999781302272)]} 0 4
>[junit4:junit4]   2> 11790 T643 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=0 
>[junit4:junit4]   2> 11791 T615 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11791 T603 C28 P39991 /update
>{wt=javabin&version=2} {add=[112]} 0 5
>[junit4:junit4]   2> 11795 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[113 (1420096999797030912)]} 0 1
>[junit4:junit4]   2> 11803 T629 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11804 T605 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=5 
>[junit4:junit4]   2> 11804 T617 C30 P49698 /update
>{wt=javabin&version=2} {add=[113]} 0 7
>[junit4:junit4]   2> 11808 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[114 (1420096999810662400)]} 0 1
>[junit4:junit4]   2> 11823 T631 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=5 
>[junit4:junit4]   2> 11824 T604 C28 P39991 /update
>{wt=javabin&version=2} {add=[114 (1420096999814856704)]} 0 14
>[junit4:junit4]   2> 11827 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[115 (1420096999830585344)]} 0 1
>[junit4:junit4]   2> 11833 T644 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11833 T616 C30 P49698 /update
>{wt=javabin&version=2} {add=[115 (1420096999834779648)]} 0 4
>[junit4:junit4]   2> 11836 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[116 (1420096999841071104)]} 0 0
>[junit4:junit4]   2> 11844 T645 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11844 T615 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11845 T605 C28 P39991 /update
>{wt=javabin&version=2} {add=[116]} 0 6
>[junit4:junit4]   2> 11848 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[117 (1420096999852605440)]} 0 1
>[junit4:junit4]   2> 11854 T646 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11854 T617 C30 P49698 /update
>{wt=javabin&version=2} {add=[117 (1420096999856799744)]} 0 4
>[junit4:junit4]   2> 11857 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[118 (1420096999863091200)]} 0 0
>[junit4:junit4]   2> 11865 T628 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=2 
>[junit4:junit4]   2> 11865 T602 C28 P39991 /update
>{wt=javabin&version=2} {add=[118 (1420096999866236928)]} 0 5
>[junit4:junit4]   2> 11868 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[119 (1420096999874625536)]} 0 0
>[junit4:junit4]   2> 11876 T643 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11876 T618 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11877 T604 C28 P39991 /update
>{wt=javabin&version=2} {add=[119]} 0 7
>[junit4:junit4]   2> 11880 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[120 (1420096999886159872)]} 0 1
>[junit4:junit4]   2> 11887 T645 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=0 
>[junit4:junit4]   2> 11888 T616 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11889 T603 C28 P39991 /update
>{wt=javabin&version=2} {add=[120]} 0 7
>[junit4:junit4]   2> 11891 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[121 (1420096999898742784)]} 0 0
>[junit4:junit4]   2> 11898 T646 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11899 T615 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11899 T605 C28 P39991 /update
>{wt=javabin&version=2} {add=[121]} 0 6
>[junit4:junit4]   2> 11907 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[122 (1420096999910277120)]} 0 6
>[junit4:junit4]   2> 11912 T629 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=0 
>[junit4:junit4]   2> 11913 T602 C28 P39991 /update
>{wt=javabin&version=2} {add=[122 (1420096999918665728)]} 0 4
>[junit4:junit4]   2> 11916 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[123 (1420096999923908608)]} 0 1
>[junit4:junit4]   2> 11923 T630 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=0 
>[junit4:junit4]   2> 11924 T604 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11925 T617 C30 P49698 /update
>{wt=javabin&version=2} {add=[123]} 0 7
>[junit4:junit4]   2> 11931 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[124 (1420096999939637248)]} 0 1
>[junit4:junit4]   2> 11938 T631 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11939 T603 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 11939 T618 C30 P49698 /update
>{wt=javabin&version=2} {add=[124]} 0 6
>[junit4:junit4]   2> 11942 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[125 (1420096999952220160)]} 0 1
>[junit4:junit4]   2> 11948 T628 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 11948 T605 C28 P39991 /update
>{wt=javabin&version=2} {add=[125 (1420096999954317312)]} 0 4
>[junit4:junit4]   2> 11951 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[126 (1420096999961657344)]} 0 1
>[junit4:junit4]   2> 11956 T644 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=0 
>[junit4:junit4]   2> 11957 T616 C30 P49698 /update
>{wt=javabin&version=2} {add=[126 (1420096999964803072)]} 0 4
>[junit4:junit4]   2> 11960 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[127 (1420096999971094528)]} 0 1
>[junit4:junit4]   2> 11978 T643 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=7 
>[junit4:junit4]   2> 11979 T615 C30 P49698 /update
>{wt=javabin&version=2} {add=[127 (1420096999974240256)]} 0 17
>[junit4:junit4]   2> 11982 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[128 (1420096999994163200)]} 0 1
>[junit4:junit4]   2> 11991 T645 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=2 
>[junit4:junit4]   2> 11991 T617 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=5 
>[junit4:junit4]   2> 11992 T602 C28 P39991 /update
>{wt=javabin&version=2} {add=[128]} 0 8
>[junit4:junit4]   2> 11995 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[129 (1420097000006746112)]} 0 1
>[junit4:junit4]   2> 12002 T629 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12002 T604 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=3 
>[junit4:junit4]   2> 12003 T618 C30 P49698 /update
>{wt=javabin&version=2} {add=[129]} 0 6
>[junit4:junit4]   2> 12006 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[130 (1420097000018280448)]} 0 1
>[junit4:junit4]   2> 12011 T646 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12012 T616 C30 P49698 /update
>{wt=javabin&version=2} {add=[130 (1420097000021426176)]} 0 4
>[junit4:junit4]   2> 12015 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[131 (1420097000027717632)]} 0 1
>[junit4:junit4]   2> 12022 T644 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12023 T615 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 12023 T603 C28 P39991 /update
>{wt=javabin&version=2} {add=[131]} 0 6
>[junit4:junit4]   2> 12030 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[132 (1420097000039251968)]} 0 5
>[junit4:junit4]   2> 12036 T630 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12037 T605 C28 P39991 /update
>{wt=javabin&version=2} {add=[132 (1420097000047640576)]} 0 4
>[junit4:junit4]   2> 12041 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[133 (1420097000053932032)]} 0 2
>[junit4:junit4]   2> 12048 T631 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12049 T602 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 12049 T618 C30 P49698 /update
>{wt=javabin&version=2} {add=[133]} 0 6
>[junit4:junit4]   2> 12053 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[134 (1420097000067563520)]} 0 1
>[junit4:junit4]   2> 12059 T643 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12060 T616 C30 P49698 /update
>{wt=javabin&version=2} {add=[134 (1420097000071757824)]} 0 5
>[junit4:junit4]   2> 12064 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[135 (1420097000079097856)]} 0 1
>[junit4:junit4]   2> 12071 T628 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12072 T604 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 12072 T615 C30 P49698 /update
>{wt=javabin&version=2} {add=[135]} 0 6
>[junit4:junit4]   2> 12076 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[136 (1420097000091680768)]} 0 1
>[junit4:junit4]   2> 12083 T645 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12083 T617 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=3 
>[junit4:junit4]   2> 12084 T603 C28 P39991 /update
>{wt=javabin&version=2} {add=[136]} 0 6
>[junit4:junit4]   2> 12087 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[137 (1420097000103215104)]} 0 1
>[junit4:junit4]   2> 12092 T646 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12092 T618 C30 P49698 /update
>{wt=javabin&version=2} {add=[137 (1420097000106360832)]} 0 3
>[junit4:junit4]   2> 12095 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[138 (1420097000112652288)]} 0 0
>[junit4:junit4]   2> 12112 T629 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=5 
>[junit4:junit4]   2> 12113 T605 C28 P39991 /update
>{wt=javabin&version=2} {add=[138 (1420097000115798016)]} 0 16
>[junit4:junit4]   2> 12116 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[139 (1420097000133623808)]} 0 1
>[junit4:junit4]   2> 12124 T644 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12124 T616 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=3 
>[junit4:junit4]   2> 12125 T602 C28 P39991 /update
>{wt=javabin&version=2} {add=[139]} 0 6
>[junit4:junit4]   2> 12130 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[140 (1420097000148303872)]} 0 1
>[junit4:junit4]   2> 12141 T643 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 12141 T615 C30 P49698 /update
>{wt=javabin&version=2} {add=[140 (1420097000152498176)]} 0 8
>[junit4:junit4]   2> 12145 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[141 (1420097000164032512)]} 0 1
>[junit4:junit4]   2> 12154 T645 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=0 
>[junit4:junit4]   2> 12155 T617 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=5 
>[junit4:junit4]   2> 12155 T604 C28 P39991 /update
>{wt=javabin&version=2} {add=[141]} 0 8
>[junit4:junit4]   2> 12164 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[142 (1420097000178712576)]} 0 6
>[junit4:junit4]   2> 12181 T646 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=5 
>[junit4:junit4]   2> 12182 T618 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=14 
>[junit4:junit4]   2> 12182 T603 C28 P39991 /update
>{wt=javabin&version=2} {add=[142]} 0 16
>[junit4:junit4]   2> 12186 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[143 (1420097000207024128)]} 0 1
>[junit4:junit4]   2> 12194 T644 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=2 
>[junit4:junit4]   2> 12195 T616 C30 P49698 /update
>{wt=javabin&version=2} {add=[143 (1420097000211218432)]} 0 6
>[junit4:junit4]   2> 12198 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[144 (1420097000219607040)]} 0 1
>[junit4:junit4]   2> 12205 T643 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12206 T615 C30 P49698 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 12206 T605 C28 P39991 /update
>{wt=javabin&version=2} {add=[144]} 0 6
>[junit4:junit4]   2> 12210 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[145 (1420097000232189952)]} 0 1
>[junit4:junit4]   2> 12216 T645 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12217 T617 C30 P49698 /update
>{wt=javabin&version=2} {add=[145 (1420097000236384256)]} 0 5
>[junit4:junit4]   2> 12220 T587 C31 P53088 /update
>{wt=javabin&version=2} {add=[146 (1420097000242675712)]} 0 1
>[junit4:junit4]   2> 12227 T630 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=2 
>[junit4:junit4]   2> 12228 T602 C28 P39991 /update
>{wt=javabin&version=2} {add=[146 (1420097000245821440)]} 0 6
>[junit4:junit4]   2> 12231 T588 C31 P53088 /update
>{wt=javabin&version=2} {add=[147 (1420097000254210048)]} 0 1
>[junit4:junit4]   2> 12236 T646 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12236 T616 C30 P49698 /update
>{wt=javabin&version=2} {add=[147 (1420097000257355776)]} 0 3
>[junit4:junit4]   2> 12240 T585 C31 P53088 /update
>{wt=javabin&version=2} {add=[148 (1420097000263647232)]} 0 1
>[junit4:junit4]   2> 12248 T628 C27 P60865 REQ /update
>{distrib.from=http://127.0.0.1:39991/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=1 
>[junit4:junit4]   2> 12248 T603 C28 P39991 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=TOLEADER&wt=javabin&version=2}
>status=0 QTime=4 
>[junit4:junit4]   2> 12249 T615 C30 P49698 /update
>{wt=javabin&version=2} {add=[148]} 0 7
>[junit4:junit4]   2> 12253 T586 C31 P53088 /update
>{wt=javabin&version=2} {add=[149 (1420097000277278720)]} 0 1
>[junit4:junit4]   2> 12260 T644 C29 P41029 REQ /update
>{distrib.from=http://127.0.0.1:49698/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2}
>status=0 QTime=2 
>[junit4:junit4]   2> 12261 T618 C30 P49698 /update
>{wt=javabin&version=2} {add=[149 (1420097000280424448)]} 0 6
>[junit4:junit4]   2> 12263 T587 C31 P53088
>oasu.DirectUpdateHandler2.commit start
>commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
>[junit4:junit4]   2> 12426 T587 C31 P53088
>oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit:
>commits:num=2
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@ef6b9;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
>[junit4:junit4]   2>
>		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1354310023722/control/data/index
>lockFactory=org.apache.lucene.store.NativeFSLockFactory@ef6b9;
>maxCacheMB=48.0
>maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[_5_nrm.cfe,
>_1_TestBloomFilteredLucene41Postings_0.pos, _0_MockSep_0.pos,
>_4_MockSep_0.tib, _4_MockSep_0.skp,
>_4_TestBloomFilteredLucene41Postings_0.pos, _3.fdt, _3_MockSep_0.frq,
>_0_TestBloomFilteredLucene41Postings_0.pos, _2_MockSep_0.doc,
>_6_MockSep_0.doc, _5_MockSep_0.skp, _4_MockSep_0.doc,
>_3_TestBloomFilteredLucene41Postings_0.blm, _6_MockSep_0.frq,
>_1_MockSep_0.pyl, _1_MockSep_0.skp,
>_0_TestBloomFilteredLucene41Postings_0.blm,
>_1_MockVariableIntBlock_0.tii, _1_MockSep_0.tib, _2.fdt,
>_1_TestBloomFilteredLucene41Postings_0.doc, _5_MockSep_0.doc, _2.fdx,
>_1_MockSep_0.tii, _1_MockVariableIntBlock_0.tib, _1.fdx,
>_2_Pulsing41_0.pos, _1_Pulsing41_0.tip,
>_6_TestBloomFilteredLucene41Postings_0.pos,
>_5_TestBloomFilteredLucene41Postings_0.pos, _5_nrm.cfs,
>_4_MockSep_0.pyl, _1.fdt, _3_MockSep_0.pos, _1_Pulsing41_0.tim,
>_4_Pulsing41_0.tip, _0_MockVariableIntBlock_0.frq,
>_4_TestBloomFilteredLucene41Postings_0.doc, _3.si, _4_Pulsing41_0.tim,
>_6.fdt, _4_MockSep_0.tii, _3_Pulsing41_0.doc,
>_1_MockVariableIntBlock_0.skp, _2.si,
>_4_TestBloomFilteredLucene41Postings_0.tip,
>_1_TestBloomFilteredLucene41Postings_0.tim, _6_MockSep_0.pyl,
>_0_MockVariableIntBlock_0.doc, _6.fdx,
>_4_TestBloomFilteredLucene41Postings_0.tim, _2_MockSep_0.skp,
>_1_MockVariableIntBlock_0.pyl,
>_1_TestBloomFilteredLucene41Postings_0.tip, _3.fnm, _5_MockSep_0.tii,
>_4_TestBloomFilteredLucene41Postings_0.blm, _3_MockSep_0.pyl,
>_6_Pulsing41_0.doc, _0_MockVariableIntBlock_0.pyl, _2_nrm.cfe,
>_6_MockSep_0.pos, _1_MockVariableIntBlock_0.doc,
>_2_TestBloomFilteredLucene41Postings_0.blm, _3_Pulsing41_0.tim,
>_0_MockVariableIntBlock_0.pos, _3_Pulsing41_0.tip, _2_nrm.cfs,
>_1_MockSep_0.pos, _4_Pulsing41_0.doc, _1_MockVariableIntBlock_0.pos,
>_6_TestBloomFilteredLucene41Postings_0.tip, _6_MockSep_0.skp,
>_3_TestBloomFilteredLucene41Postings_0.doc, _1_Pulsing41_0.pos,
>_6_TestBloomFilteredLucene41Postings_0.tim, _2.fnm, _3.fdx,
>_1_TestBloomFilteredLucene41Postings_0.blm, _5_Pulsing41_0.tim,
>_2_MockSep_0.pyl, _5_Pulsing41_0.pos, _5_MockSep_0.tib, _1.si,
>_6_Pulsing41_0.pos, _5_TestBloomFilteredLucene41Postings_0.tim,
>_0_TestBloomFilteredLucene41Postings_0.doc, _6.si, _6.fnm,
>_3_MockSep_0.skp, _5_Pulsing41_0.tip,
>_5_TestBloomFilteredLucene41Postings_0.tip, _2_Pulsing41_0.doc,
>_3_nrm.cfe, _3_TestBloomFil
>
>[...truncated too long message...]
>
>r.cloud.LeaderElector$1.process(LeaderElector.java:128)
>[junit4:junit4]   2> 	at
>org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
>[junit4:junit4]   2> 	at
>org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
>[junit4:junit4]   2> 
>[junit4:junit4]   2> 303700 T648 oascc.ZkStateReader$3.process WARNING
>ZooKeeper watch triggered, but Solr cannot talk to ZK
>[junit4:junit4]   2> 303700 T648 oascc.ZkStateReader$2.process A
>cluster state change has occurred - updating... (2)
>[junit4:junit4]   2> 303700 T648 oascc.ZkStateReader$2.process WARNING
>ZooKeeper watch triggered, but Solr cannot talk to ZK
>[junit4:junit4]   2> 303701 T648 oasc.LeaderElector$1.process WARNING 
>org.apache.zookeeper.KeeperException$SessionExpiredException:
>KeeperErrorCode = Session expired for /overseer_elect/election
>[junit4:junit4]   2> 	at
>org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
>[junit4:junit4]   2> 	at
>org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
>[junit4:junit4]   2> 	at
>org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
>[junit4:junit4]   2> 	at
>org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
>[junit4:junit4]   2> 	at
>org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
>[junit4:junit4]   2> 	at
>org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
>[junit4:junit4]   2> 	at
>org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
>[junit4:junit4]   2> 	at
>org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
>[junit4:junit4]   2> 	at
>org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
>[junit4:junit4]   2> 	at
>org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
>[junit4:junit4]   2> 	at
>org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
>[junit4:junit4]   2> 	at
>org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
>[junit4:junit4]   2> 
>[junit4:junit4]   2> 303701 T648 oaz.ClientCnxn$EventThread.run
>EventThread shut down
>[junit4:junit4]   2> 424078 T570
>oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher
>opens=1927 closes=1926
>[junit4:junit4]   2> NOTE: test params are: codec=Lucene41:
>{n_f1=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>foo_b=MockVariableIntBlock(baseBlockSize=90),
>cat=PostingsFormat(name=MockSep), foo_d=Pulsing41(freqCutoff=7
>minBlockSize=19 maxBlockSize=55),
>foo_f=MockVariableIntBlock(baseBlockSize=90),
>n_tl1=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>n_d1=PostingsFormat(name=MockSep), rnd_b=Pulsing41(freqCutoff=7
>minBlockSize=19 maxBlockSize=55),
>intDefault=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>n_td1=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>id=Pulsing41(freqCutoff=7 minBlockSize=19 maxBlockSize=55),
>timestamp=PostingsFormat(name=MockSep),
>range_facet_sl=Pulsing41(freqCutoff=7 minBlockSize=19 maxBlockSize=55),
>range_facet_si=PostingsFormat(name=MockSep),
>oddField_s=Pulsing41(freqCutoff=7 minBlockSize=19 maxBlockSize=55),
>sequence_i=Pulsing41(freqCutoff=7 minBlockSize=19 maxBlockSize=55),
>name=Pulsing41(freqCutoff=7 minBlockSize=19 maxBlockSize=55),
>foo_i=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>regex_dup_B_s=PostingsFormat(name=MockSep),
>multiDefault=PostingsFormat(name=MockSep),
>n_tf1=PostingsFormat(name=MockSep),
>n_dt1=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>genre_s=Pulsing41(freqCutoff=7 minBlockSize=19 maxBlockSize=55),
>author_t=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>n_ti1=Pulsing41(freqCutoff=7 minBlockSize=19 maxBlockSize=55),
>range_facet_l=PostingsFormat(name=MockSep),
>text=MockVariableIntBlock(baseBlockSize=90),
>_version_=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>val_i=Pulsing41(freqCutoff=7 minBlockSize=19 maxBlockSize=55),
>SubjectTerms_mfacet=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>series_t=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>a_t=PostingsFormat(name=MockSep),
>n_tdt1=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>regex_dup_A_s=MockVariableIntBlock(baseBlockSize=90),
>price=MockVariableIntBlock(baseBlockSize=90),
>other_tl1=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>n_l1=PostingsFormat(name=MockSep),
>a_si=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>inStock=MockVariableIntBlock(baseBlockSize=90)}, sim=DefaultSimilarity,
>locale=es_SV, timezone=Antarctica/Macquarie
>[junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic i386/Sun Microsystems
>Inc. 1.6.0_37 (32-bit)/cpus=8,threads=1,free=84247024,total=442826752
>[junit4:junit4]   2> NOTE: All tests run in this JVM:
>[ClusterStateUpdateTest, TestLMDirichletSimilarityFactory,
>DateFieldTest, AutoCommitTest, MBeansHandlerTest,
>WordBreakSolrSpellCheckerTest, BasicDistributedZk2Test,
>DirectSolrConnectionTest, NoCacheHeaderTest, ScriptEngineTest,
>TestBinaryResponseWriter, TestStressLucene, TermsComponentTest,
>TestLFUCache, TestSolr4Spatial, LeaderElectionIntegrationTest,
>TestExtendedDismaxParser, CoreAdminHandlerTest, MinimalSchemaTest,
>SOLR749Test, PreAnalyzedFieldTest, TestBadConfig, TestXIncludeConfig,
>BadComponentTest, TestFastWriter, TestConfig,
>CoreContainerCoreInitFailuresTest, TestNumberUtils, TestCoreContainer,
>UpdateRequestProcessorFactoryTest, CopyFieldTest, TestGroupingSearch,
>ResponseLogComponentTest, TestIBSimilarityFactory,
>FileBasedSpellCheckerTest, TestJoin, TestSolrIndexConfig,
>SolrCoreCheckLockOnStartupTest, BasicDistributedZkTest]
>[junit4:junit4]   2> NOTE: reproduce with: ant test 
>-Dtestcase=BasicDistributedZkTest -Dtests.seed=1AD86F62C49580DB
>-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_SV
>-Dtests.timezone=Antarctica/Macquarie -Dtests.file.encoding=UTF-8
>[junit4:junit4] ERROR   0.00s J0 | BasicDistributedZkTest (suite) <<<
>[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR:
>SolrIndexSearcher opens=1927 closes=1926
>[junit4:junit4]    > 	at
>__randomizedtesting.SeedInfo.seed([1AD86F62C49580DB]:0)
>[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
>[junit4:junit4]    > 	at
>org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:243)
>[junit4:junit4]    > 	at
>org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:97)
>[junit4:junit4]    > 	at
>sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
>[junit4:junit4]    > 	at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>[junit4:junit4]    > 	at
>java.lang.reflect.Method.invoke(Method.java:597)
>[junit4:junit4]    > 	at
>com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>[junit4:junit4]    > 	at
>com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>[junit4:junit4]    > 	at
>com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
>[junit4:junit4]    > 	at
>com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>[junit4:junit4]    > 	at
>com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>[junit4:junit4]    > 	at
>org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>[junit4:junit4]    > 	at
>org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>[junit4:junit4]    > 	at
>com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>[junit4:junit4]    > 	at
>com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>[junit4:junit4]    > 	at
>com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>[junit4:junit4]    > 	at
>com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>[junit4:junit4]    > 	at
>org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>[junit4:junit4]    > 	at
>org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>[junit4:junit4]    > 	at
>org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>[junit4:junit4]    > 	at
>org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>[junit4:junit4]    > 	at
>com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>[junit4:junit4]    > 	at
>com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:662)
>[junit4:junit4] Completed on J0 in 424.13s, 1 test, 1 failure <<<
>FAILURES!
>
>[...truncated 58 lines...]
>BUILD FAILED
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:335: The
>following error occurred while executing this line:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The
>following error occurred while executing this line:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:178:
>The following error occurred while executing this line:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:438:
>The following error occurred while executing this line:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1163:
>The following error occurred while executing this line:
>/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:827:
>There were test failures: 236 suites, 980 tests, 1 suite-level error, 7
>ignored (2 assumptions)
>
>Total time: 27 minutes 40 seconds
>Build step 'Invoke Ant' marked build as failure
>Archiving artifacts
>Recording test results
>Description set: Java: 32bit/jdk1.6.0_37 -server -XX:+UseParallelGC
>Email was triggered for: Failure
>Sending email for trigger: Failure
>
>
>
>
>------------------------------------------------------------------------
>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>For additional commands, e-mail: dev-help@lucene.apache.org

--
Uwe Schindler
H.-H.-Meier-Allee 63, 28213 Bremen
http://www.thetaphi.de
Mime
View raw message