lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b79) - Build # 4781 - Still Failing!
Date Fri, 22 Mar 2013 15:04:02 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/4781/
Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseG1GC -XX:MarkStackSize=256K

2 tests failed.
REGRESSION:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard2 in collection test_unload_shard_and_collection

Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
	at __randomizedtesting.SeedInfo.seed([9527A265BD6763F:88B4F43E2C891603]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:33614/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:33614/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([9527A265BD6763F:88B4F43E2C891603]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8965 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   2> 1 T229 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 4 T229 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363963700673
[junit4:junit4]   2> 7 T229 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 9 T230 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 30 T230 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 30 T230 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4]   2> 30 T230 oaz.Environment.logEnv Server environment:java.version=1.8.0-ea
[junit4:junit4]   2> 30 T230 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 31 T230 oaz.Environment.logEnv Server environment:java.home=/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/jre
[junit4:junit4]   2> 31 T230 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/noggit-0.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4]   2> 32 T230 oaz.Environment.logEnv Server environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4]   2> 32 T230 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 32 T230 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 32 T230 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4]   2> 32 T230 oaz.Environment.logEnv Server environment:os.arch=i386
[junit4:junit4]   2> 33 T230 oaz.Environment.logEnv Server environment:os.version=3.2.0-39-generic
[junit4:junit4]   2> 33 T230 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 33 T230 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 33 T230 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 45 T230 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 45 T230 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 45 T230 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 46 T230 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 70 T230 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 108 T229 oasc.ZkTestServer.run start zk server on port:59500
[junit4:junit4]   2> 128 T229 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 129 T229 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4]   2> 129 T229 oaz.Environment.logEnv Client environment:java.version=1.8.0-ea
[junit4:junit4]   2> 129 T229 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 130 T229 oaz.Environment.logEnv Client environment:java.home=/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/jre
[junit4:junit4]   2> 130 T229 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpclient-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpcore-4.2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/httpmime-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/noggit-0.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b79/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4]   2> 131 T229 oaz.Environment.logEnv Client environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4]   2> 131 T229 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 132 T229 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 132 T229 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4]   2> 132 T229 oaz.Environment.logEnv Client environment:os.arch=i386
[junit4:junit4]   2> 132 T229 oaz.Environment.logEnv Client environment:os.version=3.2.0-39-generic
[junit4:junit4]   2> 133 T229 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 133 T229 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 133 T229 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 135 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a7d9d7
[junit4:junit4]   2> 159 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 164 T235 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 165 T235 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 165 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37887
[junit4:junit4]   2> 179 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37887
[junit4:junit4]   2> 182 T233 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 310 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f0000 with negotiated timeout 10000 for client /127.0.0.1:37887
[junit4:junit4]   2> 310 T235 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f0000, negotiated timeout = 10000
[junit4:junit4]   2> 313 T236 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a7d9d7 name:ZooKeeperConnection Watcher:127.0.0.1:59500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 313 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 315 T229 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 339 T234 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9292660f0000
[junit4:junit4]   2> 340 T236 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 340 T229 oaz.ZooKeeper.close Session: 0x13d9292660f0000 closed
[junit4:junit4]   2> 341 T231 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:37887 which had sessionid 0x13d9292660f0000
[junit4:junit4]   2> 341 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@c48d7c
[junit4:junit4]   2> 342 T237 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 342 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 342 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37888
[junit4:junit4]   2> 342 T237 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 343 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37888
[junit4:junit4]   2> 343 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f0001 with negotiated timeout 10000 for client /127.0.0.1:37888
[junit4:junit4]   2> 343 T237 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f0001, negotiated timeout = 10000
[junit4:junit4]   2> 344 T238 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c48d7c name:ZooKeeperConnection Watcher:127.0.0.1:59500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 344 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 344 T229 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 348 T229 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 351 T229 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 353 T229 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 356 T229 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 367 T229 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 373 T229 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 374 T229 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 378 T229 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 379 T229 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 382 T229 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 382 T229 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 385 T229 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 386 T229 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 389 T229 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 389 T229 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 392 T229 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 393 T229 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 396 T229 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 397 T229 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 399 T229 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 400 T229 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 403 T234 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9292660f0001
[junit4:junit4]   2> 403 T238 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 403 T231 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:37888 which had sessionid 0x13d9292660f0001
[junit4:junit4]   2> 403 T229 oaz.ZooKeeper.close Session: 0x13d9292660f0001 closed
[junit4:junit4]   2> 492 T229 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 498 T229 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58666
[junit4:junit4]   2> 499 T229 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 499 T229 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 499 T229 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363963701073
[junit4:junit4]   2> 500 T229 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363963701073/solr.xml
[junit4:junit4]   2> 500 T229 oasc.CoreContainer.<init> New CoreContainer 20627388
[junit4:junit4]   2> 501 T229 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363963701073/'
[junit4:junit4]   2> 501 T229 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363963701073/'
[junit4:junit4]   2> 522 T229 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 522 T229 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 523 T229 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 523 T229 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 524 T229 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 524 T229 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 524 T229 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 525 T229 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 525 T229 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 525 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 533 T229 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 547 T229 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59500/solr
[junit4:junit4]   2> 556 T229 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 556 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@130ac87
[junit4:junit4]   2> 557 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 557 T248 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 558 T248 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 558 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37891
[junit4:junit4]   2> 559 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37891
[junit4:junit4]   2> 560 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f0002 with negotiated timeout 20000 for client /127.0.0.1:37891
[junit4:junit4]   2> 560 T248 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f0002, negotiated timeout = 20000
[junit4:junit4]   2> 560 T249 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@130ac87 name:ZooKeeperConnection Watcher:127.0.0.1:59500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 560 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 561 T234 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9292660f0002
[junit4:junit4]   2> 562 T249 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 562 T231 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:37891 which had sessionid 0x13d9292660f0002
[junit4:junit4]   2> 562 T229 oaz.ZooKeeper.close Session: 0x13d9292660f0002 closed
[junit4:junit4]   2> 564 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 568 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@f1a9e2
[junit4:junit4]   2> 569 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 570 T250 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 570 T250 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 570 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37892
[junit4:junit4]   2> 571 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37892
[junit4:junit4]   2> 571 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f0003 with negotiated timeout 20000 for client /127.0.0.1:37892
[junit4:junit4]   2> 571 T250 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f0003, negotiated timeout = 20000
[junit4:junit4]   2> 572 T251 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f1a9e2 name:ZooKeeperConnection Watcher:127.0.0.1:59500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 572 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 577 T229 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 583 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 585 T229 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 591 T229 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 593 T229 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58666_
[junit4:junit4]   2> 595 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:58666_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:58666_
[junit4:junit4]   2> 596 T229 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58666_
[junit4:junit4]   2> 603 T229 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 615 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 616 T229 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 618 T229 oasc.Overseer.start Overseer (id=89388725092417539-127.0.0.1:58666_-n_0000000000) starting
[junit4:junit4]   2> 619 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 623 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 624 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 625 T229 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 631 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 633 T253 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 633 T229 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 635 T229 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 638 T229 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 643 T252 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 647 T254 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363963701073/collection1
[junit4:junit4]   2> 647 T254 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 648 T254 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 648 T254 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 649 T254 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363963701073/collection1/'
[junit4:junit4]   2> 650 T254 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363963701073/collection1/lib/README' to classloader
[junit4:junit4]   2> 650 T254 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363963701073/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 687 T254 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 744 T254 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 745 T254 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 754 T254 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1193 T254 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1200 T254 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1203 T254 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1219 T254 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1223 T254 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1226 T254 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1228 T254 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1228 T254 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1228 T254 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1229 T254 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1229 T254 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1230 T254 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1230 T254 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363963701073/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/control/data/
[junit4:junit4]   2> 1232 T254 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12e4cb8
[junit4:junit4]   2> 1232 T254 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1232 T254 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/control/data
[junit4:junit4]   2> 1233 T254 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/control/data/index/
[junit4:junit4]   2> 1233 T254 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1233 T254 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/control/data/index
[junit4:junit4]   2> 1234 T254 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@82fabd lockFactory=org.apache.lucene.store.NativeFSLockFactory@7ae711)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1235 T254 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1246 T254 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1246 T254 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1246 T254 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1247 T254 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1247 T254 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1247 T254 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1248 T254 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1248 T254 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1249 T254 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1251 T254 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1254 T254 oass.SolrIndexSearcher.<init> Opening Searcher@107893d main
[junit4:junit4]   2> 1256 T254 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/control/data/tlog
[junit4:junit4]   2> 1262 T254 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1262 T254 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1267 T255 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@107893d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1268 T254 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1269 T254 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2148 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2149 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:58666",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:58666_",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 2150 T252 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2152 T252 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2161 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2271 T254 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2271 T254 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58666 collection:control_collection shard:shard1
[junit4:junit4]   2> 2275 T254 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 2280 T254 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2287 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0003 type:delete cxid:0x82 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2287 T254 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2288 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0003 type:create cxid:0x83 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2290 T254 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2290 T254 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2292 T254 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58666/collection1/
[junit4:junit4]   2> 2292 T254 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2293 T254 oasc.SyncStrategy.syncToMe http://127.0.0.1:58666/collection1/ has no replicas
[junit4:junit4]   2> 2293 T254 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58666/collection1/
[junit4:junit4]   2> 2293 T254 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2298 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0003 type:create cxid:0x8e zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3666 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3675 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3703 T254 oasc.ZkController.register We are http://127.0.0.1:58666/collection1/ and leader is http://127.0.0.1:58666/collection1/
[junit4:junit4]   2> 3704 T254 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58666
[junit4:junit4]   2> 3704 T254 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3704 T254 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3705 T254 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3706 T254 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3708 T229 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3708 T229 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3709 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3714 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3716 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@99c71d
[junit4:junit4]   2> 3717 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3717 T257 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3718 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37897
[junit4:junit4]   2> 3718 T257 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 3718 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37897
[junit4:junit4]   2> 3719 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f0004 with negotiated timeout 10000 for client /127.0.0.1:37897
[junit4:junit4]   2> 3719 T257 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f0004, negotiated timeout = 10000
[junit4:junit4]   2> 3719 T258 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@99c71d name:ZooKeeperConnection Watcher:127.0.0.1:59500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3720 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3721 T229 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3724 T229 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 3798 T229 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3800 T229 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37600
[junit4:junit4]   2> 3800 T229 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3801 T229 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3801 T229 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363963704394
[junit4:junit4]   2> 3802 T229 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363963704394/solr.xml
[junit4:junit4]   2> 3802 T229 oasc.CoreContainer.<init> New CoreContainer 13080136
[junit4:junit4]   2> 3802 T229 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363963704394/'
[junit4:junit4]   2> 3803 T229 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363963704394/'
[junit4:junit4]   2> 3827 T229 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 3828 T229 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3828 T229 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 3828 T229 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3829 T229 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3829 T229 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3829 T229 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3830 T229 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3830 T229 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3831 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 3839 T229 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3854 T229 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59500/solr
[junit4:junit4]   2> 3855 T229 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3855 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@17d5d6f
[junit4:junit4]   2> 3856 T268 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3856 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3857 T268 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 3857 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37898
[junit4:junit4]   2> 3858 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37898
[junit4:junit4]   2> 3858 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f0005 with negotiated timeout 20000 for client /127.0.0.1:37898
[junit4:junit4]   2> 3858 T268 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f0005, negotiated timeout = 20000
[junit4:junit4]   2> 3859 T269 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17d5d6f name:ZooKeeperConnection Watcher:127.0.0.1:59500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3859 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3860 T234 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9292660f0005
[junit4:junit4]   2> 3861 T269 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3861 T231 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:37898 which had sessionid 0x13d9292660f0005
[junit4:junit4]   2> 3861 T229 oaz.ZooKeeper.close Session: 0x13d9292660f0005 closed
[junit4:junit4]   2> 3861 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 3864 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@429722
[junit4:junit4]   2> 3865 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3865 T270 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3866 T270 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 3866 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37899
[junit4:junit4]   2> 3866 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37899
[junit4:junit4]   2> 3867 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f0006 with negotiated timeout 20000 for client /127.0.0.1:37899
[junit4:junit4]   2> 3867 T270 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f0006, negotiated timeout = 20000
[junit4:junit4]   2> 3867 T271 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@429722 name:ZooKeeperConnection Watcher:127.0.0.1:59500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3868 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3868 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0006 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3869 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0006 type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3871 T229 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4875 T229 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37600_
[junit4:junit4]   2> 4876 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0006 type:delete cxid:0xd zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:37600_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:37600_
[junit4:junit4]   2> 4876 T229 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37600_
[junit4:junit4]   2> 4878 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4879 T258 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4879 T271 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4880 T251 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4886 T272 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363963704394/collection1
[junit4:junit4]   2> 4886 T272 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4887 T272 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4887 T272 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4888 T272 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363963704394/collection1/'
[junit4:junit4]   2> 4889 T272 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363963704394/collection1/lib/README' to classloader
[junit4:junit4]   2> 4889 T272 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363963704394/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4916 T272 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 4952 T272 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4953 T272 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4958 T272 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5181 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5182 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:58666",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:58666_",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:58666__collection1",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 5188 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5188 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5189 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5363 T272 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5369 T272 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5372 T272 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5387 T272 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5390 T272 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5393 T272 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5394 T272 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5395 T272 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5395 T272 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5396 T272 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5396 T272 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5397 T272 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5397 T272 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363963704394/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty1/
[junit4:junit4]   2> 5397 T272 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12e4cb8
[junit4:junit4]   2> 5397 T272 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5398 T272 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty1
[junit4:junit4]   2> 5398 T272 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty1/index/
[junit4:junit4]   2> 5398 T272 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5399 T272 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty1/index
[junit4:junit4]   2> 5400 T272 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1fa10ba lockFactory=org.apache.lucene.store.NativeFSLockFactory@135d434)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5400 T272 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5401 T272 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5402 T272 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5402 T272 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5403 T272 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5404 T272 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5404 T272 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5404 T272 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5405 T272 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5405 T272 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5407 T272 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5410 T272 oass.SolrIndexSearcher.<init> Opening Searcher@22f109 main
[junit4:junit4]   2> 5410 T272 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty1/tlog
[junit4:junit4]   2> 5411 T272 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5411 T272 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5416 T273 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@22f109 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5417 T272 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5417 T272 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6693 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6694 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37600",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37600_",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 6694 T252 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 6695 T252 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6701 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6702 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6702 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7419 T272 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 7419 T272 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37600 collection:collection1 shard:shard1
[junit4:junit4]   2> 7420 T272 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7428 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0006 type:delete cxid:0x4a zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 7428 T272 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 7429 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0006 type:create cxid:0x4b zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7431 T272 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 7443 T272 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 7444 T272 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:37600/collection1/
[junit4:junit4]   2> 7444 T272 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 7444 T272 oasc.SyncStrategy.syncToMe http://127.0.0.1:37600/collection1/ has no replicas
[junit4:junit4]   2> 7444 T272 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:37600/collection1/
[junit4:junit4]   2> 7444 T272 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7449 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0006 type:create cxid:0x56 zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8206 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8219 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8219 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8219 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8252 T272 oasc.ZkController.register We are http://127.0.0.1:37600/collection1/ and leader is http://127.0.0.1:37600/collection1/
[junit4:junit4]   2> 8252 T272 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37600
[junit4:junit4]   2> 8253 T272 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 8253 T272 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8253 T272 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8254 T272 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8255 T229 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 8256 T229 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8257 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8339 T229 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8342 T229 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33614
[junit4:junit4]   2> 8343 T229 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8343 T229 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8343 T229 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363963708931
[junit4:junit4]   2> 8344 T229 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363963708931/solr.xml
[junit4:junit4]   2> 8344 T229 oasc.CoreContainer.<init> New CoreContainer 9509354
[junit4:junit4]   2> 8345 T229 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363963708931/'
[junit4:junit4]   2> 8345 T229 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363963708931/'
[junit4:junit4]   2> 8368 T229 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 8369 T229 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8369 T229 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 8370 T229 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8370 T229 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8371 T229 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8372 T229 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8372 T229 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8373 T229 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8373 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 8381 T229 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8393 T229 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59500/solr
[junit4:junit4]   2> 8393 T229 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8394 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@169914d
[junit4:junit4]   2> 8395 T284 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8395 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8396 T284 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 8396 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37910
[junit4:junit4]   2> 8396 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37910
[junit4:junit4]   2> 8397 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f0007 with negotiated timeout 20000 for client /127.0.0.1:37910
[junit4:junit4]   2> 8397 T284 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f0007, negotiated timeout = 20000
[junit4:junit4]   2> 8398 T285 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@169914d name:ZooKeeperConnection Watcher:127.0.0.1:59500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8398 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8400 T234 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9292660f0007
[junit4:junit4]   2> 8401 T231 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:37910 which had sessionid 0x13d9292660f0007
[junit4:junit4]   2> 8404 T285 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8404 T229 oaz.ZooKeeper.close Session: 0x13d9292660f0007 closed
[junit4:junit4]   2> 8405 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 8408 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@e21511
[junit4:junit4]   2> 8409 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8409 T286 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 8409 T286 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 8410 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37911
[junit4:junit4]   2> 8410 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37911
[junit4:junit4]   2> 8411 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f0008 with negotiated timeout 20000 for client /127.0.0.1:37911
[junit4:junit4]   2> 8411 T286 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f0008, negotiated timeout = 20000
[junit4:junit4]   2> 8411 T287 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e21511 name:ZooKeeperConnection Watcher:127.0.0.1:59500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8411 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8412 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8413 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0008 type:create cxid:0x3 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8415 T229 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 9417 T229 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33614_
[junit4:junit4]   2> 9418 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0008 type:delete cxid:0xd zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33614_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33614_
[junit4:junit4]   2> 9419 T229 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33614_
[junit4:junit4]   2> 9421 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9421 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9422 T287 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9422 T258 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9422 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9423 T271 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9424 T251 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9430 T288 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363963708931/collection1
[junit4:junit4]   2> 9430 T288 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9431 T288 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9431 T288 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9432 T288 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363963708931/collection1/'
[junit4:junit4]   2> 9433 T288 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363963708931/collection1/lib/README' to classloader
[junit4:junit4]   2> 9433 T288 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363963708931/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9468 T288 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 9509 T288 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9510 T288 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9517 T288 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 9733 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9734 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37600",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37600_",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:37600__collection1",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 9738 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9738 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9738 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9738 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9932 T288 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 9938 T288 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 9941 T288 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 9952 T288 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9956 T288 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9959 T288 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9960 T288 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 9960 T288 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 9960 T288 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9961 T288 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 9962 T288 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 9962 T288 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 9962 T288 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363963708931/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty2/
[junit4:junit4]   2> 9962 T288 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12e4cb8
[junit4:junit4]   2> 9963 T288 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 9963 T288 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty2
[junit4:junit4]   2> 9963 T288 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty2/index/
[junit4:junit4]   2> 9964 T288 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 9964 T288 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty2/index
[junit4:junit4]   2> 9965 T288 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@150659c lockFactory=org.apache.lucene.store.NativeFSLockFactory@ea5064)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9965 T288 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 9967 T288 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 9967 T288 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 9968 T288 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 9968 T288 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 9969 T288 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 9969 T288 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 9969 T288 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 9970 T288 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 9970 T288 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 9972 T288 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 9975 T288 oass.SolrIndexSearcher.<init> Opening Searcher@aedd7a main
[junit4:junit4]   2> 9975 T288 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty2/tlog
[junit4:junit4]   2> 9975 T288 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 9976 T288 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 9981 T289 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@aedd7a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 9983 T288 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 9983 T288 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11243 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11244 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33614",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33614_",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 11244 T252 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 11244 T252 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 11250 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11250 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11250 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11250 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11984 T288 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11985 T288 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33614 collection:collection1 shard:shard2
[junit4:junit4]   2> 11985 T288 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 11991 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0008 type:delete cxid:0x49 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 11992 T288 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 11992 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0008 type:create cxid:0x4a zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11994 T288 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 11994 T288 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 11994 T288 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33614/collection1/
[junit4:junit4]   2> 11994 T288 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 11995 T288 oasc.SyncStrategy.syncToMe http://127.0.0.1:33614/collection1/ has no replicas
[junit4:junit4]   2> 11995 T288 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33614/collection1/
[junit4:junit4]   2> 11995 T288 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 11998 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0008 type:create cxid:0x54 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12755 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12762 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12762 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12762 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12762 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12802 T288 oasc.ZkController.register We are http://127.0.0.1:33614/collection1/ and leader is http://127.0.0.1:33614/collection1/
[junit4:junit4]   2> 12802 T288 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33614
[junit4:junit4]   2> 12802 T288 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 12802 T288 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 12803 T288 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12804 T288 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12805 T229 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 12806 T229 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 12806 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12874 T229 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 12877 T229 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37812
[junit4:junit4]   2> 12878 T229 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 12878 T229 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 12878 T229 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363963713479
[junit4:junit4]   2> 12879 T229 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363963713479/solr.xml
[junit4:junit4]   2> 12879 T229 oasc.CoreContainer.<init> New CoreContainer 10390608
[junit4:junit4]   2> 12879 T229 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363963713479/'
[junit4:junit4]   2> 12880 T229 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363963713479/'
[junit4:junit4]   2> 12899 T229 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 12899 T229 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 12899 T229 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 12900 T229 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 12900 T229 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 12900 T229 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 12901 T229 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 12901 T229 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 12901 T229 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 12902 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 12909 T229 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 12922 T229 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59500/solr
[junit4:junit4]   2> 12922 T229 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 12923 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d55530
[junit4:junit4]   2> 12924 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12924 T300 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12924 T300 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 12924 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37915
[junit4:junit4]   2> 12925 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37915
[junit4:junit4]   2> 12926 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f0009 with negotiated timeout 20000 for client /127.0.0.1:37915
[junit4:junit4]   2> 12926 T300 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f0009, negotiated timeout = 20000
[junit4:junit4]   2> 12926 T301 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d55530 name:ZooKeeperConnection Watcher:127.0.0.1:59500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12926 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12927 T234 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9292660f0009
[junit4:junit4]   2> 12928 T301 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12928 T229 oaz.ZooKeeper.close Session: 0x13d9292660f0009 closed
[junit4:junit4]   2> 12928 T231 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:37915 which had sessionid 0x13d9292660f0009
[junit4:junit4]   2> 12928 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 12931 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e33565
[junit4:junit4]   2> 12932 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12932 T302 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12933 T302 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 12933 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37916
[junit4:junit4]   2> 12933 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37916
[junit4:junit4]   2> 12934 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f000a with negotiated timeout 20000 for client /127.0.0.1:37916
[junit4:junit4]   2> 12934 T302 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f000a, negotiated timeout = 20000
[junit4:junit4]   2> 12934 T303 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e33565 name:ZooKeeperConnection Watcher:127.0.0.1:59500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12934 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12935 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f000a type:create cxid:0x1 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12936 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f000a type:create cxid:0x3 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12938 T229 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 13941 T229 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37812_
[junit4:junit4]   2> 13941 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f000a type:delete cxid:0xd zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:37812_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:37812_
[junit4:junit4]   2> 13942 T229 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37812_
[junit4:junit4]   2> 13944 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13944 T258 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13945 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13945 T271 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13946 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13946 T303 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13946 T287 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13946 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13946 T251 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13950 T304 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363963713479/collection1
[junit4:junit4]   2> 13951 T304 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 13951 T304 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 13951 T304 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 13952 T304 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363963713479/collection1/'
[junit4:junit4]   2> 13953 T304 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363963713479/collection1/lib/README' to classloader
[junit4:junit4]   2> 13953 T304 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363963713479/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 13984 T304 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 14040 T304 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14041 T304 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14046 T304 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 14267 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14268 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:33614",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:33614_",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:33614__collection1",
[junit4:junit4]   2> 	  "shard":"shard2"}
[junit4:junit4]   2> 14271 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14271 T303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14271 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14271 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14272 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14485 T304 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 14491 T304 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 14494 T304 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 14506 T304 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14509 T304 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14513 T304 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14514 T304 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14514 T304 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14514 T304 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14515 T304 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14515 T304 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14516 T304 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 14516 T304 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363963713479/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty3/
[junit4:junit4]   2> 14516 T304 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12e4cb8
[junit4:junit4]   2> 14516 T304 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 14517 T304 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty3
[junit4:junit4]   2> 14517 T304 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty3/index/
[junit4:junit4]   2> 14517 T304 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 14517 T304 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty3/index
[junit4:junit4]   2> 14519 T304 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@f74ae9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@dc0776)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 14519 T304 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 14520 T304 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 14521 T304 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 14521 T304 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 14522 T304 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 14522 T304 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 14522 T304 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 14523 T304 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 14523 T304 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 14523 T304 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 14526 T304 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 14528 T304 oass.SolrIndexSearcher.<init> Opening Searcher@ae0c7b main
[junit4:junit4]   2> 14529 T304 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty3/tlog
[junit4:junit4]   2> 14529 T304 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 14529 T304 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 14534 T305 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ae0c7b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 14536 T304 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 14536 T304 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15776 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15777 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37812",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37812_",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 15778 T252 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 15778 T252 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 15784 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15784 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15784 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15784 T303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15784 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16537 T304 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 16537 T304 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37812 collection:collection1 shard:shard1
[junit4:junit4]   2> 16540 T304 oasc.ZkController.register We are http://127.0.0.1:37812/collection1/ and leader is http://127.0.0.1:37600/collection1/
[junit4:junit4]   2> 16541 T304 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37812
[junit4:junit4]   2> 16541 T304 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 16541 T304 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C16 name=collection1 org.apache.solr.core.SolrCore@186fe24 url=http://127.0.0.1:37812/collection1 node=127.0.0.1:37812_ C16_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:37812, node_name=127.0.0.1:37812_, state=down, core=collection1}
[junit4:junit4]   2> 16546 T306 C16 P37812 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 16547 T304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16551 T306 C16 P37812 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 16552 T306 C16 P37812 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 16552 T306 C16 P37812 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16555 T229 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 16556 T229 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 16557 T306 C16 P37812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16557 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16667 T229 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 16673 T229 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38702
[junit4:junit4]   2> 16673 T229 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 16674 T229 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 16674 T229 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363963717230
[junit4:junit4]   2> 16674 T229 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363963717230/solr.xml
[junit4:junit4]   2> 16675 T229 oasc.CoreContainer.<init> New CoreContainer 28563973
[junit4:junit4]   2> 16675 T229 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363963717230/'
[junit4:junit4]   2> 16676 T229 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363963717230/'
[junit4:junit4]   2> 16705 T229 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 16706 T229 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 16706 T229 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 16706 T229 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 16707 T229 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 16707 T229 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 16708 T229 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 16708 T229 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 16708 T229 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 16709 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 16716 T229 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 16732 T229 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:59500/solr
[junit4:junit4]   2> 16733 T229 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 16734 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@ee5472
[junit4:junit4]   2> 16735 T317 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 16735 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16737 T317 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 16737 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37943
[junit4:junit4]   2> 16737 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37943
[junit4:junit4]   2> 16738 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f000b with negotiated timeout 20000 for client /127.0.0.1:37943
[junit4:junit4]   2> 16738 T317 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f000b, negotiated timeout = 20000
[junit4:junit4]   2> 16739 T318 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ee5472 name:ZooKeeperConnection Watcher:127.0.0.1:59500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16739 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16740 T234 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9292660f000b
[junit4:junit4]   2> 16741 T318 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 16741 T231 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:37943 which had sessionid 0x13d9292660f000b
[junit4:junit4]   2> 16741 T229 oaz.ZooKeeper.close Session: 0x13d9292660f000b closed
[junit4:junit4]   2> 16741 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 16744 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e421ca
[junit4:junit4]   2> 16748 T319 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:59500. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 16748 T229 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16749 T231 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:37944
[junit4:junit4]   2> 16749 T319 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:59500, initiating session
[junit4:junit4]   2> 16750 T231 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:37944
[junit4:junit4]   2> 16751 T233 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9292660f000c with negotiated timeout 20000 for client /127.0.0.1:37944
[junit4:junit4]   2> 16751 T319 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:59500, sessionid = 0x13d9292660f000c, negotiated timeout = 20000
[junit4:junit4]   2> 16754 T320 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e421ca name:ZooKeeperConnection Watcher:127.0.0.1:59500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16754 T229 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16758 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f000c type:create cxid:0x1 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16760 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f000c type:create cxid:0x3 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16763 T229 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 17292 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17293 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37812",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37812_",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:37812__collection1",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 17300 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17300 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17301 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17300 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17300 T320 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17300 T303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17568 T266 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {nodeName=127.0.0.1:37812_&action=PREPRECOVERY&state=recovering&coreNodeName=127.0.0.1:37812__collection1&onlyIfLeader=true&core=collection1&checkLive=true&version=2&wt=javabin} status=0 QTime=1002 
[junit4:junit4]   2> 17767 T229 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38702_
[junit4:junit4]   2> 17768 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f000c type:delete cxid:0xf zxid:0xa7 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:38702_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:38702_
[junit4:junit4]   2> 17769 T229 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38702_
[junit4:junit4]   2> 17772 T303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17773 T258 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17773 T320 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17774 T251 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17774 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17774 T287 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17774 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17774 T271 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17774 T320 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17775 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17776 T303 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17776 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17785 T321 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363963717230/collection1
[junit4:junit4]   2> 17786 T321 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 17787 T321 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 17787 T321 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 17789 T321 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363963717230/collection1/'
[junit4:junit4]   2> 17791 T321 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363963717230/collection1/lib/README' to classloader
[junit4:junit4]   2> 17791 T321 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363963717230/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 17835 T321 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 17878 T321 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 17879 T321 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 17885 T321 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 18330 T321 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 18336 T321 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 18339 T321 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 18351 T321 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 18354 T321 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 18357 T321 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 18358 T321 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 18358 T321 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 18359 T321 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 18360 T321 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 18360 T321 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 18360 T321 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 18360 T321 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363963717230/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty4/
[junit4:junit4]   2> 18360 T321 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12e4cb8
[junit4:junit4]   2> 18361 T321 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 18361 T321 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty4
[junit4:junit4]   2> 18361 T321 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty4/index/
[junit4:junit4]   2> 18362 T321 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 18362 T321 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty4/index
[junit4:junit4]   2> 18363 T321 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@11be0d6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@137fc3e)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 18364 T321 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 18366 T321 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 18366 T321 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 18367 T321 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 18368 T321 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 18368 T321 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 18369 T321 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 18369 T321 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 18370 T321 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 18370 T321 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 18373 T321 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 18377 T321 oass.SolrIndexSearcher.<init> Opening Searcher@5388f0 main
[junit4:junit4]   2> 18377 T321 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty4/tlog
[junit4:junit4]   2> 18378 T321 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 18378 T321 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 18382 T322 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5388f0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 18384 T321 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 18384 T321 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18809 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18811 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38702",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38702_",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 18811 T252 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 18812 T252 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 18839 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18839 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18839 T303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18839 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18839 T320 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18839 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19385 T321 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 19386 T321 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38702 collection:collection1 shard:shard2
[junit4:junit4]   2> 19390 T321 oasc.ZkController.register We are http://127.0.0.1:38702/collection1/ and leader is http://127.0.0.1:33614/collection1/
[junit4:junit4]   2> 19391 T321 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38702
[junit4:junit4]   2> 19391 T321 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 19392 T321 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C17 name=collection1 org.apache.solr.core.SolrCore@8d246 url=http://127.0.0.1:38702/collection1 node=127.0.0.1:38702_ C17_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:38702, node_name=127.0.0.1:38702_, state=down, core=collection1}
[junit4:junit4]   2> 19393 T323 C17 P38702 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 19393 T323 C17 P38702 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 19394 T321 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19394 T323 C17 P38702 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 19395 T323 C17 P38702 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19396 T229 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 19396 T323 C17 P38702 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19396 T229 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 19397 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19404 T229 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19407 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19427 T266 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363963704394/onenodecollectioncore
[junit4:junit4]   2> 19428 T266 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4]   2> 19428 T266 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   2> 19429 T266 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 19430 T266 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 19430 T266 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4]   2> 19432 T266 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4]   2> 19433 T266 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363963704394/onenodecollectioncore/'
[junit4:junit4]   2> 19468 T266 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 19512 T266 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 19513 T266 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 19522 T266 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2>  C16_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:37812, node_name=127.0.0.1:37812_, state=recovering, core=collection1, shard=shard1}
[junit4:junit4]   2> 19570 T306 C16 P37812 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:37600/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 19574 T306 C16 P37812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 19578 T306 C16 P37812 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:37812 START replicas=[http://127.0.0.1:37600/collection1/] nUpdates=100
[junit4:junit4]   2> 19579 T306 C16 P37812 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 19580 T306 C16 P37812 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 19580 T306 C16 P37812 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 19580 T306 C16 P37812 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 19580 T306 C16 P37812 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 19581 T306 C16 P37812 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:37600/collection1/. core=collection1
[junit4:junit4]   2> 19581 T306 C16 P37812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C18 name=collection1 org.apache.solr.core.SolrCore@1475c88 url=http://127.0.0.1:37600/collection1 node=127.0.0.1:37600_ C18_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:37600, node_name=127.0.0.1:37600_, state=active, core=collection1, shard=shard1, leader=true}
[junit4:junit4]   2> 19584 T265 C18 P37600 REQ /get {qt=/get&getVersions=100&distrib=false&version=2&wt=javabin} status=0 QTime=0 
[junit4:junit4]   2> 19591 T267 C18 P37600 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 19593 T267 C18 P37600 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1fa10ba lockFactory=org.apache.lucene.store.NativeFSLockFactory@135d434)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 19594 T267 C18 P37600 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 19594 T267 C18 P37600 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1fa10ba lockFactory=org.apache.lucene.store.NativeFSLockFactory@135d434)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1fa10ba lockFactory=org.apache.lucene.store.NativeFSLockFactory@135d434)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 19595 T267 C18 P37600 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 19595 T267 C18 P37600 oass.SolrIndexSearcher.<init> Opening Searcher@94e88b realtime
[junit4:junit4]   2> 19596 T267 C18 P37600 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 19597 T267 C18 P37600 /update {commit=true&commit_end_point=true&openSearcher=false&softCommit=false&waitSearcher=true&version=2&wt=javabin} {commit=} 0 11
[junit4:junit4]   2> 19616 T306 C16 P37812 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19617 T306 C16 P37812 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 19621 T306 C16 P37812 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 19625 T265 C18 P37600 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19626 T265 C18 P37600 REQ /replication {qt=/replication&command=indexversion&version=2&wt=javabin} status=0 QTime=3 
[junit4:junit4]   2> 19626 T306 C16 P37812 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 19627 T306 C16 P37812 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 19627 T306 C16 P37812 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 19629 T267 C18 P37600 REQ /replication {qt=/replication&command=filelist&version=2&wt=javabin&generation=2} status=0 QTime=1 
[junit4:junit4]   2> 19629 T306 C16 P37812 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 19630 T306 C16 P37812 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty3/index.20130322114840299
[junit4:junit4]   2> 19630 T306 C16 P37812 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3ad139 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d05d0) fullCopy=false
[junit4:junit4]   2> 19635 T264 C18 P37600 REQ /replication {qt=/replication&file=segments_2&checksum=true&command=filecontent&wt=filestream&generation=2} status=0 QTime=1 
[junit4:junit4]   2> 19640 T306 C16 P37812 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 19641 T306 C16 P37812 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 19641 T306 C16 P37812 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 19642 T306 C16 P37812 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@f74ae9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@dc0776)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@f74ae9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@dc0776)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 19642 T306 C16 P37812 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 19643 T306 C16 P37812 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 19643 T306 C16 P37812 oass.SolrIndexSearcher.<init> Opening Searcher@1beb84 main
[junit4:junit4]   2> 19644 T305 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1beb84 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 19644 T306 C16 P37812 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 19644 T306 C16 P37812 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 19645 T306 C16 P37812 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 19645 T306 C16 P37812 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19646 T306 C16 P37812 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 19939 T266 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 19945 T266 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 19948 T266 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 19965 T266 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 19974 T266 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 19981 T266 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 19983 T266 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 19984 T266 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 19984 T266 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 19986 T266 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 19987 T266 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 19988 T266 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 19988 T266 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363963704394/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363963700673/onenodecollection/
[junit4:junit4]   2> 19989 T266 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12e4cb8
[junit4:junit4]   2> 19990 T266 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 19991 T266 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363963700673/onenodecollection
[junit4:junit4]   2> 19992 T266 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363963700673/onenodecollection/index/
[junit4:junit4]   2> 19993 T266 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363963700673/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 19994 T266 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363963700673/onenodecollection/index
[junit4:junit4]   2> 19997 T266 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@601a76 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2c8a3e)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 19997 T266 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 20001 T266 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 20001 T266 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 20003 T266 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 20004 T266 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 20005 T266 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 20006 T266 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 20006 T266 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 20007 T266 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 20008 T266 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 20014 T266 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 20019 T266 oass.SolrIndexSearcher.<init> Opening Searcher@6f72af main
[junit4:junit4]   2> 20019 T266 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363963700673/onenodecollection/tlog
[junit4:junit4]   2> 20020 T266 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 20020 T266 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 20023 T327 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@6f72af main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 20024 T266 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4]   2> 20353 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20355 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38702",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38702_",
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:38702__collection1",
[junit4:junit4]   2> 	  "shard":"shard2"}
[junit4:junit4]   2> 20360 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37812",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37812_",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:37812__collection1",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 20366 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "collection":"onenodecollection",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":"none",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37600",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37600_",
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"onenodecollectioncore",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 20366 T252 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4]   2> 20367 T252 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 20373 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20374 T303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20374 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20373 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20373 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20373 T320 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20405 T280 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {nodeName=127.0.0.1:38702_&action=PREPRECOVERY&state=recovering&coreNodeName=127.0.0.1:38702__collection1&onlyIfLeader=true&core=collection1&checkLive=true&version=2&wt=javabin} status=0 QTime=1000 
[junit4:junit4]   2> 21026 T266 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4]   2> 21026 T266 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:37600 collection:onenodecollection shard:shard1
[junit4:junit4]   2> 21027 T266 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   2> 21032 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0006 type:delete cxid:0xac zxid:0xc2 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4]   2> 21033 T266 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 21034 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0006 type:create cxid:0xad zxid:0xc3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 21035 T266 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 21036 T266 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 21036 T266 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:37600/onenodecollectioncore/
[junit4:junit4]   2> 21036 T266 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 21037 T266 oasc.SyncStrategy.syncToMe http://127.0.0.1:37600/onenodecollectioncore/ has no replicas
[junit4:junit4]   2> 21037 T266 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:37600/onenodecollectioncore/
[junit4:junit4]   2> 21038 T266 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   2> 21041 T234 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9292660f0006 type:create cxid:0xb8 zxid:0xc7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 21885 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21893 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21893 T303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21893 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21893 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21893 T320 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21893 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21944 T266 oasc.ZkController.register We are http://127.0.0.1:37600/onenodecollectioncore/ and leader is http://127.0.0.1:37600/onenodecollectioncore/
[junit4:junit4]   2> 21945 T266 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:37600
[junit4:junit4]   2> 21945 T266 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 21945 T266 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4]   2> 21947 T266 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21948 T266 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {collection=onenodecollection&action=CREATE&numShards=1&roles=none&name=onenodecollectioncore&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363963700673/onenodecollection&version=2&wt=javabin} status=0 QTime=2521 
[junit4:junit4]   2> 21949 T229 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 21949 T229 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C17_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:38702, node_name=127.0.0.1:38702_, state=recovering, core=collection1, shard=shard2}
[junit4:junit4]   2> 22407 T323 C17 P38702 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:33614/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 22407 T323 C17 P38702 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:38702 START replicas=[http://127.0.0.1:33614/collection1/] nUpdates=100
[junit4:junit4]   2> 22407 T323 C17 P38702 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 22407 T323 C17 P38702 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 22408 T323 C17 P38702 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 22408 T323 C17 P38702 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 22408 T323 C17 P38702 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 22408 T323 C17 P38702 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:33614/collection1/. core=collection1
[junit4:junit4]   2> 22409 T323 C17 P38702 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C19 name=collection1 org.apache.solr.core.SolrCore@189153f url=http://127.0.0.1:33614/collection1 node=127.0.0.1:33614_ C19_STATE=coll:collection1 core:collection1 props:{collection=collection1, base_url=http://127.0.0.1:33614, node_name=127.0.0.1:33614_, state=active, core=collection1, shard=shard2, leader=true}
[junit4:junit4]   2> 22412 T280 C19 P33614 REQ /get {qt=/get&getVersions=100&distrib=false&version=2&wt=javabin} status=0 QTime=0 
[junit4:junit4]   2> 22413 T281 C19 P33614 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22415 T281 C19 P33614 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@150659c lockFactory=org.apache.lucene.store.NativeFSLockFactory@ea5064)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 22415 T281 C19 P33614 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 22416 T281 C19 P33614 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@150659c lockFactory=org.apache.lucene.store.NativeFSLockFactory@ea5064)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@150659c lockFactory=org.apache.lucene.store.NativeFSLockFactory@ea5064)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 22416 T281 C19 P33614 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 22416 T281 C19 P33614 oass.SolrIndexSearcher.<init> Opening Searcher@11271de realtime
[junit4:junit4]   2> 22417 T281 C19 P33614 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22417 T281 C19 P33614 /update {commit=true&commit_end_point=true&openSearcher=false&softCommit=false&waitSearcher=true&version=2&wt=javabin} {commit=} 0 5
[junit4:junit4]   2> 22418 T323 C17 P38702 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 22418 T323 C17 P38702 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 22420 T283 C19 P33614 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 22420 T283 C19 P33614 REQ /replication {qt=/replication&command=indexversion&version=2&wt=javabin} status=0 QTime=1 
[junit4:junit4]   2> 22420 T323 C17 P38702 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 22421 T323 C17 P38702 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 22421 T323 C17 P38702 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 22422 T280 C19 P33614 REQ /replication {qt=/replication&command=filelist&version=2&wt=javabin&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 22423 T323 C17 P38702 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 22423 T323 C17 P38702 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363963700673/jetty4/index.20130322114843092
[junit4:junit4]   2> 22424 T323 C17 P38702 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a4680 lockFactory=org.apache.lucene.store.NativeFSLockFactory@108afcb) fullCopy=false
[junit4:junit4]   2> 22426 T281 C19 P33614 REQ /replication {qt=/replication&file=segments_2&checksum=true&command=filecontent&wt=filestream&generation=2} status=0 QTime=0 
[junit4:junit4]   2> 22427 T323 C17 P38702 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 22428 T323 C17 P38702 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 22428 T323 C17 P38702 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 22429 T323 C17 P38702 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@11be0d6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@137fc3e)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@11be0d6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@137fc3e)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 22429 T323 C17 P38702 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 22429 T323 C17 P38702 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 22429 T323 C17 P38702 oass.SolrIndexSearcher.<init> Opening Searcher@10d7747 main
[junit4:junit4]   2> 22431 T322 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10d7747 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 22431 T323 C17 P38702 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 22432 T323 C17 P38702 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 22432 T323 C17 P38702 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 22432 T323 C17 P38702 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 22434 T323 C17 P38702 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 22951 T229 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23398 T252 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23399 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "collection":"onenodecollection",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":"none",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:37600",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:37600_",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"onenodecollectioncore",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:37600__onenodecollectioncore",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 23402 T252 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:38702",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:38702_",
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:38702__collection1",
[junit4:junit4]   2> 	  "shard":"shard2"}
[junit4:junit4]   2> 23406 T287 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23406 T320 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23406 T271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23406 T258 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23406 T303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23406 T251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23953 T229 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23954 T229 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4]   2> 23954 T229 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 23965 T229 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:59500 sessionTimeout=10000 watcher=org.apache.solr.commo

[...truncated too long message...]

127.0.0.1:33245",
[junit4:junit4]   1>                   "core":"unloadcollection4",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:33245_"},
[junit4:junit4]   1>                 "127.0.0.1:35854__unloadcollection2":{
[junit4:junit4]   1>                   "collection":"unloadcollection",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:35854",
[junit4:junit4]   1>                   "core":"unloadcollection2",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:35854_"}}}}},
[junit4:junit4]   1>         "test_unload_shard_and_collection":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{"shard2":{
[junit4:junit4]   1>               "range":"0-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"127.0.0.1:41868__test_unload_shard_and_collection_1":{
[junit4:junit4]   1>                   "collection":"test_unload_shard_and_collection",
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "shard":"shard2",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:41868",
[junit4:junit4]   1>                   "core":"test_unload_shard_and_collection_1",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:41868_",
[junit4:junit4]   1>                   "leader":"true"}}}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=9527A265BD6763F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_PH -Dtests.timezone=Pacific/Efate -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  138s J0 | UnloadDistributedZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([9527A265BD6763F:88B4F43E2C891603]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:124)
[junit4:junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:77)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 138490 T22 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 138502 T21 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> 138953 T25 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {range_facet_sl=Pulsing41(freqCutoff=8 minBlockSize=52 maxBlockSize=147), id=Pulsing41(freqCutoff=8 minBlockSize=52 maxBlockSize=147), a_si=PostingsFormat(name=Asserting), range_facet_si=PostingsFormat(name=Direct), intDefault=PostingsFormat(name=Asserting), timestamp=PostingsFormat(name=Direct), other_tl1=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=Direct), _version_=PostingsFormat(name=Asserting), range_facet_l=PostingsFormat(name=Direct), multiDefault=PostingsFormat(name=Direct), text=Lucene41(blocksize=128)}, docValues:{}, sim=DefaultSimilarity, locale=en_PH, timezone=Pacific/Efate
[junit4:junit4]   2> NOTE: Linux 3.2.0-39-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=207445520,total=262144000
[junit4:junit4]   2> NOTE: All tests run in this JVM: [DirectSolrConnectionTest, SOLR749Test, TestFunctionQuery, TestPerFieldSimilarity, UnloadDistributedZkTest]
[junit4:junit4] Completed on J0 in 139.03s, 1 test, 1 failure <<< FAILURES!

[...truncated 707 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:381: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:361: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1213: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:877: There were test failures: 273 suites, 1149 tests, 1 error, 1 failure, 13 ignored (7 assumptions)

Total time: 45 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b79 -client -XX:+UseG1GC -XX:MarkStackSize=256K
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message