lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-tests-only-trunk - Build # 14999 - Still Failing
Date Sun, 05 Aug 2012 01:57:03 GMT
Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk/14999/

1 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
	at __randomizedtesting.SeedInfo.seed([7E0A383C1C89C77A:FFECB6246BD6A746]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:237)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:179)
	at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:155)
	at org.apache.solr.cloud.FullSolrCloudTest.commit(FullSolrCloudTest.java:1477)
	at org.apache.solr.cloud.SyncSliceTest.waitForThingsToLevelOut(SyncSliceTest.java:268)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:162)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:679)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:616)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
	at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)




Build Log:
[...truncated 6284 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] ERROR   45.4s J0 | SyncSliceTest.testDistribSearch
[junit4:junit4]    > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([7E0A383C1C89C77A:FFECB6246BD6A746]:0)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:237)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:179)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:155)
[junit4:junit4]    > 	at org.apache.solr.cloud.FullSolrCloudTest.commit(FullSolrCloudTest.java:1477)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.waitForThingsToLevelOut(SyncSliceTest.java:268)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:162)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:679)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    > 
[junit4:junit4]   2> 6 T149 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1344130879357
[junit4:junit4]   2> 10 T149 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 33 T150 oaz.Environment.logEnv Server environment:zookeeper.version=3.3.6-1366786, built on 07/29/2012 06:22 GMT
[junit4:junit4]   2> 33 T150 oaz.Environment.logEnv Server environment:host.name=lucene.zones.apache.org
[junit4:junit4]   2> 34 T150 oaz.Environment.logEnv Server environment:java.version=1.6.0_32
[junit4:junit4]   2> 34 T150 oaz.Environment.logEnv Server environment:java.vendor=Sun Microsystems Inc.
[junit4:junit4]   2> 34 T150 oaz.Environment.logEnv Server environment:java.home=/usr/local/openjdk6/jre
[junit4:junit4]   2> 34 T150 oaz.Environment.logEnv Server environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/commons-codec-1.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/easymock-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/guava-r05.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/httpclient-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/httpcore-4.1.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/httpmime-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/log4j-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/spatial4j-0.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/zookeeper-3.3.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-continuation-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-deploy-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-http-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-io-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-jmx-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-security-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-server-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-servlet-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-util-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-webapp-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-xml-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/test-framework/lib/randomizedtesting-runner-1.6.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/classes/test:/home/hudson/tools/ant/supported18/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/.ant/lib/js.jar:/home/hudson/.ant/lib/script-js.jar:/home/hudson/tools/ant/supported18/lib/ant-jsch.jar:/home/hudson/tools/ant/supported18/lib/ant.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-oro.jar:/home/hudson/tools/ant/supported18/lib/ant-commons-logging.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-regexp.jar:/home/hudson/tools/ant/supported18/lib/ant-jmf.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-bcel.jar:/home/hudson/tools/ant/supported18/lib/ant-netrexx.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-bsf.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-log4j.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-xalan2.jar:/home/hudson/tools/ant/supported18/lib/ant-jai.jar:/home/hudson/tools/ant/supported18/lib/ant-swing.jar:/home/hudson/tools/ant/supported18/lib/ant-jdepend.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-resolver.jar:/home/hudson/tools/ant/supported18/lib/ant-testutil.jar:/home/hudson/tools/ant/supported18/lib/ant-commons-net.jar:/home/hudson/tools/ant/supported18/lib/ant-antlr.jar:/home/hudson/tools/ant/supported18/lib/ant-javamail.jar:/home/hudson/tools/ant/supported18/lib/ant-junit.jar:/home/hudson/tools/ant/supported18/lib/ant-junit4.jar:/usr/local/openjdk6/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-1.6.0.jar
[junit4:junit4]   2> 36 T150 oaz.Environment.logEnv Server environment:java.library.path=/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4]   2> 36 T150 oaz.Environment.logEnv Server environment:java.io.tmpdir=/var/tmp/
[junit4:junit4]   2> 37 T150 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 37 T150 oaz.Environment.logEnv Server environment:os.name=FreeBSD
[junit4:junit4]   2> 37 T150 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4]   2> 37 T150 oaz.Environment.logEnv Server environment:os.version=9.0-RELEASE
[junit4:junit4]   2> 37 T150 oaz.Environment.logEnv Server environment:user.name=hudson
[junit4:junit4]   2> 38 T150 oaz.Environment.logEnv Server environment:user.home=/home/hudson
[junit4:junit4]   2> 38 T150 oaz.Environment.logEnv Server environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0
[junit4:junit4]   2> 50 T150 oazs.ZooKeeperServer.setTickTime tickTime set to 3000
[junit4:junit4]   2> 75 T150 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 108 T150 oazsp.FileTxnSnapLog.save Snapshotting: 0
[junit4:junit4]   2> 137 T149 oaz.Environment.logEnv Client environment:zookeeper.version=3.3.6-1366786, built on 07/29/2012 06:22 GMT
[junit4:junit4]   2> 138 T149 oaz.Environment.logEnv Client environment:host.name=lucene.zones.apache.org
[junit4:junit4]   2> 138 T149 oaz.Environment.logEnv Client environment:java.version=1.6.0_32
[junit4:junit4]   2> 138 T149 oaz.Environment.logEnv Client environment:java.vendor=Sun Microsystems Inc.
[junit4:junit4]   2> 139 T149 oaz.Environment.logEnv Client environment:java.home=/usr/local/openjdk6/jre
[junit4:junit4]   2> 139 T149 oaz.Environment.logEnv Client environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/commons-codec-1.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/easymock-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/guava-r05.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/httpclient-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/httpcore-4.1.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/httpmime-4.1.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/log4j-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/spatial4j-0.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/lib/zookeeper-3.3.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-continuation-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-deploy-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-http-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-io-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-jmx-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-security-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-server-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-servlet-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-util-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-webapp-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/jetty-xml-8.1.2.v20120308.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/test-framework/lib/randomizedtesting-runner-1.6.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/classes/test:/home/hudson/tools/ant/supported18/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/.ant/lib/js.jar:/home/hudson/.ant/lib/script-js.jar:/home/hudson/tools/ant/supported18/lib/ant-jsch.jar:/home/hudson/tools/ant/supported18/lib/ant.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-oro.jar:/home/hudson/tools/ant/supported18/lib/ant-commons-logging.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-regexp.jar:/home/hudson/tools/ant/supported18/lib/ant-jmf.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-bcel.jar:/home/hudson/tools/ant/supported18/lib/ant-netrexx.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-bsf.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-log4j.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-xalan2.jar:/home/hudson/tools/ant/supported18/lib/ant-jai.jar:/home/hudson/tools/ant/supported18/lib/ant-swing.jar:/home/hudson/tools/ant/supported18/lib/ant-jdepend.jar:/home/hudson/tools/ant/supported18/lib/ant-apache-resolver.jar:/home/hudson/tools/ant/supported18/lib/ant-testutil.jar:/home/hudson/tools/ant/supported18/lib/ant-commons-net.jar:/home/hudson/tools/ant/supported18/lib/ant-antlr.jar:/home/hudson/tools/ant/supported18/lib/ant-javamail.jar:/home/hudson/tools/ant/supported18/lib/ant-junit.jar:/home/hudson/tools/ant/supported18/lib/ant-junit4.jar:/usr/local/openjdk6/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-1.6.0.jar
[junit4:junit4]   2> 141 T149 oaz.Environment.logEnv Client environment:java.library.path=/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4]   2> 141 T149 oaz.Environment.logEnv Client environment:java.io.tmpdir=/var/tmp/
[junit4:junit4]   2> 142 T149 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 142 T149 oaz.Environment.logEnv Client environment:os.name=FreeBSD
[junit4:junit4]   2> 142 T149 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4]   2> 143 T149 oaz.Environment.logEnv Client environment:os.version=9.0-RELEASE
[junit4:junit4]   2> 143 T149 oaz.Environment.logEnv Client environment:user.name=hudson
[junit4:junit4]   2> 143 T149 oaz.Environment.logEnv Client environment:user.home=/home/hudson
[junit4:junit4]   2> 144 T149 oaz.Environment.logEnv Client environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0
[junit4:junit4]   2> 145 T149 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51205 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@9e9c826
[junit4:junit4]   2> 159 T155 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:51205
[junit4:junit4]   2> 163 T155 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51205, initiating session
[junit4:junit4]   2> 163 T151 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:51206
[junit4:junit4]   2> 170 T151 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:51206
[junit4:junit4]   2> 175 T153 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 189 T153 oazs.NIOServerCnxn.finishSessionInit Established session 0x138f4718fec0000 with negotiated timeout 10000 for client /140.211.11.196:51206
[junit4:junit4]   2> 189 T155 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:51205, sessionid = 0x138f4718fec0000, negotiated timeout = 10000
[junit4:junit4]   2> 192 T156 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9e9c826 name:ZooKeeperConnection Watcher:127.0.0.1:51205 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 193 T149 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 238 T154 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x138f4718fec0000
[junit4:junit4]   2> 240 T156 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 240 T149 oaz.ZooKeeper.close Session: 0x138f4718fec0000 closed
[junit4:junit4]   2> 241 T149 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51205/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@30ae6e72
[junit4:junit4]   2> 242 T151 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51206 which had sessionid 0x138f4718fec0000
[junit4:junit4]   2> 242 T157 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:51205
[junit4:junit4]   2> 243 T157 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51205, initiating session
[junit4:junit4]   2> 243 T151 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:51207
[junit4:junit4]   2> 243 T151 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:51207
[junit4:junit4]   2> 250 T153 oazs.NIOServerCnxn.finishSessionInit Established session 0x138f4718fec0001 with negotiated timeout 10000 for client /140.211.11.196:51207
[junit4:junit4]   2> 251 T157 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:51205, sessionid = 0x138f4718fec0001, negotiated timeout = 10000
[junit4:junit4]   2> 251 T158 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30ae6e72 name:ZooKeeperConnection Watcher:127.0.0.1:51205/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 254 T149 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 260 T149 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 268 T149 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 271 T149 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 283 T149 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 297 T149 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 407 T149 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 417 T149 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 422 T149 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 426 T149 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 431 T149 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 436 T149 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 441 T149 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 446 T149 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 450 T154 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x138f4718fec0001
[junit4:junit4]   2> 451 T158 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 451 T149 oaz.ZooKeeper.close Session: 0x138f4718fec0001 closed
[junit4:junit4]   2> 452 T151 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51207 which had sessionid 0x138f4718fec0001
[junit4:junit4]   2> 453 T149 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 460 T149 oejs.AbstractConnector.doStart Started SocketConnector@0.0.0.0:51208
[junit4:junit4]   2> 460 T149 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 461 T149 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 461 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 473 T149 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 474 T149 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 474 T149 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 475 T149 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 475 T149 oasc.CoreContainer.<init> New CoreContainer 117686693
[junit4:junit4]   2> 475 T149 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 476 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 491 T149 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 501 T149 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:51205/solr
[junit4:junit4]   2> 510 T149 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51205/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@48ebd302
[junit4:junit4]   2> 511 T168 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:51205
[junit4:junit4]   2> 524 T151 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:51209
[junit4:junit4]   2> 524 T168 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51205, initiating session
[junit4:junit4]   2> 534 T151 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:51209
[junit4:junit4]   2> 536 T153 oazs.NIOServerCnxn.finishSessionInit Established session 0x138f4718fec0002 with negotiated timeout 8000 for client /140.211.11.196:51209
[junit4:junit4]   2> 536 T168 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:51205, sessionid = 0x138f4718fec0002, negotiated timeout = 8000
[junit4:junit4]   2> 537 T169 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48ebd302 name:ZooKeeperConnection Watcher:127.0.0.1:51205/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 545 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0002 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 550 T149 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 554 T149 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51208_solr
[junit4:junit4]   2> 556 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0002 type:delete cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51208_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51208_solr
[junit4:junit4]   2> 557 T149 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51208_solr
[junit4:junit4]   2> 563 T149 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 564 T149 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 564 T149 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 565 T149 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 566 T149 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 566 T149 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 567 T149 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 567 T149 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 568 T149 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 568 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 583 T149 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 595 T149 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 599 T149 oasc.Overseer.start Overseer (id=88088961316814850-127.0.0.1:51208_solr-n_0000000000) starting
[junit4:junit4]   2> 600 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0002 type:create cxid:0x19 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 603 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0002 type:create cxid:0x1a zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 606 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0002 type:create cxid:0x1b zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 614 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0002 type:create cxid:0x1c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 615 T171 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 616 T149 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 620 T149 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 629 T170 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 635 T149 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 636 T149 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 637 T149 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 638 T149 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 640 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 642 T149 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 643 T149 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 696 T149 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 770 T149 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 872 T149 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 888 T149 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1571 T149 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1579 T149 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1583 T149 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1601 T149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1606 T149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1611 T149 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1613 T149 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1615 T149 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1344130879357/control/data/
[junit4:junit4]   2> 1615 T149 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3a4c5b4
[junit4:junit4]   2> 1621 T149 oasc.SolrCore.getNewIndexDir WARNING New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1344130879357/control/data/index/
[junit4:junit4]   2> 1622 T149 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1344130879357/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1630 T149 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/control/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60194bf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1631 T149 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1631 T149 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1633 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1633 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1633 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1634 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1634 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1635 T149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1635 T149 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1635 T149 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1636 T149 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1636 T149 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1636 T149 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1637 T149 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1637 T149 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1637 T149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1638 T149 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1638 T149 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1638 T149 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1639 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1639 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1639 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1640 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1640 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1640 T149 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1641 T149 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1641 T149 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1642 T149 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1644 T149 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1646 T149 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1648 T149 oass.SolrIndexSearcher.<init> Opening Searcher@24a3bd67 main
[junit4:junit4]   2> 1649 T149 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1649 T149 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1649 T149 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1663 T149 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1706 T172 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@24a3bd67 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1708 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0002 type:create cxid:0x55 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1719 T149 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1719 T149 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:51208/solr shardId:control_shard
[junit4:junit4]   2> 1723 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 1733 T149 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1752 T149 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1757 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0002 type:create cxid:0x6c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2139 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2145 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0002 type:create cxid:0x77 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2186 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 2226 T149 oasc.ZkController.register We are http://127.0.0.1:51208/solr/collection1/ and leader is http://127.0.0.1:51208/solr/collection1/
[junit4:junit4]   2> 2226 T149 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51208/solr
[junit4:junit4]   2> 2226 T149 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2230 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2231 T149 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2231 T149 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2231 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2239 T149 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 2241 T149 oejs.AbstractConnector.doStart Started SocketConnector@0.0.0.0:51211
[junit4:junit4]   2> 2242 T149 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2242 T149 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 2242 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 2251 T149 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2252 T149 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2252 T149 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 2252 T149 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 2252 T149 oasc.CoreContainer.<init> New CoreContainer 496350637
[junit4:junit4]   2> 2253 T149 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 2253 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 2264 T149 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2272 T149 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:51205/solr
[junit4:junit4]   2> 2272 T149 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51205/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@779b747d
[junit4:junit4]   2> 2273 T182 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:51205
[junit4:junit4]   2> 2274 T151 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:51212
[junit4:junit4]   2> 2274 T182 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51205, initiating session
[junit4:junit4]   2> 2275 T151 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:51212
[junit4:junit4]   2> 2276 T153 oazs.NIOServerCnxn.finishSessionInit Established session 0x138f4718fec0003 with negotiated timeout 8000 for client /140.211.11.196:51212
[junit4:junit4]   2> 2276 T182 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:51205, sessionid = 0x138f4718fec0003, negotiated timeout = 8000
[junit4:junit4]   2> 2276 T183 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@779b747d name:ZooKeeperConnection Watcher:127.0.0.1:51205/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2277 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0003 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2278 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0003 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2287 T149 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51211_solr
[junit4:junit4]   2> 2288 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0003 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51211_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51211_solr
[junit4:junit4]   2> 2290 T149 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51211_solr
[junit4:junit4]   2> 2293 T169 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 2293 T149 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2294 T149 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2294 T149 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2294 T149 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2294 T149 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2295 T149 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2295 T149 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2295 T149 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2295 T149 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2296 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2308 T149 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2312 T149 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 2312 T149 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2313 T149 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2313 T149 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2314 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 2315 T149 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2315 T149 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 2342 T149 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 2384 T149 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2485 T149 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2493 T149 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2700 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2716 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 2717 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 3007 T149 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3016 T149 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3020 T149 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3039 T149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3044 T149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3048 T149 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3050 T149 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3056 T149 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty1/
[junit4:junit4]   2> 3057 T149 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3a4c5b4
[junit4:junit4]   2> 3057 T149 oasc.SolrCore.getNewIndexDir WARNING New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty1/index/
[junit4:junit4]   2> 3058 T149 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3063 T149 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty1/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@97c2b3f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3063 T149 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 3064 T149 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3066 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3066 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3067 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3067 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3068 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3069 T149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3069 T149 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3070 T149 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3070 T149 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3071 T149 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3071 T149 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3072 T149 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3072 T149 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3073 T149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3073 T149 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3074 T149 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3074 T149 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3075 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3075 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3076 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3076 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3077 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3078 T149 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3078 T149 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3079 T149 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3080 T149 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3082 T149 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3083 T149 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3086 T149 oass.SolrIndexSearcher.<init> Opening Searcher@7aa34f04 main
[junit4:junit4]   2> 3087 T149 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3087 T149 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3088 T149 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3094 T149 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 3148 T184 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7aa34f04 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3224 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3240 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 3240 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 3654 T149 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3654 T149 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:51211/solr shardId:shard1
[junit4:junit4]   2> 3655 T149 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3699 T149 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3704 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0003 type:create cxid:0x4b zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3746 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3765 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 3765 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 3816 T149 oasc.ZkController.register We are http://127.0.0.1:51211/solr/collection1/ and leader is http://127.0.0.1:51211/solr/collection1/
[junit4:junit4]   2> 3816 T149 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51211/solr
[junit4:junit4]   2> 3817 T149 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3819 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3820 T149 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3821 T149 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3821 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3833 T149 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 3836 T149 oejs.AbstractConnector.doStart Started SocketConnector@0.0.0.0:51218
[junit4:junit4]   2> 3836 T149 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3837 T149 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 3837 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 3849 T149 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3850 T149 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3850 T149 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 3851 T149 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 3851 T149 oasc.CoreContainer.<init> New CoreContainer 1628577465
[junit4:junit4]   2> 3851 T149 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 3852 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 3867 T149 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3877 T149 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:51205/solr
[junit4:junit4]   2> 3878 T149 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51205/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@486f90fe
[junit4:junit4]   2> 3879 T194 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:51205
[junit4:junit4]   2> 3882 T151 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:51219
[junit4:junit4]   2> 3882 T194 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51205, initiating session
[junit4:junit4]   2> 3883 T151 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:51219
[junit4:junit4]   2> 3885 T153 oazs.NIOServerCnxn.finishSessionInit Established session 0x138f4718fec0004 with negotiated timeout 8000 for client /140.211.11.196:51219
[junit4:junit4]   2> 3885 T194 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:51205, sessionid = 0x138f4718fec0004, negotiated timeout = 8000
[junit4:junit4]   2> 3885 T195 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@486f90fe name:ZooKeeperConnection Watcher:127.0.0.1:51205/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3886 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0004 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3888 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0004 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3895 T149 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51218_solr
[junit4:junit4]   2> 3896 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0004 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51218_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51218_solr
[junit4:junit4]   2> 3897 T149 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51218_solr
[junit4:junit4]   2> 3899 T169 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 3899 T183 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 3900 T149 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3901 T149 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3901 T149 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3901 T149 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3901 T149 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3902 T149 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3902 T149 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3902 T149 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3902 T149 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3903 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3914 T149 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3919 T149 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 3919 T149 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3920 T149 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3920 T149 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3921 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 3922 T149 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3922 T149 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 3950 T149 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 3986 T149 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4087 T149 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4092 T149 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4278 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4293 T195 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 4293 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 4293 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 4429 T149 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4435 T149 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4438 T149 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4464 T149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4468 T149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4472 T149 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4474 T149 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4476 T149 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/
[junit4:junit4]   2> 4476 T149 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3a4c5b4
[junit4:junit4]   2> 4477 T149 oasc.SolrCore.getNewIndexDir WARNING New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/index/
[junit4:junit4]   2> 4477 T149 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4481 T149 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21852a95; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4481 T149 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4481 T149 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4487 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4488 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4488 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4488 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4489 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4489 T149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4489 T149 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4490 T149 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4490 T149 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4491 T149 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4491 T149 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4492 T149 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4492 T149 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4493 T149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4493 T149 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4493 T149 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4494 T149 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4494 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4495 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4495 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4495 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4496 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4496 T149 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4496 T149 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4497 T149 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4498 T149 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4499 T149 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4500 T149 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4502 T149 oass.SolrIndexSearcher.<init> Opening Searcher@698add5e main
[junit4:junit4]   2> 4503 T149 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4504 T149 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4504 T149 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4509 T149 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4554 T196 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@698add5e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4800 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4846 T195 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 4846 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 4846 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 5058 T149 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 5058 T149 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:51218/solr shardId:shard1
[junit4:junit4]   2> 5068 T149 oasc.ZkController.register We are http://127.0.0.1:51218/solr/collection1/ and leader is http://127.0.0.1:51211/solr/collection1/
[junit4:junit4]   2> 5068 T149 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51218/solr
[junit4:junit4]   2> 5069 T149 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C13 name=collection1 org.apache.solr.core.SolrCore@2508d3eb url=http://127.0.0.1:51218/solr/collection1 node=127.0.0.1:51218_solr
[junit4:junit4]   2> 5071 T197 C13 P51218 oasc.RecoveryStrategy.run Starting recovery process. recoveringAfterStartup=true
[junit4:junit4]   2> 5072 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5072 T197 C13 P51218 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 5073 T149 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0
[junit4:junit4]   2> 5073 T149 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5073 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5077 T197 C13 P51218 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 5083 T149 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 5085 T149 oejs.AbstractConnector.doStart Started SocketConnector@0.0.0.0:51224
[junit4:junit4]   2> 5086 T149 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5086 T149 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 5086 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 5096 T149 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5097 T149 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5097 T149 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 5097 T149 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 5097 T149 oasc.CoreContainer.<init> New CoreContainer 1072316483
[junit4:junit4]   2> 5098 T149 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 5098 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 5109 T149 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5116 T149 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:51205/solr
[junit4:junit4]   2> 5116 T149 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51205/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@2e7fee2d
[junit4:junit4]   2> 5117 T207 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:51205
[junit4:junit4]   2> 5118 T207 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51205, initiating session
[junit4:junit4]   2> 5118 T151 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:51226
[junit4:junit4]   2> 5119 T151 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:51226
[junit4:junit4]   2> 5121 T153 oazs.NIOServerCnxn.finishSessionInit Established session 0x138f4718fec0005 with negotiated timeout 8000 for client /140.211.11.196:51226
[junit4:junit4]   2> 5121 T207 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:51205, sessionid = 0x138f4718fec0005, negotiated timeout = 8000
[junit4:junit4]   2> 5121 T208 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e7fee2d name:ZooKeeperConnection Watcher:127.0.0.1:51205/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5122 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0005 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5125 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0005 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5132 T149 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51224_solr
[junit4:junit4]   2> 5132 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0005 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51224_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51224_solr
[junit4:junit4]   2> 5133 T149 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51224_solr
[junit4:junit4]   2> 5137 T169 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 5137 T195 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 5137 T183 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 5138 T149 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 5139 T149 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5139 T149 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 5139 T149 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5139 T149 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5139 T149 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5140 T149 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5140 T149 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5140 T149 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5141 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5152 T149 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5156 T149 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 5157 T149 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5157 T149 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5158 T149 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5159 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 5160 T149 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5160 T149 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 5190 T149 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 5234 T149 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5335 T149 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5341 T149 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5384 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5399 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 5399 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 5399 T195 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 5399 T208 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 5808 T149 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5821 T149 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5825 T149 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5851 T149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5855 T149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5859 T149 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5861 T149 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5863 T149 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/
[junit4:junit4]   2> 5864 T149 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3a4c5b4
[junit4:junit4]   2> 5865 T149 oasc.SolrCore.getNewIndexDir WARNING New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/index/
[junit4:junit4]   2> 5865 T149 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5872 T149 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@257f2ad0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5873 T149 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 5874 T149 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5877 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5877 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5878 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5879 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5880 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5880 T149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5881 T149 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5881 T149 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5882 T149 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5882 T149 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5883 T149 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5884 T149 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5884 T149 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5885 T149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5885 T149 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5886 T149 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5886 T149 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5887 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5887 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5888 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5888 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5889 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5889 T149 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5890 T149 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5891 T149 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5892 T149 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5894 T149 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5896 T149 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5899 T149 oass.SolrIndexSearcher.<init> Opening Searcher@2c61bbb7 main
[junit4:junit4]   2> 5900 T149 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5900 T149 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5900 T149 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5907 T149 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5952 T209 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c61bbb7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6408 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6425 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 6425 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 6425 T195 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 6425 T208 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 6458 T149 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 6458 T149 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:51224/solr shardId:shard1
[junit4:junit4]   2> 6462 T149 oasc.ZkController.register We are http://127.0.0.1:51224/solr/collection1/ and leader is http://127.0.0.1:51211/solr/collection1/
[junit4:junit4]   2> 6463 T149 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51224/solr
[junit4:junit4]   2> 6463 T149 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C14 name=collection1 org.apache.solr.core.SolrCore@c876cb0 url=http://127.0.0.1:51224/solr/collection1 node=127.0.0.1:51224_solr
[junit4:junit4]   2> 6464 T210 C14 P51224 oasc.RecoveryStrategy.run Starting recovery process. recoveringAfterStartup=true
[junit4:junit4]   2> 6464 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6465 T210 C14 P51224 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 6465 T149 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6466 T149 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6466 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6467 T210 C14 P51224 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6476 T149 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 6479 T149 oejs.AbstractConnector.doStart Started SocketConnector@0.0.0.0:51227
[junit4:junit4]   2> 6480 T149 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6480 T149 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 6480 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 6489 T149 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6490 T149 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6490 T149 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 6490 T149 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 6490 T149 oasc.CoreContainer.<init> New CoreContainer 2129565033
[junit4:junit4]   2> 6491 T149 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 6491 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 6502 T149 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6510 T149 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:51205/solr
[junit4:junit4]   2> 6510 T149 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51205/solr sessionTimeout=8000 watcher=org.apache.solr.common.cloud.ConnectionManager@12ecb5db
[junit4:junit4]   2> 6511 T220 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:51205
[junit4:junit4]   2> 6512 T151 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:51229
[junit4:junit4]   2> 6512 T220 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51205, initiating session
[junit4:junit4]   2> 6513 T151 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:51229
[junit4:junit4]   2> 6515 T153 oazs.NIOServerCnxn.finishSessionInit Established session 0x138f4718fec0006 with negotiated timeout 8000 for client /140.211.11.196:51229
[junit4:junit4]   2> 6515 T220 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:51205, sessionid = 0x138f4718fec0006, negotiated timeout = 8000
[junit4:junit4]   2> 6516 T221 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12ecb5db name:ZooKeeperConnection Watcher:127.0.0.1:51205/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6516 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0006 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6525 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0006 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6529 T149 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51227_solr
[junit4:junit4]   2> 6529 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0006 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51227_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51227_solr
[junit4:junit4]   2> 6531 T149 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51227_solr
[junit4:junit4]   2> 6539 T208 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 6539 T169 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 6539 T183 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 6539 T195 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 6540 T149 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6540 T149 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6541 T149 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6541 T149 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6541 T149 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6541 T149 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6542 T149 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6542 T149 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6542 T149 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6542 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6554 T149 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6559 T149 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 6560 T149 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6560 T149 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6561 T149 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6563 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 6563 T149 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6563 T149 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 6589 T149 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 6628 T149 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6729 T149 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6735 T149 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6941 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6978 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 6978 T221 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 6978 T195 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 6978 T208 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 6978 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 7158 T149 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7166 T149 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7170 T149 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7194 T149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7199 T149 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7204 T149 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7206 T149 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7208 T149 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty4/
[junit4:junit4]   2> 7209 T149 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3a4c5b4
[junit4:junit4]   2> 7210 T149 oasc.SolrCore.getNewIndexDir WARNING New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty4/index/
[junit4:junit4]   2> 7211 T149 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7215 T149 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty4/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@418c43ad; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7215 T149 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 7216 T149 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7218 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7218 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7218 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7219 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7220 T149 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7220 T149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7220 T149 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7221 T149 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7221 T149 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7222 T149 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7223 T149 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7223 T149 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7224 T149 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7224 T149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7224 T149 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7225 T149 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7225 T149 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7226 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7226 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7227 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7227 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7228 T149 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7228 T149 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7229 T149 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7230 T149 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7231 T149 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7232 T149 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7234 T149 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7236 T149 oass.SolrIndexSearcher.<init> Opening Searcher@70b139c9 main
[junit4:junit4]   2> 7237 T149 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7238 T149 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7238 T149 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7243 T149 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7289 T222 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@70b139c9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7492 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7509 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 7509 T208 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 7509 T195 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 7509 T221 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 7509 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 7794 T149 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 7794 T149 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:51227/solr shardId:shard1
[junit4:junit4]   2> 7803 T149 oasc.ZkController.register We are http://127.0.0.1:51227/solr/collection1/ and leader is http://127.0.0.1:51211/solr/collection1/
[junit4:junit4]   2> 7804 T149 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51227/solr
[junit4:junit4]   2> 7804 T149 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C15 name=collection1 org.apache.solr.core.SolrCore@789ab21d url=http://127.0.0.1:51227/solr/collection1 node=127.0.0.1:51227_solr
[junit4:junit4]   2> 7805 T223 C15 P51227 oasc.RecoveryStrategy.run Starting recovery process. recoveringAfterStartup=true
[junit4:junit4]   2> 7806 T223 C15 P51227 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7806 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7808 T223 C15 P51227 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7808 T149 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0
[junit4:junit4]   2> 7808 T149 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7809 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7825 T149 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51205/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@18fd54ec
[junit4:junit4]   2> 7827 T224 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:51205
[junit4:junit4]   2> 7828 T224 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51205, initiating session
[junit4:junit4]   2> 7828 T151 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:51231
[junit4:junit4]   2> 7828 T151 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:51231
[junit4:junit4]   2> 7830 T153 oazs.NIOServerCnxn.finishSessionInit Established session 0x138f4718fec0007 with negotiated timeout 10000 for client /140.211.11.196:51231
[junit4:junit4]   2> 7830 T224 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:51205, sessionid = 0x138f4718fec0007, negotiated timeout = 10000
[junit4:junit4]   2> 7831 T225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18fd54ec name:ZooKeeperConnection Watcher:127.0.0.1:51205/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7833 T149 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7836 T149 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:false
[junit4:junit4]   2> 7837 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 7848 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7850 T149 oasc.AbstractDistributedZkTestCase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):360
[junit4:junit4]   2> 7851 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8015 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8031 T225 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 8032 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 8032 T221 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 8032 T208 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 8032 T195 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 8032 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 8853 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9855 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10857 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11869 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C13_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51218_solr, base_url=http://127.0.0.1:51218/solr}
[junit4:junit4]   2> 12092 T197 C13 P51218 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51211/solr/collection1/ recoveringAfterStartup=true
[junit4:junit4]   2> 12096 T197 C13 P51218 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 12108 T197 C13 P51218 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51218/solr START replicas=[http://127.0.0.1:51211/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 12109 T197 C13 P51218 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication
[junit4:junit4]   2> 12109 T197 C13 P51218 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery
[junit4:junit4]   2> 12109 T197 C13 P51218 oasc.RecoveryStrategy.doRecovery Begin buffering updates
[junit4:junit4]   2> 12110 T197 C13 P51218 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 12110 T197 C13 P51218 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51211/solr/collection1/
[junit4:junit4]   2> 12110 T197 C13 P51218 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C16 name=collection1 org.apache.solr.core.SolrCore@18c14dd1 url=http://127.0.0.1:51211/solr/collection1 node=127.0.0.1:51211_solr
[junit4:junit4]   2> 12115 T178 C16 P51211 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1 
[junit4:junit4]   2> 12122 T179 C16 P51211 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12124 T179 C16 P51211 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty1/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@97c2b3f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12125 T179 C16 P51211 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 12126 T179 C16 P51211 oass.SolrIndexSearcher.<init> Opening Searcher@7130d331 main
[junit4:junit4]   2> 12126 T179 C16 P51211 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12127 T184 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7130d331 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 12128 T179 C16 P51211 /update {waitSearcher=true&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 7
[junit4:junit4]   2> 12129 T197 C13 P51218 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12129 T197 C13 P51218 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 12140 T197 C13 P51218 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 12143 T180 C16 P51211 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 12144 T180 C16 P51211 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 12147 T197 C13 P51218 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21852a95; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 12147 T197 C13 P51218 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 12148 T197 C13 P51218 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 12150 T197 C13 P51218 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21852a95; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21852a95; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 12151 T197 C13 P51218 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 12153 T197 C13 P51218 oass.SolrIndexSearcher.<init> Opening Searcher@f1c2137 main
[junit4:junit4]   2> 12153 T197 C13 P51218 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 12154 T196 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f1c2137 main{StandardDirectoryReader(segments_2:2)}
[junit4:junit4]   2> 12155 T197 C13 P51218 oasc.RecoveryStrategy.replay No replay needed
[junit4:junit4]   2> 12155 T197 C13 P51218 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active
[junit4:junit4]   2> 12162 T197 C13 P51218 oasc.RecoveryStrategy.doRecovery Finished recovery process
[junit4:junit4]   2> 12562 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12578 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 12578 T225 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 12578 T195 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 12578 T221 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 12578 T208 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 12578 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 12871 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C14_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51224_solr, base_url=http://127.0.0.1:51224/solr}
[junit4:junit4]   2> 13483 T210 C14 P51224 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51211/solr/collection1/ recoveringAfterStartup=true
[junit4:junit4]   2> 13485 T210 C14 P51224 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51224/solr START replicas=[http://127.0.0.1:51211/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 13485 T210 C14 P51224 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication
[junit4:junit4]   2> 13485 T210 C14 P51224 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery
[junit4:junit4]   2> 13486 T210 C14 P51224 oasc.RecoveryStrategy.doRecovery Begin buffering updates
[junit4:junit4]   2> 13486 T210 C14 P51224 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 13486 T210 C14 P51224 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51211/solr/collection1/
[junit4:junit4]   2> 13486 T210 C14 P51224 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 13488 T178 C16 P51211 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 13497 T181 C16 P51211 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 13500 T181 C16 P51211 oass.SolrIndexSearcher.<init> Opening Searcher@4dcc8fa3 main
[junit4:junit4]   2> 13501 T181 C16 P51211 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 13502 T184 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4dcc8fa3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 13502 T181 C16 P51211 /update {waitSearcher=true&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 5
[junit4:junit4]   2> 13503 T210 C14 P51224 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 13503 T210 C14 P51224 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 13506 T180 C16 P51211 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 13509 T210 C14 P51224 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@257f2ad0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13509 T210 C14 P51224 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 13510 T210 C14 P51224 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 13512 T210 C14 P51224 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@257f2ad0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@257f2ad0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 13513 T210 C14 P51224 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 13515 T210 C14 P51224 oass.SolrIndexSearcher.<init> Opening Searcher@397ac43d main
[junit4:junit4]   2> 13515 T210 C14 P51224 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 13517 T209 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@397ac43d main{StandardDirectoryReader(segments_2:2)}
[junit4:junit4]   2> 13517 T210 C14 P51224 oasc.RecoveryStrategy.replay No replay needed
[junit4:junit4]   2> 13518 T210 C14 P51224 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active
[junit4:junit4]   2> 13520 T210 C14 P51224 oasc.RecoveryStrategy.doRecovery Finished recovery process
[junit4:junit4]   2> 13588 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13602 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 13603 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 13603 T195 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 13603 T221 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 13603 T225 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 13603 T208 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 13876 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C15_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51227_solr, base_url=http://127.0.0.1:51227/solr}
[junit4:junit4]   2> 14825 T223 C15 P51227 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51211/solr/collection1/ recoveringAfterStartup=true
[junit4:junit4]   2> 14826 T223 C15 P51227 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51227/solr START replicas=[http://127.0.0.1:51211/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 14826 T223 C15 P51227 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication
[junit4:junit4]   2> 14826 T223 C15 P51227 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery
[junit4:junit4]   2> 14827 T223 C15 P51227 oasc.RecoveryStrategy.doRecovery Begin buffering updates
[junit4:junit4]   2> 14827 T223 C15 P51227 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 14827 T223 C15 P51227 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51211/solr/collection1/
[junit4:junit4]   2> 14827 T223 C15 P51227 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14829 T178 C16 P51211 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 14839 T175 C16 P51211 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 14841 T175 C16 P51211 oass.SolrIndexSearcher.<init> Opening Searcher@4cdc1165 main
[junit4:junit4]   2> 14841 T175 C16 P51211 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 14842 T184 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4cdc1165 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 14843 T175 C16 P51211 /update {waitSearcher=true&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 4
[junit4:junit4]   2> 14844 T223 C15 P51227 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 14844 T223 C15 P51227 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 14846 T180 C16 P51211 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
[junit4:junit4]   2> 14849 T223 C15 P51227 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty4/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@418c43ad; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 14850 T223 C15 P51227 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 14850 T223 C15 P51227 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 14876 T223 C15 P51227 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty4/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@418c43ad; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty4/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@418c43ad; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 14877 T223 C15 P51227 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 14878 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14879 T223 C15 P51227 oass.SolrIndexSearcher.<init> Opening Searcher@3e9504f2 main
[junit4:junit4]   2> 14879 T223 C15 P51227 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 14881 T222 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e9504f2 main{StandardDirectoryReader(segments_2:2)}
[junit4:junit4]   2> 14881 T223 C15 P51227 oasc.RecoveryStrategy.replay No replay needed
[junit4:junit4]   2> 14882 T223 C15 P51227 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active
[junit4:junit4]   2> 14884 T223 C15 P51227 oasc.RecoveryStrategy.doRecovery Finished recovery process
[junit4:junit4]   2> 15115 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15131 T169 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 15131 T208 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 15131 T225 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 15131 T195 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 15131 T183 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 15131 T221 oascc.ZkStateReader$2.process A cluster state change has occurred - updating...
[junit4:junit4]   2> 15882 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> ASYNC  NEW_CORE C17 name=collection1 org.apache.solr.core.SolrCore@5de890b4 url=http://127.0.0.1:51208/solr/collection1 node=127.0.0.1:51208_solr
[junit4:junit4]   2> 15890 T161 C17 P51208 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 15892 T161 C17 P51208 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/control/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60194bf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15893 T161 C17 P51208 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 15895 T161 C17 P51208 oass.SolrIndexSearcher.<init> Opening Searcher@1b0b4509 main
[junit4:junit4]   2> 15895 T161 C17 P51208 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15896 T172 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b0b4509 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15897 T161 C17 P51208 /update {waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=} 0 7
[junit4:junit4]   2> 15898 T149 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51205/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@e15fbe
[junit4:junit4]   2> 15899 T229 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:51205
[junit4:junit4]   2> 15900 T229 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51205, initiating session
[junit4:junit4]   2> 15900 T151 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:51255
[junit4:junit4]   2> 15901 T151 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:51255
[junit4:junit4]   2> 15928 T153 oazs.NIOServerCnxn.finishSessionInit Established session 0x138f4718fec0008 with negotiated timeout 10000 for client /140.211.11.196:51255
[junit4:junit4]   2> 15928 T229 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:51205, sessionid = 0x138f4718fec0008, negotiated timeout = 10000
[junit4:junit4]   2> 15929 T230 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e15fbe name:ZooKeeperConnection Watcher:127.0.0.1:51205/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15930 T149 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15935 T179 C16 P51211 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 15937 T179 C16 P51211 oass.SolrIndexSearcher.<init> Opening Searcher@75055c5 main
[junit4:junit4]   2> 15937 T179 C16 P51211 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15938 T184 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@75055c5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2>  C14_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51224_solr, base_url=http://127.0.0.1:51224/solr}
[junit4:junit4]   2> 15952 T200 C14 P51224 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2>  C15_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51227_solr, base_url=http://127.0.0.1:51227/solr}
[junit4:junit4]   2> 15952 T213 C15 P51227 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 15954 T213 C15 P51227 oass.SolrIndexSearcher.<init> Opening Searcher@55aa167a main
[junit4:junit4]   2>  C13_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51218_solr, base_url=http://127.0.0.1:51218/solr}
[junit4:junit4]   2> 15955 T187 C13 P51218 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 15955 T213 C15 P51227 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15955 T200 C14 P51224 oass.SolrIndexSearcher.<init> Opening Searcher@23776f79 main
[junit4:junit4]   2> 15956 T200 C14 P51224 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15957 T222 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@55aa167a main{StandardDirectoryReader(segments_2:2)}
[junit4:junit4]   2> 15957 T187 C13 P51218 oass.SolrIndexSearcher.<init> Opening Searcher@441a0353 main
[junit4:junit4]   2> 15957 T213 C15 P51227 /update {waitSearcher=true&commit=true&wt=javabin&commit_end_point=true&softCommit=false&version=2} {commit=} 0 5
[junit4:junit4]   2> 15957 T209 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@23776f79 main{StandardDirectoryReader(segments_2:2)}
[junit4:junit4]   2> 15958 T187 C13 P51218 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15958 T200 C14 P51224 /update {waitSearcher=true&commit=true&wt=javabin&commit_end_point=true&softCommit=false&version=2} {commit=} 0 6
[junit4:junit4]   2> 15959 T196 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@441a0353 main{StandardDirectoryReader(segments_2:2)}
[junit4:junit4]   2> 15959 T187 C13 P51218 /update {waitSearcher=true&commit=true&wt=javabin&commit_end_point=true&softCommit=false&version=2} {commit=} 0 5
[junit4:junit4]   2> 15960 T179 C16 P51211 /update {waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=} 0 25
[junit4:junit4]   2> 15961 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15966 T176 C16 P51211 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 15970 T188 C13 P51218 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 15976 T201 C14 P51224 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=0 status=0 QTime=4 
[junit4:junit4]   2> 15981 T214 C15 P51227 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=0 status=0 QTime=1 
[junit4:junit4]   2> 17986 T161 C17 P51208 oass.SolrIndexSearcher.<init> Opening Searcher@6210bc1e realtime
[junit4:junit4]   2> 17987 T161 C17 P51208 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1409423399803944960)} 0 3
[junit4:junit4]   2> 17990 T179 C16 P51211 oass.SolrIndexSearcher.<init> Opening Searcher@4a5a1ce4 realtime
[junit4:junit4]   2> 17994 T213 C15 P51227 oass.SolrIndexSearcher.<init> Opening Searcher@12da44a7 realtime
[junit4:junit4]   2> 17994 T187 C13 P51218 oass.SolrIndexSearcher.<init> Opening Searcher@91d4d65 realtime
[junit4:junit4]   2> 17994 T213 C15 P51227 REQ /update {update.distrib=FROMLEADER&_version_=-1409423399808139264&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 17994 T187 C13 P51218 REQ /update {update.distrib=FROMLEADER&_version_=-1409423399808139264&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 17994 T200 C14 P51224 oass.SolrIndexSearcher.<init> Opening Searcher@3bbfa8f1 realtime
[junit4:junit4]   2> 17995 T200 C14 P51224 REQ /update {update.distrib=FROMLEADER&_version_=-1409423399808139264&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 17995 T179 C16 P51211 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1409423399808139264)} 0 6
[junit4:junit4]   2> 17999 T161 C17 P51208 /update {wt=javabin&version=2} {add=[0 (1409423399817576448)]} 0 1
[junit4:junit4]   2> 18007 T213 C15 P51227 REQ /update {update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 18008 T187 C13 P51218 REQ /update {update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 18008 T200 C14 P51224 REQ /update {update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 18008 T179 C16 P51211 /update {wt=javabin&version=2} {add=[0 (1409423399821770752)]} 0 6
[junit4:junit4]   2> 18011 T161 C17 P51208 /update {wt=javabin&version=2} {add=[1 (1409423399831207936)]} 0 0
[junit4:junit4]   2> 18022 T187 C13 P51218 REQ /update {update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 18022 T200 C14 P51224 REQ /update {update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 18022 T213 C15 P51227 REQ /update {update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18023 T179 C16 P51211 /update {wt=javabin&version=2} {add=[1 (1409423399834353664)]} 0 9
[junit4:junit4]   2> 18027 T161 C17 P51208 /update {wt=javabin&version=2} {add=[2 (1409423399846936576)]} 0 1
[junit4:junit4]   2> 18033 T213 C15 P51227 REQ /update {update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:51218/solr/collection1/&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 18033 T200 C14 P51224 REQ /update {update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:51218/solr/collection1/&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 18034 T179 C16 P51211 /update {test.distrib.skip.servers=http://127.0.0.1:51218/solr/collection1/&wt=javabin&version=2} {add=[2 (1409423399850082304)]} 0 5
[junit4:junit4]   2> 18037 T161 C17 P51208 /update {wt=javabin&version=2} {add=[3 (1409423399857422336)]} 0 1
[junit4:junit4]   2> 18043 T213 C15 P51227 REQ /update {update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:51218/solr/collection1/&test.distrib.skip.servers=http://127.0.0.1:51224/solr/collection1/&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 18044 T179 C16 P51211 /update {test.distrib.skip.servers=http://127.0.0.1:51218/solr/collection1/&test.distrib.skip.servers=http://127.0.0.1:51224/solr/collection1/&wt=javabin&version=2} {add=[3 (1409423399860568064)]} 0 5
[junit4:junit4]   2> 18046 T161 C17 P51208 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18084 T161 C17 P51208 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/control/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60194bf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/control/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60194bf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[_0.fnm, _0.frq, _0.tim, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0.prx, _0.tip, _0.fdt]
[junit4:junit4]   2> 18085 T161 C17 P51208 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 18089 T161 C17 P51208 oass.SolrIndexSearcher.<init> Opening Searcher@e6efc82 main
[junit4:junit4]   2> 18089 T161 C17 P51208 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18090 T172 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e6efc82 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C4)}
[junit4:junit4]   2> 18091 T161 C17 P51208 /update {waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=} 0 45
[junit4:junit4]   2> 18094 T179 C16 P51211 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18105 T179 C16 P51211 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty1/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@97c2b3f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty1/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@97c2b3f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[_0.fnm, _0.frq, _0.tim, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0.prx, _0.tip, _0.fdt]
[junit4:junit4]   2> 18106 T179 C16 P51211 oasc.SolrDeletionPolicy.updateCommits newest commit = 2
[junit4:junit4]   2> 18109 T179 C16 P51211 oass.SolrIndexSearcher.<init> Opening Searcher@416baa61 main
[junit4:junit4]   2> 18110 T179 C16 P51211 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18111 T184 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@416baa61 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C4)}
[junit4:junit4]   2> 18114 T200 C14 P51224 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18114 T213 C15 P51227 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18114 T187 C13 P51218 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18200 T213 C15 P51227 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty4/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@418c43ad; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty4/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@418c43ad; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_0.fnm, _0.frq, _0.tim, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0.prx, _0.tip, _0.fdt, segments_3]
[junit4:junit4]   2> 18200 T200 C14 P51224 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@257f2ad0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@257f2ad0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_0.fnm, _0.frq, _0.tim, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0.prx, _0.tip, _0.fdt, segments_3]
[junit4:junit4]   2> 18201 T187 C13 P51218 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21852a95; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21852a95; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_0.fnm, _0.frq, _0.tim, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0.prx, _0.tip, _0.fdt, segments_3]
[junit4:junit4]   2> 18201 T213 C15 P51227 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 18202 T187 C13 P51218 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 18201 T200 C14 P51224 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 18206 T187 C13 P51218 oass.SolrIndexSearcher.<init> Opening Searcher@5cea6f21 main
[junit4:junit4]   2> 18207 T213 C15 P51227 oass.SolrIndexSearcher.<init> Opening Searcher@5c2e86f5 main
[junit4:junit4]   2> 18207 T200 C14 P51224 oass.SolrIndexSearcher.<init> Opening Searcher@4e72de5 main
[junit4:junit4]   2> 18207 T187 C13 P51218 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18208 T213 C15 P51227 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18208 T200 C14 P51224 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18209 T222 oasc.JmxMonitoredMap.put WARNING Failed to register info bean: fieldValueCache javax.management.InstanceAlreadyExistsException: solr/collection1:type=fieldValueCache,id=org.apache.solr.search.FastLRUCache
[junit4:junit4]   2> 	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:467)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.internal_addObject(DefaultMBeanServerInterceptor.java:1520)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:986)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:938)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:330)
[junit4:junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:516)
[junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4]   2> 	at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:246)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1597)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.access$000(SolrCore.java:119)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1474)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2> 
[junit4:junit4]   2> 18209 T209 oasc.JmxMonitoredMap.put WARNING Failed to register info bean: filterCache javax.management.InstanceAlreadyExistsException: solr/collection1:type=filterCache,id=org.apache.solr.search.FastLRUCache
[junit4:junit4]   2> 	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:467)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.internal_addObject(DefaultMBeanServerInterceptor.java:1520)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:986)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:938)
[junit4:junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:330)
[junit4:junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:516)
[junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4]   2> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4]   2> 	at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:246)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1597)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore.access$000(SolrCore.java:119)
[junit4:junit4]   2> 	at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1474)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2> 
[junit4:junit4]   2> 18211 T222 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5c2e86f5 main{StandardDirectoryReader(segments_3:4:nrt _0(5.0):C4)}
[junit4:junit4]   2> 18210 T196 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5cea6f21 main{StandardDirectoryReader(segments_3:4:nrt _0(5.0):C2)}
[junit4:junit4]   2> 18212 T209 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4e72de5 main{StandardDirectoryReader(segments_3:4:nrt _0(5.0):C3)}
[junit4:junit4]   2> 18212 T213 C15 P51227 /update {waitSearcher=true&commit=true&wt=javabin&commit_end_point=true&softCommit=false&version=2} {commit=} 0 98
[junit4:junit4]   2> 18212 T187 C13 P51218 /update {waitSearcher=true&commit=true&wt=javabin&commit_end_point=true&softCommit=false&version=2} {commit=} 0 98
[junit4:junit4]   2> 18213 T200 C14 P51224 /update {waitSearcher=true&commit=true&wt=javabin&commit_end_point=true&softCommit=false&version=2} {commit=} 0 99
[junit4:junit4]   2> 18214 T179 C16 P51211 /update {waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=} 0 120
[junit4:junit4]   2> 18215 T149 oasc.AbstractDistributedZkTestCase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):360
[junit4:junit4]   2> 18216 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> check const of shard1
[junit4:junit4]   2> client0
[junit4:junit4]   2> PROPS:shard=shard1
[junit4:junit4]   2> leader=true
[junit4:junit4]   2> roles=null
[junit4:junit4]   2> state=active
[junit4:junit4]   2> core=collection1
[junit4:junit4]   2> collection=collection1
[junit4:junit4]   2> node_name=127.0.0.1:51211_solr
[junit4:junit4]   2> base_url=http://127.0.0.1:51211/solr
[junit4:junit4]   2> 
[junit4:junit4]   2> 18220 T176 C16 P51211 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=4 status=0 QTime=1 
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2> 
[junit4:junit4]   2> client1
[junit4:junit4]   2> PROPS:shard=shard1
[junit4:junit4]   2> roles=null
[junit4:junit4]   2> state=active
[junit4:junit4]   2> core=collection1
[junit4:junit4]   2> collection=collection1
[junit4:junit4]   2> node_name=127.0.0.1:51218_solr
[junit4:junit4]   2> base_url=http://127.0.0.1:51218/solr
[junit4:junit4]   2> 
[junit4:junit4]   2> 18225 T188 C13 P51218 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=2 status=0 QTime=1 
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:2
[junit4:junit4]   2> 
[junit4:junit4]   2> ######shard1 is not consistent.  Got 4 from org.apache.solr.client.solrj.impl.HttpSolrServer@75a7d0f4lastClient and got 2 from http://127.0.0.1:51218/solr/collection1
[junit4:junit4]   2> 18231 T176 C16 P51211 REQ /select {fl=id,_version_&sort=id+asc&q=*:*&distrib=false&wt=javabin&rows=1000&version=2} hits=4 status=0 QTime=1 
[junit4:junit4]   2> 18235 T188 C13 P51218 REQ /select {fl=id,_version_&sort=id+asc&q=*:*&distrib=false&wt=javabin&rows=1000&version=2} hits=2 status=0 QTime=1 
[junit4:junit4]   2> ######org.apache.solr.client.solrj.impl.HttpSolrServer@75a7d0f4: {numFound=4,start=0,docs=[SolrDocument{id=0, _version_=1409423399821770752}, SolrDocument{id=1, _version_=1409423399834353664}, SolrDocument{id=2, _version_=1409423399850082304}, SolrDocument{id=3, _version_=1409423399860568064}]}
[junit4:junit4]   2> ######org.apache.solr.client.solrj.impl.HttpSolrServer@42f961d5: {numFound=2,start=0,docs=[SolrDocument{id=0, _version_=1409423399821770752}, SolrDocument{id=1, _version_=1409423399834353664}]}
[junit4:junit4]   2> ###### sizes=4,2
[junit4:junit4]   2> ###### Only in org.apache.solr.client.solrj.impl.HttpSolrServer@75a7d0f4: [{id=3, _version_=1409423399860568064}, {id=2, _version_=1409423399850082304}]
[junit4:junit4]   2> client2
[junit4:junit4]   2> PROPS:shard=shard1
[junit4:junit4]   2> roles=null
[junit4:junit4]   2> state=active
[junit4:junit4]   2> core=collection1
[junit4:junit4]   2> collection=collection1
[junit4:junit4]   2> node_name=127.0.0.1:51224_solr
[junit4:junit4]   2> base_url=http://127.0.0.1:51224/solr
[junit4:junit4]   2> 
[junit4:junit4]   2> 18238 T201 C14 P51224 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=3 status=0 QTime=0 
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:3
[junit4:junit4]   2> 
[junit4:junit4]   2> client3
[junit4:junit4]   2> PROPS:shard=shard1
[junit4:junit4]   2> roles=null
[junit4:junit4]   2> state=active
[junit4:junit4]   2> core=collection1
[junit4:junit4]   2> collection=collection1
[junit4:junit4]   2> node_name=127.0.0.1:51227_solr
[junit4:junit4]   2> base_url=http://127.0.0.1:51227/solr
[junit4:junit4]   2> 
[junit4:junit4]   2> 18242 T214 C15 P51227 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=4 status=0 QTime=0 
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2> 
[junit4:junit4]   2> 18246 T149 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18256 T202 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : action=SYNCSHARD&collection=collection1&shard=shard1&wt=javabin&version=2
[junit4:junit4]   2> 18257 T202 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18270 T181 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4]   2> 18271 T181 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51211/solr/collection1/
[junit4:junit4]   2> 18271 T181 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51211/solr START replicas=[http://127.0.0.1:51218/solr/collection1/, http://127.0.0.1:51224/solr/collection1/, http://127.0.0.1:51227/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 18275 T215 C15 P51227 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=2 
[junit4:junit4]   2> 18275 T189 C13 P51218 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=2 
[junit4:junit4]   2> 18275 T203 C14 P51224 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=2 
[junit4:junit4]   2> 18276 T181 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51211/solr  Received 5 versions from 127.0.0.1:51227/solr/collection1/
[junit4:junit4]   2> 18276 T181 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51211/solr  Our versions are newer. ourLowThreshold=1409423399808139264 otherHigh=1409423399850082304
[junit4:junit4]   2> 18276 T181 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51211/solr  Received 3 versions from 127.0.0.1:51218/solr/collection1/
[junit4:junit4]   2> 18277 T181 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51211/solr  Our versions are newer. ourLowThreshold=1409423399808139264 otherHigh=1409423399834353664
[junit4:junit4]   2> 18277 T181 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51211/solr  Received 4 versions from 127.0.0.1:51224/solr/collection1/
[junit4:junit4]   2> 18277 T181 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51211/solr  Our versions are newer. ourLowThreshold=1409423399808139264 otherHigh=1409423399850082304
[junit4:junit4]   2> 18277 T181 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51211/solr DONE. sync succeeded
[junit4:junit4]   2> 18278 T181 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 18278 T181 oasc.SyncStrategy.syncToMe http://127.0.0.1:51211/solr/collection1/: try and ask http://127.0.0.1:51218/solr/collection1/ to sync
[junit4:junit4]   2> 18279 T181 oasc.SyncStrategy.syncToMe http://127.0.0.1:51211/solr/collection1/: try and ask http://127.0.0.1:51224/solr/collection1/ to sync
[junit4:junit4]   2> 18279 T181 oasc.SyncStrategy.syncToMe http://127.0.0.1:51211/solr/collection1/: try and ask http://127.0.0.1:51227/solr/collection1/ to sync
[junit4:junit4]   2> 18280 T190 C13 P51218 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51218/solr START replicas=[http://127.0.0.1:51211/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 18280 T204 C14 P51224 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51224/solr START replicas=[http://127.0.0.1:51211/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 18281 T216 C15 P51227 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51227/solr START replicas=[http://127.0.0.1:51211/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 18284 T177 C16 P51211 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1 
[junit4:junit4]   2> 18284 T175 C16 P51211 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1 
[junit4:junit4]   2> 18284 T178 C16 P51211 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 18285 T216 C15 P51227 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51227/solr  Received 5 versions from 127.0.0.1:51211/solr/collection1/
[junit4:junit4]   2> 18285 T204 C14 P51224 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51224/solr  Received 5 versions from 127.0.0.1:51211/solr/collection1/
[junit4:junit4]   2> 18285 T216 C15 P51227 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51227/solr  Our versions are newer. ourLowThreshold=1409423399808139264 otherHigh=1409423399850082304
[junit4:junit4]   2> 18285 T204 C14 P51224 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:51224/solr Requesting updates from 127.0.0.1:51211/solr/collection1/n=1 versions=[1409423399860568064]
[junit4:junit4]   2> 18285 T216 C15 P51227 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51227/solr DONE. sync succeeded
[junit4:junit4]   2> 18285 T190 C13 P51218 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51218/solr  Received 5 versions from 127.0.0.1:51211/solr/collection1/
[junit4:junit4]   2> 18286 T216 C15 P51227 REQ /get {sync=http://127.0.0.1:51211/solr/collection1/&getVersions=100&distrib=false&qt=/get&wt=javabin&version=2} status=0 QTime=5 
[junit4:junit4]   2> 18286 T190 C13 P51218 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:51218/solr Requesting updates from 127.0.0.1:51211/solr/collection1/n=2 versions=[1409423399860568064, 1409423399850082304]
[junit4:junit4]   2> 18287 T181 oasc.SyncStrategy.syncToMe http://127.0.0.1:51211/solr/collection1/:  sync completed with http://127.0.0.1:51227/solr/collection1/
[junit4:junit4]   2> 18288 T178 C16 P51211 REQ /get {distrib=false&getUpdates=1409423399860568064&qt=/get&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18289 T175 C16 P51211 REQ /get {distrib=false&getUpdates=1409423399860568064,1409423399850082304&qt=/get&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 18292 T204 C14 P51224 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51224/solr DONE. sync succeeded
[junit4:junit4]   2> 18292 T204 C14 P51224 REQ /get {sync=http://127.0.0.1:51211/solr/collection1/&getVersions=100&distrib=false&qt=/get&wt=javabin&version=2} status=0 QTime=12 
[junit4:junit4]   2> 18293 T181 oasc.SyncStrategy.syncToMe http://127.0.0.1:51211/solr/collection1/:  sync completed with http://127.0.0.1:51224/solr/collection1/
[junit4:junit4]   2> 18293 T190 C13 P51218 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51218/solr DONE. sync succeeded
[junit4:junit4]   2> 18294 T190 C13 P51218 REQ /get {sync=http://127.0.0.1:51211/solr/collection1/&getVersions=100&distrib=false&qt=/get&wt=javabin&version=2} status=0 QTime=14 
[junit4:junit4]   2> 18294 T181 oasc.SyncStrategy.syncToMe http://127.0.0.1:51211/solr/collection1/:  sync completed with http://127.0.0.1:51218/solr/collection1/
[junit4:junit4]   2> 18295 T149 oasc.AbstractDistributedZkTestCase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):360
[junit4:junit4]   2> 18296 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18299 T161 C17 P51208 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18300 T161 C17 P51208 oass.SolrIndexSearcher.<init> Opening Searcher@1f78e951 main
[junit4:junit4]   2> 18301 T161 C17 P51208 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18302 T172 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f78e951 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C4)}
[junit4:junit4]   2> 18303 T161 C17 P51208 /update {waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=} 0 4
[junit4:junit4]   2> 18306 T179 C16 P51211 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18307 T179 C16 P51211 oass.SolrIndexSearcher.<init> Opening Searcher@2389c90f main
[junit4:junit4]   2> 18308 T179 C16 P51211 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18309 T184 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2389c90f main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C4)}
[junit4:junit4]   2> 18311 T187 C13 P51218 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18311 T213 C15 P51227 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18311 T200 C14 P51224 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 18313 T213 C15 P51227 oass.SolrIndexSearcher.<init> Opening Searcher@20ca0c9 main
[junit4:junit4]   2> 18314 T213 C15 P51227 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18315 T222 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@20ca0c9 main{StandardDirectoryReader(segments_3:4:nrt _0(5.0):C4)}
[junit4:junit4]   2> 18315 T213 C15 P51227 /update {waitSearcher=true&commit=true&wt=javabin&commit_end_point=true&softCommit=false&version=2} {commit=} 0 4
[junit4:junit4]   2> 18397 T187 C13 P51218 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21852a95; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_0.fnm, _0.frq, _0.tim, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0.prx, _0.tip, _0.fdt, segments_3]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21852a95; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[_1_nrm.cfs, _0.fnm, _1.frq, _0_nrm.cfs, _1.fnm, _1_nrm.cfe, _1.fdx, _1.prx, _1.fdt, _1.si, _0_nrm.cfe, _0.tim, _0.frq, _0.fdx, _0.si, _1.tip, _0.tip, _0.prx, _1.tim, _0.fdt, segments_4]
[junit4:junit4]   2> 18398 T187 C13 P51218 oasc.SolrDeletionPolicy.updateCommits newest commit = 4
[junit4:junit4]   2> 18401 T187 C13 P51218 oass.SolrIndexSearcher.<init> Opening Searcher@1bf1a64c main
[junit4:junit4]   2> 18403 T187 C13 P51218 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18404 T196 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1bf1a64c main{StandardDirectoryReader(segments_4:6:nrt _0(5.0):C2 _1(5.0):C2)}
[junit4:junit4]   2> 18404 T187 C13 P51218 /update {waitSearcher=true&commit=true&wt=javabin&commit_end_point=true&softCommit=false&version=2} {commit=} 0 93
[junit4:junit4]   2> 18408 T200 C14 P51224 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@257f2ad0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_0.fnm, _0.frq, _0.tim, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0.prx, _0.tip, _0.fdt, segments_3]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@257f2ad0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[_1_nrm.cfs, _0.fnm, _1.frq, _0_nrm.cfs, _1.fnm, _1_nrm.cfe, _1.fdx, _1.prx, _1.fdt, _1.si, _0_nrm.cfe, _0.tim, _0.frq, _0.fdx, _0.si, _1.tip, _0.tip, _0.prx, _1.tim, _0.fdt, segments_4]
[junit4:junit4]   2> 18409 T200 C14 P51224 oasc.SolrDeletionPolicy.updateCommits newest commit = 4
[junit4:junit4]   2> 18413 T200 C14 P51224 oass.SolrIndexSearcher.<init> Opening Searcher@2516ac04 main
[junit4:junit4]   2> 18415 T200 C14 P51224 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18415 T209 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2516ac04 main{StandardDirectoryReader(segments_4:6:nrt _0(5.0):C3 _1(5.0):C1)}
[junit4:junit4]   2> 18416 T200 C14 P51224 /update {waitSearcher=true&commit=true&wt=javabin&commit_end_point=true&softCommit=false&version=2} {commit=} 0 105
[junit4:junit4]   2> 18417 T179 C16 P51211 /update {waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=} 0 111
[junit4:junit4]   2> 18418 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18422 T176 C16 P51211 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=4 status=0 QTime=1 
[junit4:junit4]   2> 18425 T188 C13 P51218 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 18430 T201 C14 P51224 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=4 status=0 QTime=1 
[junit4:junit4]   2> 18434 T214 C15 P51227 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=4 status=0 QTime=1 
[junit4:junit4]   2> 20442 T162 C17 P51208 REQ /select {fl=id,score&shard.url=127.0.0.1:51208/solr/collection1/&NOW=1344130899788&start=0&q=*:*&distrib=false&isShard=true&wt=javabin&fsv=true&rows=10&version=2} hits=4 status=0 QTime=1 
[junit4:junit4]   2> 20450 T162 C17 P51208 REQ /select {shard.url=127.0.0.1:51208/solr/collection1/&NOW=1344130899788&q=*:*&ids=3,2,1,0&distrib=false&isShard=true&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 20451 T161 C17 P51208 REQ /select {wt=javabin&q=*:*&version=2} status=0 QTime=13 
[junit4:junit4]   2> Control Docs:4
[junit4:junit4]   2> 20453 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> check const of shard1
[junit4:junit4]   2> client0
[junit4:junit4]   2> PROPS:shard=shard1
[junit4:junit4]   2> leader=true
[junit4:junit4]   2> roles=null
[junit4:junit4]   2> state=active
[junit4:junit4]   2> core=collection1
[junit4:junit4]   2> collection=collection1
[junit4:junit4]   2> node_name=127.0.0.1:51211_solr
[junit4:junit4]   2> base_url=http://127.0.0.1:51211/solr
[junit4:junit4]   2> 
[junit4:junit4]   2> 20456 T176 C16 P51211 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=4 status=0 QTime=0 
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2> 
[junit4:junit4]   2> client1
[junit4:junit4]   2> PROPS:shard=shard1
[junit4:junit4]   2> roles=null
[junit4:junit4]   2> state=active
[junit4:junit4]   2> core=collection1
[junit4:junit4]   2> collection=collection1
[junit4:junit4]   2> node_name=127.0.0.1:51218_solr
[junit4:junit4]   2> base_url=http://127.0.0.1:51218/solr
[junit4:junit4]   2> 
[junit4:junit4]   2> 20460 T188 C13 P51218 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=4 status=0 QTime=0 
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2> 
[junit4:junit4]   2> client2
[junit4:junit4]   2> PROPS:shard=shard1
[junit4:junit4]   2> roles=null
[junit4:junit4]   2> state=active
[junit4:junit4]   2> core=collection1
[junit4:junit4]   2> collection=collection1
[junit4:junit4]   2> node_name=127.0.0.1:51224_solr
[junit4:junit4]   2> base_url=http://127.0.0.1:51224/solr
[junit4:junit4]   2> 
[junit4:junit4]   2> 20463 T201 C14 P51224 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=4 status=0 QTime=0 
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2> 
[junit4:junit4]   2> client3
[junit4:junit4]   2> PROPS:shard=shard1
[junit4:junit4]   2> roles=null
[junit4:junit4]   2> state=active
[junit4:junit4]   2> core=collection1
[junit4:junit4]   2> collection=collection1
[junit4:junit4]   2> node_name=127.0.0.1:51227_solr
[junit4:junit4]   2> base_url=http://127.0.0.1:51227/solr
[junit4:junit4]   2> 
[junit4:junit4]   2> 20466 T214 C15 P51227 REQ /select {distrib=false&wt=javabin&q=*:*&version=2} hits=4 status=0 QTime=0 
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2> 
[junit4:junit4]   2> 20470 T191 C13 P51218 REQ /select {fl=id,score&shard.url=127.0.0.1:51211/solr/collection1/|127.0.0.1:51218/solr/collection1/|127.0.0.1:51224/solr/collection1/|127.0.0.1:51227/solr/collection1/&NOW=1344130899818&start=0&q=*:*&distrib=false&isShard=true&wt=javabin&fsv=true&rows=10&version=2} hits=4 status=0 QTime=0 
[junit4:junit4]   2> 20474 T191 C13 P51218 REQ /select {shard.url=127.0.0.1:51211/solr/collection1/|127.0.0.1:51218/solr/collection1/|127.0.0.1:51224/solr/collection1/|127.0.0.1:51227/solr/collection1/&NOW=1344130899818&q=*:*&ids=3,2,1,0&distrib=false&isShard=true&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   2> 20475 T205 C14 P51224 REQ /select {wt=javabin&q=*:*&version=2} status=0 QTime=7 
[junit4:junit4]   2> 20480 T161 C17 P51208 /update {wt=javabin&version=2} {add=[4 (1409423402418044928)]} 0 2
[junit4:junit4]   2> 20489 T187 C13 P51218 REQ /update {update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:51227/solr/collection1/&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 20489 T200 C14 P51224 REQ /update {update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:51227/solr/collection1/&wt=javabin&version=2} status=0 QTime=2 
[junit4:junit4]   2> 20490 T179 C16 P51211 /update {test.distrib.skip.servers=http://127.0.0.1:51227/solr/collection1/&wt=javabin&version=2} {add=[4 (1409423402423287808)]} 0 6
[junit4:junit4]   2> 20490 T149 oasc.ChaosMonkey.monkeyLog monkey: kill shard! 51211
[junit4:junit4]   2> 20491 T149 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=496350637
[junit4:junit4]   2> 20493 T149 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@18c14dd1
[junit4:junit4]   2> 20497 T149 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 20497 T149 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   2> 20555 T149 C16 P51211 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty1/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@97c2b3f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty1/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@97c2b3f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[_0.fnm, _0.frq, _0.tim, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0.prx, _0.tip, _0.fdt]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty1/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@97c2b3f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_1_nrm.cfs, _0.fnm, _1.frq, _0_nrm.cfs, _1.fnm, _1_nrm.cfe, _1.fdx, _1.prx, _1.fdt, _1.si, _0_nrm.cfe, _0.tim, _0.frq, _0.fdx, _0.si, _1.tip, _0.tip, _0.prx, _1.tim, segments_3, _0.fdt]
[junit4:junit4]   2> 20556 T149 C16 P51211 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 20558 T154 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x138f4718fec0003
[junit4:junit4]   2> 20559 T208 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 20559 T230 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 20559 T225 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 20560 T183 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 20560 T195 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 20560 T149 oaz.ZooKeeper.close Session: 0x138f4718fec0003 closed
[junit4:junit4]   2> 20559 T221 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 20559 T169 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 20560 T151 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51212 which had sessionid 0x138f4718fec0003
[junit4:junit4]   2> 20561 T149 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 20562 T183 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 20562 T183 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 20565 T195 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51218/solr/collection1/
[junit4:junit4]   2> 20566 T195 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51218/solr START replicas=[http://127.0.0.1:51224/solr/collection1/, http://127.0.0.1:51227/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 20569 T203 C14 P51224 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1 
[junit4:junit4]   2> 20569 T215 C15 P51227 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 20569 T195 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51218/solr  Received 6 versions from 127.0.0.1:51224/solr/collection1/
[junit4:junit4]   2> 20570 T195 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51218/solr  Our versions are newer. ourLowThreshold=1409423399821770752 otherHigh=1409423399860568064
[junit4:junit4]   2> 20570 T195 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51218/solr  Received 5 versions from 127.0.0.1:51227/solr/collection1/
[junit4:junit4]   2> 20570 T195 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51218/solr  Our versions are newer. ourLowThreshold=1409423399821770752 otherHigh=1409423399850082304
[junit4:junit4]   2> 20570 T195 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51218/solr DONE. sync succeeded
[junit4:junit4]   2> 20571 T195 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 20571 T195 oasc.SyncStrategy.syncToMe http://127.0.0.1:51218/solr/collection1/: try and ask http://127.0.0.1:51224/solr/collection1/ to sync
[junit4:junit4]   2> 20571 T195 oasc.SyncStrategy.syncToMe http://127.0.0.1:51218/solr/collection1/: try and ask http://127.0.0.1:51227/solr/collection1/ to sync
[junit4:junit4]   2> 20573 T204 C14 P51224 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51224/solr START replicas=[http://127.0.0.1:51218/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 20574 T216 C15 P51227 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51227/solr START replicas=[http://127.0.0.1:51218/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 20576 T192 C13 P51218 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 20576 T189 C13 P51218 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=0 
[junit4:junit4]   2> 20577 T216 C15 P51227 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51227/solr  Received 6 versions from 127.0.0.1:51218/solr/collection1/
[junit4:junit4]   2> 20577 T204 C14 P51224 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51224/solr  Received 6 versions from 127.0.0.1:51218/solr/collection1/
[junit4:junit4]   2> 20577 T216 C15 P51227 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:51227/solr Requesting updates from 127.0.0.1:51218/solr/collection1/n=1 versions=[1409423402423287808]
[junit4:junit4]   2> 20578 T204 C14 P51224 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:51224/solr  Our versions are newer. ourLowThreshold=1409423399821770752 otherHigh=1409423399860568064
[junit4:junit4]   2> 20578 T204 C14 P51224 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51224/solr DONE. sync succeeded
[junit4:junit4]   2> 20579 T204 C14 P51224 REQ /get {sync=http://127.0.0.1:51218/solr/collection1/&getVersions=100&distrib=false&qt=/get&wt=javabin&version=2} status=0 QTime=6 
[junit4:junit4]   2> 20579 T195 oasc.SyncStrategy.syncToMe http://127.0.0.1:51218/solr/collection1/:  sync completed with http://127.0.0.1:51224/solr/collection1/
[junit4:junit4]   2> 20580 T189 C13 P51218 REQ /get {distrib=false&getUpdates=1409423402423287808&qt=/get&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   2> 20584 T216 C15 P51227 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51227/solr DONE. sync succeeded
[junit4:junit4]   2> 20585 T216 C15 P51227 REQ /get {sync=http://127.0.0.1:51218/solr/collection1/&getVersions=100&distrib=false&qt=/get&wt=javabin&version=2} status=0 QTime=11 
[junit4:junit4]   2> 20586 T195 oasc.SyncStrategy.syncToMe http://127.0.0.1:51218/solr/collection1/:  sync completed with http://127.0.0.1:51227/solr/collection1/
[junit4:junit4]   2> 20586 T195 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:51218_solr_collection1
[junit4:junit4]   2> 20588 T195 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 20593 T154 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138f4718fec0004 type:create cxid:0x56 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 20614 T149 oasc.AbstractDistributedZkTestCase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):360
[junit4:junit4]   2> 20615 T149 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20618 T161 C17 P51208 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 20665 T170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20669 T161 C17 P51208 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/control/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60194bf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[_0.fnm, _0.frq, _0.tim, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0.prx, _0.tip, _0.fdt]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/control/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60194bf0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_1_nrm.cfs, _0.fnm, _1.frq, _0_nrm.cfs, _1.fnm, _1_nrm.cfe, _1.fdx, _1.prx, _1.fdt, _1.si, _0_nrm.cfe, _0.tim, _0.frq, _0.fdx, _0.si, _1.tip, _0.tip, _0.prx, _1.tim, segments_3, _0.fdt]
[junit4:junit4]   2> 20670 T161 C17 P51208 oasc.SolrDeletionPolicy.updateCommits newest commit = 3
[junit4:junit4]   2> 20673 T161 C17 P51208 oass.SolrIndexSearcher.<init> Opening Searcher@2dd9928 main
[junit4:junit4]   2> 20674 T161 C17 P51208 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 20675 T172 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2dd9928 main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):C4 _1(5.0):C1)}
[junit4:junit4]   2> 20675 T161 C17 P51208 /update {waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=} 0 57
[junit4:junit4]   2> 20677 T154 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x138f4718fec0008
[junit4:junit4]   2> 20681 T230 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 20682 T151 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51255 which had sessionid 0x138f4718fec0008
[junit4:junit4]   2> 20681 T149 oaz.ZooKeeper.close Session: 0x138f4718fec0008 closed
[junit4:junit4]   2> 20683 T154 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x138f4718fec0007
[junit4:junit4]   2> 20689 T225 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 20689 T149 oaz.ZooKeeper.close Session: 0x138f4718fec0007 closed
[junit4:junit4]   2> 20689 T151 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51231 which had sessionid 0x138f4718fec0007
[junit4:junit4]   2> 20690 T153 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 20690 T154 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 20690 T149 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 20848 T149 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51209 which had sessionid 0x138f4718fec0002
[junit4:junit4]   2> 20848 T168 oaz.ClientCnxn$SendThread.run Unable to read additional data from server sessionid 0x138f4718fec0002, likely server has closed socket, closing socket connection and attempting reconnect
[junit4:junit4]   2> 20848 T149 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51226 which had sessionid 0x138f4718fec0005
[junit4:junit4]   2> 20849 T207 oaz.ClientCnxn$SendThread.run Unable to read additional data from server sessionid 0x138f4718fec0005, likely server has closed socket, closing socket connection and attempting reconnect
[junit4:junit4]   2> 20849 T149 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51229 which had sessionid 0x138f4718fec0006
[junit4:junit4]   2> 20849 T220 oaz.ClientCnxn$SendThread.run Unable to read additional data from server sessionid 0x138f4718fec0006, likely server has closed socket, closing socket connection and attempting reconnect
[junit4:junit4]   2> 20850 T149 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51219 which had sessionid 0x138f4718fec0004
[junit4:junit4]   2> 20850 T194 oaz.ClientCnxn$SendThread.run Unable to read additional data from server sessionid 0x138f4718fec0004, likely server has closed socket, closing socket connection and attempting reconnect
[junit4:junit4]   2> 20850 T151 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 20851 T149 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 20851 T149 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 51208
[junit4:junit4]   2> 20852 T149 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=117686693
[junit4:junit4]   2> 20852 T149 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5de890b4
[junit4:junit4]   2> 20855 T149 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 20856 T149 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   2> 20950 T208 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e7fee2d name:ZooKeeperConnection Watcher:127.0.0.1:51205/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 20950 T149 oaz.ZooKeeper.close Session: 0x138f4718fec0002 closed
[junit4:junit4]   2> 20950 T170 oasc.Overseer$ClusterStateUpdater.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 20950 T169 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48ebd302 name:ZooKeeperConnection Watcher:127.0.0.1:51205/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 20951 T221 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12ecb5db name:ZooKeeperConnection Watcher:127.0.0.1:51205/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 20951 T195 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@486f90fe name:ZooKeeperConnection Watcher:127.0.0.1:51205/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 20951 T169 oascc.ConnectionManager.checkClosed Not acting because I am closed
[junit4:junit4]   2> 20951 T149 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 20952 T169 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 20952 T171 oasc.OverseerCollectionProcessor.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 21004 T149 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 51211
[junit4:junit4]   2> 21004 T149 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 51218
[junit4:junit4]   2> 21004 T149 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1628577465
[junit4:junit4]   2> 21005 T149 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:51218_solr_collection1
[junit4:junit4]   2> 21005 T149 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2508d3eb
[junit4:junit4]   2> 21008 T149 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 21008 T149 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   2> 21063 T149 C13 P51218 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21852a95; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[_1_nrm.cfs, _0.fnm, _1.frq, _0_nrm.cfs, _1.fnm, _1_nrm.cfe, _1.fdx, _1.prx, _1.fdt, _1.si, _0_nrm.cfe, _0.tim, _0.frq, _0.fdx, _0.si, _1.tip, _0.tip, _0.prx, _1.tim, _0.fdt, segments_4]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty2/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21852a95; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[_2.si, _1.frq, _1.fnm, _2.tim, _2_nrm.cfe, _2_nrm.cfs, _0.si, _0.prx, _1.tip, _1.tim, _1_nrm.cfs, _0.fnm, _2.prx, _2.fdt, _2.frq, _0_nrm.cfs, _2.fdx, _2.fnm, _1_nrm.cfe, _1.prx, _1.fdx, _2.tip, _1.fdt, _1.si, _0.frq, _0.tim, _0_nrm.cfe, _0.fdx, segments_5, _0.tip, _0.fdt]
[junit4:junit4]   2> 21064 T149 C13 P51218 oasc.SolrDeletionPolicy.updateCommits newest commit = 5
[junit4:junit4]   2> 21065 T149 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:51218_solr_collection1
[junit4:junit4]   2> 22101 T207 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:51205
[junit4:junit4]   2> 22321 T220 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:51205
[junit4:junit4]   2> 22403 T194 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:51205
[junit4:junit4]   2> 22651 T152 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 28951 T207 oaz.ClientCnxn$SendThread.run Client session timed out, have not heard from server in 8001ms for sessionid 0x138f4718fec0005, closing socket connection and attempting reconnect
[junit4:junit4]   2> 28952 T220 oaz.ClientCnxn$SendThread.run Client session timed out, have not heard from server in 8001ms for sessionid 0x138f4718fec0006, closing socket connection and attempting reconnect
[junit4:junit4]   2> 29053 T195 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 29053 T149 oaz.ZooKeeper.close Session: 0x138f4718fec0004 closed
[junit4:junit4]   2> 29054 T149 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 29107 T149 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 51224
[junit4:junit4]   2> 29107 T149 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1072316483
[junit4:junit4]   2> 29107 T149 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:51224_solr_collection1
[junit4:junit4]   2> 29108 T149 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@c876cb0
[junit4:junit4]   2> 29111 T149 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 29111 T149 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   2> 29159 T149 C14 P51224 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@257f2ad0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[_1_nrm.cfs, _0.fnm, _1.frq, _0_nrm.cfs, _1.fnm, _1_nrm.cfe, _1.fdx, _1.prx, _1.fdt, _1.si, _0_nrm.cfe, _0.tim, _0.frq, _0.fdx, _0.si, _1.tip, _0.tip, _0.prx, _1.tim, _0.fdt, segments_4]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty3/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@257f2ad0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[_2.si, _1.frq, _1.fnm, _2.tim, _2_nrm.cfe, _2_nrm.cfs, _0.si, _0.prx, _1.tip, _1.tim, _1_nrm.cfs, _0.fnm, _2.prx, _2.fdt, _2.frq, _0_nrm.cfs, _2.fdx, _2.fnm, _1_nrm.cfe, _1.prx, _1.fdx, _2.tip, _1.fdt, _1.si, _0.frq, _0.tim, _0_nrm.cfe, _0.fdx, segments_5, _0.tip, _0.fdt]
[junit4:junit4]   2> 29159 T149 C14 P51224 oasc.SolrDeletionPolicy.updateCommits newest commit = 5
[junit4:junit4]   2> 29161 T149 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:51224_solr_collection1
[junit4:junit4]   2> 30372 T207 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:51205
[junit4:junit4]   2> 30887 T220 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:51205
[junit4:junit4]   2> 37054 T220 oaz.ClientCnxn$SendThread.run Client session timed out, have not heard from server in 8001ms for sessionid 0x138f4718fec0006, closing socket connection and attempting reconnect
[junit4:junit4]   2> 37154 T208 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 37154 T149 oaz.ZooKeeper.close Session: 0x138f4718fec0005 closed
[junit4:junit4]   2> 37155 T149 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 37208 T149 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 51227
[junit4:junit4]   2> 37208 T149 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=2129565033
[junit4:junit4]   2> 37208 T149 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:51227_solr_collection1
[junit4:junit4]   2> 37209 T149 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@789ab21d
[junit4:junit4]   2> 37213 T149 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 37214 T149 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   2> 37263 T149 C15 P51227 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty4/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@418c43ad; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_0.fnm, _0.frq, _0.tim, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0.prx, _0.tip, _0.fdt, segments_3]
[junit4:junit4]   2> 		commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1344130879357/jetty4/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@418c43ad; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[_1_nrm.cfs, _0.fnm, _1.frq, _0_nrm.cfs, _1.fnm, _1_nrm.cfe, _1.fdx, _1.prx, _1.fdt, _1.si, _0_nrm.cfe, _0.tim, _0.frq, _0.fdx, _0.si, _1.tip, _0.tip, _0.prx, _1.tim, _0.fdt, segments_4]
[junit4:junit4]   2> 37264 T149 C15 P51227 oasc.SolrDeletionPolicy.updateCommits newest commit = 4
[junit4:junit4]   2> 37266 T149 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:51227_solr_collection1
[junit4:junit4]   2> 38239 T220 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:51205
[junit4:junit4]   2> 45257 T221 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 45257 T149 oaz.ZooKeeper.close Session: 0x138f4718fec0006 closed
[junit4:junit4]   2> 45258 T149 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 45340 T149 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=7E0A383C1C89C77A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=th -Dtests.timezone=America/Cuiaba -Dtests.file.encoding=ISO8859-1
[junit4:junit4]   2>
[junit4:junit4]    > (@AfterClass output)
[junit4:junit4]   2> 45400 T149 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Appending, sim=DefaultSimilarity, locale=th, timezone=America/Cuiaba
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=1,free=166510936,total=241369088
[junit4:junit4]   2> NOTE: All tests run in this JVM: [DistanceFunctionTest, MinimalSchemaTest, TestDistributedGrouping, PathHierarchyTokenizerFactoryTest, TestUpdate, SyncSliceTest]
[junit4:junit4]   2> 
[junit4:junit4] Completed on J0 in 45.42s, 1 test, 1 error <<< FAILURES!

[...truncated 636 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/build.xml:29: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/solr/build.xml:144: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/module-build.xml:62: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/common-build.xml:1095: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/common-build.xml:790: There were test failures: 223 suites, 899 tests, 1 error, 5 ignored

Total time: 28 minutes 8 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Publishing Clover coverage report...
No Clover report will be published due to a Build Failure
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message