lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.6.0) - Build # 1230 - Still Failing!
Date Sat, 25 Jan 2014 01:47:29 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/1230/
Java: 64bit/jdk1.6.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch

Error Message:
collection already exists: collection2

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: collection2
	at __randomizedtesting.SeedInfo.seed([C9D33542556706D1:4835BB5A223866ED]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:495)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:283)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:640)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1623)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1649)
	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrServer(FullSolrCloudDistribCmdsTest.java:353)
	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.doTest(FullSolrCloudDistribCmdsTest.java:143)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:695)




Build Log:
[...truncated 9760 lines...]
   [junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
   [junit4]   2> 1445658 T5719 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1445664 T5719 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solrtest-FullSolrCloudDistribCmdsTest-1390612927719
   [junit4]   2> 1445666 T5719 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1445667 T5720 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1445768 T5719 oasc.ZkTestServer.run start zk server on port:59076
   [junit4]   2> 1445771 T5719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1445782 T5726 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b60fdbd name:ZooKeeperConnection Watcher:127.0.0.1:59076 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1445784 T5719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1445784 T5719 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1445812 T5719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1445818 T5728 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45ec9c22 name:ZooKeeperConnection Watcher:127.0.0.1:59076/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1445819 T5719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1445819 T5719 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1445831 T5719 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1445844 T5719 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1445858 T5719 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1445873 T5719 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1445874 T5719 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1445892 T5719 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 1445893 T5719 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1445904 T5719 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1445904 T5719 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1445915 T5719 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1445916 T5719 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1445927 T5719 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1445927 T5719 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1445938 T5719 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1445939 T5719 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1445949 T5719 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1445950 T5719 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1445960 T5719 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1445961 T5719 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1445972 T5719 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1445972 T5719 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1445983 T5719 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1445984 T5719 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1445996 T5719 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1445997 T5719 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1446356 T5719 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1446364 T5719 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59079
   [junit4]   2> 1446365 T5719 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1446367 T5719 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1446367 T5719 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1390612928064
   [junit4]   2> 1446368 T5719 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1390612928064/'
   [junit4]   2> 1446400 T5719 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1390612928064/solr.xml
   [junit4]   2> 1446472 T5719 oasc.CoreContainer.<init> New CoreContainer 1852336256
   [junit4]   2> 1446472 T5719 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1390612928064/]
   [junit4]   2> 1446473 T5719 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1446474 T5719 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1446474 T5719 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1446474 T5719 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1446475 T5719 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1446475 T5719 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1446476 T5719 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1446476 T5719 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1446477 T5719 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1446499 T5719 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1446500 T5719 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1446500 T5719 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1446500 T5719 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59076/solr
   [junit4]   2> 1446501 T5719 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1446503 T5719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1446507 T5739 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8a4e421 name:ZooKeeperConnection Watcher:127.0.0.1:59076 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1446509 T5719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1446515 T5719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1446518 T5741 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d02c2b1 name:ZooKeeperConnection Watcher:127.0.0.1:59076/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1446519 T5719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1446523 T5719 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1446536 T5719 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1446564 T5719 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1446573 T5719 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59079_
   [junit4]   2> 1446576 T5719 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59079_
   [junit4]   2> 1446590 T5719 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1446598 T5719 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1446616 T5719 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1446626 T5719 oasc.Overseer.start Overseer (id=91135208831451139-127.0.0.1:59079_-n_0000000000) starting
   [junit4]   2> 1446638 T5719 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1446653 T5743 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1446655 T5743 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 1446658 T5719 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1446670 T5719 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1446678 T5719 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1446694 T5742 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1446705 T5744 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1446706 T5744 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1446710 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1446710 T5744 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1446716 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1446718 T5742 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59079",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59079_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1446718 T5742 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1446718 T5742 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1446728 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1446731 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1447712 T5744 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1447713 T5744 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1390612928064/collection1
   [junit4]   2> 1447713 T5744 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1447716 T5744 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1447716 T5744 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1447722 T5744 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1390612928064/collection1/'
   [junit4]   2> 1447723 T5744 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1390612928064/collection1/lib/classes/' to classloader
   [junit4]   2> 1447724 T5744 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1390612928064/collection1/lib/README' to classloader
   [junit4]   2> 1447804 T5744 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1447856 T5744 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1447860 T5744 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1447872 T5744 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1448380 T5744 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1448387 T5744 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1448389 T5744 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1448396 T5744 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1448486 T5744 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1448487 T5744 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1390612928064/collection1/, dataDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/control/data/
   [junit4]   2> 1448487 T5744 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@72c25346
   [junit4]   2> 1448489 T5744 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/control/data
   [junit4]   2> 1448489 T5744 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/control/data/index/
   [junit4]   2> 1448489 T5744 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1448490 T5744 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/control/data/index
   [junit4]   2> 1448491 T5744 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=33.4599609375, floorSegmentMB=1.8203125, forceMergeDeletesPctAllowed=8.487764449854266, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34864110696386
   [junit4]   2> 1448492 T5744 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@67a94d5e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7b0376bc),segFN=segments_1,generation=1}
   [junit4]   2> 1448493 T5744 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1448500 T5744 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1448500 T5744 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1448501 T5744 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1448501 T5744 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1448501 T5744 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1448502 T5744 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1448502 T5744 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1448503 T5744 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1448503 T5744 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1448503 T5744 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1448504 T5744 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1448504 T5744 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1448505 T5744 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1448505 T5744 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1448506 T5744 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1448506 T5744 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1448512 T5744 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1448517 T5744 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1448517 T5744 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1448518 T5744 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=8.0380859375, floorSegmentMB=1.2216796875, forceMergeDeletesPctAllowed=19.833396122215518, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1448519 T5744 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@67a94d5e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7b0376bc),segFN=segments_1,generation=1}
   [junit4]   2> 1448519 T5744 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1448519 T5744 oass.SolrIndexSearcher.<init> Opening Searcher@2baf00e2 main
   [junit4]   2> 1448524 T5745 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2baf00e2 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1448528 T5744 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1448530 T5719 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1448531 T5719 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1448530 T5748 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59079 collection:control_collection shard:shard1
   [junit4]   2> 1448534 T5719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1448537 T5748 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1448539 T5750 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e9b6aae name:ZooKeeperConnection Watcher:127.0.0.1:59076/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1448539 T5719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1448545 T5719 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1448565 T5719 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1448574 T5748 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1448592 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1448597 T5748 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1448598 T5748 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C4761 name=collection1 org.apache.solr.core.SolrCore@10e7e20d url=http://127.0.0.1:59079/collection1 node=127.0.0.1:59079_ C4761_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:59079, core=collection1, node_name=127.0.0.1:59079_}
   [junit4]   2> 1448599 T5748 C4761 P59079 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59079/collection1/
   [junit4]   2> 1448599 T5748 C4761 P59079 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1448600 T5748 C4761 P59079 oasc.SyncStrategy.syncToMe http://127.0.0.1:59079/collection1/ has no replicas
   [junit4]   2> 1448600 T5748 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59079/collection1/ shard1
   [junit4]   2> 1448600 T5748 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1448606 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1448621 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1448624 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1448627 T5750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1448649 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1448663 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1448770 T5750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1448771 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1448795 T5748 oasc.ZkController.register We are http://127.0.0.1:59079/collection1/ and leader is http://127.0.0.1:59079/collection1/
   [junit4]   2> 1448796 T5748 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59079
   [junit4]   2> 1448796 T5748 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1448796 T5748 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1448797 T5748 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1448800 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1448800 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1448800 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1448803 T5748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1448809 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1448812 T5742 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59079",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59079_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1448822 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1448929 T5750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1448931 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1448966 T5719 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1448967 T5719 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1448972 T5719 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59083
   [junit4]   2> 1448972 T5719 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1448973 T5719 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1448973 T5719 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1390612930619
   [junit4]   2> 1448973 T5719 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1390612930619/'
   [junit4]   2> 1449003 T5719 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1390612930619/solr.xml
   [junit4]   2> 1449057 T5719 oasc.CoreContainer.<init> New CoreContainer 2023483657
   [junit4]   2> 1449058 T5719 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1390612930619/]
   [junit4]   2> 1449059 T5719 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1449060 T5719 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1449060 T5719 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1449061 T5719 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1449062 T5719 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1449062 T5719 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1449063 T5719 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1449063 T5719 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1449063 T5719 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1449086 T5719 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1449087 T5719 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1449087 T5719 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1449088 T5719 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59076/solr
   [junit4]   2> 1449088 T5719 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1449089 T5719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1449094 T5761 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43e08bbb name:ZooKeeperConnection Watcher:127.0.0.1:59076 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1449095 T5719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1449101 T5719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1449105 T5763 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c0f8972 name:ZooKeeperConnection Watcher:127.0.0.1:59076/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1449106 T5719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1449118 T5719 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1450130 T5719 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59083_
   [junit4]   2> 1450134 T5719 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59083_
   [junit4]   2> 1450144 T5750 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1450149 T5741 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1450149 T5763 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1450169 T5764 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1450170 T5764 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1450173 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1450173 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1450174 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1450174 T5764 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1450180 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1450183 T5742 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59083",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59083_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1450183 T5742 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 1450183 T5742 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1450192 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1450303 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1450303 T5750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1450303 T5763 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1451176 T5764 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1451176 T5764 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1390612930619/collection1
   [junit4]   2> 1451176 T5764 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1451179 T5764 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1451179 T5764 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1451183 T5764 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1390612930619/collection1/'
   [junit4]   2> 1451184 T5764 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1390612930619/collection1/lib/classes/' to classloader
   [junit4]   2> 1451185 T5764 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1390612930619/collection1/lib/README' to classloader
   [junit4]   2> 1451235 T5764 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1451287 T5764 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1451291 T5764 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1451299 T5764 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1451739 T5764 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1451742 T5764 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1451744 T5764 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1451754 T5764 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1451843 T5764 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1451843 T5764 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1390612930619/collection1/, dataDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty1/
   [junit4]   2> 1451844 T5764 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@72c25346
   [junit4]   2> 1451845 T5764 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty1
   [junit4]   2> 1451845 T5764 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty1/index/
   [junit4]   2> 1451845 T5764 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 1451846 T5764 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty1/index
   [junit4]   2> 1451846 T5764 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=33.4599609375, floorSegmentMB=1.8203125, forceMergeDeletesPctAllowed=8.487764449854266, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34864110696386
   [junit4]   2> 1451847 T5764 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6c966e32 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7557a4bb),segFN=segments_1,generation=1}
   [junit4]   2> 1451848 T5764 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1451853 T5764 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1451854 T5764 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1451854 T5764 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1451854 T5764 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1451855 T5764 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1451855 T5764 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1451856 T5764 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1451856 T5764 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1451856 T5764 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1451858 T5764 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1451859 T5764 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1451859 T5764 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1451859 T5764 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1451860 T5764 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1451860 T5764 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1451861 T5764 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1451867 T5764 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1451872 T5764 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1451872 T5764 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1451873 T5764 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=8.0380859375, floorSegmentMB=1.2216796875, forceMergeDeletesPctAllowed=19.833396122215518, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1451874 T5764 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6c966e32 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7557a4bb),segFN=segments_1,generation=1}
   [junit4]   2> 1451874 T5764 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1451874 T5764 oass.SolrIndexSearcher.<init> Opening Searcher@3dc68662 main
   [junit4]   2> 1451893 T5765 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3dc68662 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1451895 T5764 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1451897 T5719 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1451898 T5719 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1451897 T5768 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59083 collection:collection1 shard:shard1
   [junit4]   2> 1451902 T5768 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1451923 T5768 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1451931 T5768 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1451931 T5768 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C4762 name=collection1 org.apache.solr.core.SolrCore@43e53e8f url=http://127.0.0.1:59083/collection1 node=127.0.0.1:59083_ C4762_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59083, core=collection1, node_name=127.0.0.1:59083_}
   [junit4]   2> 1451932 T5768 C4762 P59083 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59083/collection1/
   [junit4]   2> 1451932 T5768 C4762 P59083 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1451933 T5768 C4762 P59083 oasc.SyncStrategy.syncToMe http://127.0.0.1:59083/collection1/ has no replicas
   [junit4]   2> 1451933 T5768 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59083/collection1/ shard1
   [junit4]   2> 1451933 T5768 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1451934 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1451934 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1451934 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1451944 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1451963 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1451968 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1451969 T5763 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1451971 T5750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1451990 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1452005 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1452114 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1452114 T5763 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1452115 T5750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1452131 T5768 oasc.ZkController.register We are http://127.0.0.1:59083/collection1/ and leader is http://127.0.0.1:59083/collection1/
   [junit4]   2> 1452131 T5768 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59083
   [junit4]   2> 1452131 T5768 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1452132 T5768 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1452132 T5768 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1452135 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1452135 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1452135 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1452141 T5768 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1452144 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1452146 T5742 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59083",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59083_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1452154 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1452226 T5719 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1452227 T5719 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1452233 T5719 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59086
   [junit4]   2> 1452234 T5719 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1452234 T5719 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1452235 T5719 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1390612933951
   [junit4]   2> 1452236 T5719 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1390612933951/'
   [junit4]   2> 1452263 T5750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1452263 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1452266 T5763 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1452300 T5719 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1390612933951/solr.xml
   [junit4]   2> 1452389 T5719 oasc.CoreContainer.<init> New CoreContainer 479828950
   [junit4]   2> 1452391 T5719 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1390612933951/]
   [junit4]   2> 1452393 T5719 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1452393 T5719 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1452393 T5719 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1452394 T5719 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1452395 T5719 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1452396 T5719 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1452397 T5719 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1452397 T5719 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1452398 T5719 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1452432 T5719 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1452433 T5719 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1452434 T5719 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1452435 T5719 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59076/solr
   [junit4]   2> 1452436 T5719 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1452438 T5719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1452443 T5779 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28c60d45 name:ZooKeeperConnection Watcher:127.0.0.1:59076 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1452445 T5719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1452453 T5719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1452459 T5781 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@135f9de3 name:ZooKeeperConnection Watcher:127.0.0.1:59076/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1452461 T5719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1452479 T5719 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1453496 T5719 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59086_
   [junit4]   2> 1453500 T5719 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59086_
   [junit4]   2> 1453518 T5763 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1453518 T5741 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1453519 T5750 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1453520 T5781 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1453545 T5782 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1453546 T5782 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1453550 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1453550 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1453551 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1453550 T5782 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1453558 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1453561 T5742 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59086",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59086_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1453561 T5742 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 1453561 T5742 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1453573 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1453684 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1453685 T5750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1453685 T5763 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1453686 T5781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1454553 T5782 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1454553 T5782 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1390612933951/collection1
   [junit4]   2> 1454553 T5782 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1454556 T5782 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1454556 T5782 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1454560 T5782 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1390612933951/collection1/'
   [junit4]   2> 1454561 T5782 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1390612933951/collection1/lib/classes/' to classloader
   [junit4]   2> 1454562 T5782 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1390612933951/collection1/lib/README' to classloader
   [junit4]   2> 1454626 T5782 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1454680 T5782 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1454685 T5782 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1454693 T5782 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1455110 T5782 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1455112 T5782 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1455114 T5782 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1455135 T5782 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1455224 T5782 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1455225 T5782 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1390612933951/collection1/, dataDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty2/
   [junit4]   2> 1455225 T5782 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@72c25346
   [junit4]   2> 1455226 T5782 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty2
   [junit4]   2> 1455226 T5782 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty2/index/
   [junit4]   2> 1455226 T5782 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 1455227 T5782 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty2/index
   [junit4]   2> 1455227 T5782 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=33.4599609375, floorSegmentMB=1.8203125, forceMergeDeletesPctAllowed=8.487764449854266, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34864110696386
   [junit4]   2> 1455229 T5782 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@7291e78c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@e52aa5),segFN=segments_1,generation=1}
   [junit4]   2> 1455229 T5782 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1455235 T5782 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1455235 T5782 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1455236 T5782 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1455236 T5782 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1455236 T5782 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1455236 T5782 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1455237 T5782 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1455238 T5782 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1455238 T5782 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1455239 T5782 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1455239 T5782 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1455240 T5782 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1455241 T5782 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1455242 T5782 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1455242 T5782 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1455243 T5782 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1455249 T5782 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1455254 T5782 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1455254 T5782 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1455255 T5782 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=8.0380859375, floorSegmentMB=1.2216796875, forceMergeDeletesPctAllowed=19.833396122215518, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1455256 T5782 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@7291e78c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@e52aa5),segFN=segments_1,generation=1}
   [junit4]   2> 1455256 T5782 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1455257 T5782 oass.SolrIndexSearcher.<init> Opening Searcher@a375fe8 main
   [junit4]   2> 1455263 T5783 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a375fe8 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1455267 T5782 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1455269 T5719 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1455269 T5719 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1455269 T5786 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59086 collection:collection1 shard:shard2
   [junit4]   2> 1455275 T5786 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1455310 T5786 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1455319 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1455320 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1455320 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1455325 T5786 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1455325 T5786 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C4763 name=collection1 org.apache.solr.core.SolrCore@6263e054 url=http://127.0.0.1:59086/collection1 node=127.0.0.1:59086_ C4763_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59086, core=collection1, node_name=127.0.0.1:59086_}
   [junit4]   2> 1455326 T5786 C4763 P59086 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59086/collection1/
   [junit4]   2> 1455326 T5786 C4763 P59086 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1455327 T5786 C4763 P59086 oasc.SyncStrategy.syncToMe http://127.0.0.1:59086/collection1/ has no replicas
   [junit4]   2> 1455327 T5786 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59086/collection1/ shard2
   [junit4]   2> 1455327 T5786 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1455337 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1455363 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1455371 T5781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1455371 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1455376 T5750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1455380 T5763 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1455411 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1455424 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1455535 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1455536 T5781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1455537 T5763 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1455537 T5750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1455603 T5786 oasc.ZkController.register We are http://127.0.0.1:59086/collection1/ and leader is http://127.0.0.1:59086/collection1/
   [junit4]   2> 1455604 T5786 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59086
   [junit4]   2> 1455604 T5786 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1455605 T5786 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1455605 T5786 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1455608 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1455609 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1455609 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1455618 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1455621 T5786 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1455621 T5742 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59086",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59086_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 1455633 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1455734 T5719 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1455735 T5719 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1455741 T5719 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59089
   [junit4]   2> 1455742 T5719 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1455743 T5719 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1455745 T5719 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1390612937323
   [junit4]   2> 1455745 T5719 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1390612937323/'
   [junit4]   2> 1455746 T5763 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1455747 T5750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1455747 T5781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1455748 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1455791 T5719 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1390612937323/solr.xml
   [junit4]   2> 1455880 T5719 oasc.CoreContainer.<init> New CoreContainer 1318317697
   [junit4]   2> 1455881 T5719 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1390612937323/]
   [junit4]   2> 1455882 T5719 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1455884 T5719 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1455884 T5719 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1455884 T5719 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1455886 T5719 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1455886 T5719 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1455887 T5719 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1455887 T5719 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1455888 T5719 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1455919 T5719 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1455920 T5719 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1455920 T5719 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1455921 T5719 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59076/solr
   [junit4]   2> 1455921 T5719 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1455923 T5719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1455927 T5797 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@520f7f74 name:ZooKeeperConnection Watcher:127.0.0.1:59076 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1455927 T5719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1455934 T5719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1455940 T5799 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2954c8dc name:ZooKeeperConnection Watcher:127.0.0.1:59076/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1455941 T5719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1455955 T5719 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1456968 T5719 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59089_
   [junit4]   2> 1456972 T5719 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59089_
   [junit4]   2> 1456984 T5741 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1456984 T5781 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1456987 T5750 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1456989 T5799 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1456990 T5763 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1457011 T5800 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1457012 T5800 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1457014 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1457015 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1457015 T5800 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1457015 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1457020 T5742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1457022 T5742 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59089",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59089_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1457022 T5742 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 1457023 T5742 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 1457047 T5741 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1457155 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1457155 T5781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1457156 T5799 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1457157 T5750 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1457158 T5763 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1458017 T5800 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1458017 T5800 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1390612937323/collection1
   [junit4]   2> 1458018 T5800 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1458020 T5800 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1458021 T5800 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1458026 T5800 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1390612937323/collection1/'
   [junit4]   2> 1458027 T5800 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1390612937323/collection1/lib/classes/' to classloader
   [junit4]   2> 1458028 T5800 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1390612937323/collection1/lib/README' to classloader
   [junit4]   2> 1458082 T5800 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1458146 T5800 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1458150 T5800 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1458162 T5800 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1458603 T5800 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1458608 T5800 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1458610 T5800 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1458619 T5800 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1458721 T5800 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1458722 T5800 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1390612937323/collection1/, dataDir=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty3/
   [junit4]   2> 1458722 T5800 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@72c25346
   [junit4]   2> 1458723 T5800 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty3
   [junit4]   2> 1458724 T5800 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty3/index/
   [junit4]   2> 1458724 T5800 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty3/index' doesn't exist. Creating new index...
   [junit4]   2> 1458725 T5800 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1390612927718/jetty3/index
   [junit4]   2> 1458726 T5800 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=33.4599609375, floorSegmentMB=1.8203125, forceMergeDeletesPctAllowed=8.487764449854266, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34864110696386
   [junit4]   2> 1458727 T5800 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		comm

[...truncated too long message...]

eckIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 1570041 T5836 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 1570043 T5836 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection2/leader_elect/shard3/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 1570043 T5836 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection2/leader_elect/shard13/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=en_US, timezone=Mideast/Riyadh87
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Apple Inc. 1.6.0_65 (64-bit)/cpus=2,threads=1,free=346300208,total=532545536
   [junit4]   2> NOTE: All tests run in this JVM: [TestDefaultSimilarityFactory, TestSchemaResource, TestJmxMonitoredMap, TestSchemaNameResource, JsonLoaderTest, TestLMJelinekMercerSimilarityFactory, TestLMDirichletSimilarityFactory, TestSolrIndexConfig, ConnectionManagerTest, JSONWriterTest, DistributedQueryElevationComponentTest, AutoCommitTest, SuggesterTest, SolrTestCaseJ4Test, TestStressLucene, SampleTest, TestCSVLoader, FieldAnalysisRequestHandlerTest, TestFieldTypeCollectionResource, EnumFieldTest, ZkSolrClientTest, CoreAdminCreateDiscoverTest, SoftAutoCommitTest, ReturnFieldsTest, TestLazyCores, NoCacheHeaderTest, TestHashPartitioner, DirectUpdateHandlerOptimizeTest, HdfsUnloadDistributedZkTest, TimeZoneUtilsTest, TestWriterPerf, TestFieldCollectionResource, PluginInfoTest, TestDocBasedVersionConstraints, AlternateDirectoryTest, HdfsSyncSliceTest, TermVectorComponentDistributedTest, HdfsBasicDistributedZkTest, TestReloadAndDeleteDocs, DirectSolrConnectionTest, TestOverriddenPrefixQueryForCustomFieldType, SortByFunctionTest, ZkCLITest, ResponseLogComponentTest, MoreLikeThisHandlerTest, TestSchemaVersionResource, TestDistributedMissingSort, TestSearchPerf, DeleteReplicaTest, TestSolrXmlPersistor, CursorPagingTest, TestFiltering, RegexBoostProcessorTest, TestSolrQueryParser, TestJmxIntegration, BlockDirectoryTest, DocumentBuilderTest, HdfsRecoveryZkTest, SolrIndexConfigTest, TestIndexSearcher, HighlighterTest, TestDynamicFieldResource, TestSurroundQueryParser, SimplePostToolTest, DeleteShardTest, TestAtomicUpdateErrorCases, TestSimpleQParserPlugin, RAMDirectoryFactoryTest, TestConfig, TestCoreDiscovery, TestIBSimilarityFactory, TestManagedSchema, CoreMergeIndexesAdminHandlerTest, URLClassifyProcessorTest, TestElisionMultitermQuery, TestReplicationHandler, BadCopyFieldTest, MBeansHandlerTest, TestFastLRUCache, TestCopyFieldCollectionResource, XmlUpdateRequestHandlerTest, TestFastOutputStream, TestGroupingSearch, TestRemoteStreaming, CopyFieldTest, SolrCoreTest, TestFaceting, OpenExchangeRatesOrgProviderTest, CircularListTest, ZkNodePropsTest, TestCursorMarkWithoutUniqueKey, TestStressReorder, TestPseudoReturnFields, TestStressVersions, TestLFUCache, DefaultValueUpdateProcessorTest, TestNRTOpen, TestMaxScoreQueryParser, TestCloudManagedSchemaAddField, MultiTermTest, TestDefaultSearchFieldResource, SpatialFilterTest, FieldMutatingUpdateProcessorTest, XsltUpdateRequestHandlerTest, ZkControllerTest, OverseerTest, BlockCacheTest, CursorMarkTest, ChaosMonkeySafeLeaderTest, HdfsDirectoryTest, LeaderElectionIntegrationTest, CurrencyFieldXmlFileTest, PolyFieldTest, BasicDistributedZkTest, QueryParsingTest, LeaderElectionTest, BasicDistributedZk2Test, TestClassNameShortening, HighlighterConfigTest, HardAutoCommitTest, TestFieldTypeResource, DirectSolrSpellCheckerTest, TestSolr4Spatial, DOMUtilTest, TestPhraseSuggestions, TestCollationFieldDocValues, TestSolrXmlPersistence, DocValuesMissingTest, UUIDFieldTest, SpellingQueryConverterTest, NumericFieldsTest, TestCoreContainer, TriLevelCompositeIdRoutingTest, TestJoin, SuggesterWFSTTest, AddBlockUpdateTest, HdfsLockFactoryTest, QueryElevationComponentTest, BadIndexSchemaTest, SolrXmlInZkTest, PreAnalyzedFieldTest, SolrIndexSplitterTest, TestSolrDeletionPolicy2, TestCharFilters, NotRequiredUniqueKeyTest, TestAnalyzeInfixSuggestions, TestSweetSpotSimilarityFactory, IndexSchemaTest, TestCloudManagedSchema, BinaryUpdateRequestHandlerTest, SpellCheckCollatorTest, TestNonNRTOpen, DistribCursorPagingTest, TestFileDictionaryLookup, TestCodecSupport, CSVRequestHandlerTest, TestRealTimeGet, TestDocSet, TestSolrXMLSerializer, SystemInfoHandlerTest, TestNumberUtils, SuggesterFSTTest, LegacyHTMLStripCharFilterTest, TestIndexingPerformance, BJQParserTest, TestSolrQueryParserResource, UniqFieldsUpdateProcessorFactoryTest, FullSolrCloudDistribCmdsTest]
   [junit4] Completed in 125.42s, 1 test, 1 error <<< FAILURES!

[...truncated 565 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:459: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:439: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1308: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:941: There were test failures: 355 suites, 1546 tests, 1 error, 40 ignored (6 assumptions)

Total time: 85 minutes 6 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.6.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message