lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_20-ea-b15) - Build # 10376 - Still Failing!
Date Sun, 25 May 2014 07:51:01 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10376/
Java: 64bit/jdk1.8.0_20-ea-b15 -XX:+UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.AliasIntegrationTest.testDistribSearch

Error Message:
KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000014

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000014
	at __randomizedtesting.SeedInfo.seed([8B04A221C3480845:AE22C39B4176879]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:554)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
	at org.apache.solr.cloud.AliasIntegrationTest.createAlias(AliasIntegrationTest.java:267)
	at org.apache.solr.cloud.AliasIntegrationTest.doTest(AliasIntegrationTest.java:237)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11565 lines...]
   [junit4] Suite: org.apache.solr.cloud.AliasIntegrationTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/init-core-data-001
   [junit4]   2> 1205494 T6349 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 1205494 T6349 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1205496 T6349 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1205497 T6349 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1205497 T6350 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1205597 T6349 oasc.ZkTestServer.run start zk server on port:55507
   [junit4]   2> 1205598 T6349 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1214923 T6353 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 9324ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
   [junit4]   2> 1214924 T6356 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@198cf2a5 name:ZooKeeperConnection Watcher:127.0.0.1:55507 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1214925 T6349 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1214925 T6349 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1214928 T6349 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1214929 T6358 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d5d6c21 name:ZooKeeperConnection Watcher:127.0.0.1:55507/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1214929 T6349 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1214929 T6349 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1214931 T6349 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1214932 T6349 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1214933 T6349 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1214934 T6349 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1214934 T6349 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1214937 T6349 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1214938 T6349 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1214940 T6349 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1214940 T6349 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1214942 T6349 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1214942 T6349 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1214946 T6349 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1214947 T6349 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1214948 T6349 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1214948 T6349 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1214950 T6349 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1214950 T6349 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1214952 T6349 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1214952 T6349 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1214953 T6349 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1214954 T6349 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1214955 T6349 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1214956 T6349 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1214957 T6349 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1214957 T6349 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1214959 T6349 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1214960 T6360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a0d36e6 name:ZooKeeperConnection Watcher:127.0.0.1:55507/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1214960 T6349 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1215196 T6349 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1215198 T6349 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1215199 T6349 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:38799
   [junit4]   2> 1215201 T6349 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1215201 T6349 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1215201 T6349 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-002
   [junit4]   2> 1215201 T6349 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-002/'
   [junit4]   2> 1215213 T6349 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-002/solr.xml
   [junit4]   2> 1215219 T6349 oasc.CoreContainer.<init> New CoreContainer 394299630
   [junit4]   2> 1215220 T6349 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-002/]
   [junit4]   2> 1215220 T6349 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1215220 T6349 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1215221 T6349 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1215221 T6349 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1215221 T6349 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1215221 T6349 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1215222 T6349 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1215222 T6349 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1215222 T6349 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1215224 T6349 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1215224 T6349 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1215224 T6349 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1215224 T6349 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55507/solr
   [junit4]   2> 1215225 T6349 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1215225 T6349 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1215226 T6371 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e76b98e name:ZooKeeperConnection Watcher:127.0.0.1:55507 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1215227 T6349 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1215228 T6349 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1215229 T6373 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fc5acf2 name:ZooKeeperConnection Watcher:127.0.0.1:55507/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1215229 T6349 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1215230 T6349 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1215232 T6349 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1215234 T6349 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1215235 T6349 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1215237 T6349 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1215238 T6349 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1215239 T6349 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38799_
   [junit4]   2> 1215249 T6349 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38799_
   [junit4]   2> 1215251 T6349 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1215252 T6349 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1215254 T6349 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:38799_
   [junit4]   2> 1215255 T6349 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1215256 T6349 oasc.Overseer.start Overseer (id=91816182413983748-127.0.0.1:38799_-n_0000000000) starting
   [junit4]   2> 1215259 T6349 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1215280 T6349 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1215280 T6375 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1215282 T6349 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1215284 T6349 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1215286 T6374 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1215288 T6376 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 1215288 T6376 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1215288 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1215288 T6376 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1215289 T6374 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1215290 T6374 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:38799",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:38799_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1215290 T6374 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1215290 T6374 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1215291 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1215292 T6373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1216289 T6376 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1216289 T6376 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1216290 T6376 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1216290 T6376 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1216291 T6376 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1216291 T6376 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-002/collection1/'
   [junit4]   2> 1216292 T6376 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 1216292 T6376 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 1216292 T6376 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 1216310 T6376 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 1216318 T6376 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1216319 T6376 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1216323 T6376 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1216405 T6376 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1216408 T6376 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1216409 T6376 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1216417 T6376 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1216418 T6376 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1216420 T6376 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1216421 T6376 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1216421 T6376 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1216421 T6376 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1216422 T6376 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1216422 T6376 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1216422 T6376 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1216422 T6376 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1216422 T6376 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/control/data/
   [junit4]   2> 1216422 T6376 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@290ef0a8
   [junit4]   2> 1216423 T6376 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/control/data
   [junit4]   2> 1216423 T6376 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/control/data/index/
   [junit4]   2> 1216423 T6376 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1216423 T6376 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/control/data/index
   [junit4]   2> 1216424 T6376 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1216424 T6376 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@612dcffa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@109164b4),segFN=segments_1,generation=1}
   [junit4]   2> 1216424 T6376 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1216426 T6376 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1216427 T6376 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1216427 T6376 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1216427 T6376 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1216427 T6376 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1216427 T6376 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1216428 T6376 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1216428 T6376 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1216428 T6376 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1216428 T6376 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1216429 T6376 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1216429 T6376 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1216429 T6376 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1216429 T6376 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1216429 T6376 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1216430 T6376 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1216430 T6376 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1216431 T6376 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1216433 T6376 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1216433 T6376 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1216433 T6376 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6134691209793036]
   [junit4]   2> 1216434 T6376 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@612dcffa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@109164b4),segFN=segments_1,generation=1}
   [junit4]   2> 1216434 T6376 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1216434 T6376 oass.SolrIndexSearcher.<init> Opening Searcher@7c283d5d[collection1] main
   [junit4]   2> 1216434 T6376 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1216435 T6376 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1216435 T6376 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1216435 T6376 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1216436 T6376 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1216436 T6376 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1216436 T6376 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1216436 T6376 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1216436 T6376 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 1216437 T6376 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1216438 T6377 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7c283d5d[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 1216438 T6376 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1216439 T6380 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:38799 collection:control_collection shard:shard1
   [junit4]   2> 1216439 T6349 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1216440 T6380 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1216440 T6349 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1216442 T6349 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1216443 T6382 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30a6683 name:ZooKeeperConnection Watcher:127.0.0.1:55507/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1216444 T6349 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1216445 T6349 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1216445 T6380 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1216446 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1216446 T6349 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1216446 T6380 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1216447 T6380 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1471 name=collection1 org.apache.solr.core.SolrCore@2f8d1a9 url=https://127.0.0.1:38799/collection1 node=127.0.0.1:38799_ C1471_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:38799, core=collection1, node_name=127.0.0.1:38799_}
   [junit4]   2> 1216447 T6380 C1471 P38799 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:38799/collection1/
   [junit4]   2> 1216447 T6374 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1216447 T6380 C1471 P38799 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1216448 T6380 C1471 P38799 oasc.SyncStrategy.syncToMe https://127.0.0.1:38799/collection1/ has no replicas
   [junit4]   2> 1216448 T6380 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:38799/collection1/ shard1
   [junit4]   2> 1216448 T6380 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1216449 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1216451 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1216454 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1216555 T6373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1216555 T6382 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1216602 T6380 oasc.ZkController.register We are https://127.0.0.1:38799/collection1/ and leader is https://127.0.0.1:38799/collection1/
   [junit4]   2> 1216602 T6380 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:38799
   [junit4]   2> 1216602 T6380 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1216603 T6380 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 1216603 T6380 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1216605 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1216605 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1216605 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1216605 T6380 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1216606 T6374 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1216606 T6374 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:38799",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:38799_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1216608 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1216709 T6373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1216709 T6382 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1216813 T6349 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1216814 T6349 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1216816 T6349 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1216817 T6349 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:58839
   [junit4]   2> 1216819 T6349 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1216819 T6349 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1216819 T6349 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-003
   [junit4]   2> 1216820 T6349 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-003/'
   [junit4]   2> 1216833 T6349 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-003/solr.xml
   [junit4]   2> 1216840 T6349 oasc.CoreContainer.<init> New CoreContainer 1061059609
   [junit4]   2> 1216840 T6349 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-003/]
   [junit4]   2> 1216841 T6349 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1216841 T6349 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1216841 T6349 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1216841 T6349 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1216842 T6349 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1216842 T6349 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1216842 T6349 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1216843 T6349 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1216843 T6349 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1216845 T6349 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1216845 T6349 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1216845 T6349 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1216846 T6349 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55507/solr
   [junit4]   2> 1216846 T6349 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1216847 T6349 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1216848 T6393 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64322135 name:ZooKeeperConnection Watcher:127.0.0.1:55507 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1216849 T6349 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1216850 T6349 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1216851 T6395 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31757d29 name:ZooKeeperConnection Watcher:127.0.0.1:55507/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1216851 T6349 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1216855 T6349 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1217856 T6349 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58839_
   [junit4]   2> 1217857 T6349 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58839_
   [junit4]   2> 1217863 T6396 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1217863 T6396 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1217864 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1217864 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1217864 T6396 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1217864 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1217866 T6374 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1217866 T6374 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:58839",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:58839_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1217867 T6374 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
   [junit4]   2> 1217867 T6374 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1217868 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1217970 T6373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1217970 T6395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1217970 T6382 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1218865 T6396 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1218865 T6396 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1218865 T6396 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1218866 T6396 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1218866 T6396 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1218867 T6396 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-003/collection1/'
   [junit4]   2> 1218867 T6396 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 1218867 T6396 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 1218868 T6396 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 1218913 T6396 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 1218922 T6396 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1218923 T6396 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1218927 T6396 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1219010 T6396 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1219014 T6396 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1219016 T6396 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1219023 T6396 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1219024 T6396 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1219026 T6396 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1219027 T6396 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1219027 T6396 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1219027 T6396 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1219028 T6396 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1219028 T6396 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1219028 T6396 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1219028 T6396 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1219029 T6396 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty1/
   [junit4]   2> 1219029 T6396 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@290ef0a8
   [junit4]   2> 1219029 T6396 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty1
   [junit4]   2> 1219030 T6396 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty1/index/
   [junit4]   2> 1219030 T6396 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 1219030 T6396 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty1/index
   [junit4]   2> 1219030 T6396 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1219031 T6396 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@94da63 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@719bce31),segFN=segments_1,generation=1}
   [junit4]   2> 1219031 T6396 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1219034 T6396 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1219034 T6396 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1219034 T6396 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1219034 T6396 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1219035 T6396 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1219035 T6396 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1219035 T6396 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1219035 T6396 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1219035 T6396 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1219036 T6396 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1219036 T6396 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1219036 T6396 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1219037 T6396 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1219037 T6396 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1219037 T6396 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1219038 T6396 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1219038 T6396 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1219040 T6396 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1219041 T6396 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1219041 T6396 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1219042 T6396 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6134691209793036]
   [junit4]   2> 1219042 T6396 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@94da63 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@719bce31),segFN=segments_1,generation=1}
   [junit4]   2> 1219042 T6396 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1219043 T6396 oass.SolrIndexSearcher.<init> Opening Searcher@9be15a0[collection1] main
   [junit4]   2> 1219043 T6396 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1219043 T6396 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1219044 T6396 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1219044 T6396 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1219044 T6396 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1219044 T6396 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1219045 T6396 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1219045 T6396 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1219045 T6396 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 1219045 T6396 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1219047 T6397 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9be15a0[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 1219048 T6396 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1219049 T6400 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:58839 collection:collection1 shard:shard1
   [junit4]   2> 1219049 T6349 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1219049 T6349 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1219049 T6400 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1219054 T6400 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1219055 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1219055 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1219055 T6400 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1219055 T6400 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 1219055 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> ASYNC  NEW_CORE C1472 name=collection1 org.apache.solr.core.SolrCore@13c0c347 url=https://127.0.0.1:58839/collection1 node=127.0.0.1:58839_ C1472_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:58839, core=collection1, node_name=127.0.0.1:58839_}
   [junit4]   2> 1219056 T6400 C1472 P58839 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:58839/collection1/
   [junit4]   2> 1219056 T6400 C1472 P58839 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1219056 T6374 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1219056 T6400 C1472 P58839 oasc.SyncStrategy.syncToMe https://127.0.0.1:58839/collection1/ has no replicas
   [junit4]   2> 1219057 T6400 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:58839/collection1/ shard1
   [junit4]   2> 1219057 T6400 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1219058 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1219061 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1219064 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1219168 T6373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1219168 T6395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1219168 T6382 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1219212 T6400 oasc.ZkController.register We are https://127.0.0.1:58839/collection1/ and leader is https://127.0.0.1:58839/collection1/
   [junit4]   2> 1219213 T6400 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:58839
   [junit4]   2> 1219213 T6400 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1219213 T6400 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1219213 T6400 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1219214 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1219214 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1219214 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1219215 T6400 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1219215 T6374 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1219215 T6374 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:58839",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:58839_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1219217 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1219301 T6349 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1219301 T6349 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1219304 T6349 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1219305 T6349 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55320
   [junit4]   2> 1219307 T6349 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1219307 T6349 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1219308 T6349 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-004
   [junit4]   2> 1219308 T6349 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-004/'
   [junit4]   2> 1219319 T6382 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1219319 T6395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1219319 T6373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1219322 T6349 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-004/solr.xml
   [junit4]   2> 1219330 T6349 oasc.CoreContainer.<init> New CoreContainer 567211957
   [junit4]   2> 1219331 T6349 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-004/]
   [junit4]   2> 1219331 T6349 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1219331 T6349 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1219332 T6349 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1219332 T6349 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1219332 T6349 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1219332 T6349 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1219332 T6349 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1219333 T6349 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1219333 T6349 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1219334 T6349 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1219335 T6349 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1219335 T6349 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1219335 T6349 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55507/solr
   [junit4]   2> 1219335 T6349 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1219336 T6349 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1219337 T6411 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d6e1057 name:ZooKeeperConnection Watcher:127.0.0.1:55507 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1219338 T6349 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1219340 T6349 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1219341 T6413 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5017caab name:ZooKeeperConnection Watcher:127.0.0.1:55507/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1219341 T6349 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1219348 T6349 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1220351 T6349 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55320_
   [junit4]   2> 1220352 T6349 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55320_
   [junit4]   2> 1220357 T6414 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1220358 T6414 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1220359 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1220359 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1220359 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1220359 T6414 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1220360 T6374 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1220360 T6374 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55320",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55320_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1220361 T6374 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
   [junit4]   2> 1220361 T6374 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1220362 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1220464 T6413 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1220464 T6395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1220464 T6373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1220464 T6382 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1221360 T6414 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1221360 T6414 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1221360 T6414 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1221361 T6414 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1221361 T6414 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1221361 T6414 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-004/collection1/'
   [junit4]   2> 1221362 T6414 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 1221362 T6414 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 1221362 T6414 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 1221399 T6414 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 1221408 T6414 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1221409 T6414 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1221413 T6414 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1221496 T6414 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1221500 T6414 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1221501 T6414 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1221507 T6414 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1221509 T6414 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1221511 T6414 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1221512 T6414 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1221512 T6414 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1221513 T6414 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1221513 T6414 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1221513 T6414 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1221514 T6414 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1221514 T6414 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1221514 T6414 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty2/
   [junit4]   2> 1221514 T6414 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@290ef0a8
   [junit4]   2> 1221515 T6414 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty2
   [junit4]   2> 1221515 T6414 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty2/index/
   [junit4]   2> 1221515 T6414 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 1221516 T6414 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty2/index
   [junit4]   2> 1221516 T6414 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1221516 T6414 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2390de29 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@29044d26),segFN=segments_1,generation=1}
   [junit4]   2> 1221517 T6414 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1221519 T6414 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1221520 T6414 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1221520 T6414 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1221520 T6414 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1221520 T6414 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1221520 T6414 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1221521 T6414 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1221521 T6414 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1221521 T6414 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1221521 T6414 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1221522 T6414 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1221522 T6414 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1221522 T6414 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1221522 T6414 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1221523 T6414 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1221523 T6414 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1221523 T6414 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1221525 T6414 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1221526 T6414 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1221526 T6414 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1221526 T6414 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6134691209793036]
   [junit4]   2> 1221527 T6414 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2390de29 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@29044d26),segFN=segments_1,generation=1}
   [junit4]   2> 1221527 T6414 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1221527 T6414 oass.SolrIndexSearcher.<init> Opening Searcher@66c45ede[collection1] main
   [junit4]   2> 1221527 T6414 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1221528 T6414 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1221528 T6414 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1221528 T6414 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1221528 T6414 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1221528 T6414 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1221529 T6414 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1221529 T6414 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1221529 T6414 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 1221529 T6414 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1221531 T6415 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@66c45ede[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 1221532 T6414 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1221533 T6418 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55320 collection:collection1 shard:shard1
   [junit4]   2> 1221533 T6349 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1221533 T6349 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1221535 T6418 oasc.ZkController.register We are https://127.0.0.1:55320/collection1/ and leader is https://127.0.0.1:58839/collection1/
   [junit4]   2> 1221535 T6418 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55320
   [junit4]   2> 1221535 T6418 oasc.ZkController.checkRecovery Core needs to recover:collection1
   [junit4]   2> 1221535 T6418 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
   [junit4]   2> ASYNC  NEW_CORE C1473 name=collection1 org.apache.solr.core.SolrCore@516f3158 url=https://127.0.0.1:55320/collection1 node=127.0.0.1:55320_ C1473_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:55320, core=collection1, node_name=127.0.0.1:55320_}
   [junit4]   2> 1221535 T6419 C1473 P55320 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
   [junit4]   2> 1221535 T6418 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1221536 T6419 C1473 P55320 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
   [junit4]   2> 1221536 T6419 C1473 P55320 oasc.RecoveryStrategy.doRecovery Publishing state of core collection1 as recovering, leader is https://127.0.0.1:58839/collection1/ and I am https://127.0.0.1:55320/collection1/
   [junit4]   2> 1221536 T6419 C1473 P55320 oasc.ZkController.publish publishing core=collection1 state=recovering collection=collection1
   [junit4]   2> 1221536 T6419 C1473 P55320 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1221537 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1221537 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1221538 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1221538 T6419 C1473 P55320 oasc.RecoveryStrategy.sendPrepRecoveryCmd Sending prep recovery command to https://127.0.0.1:58839; WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1%3A55320_&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true
   [junit4]   2> 1221538 T6374 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1221539 T6374 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"recovering",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55320",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55320_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 1221541 T6373 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1221603 T6391 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
   [junit4]   2> 1221603 T6391 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1221604 T6391 oasha.CoreAdminHandler.handleWaitForStateAction Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering
   [junit4]   2> 1221604 T6391 oasha.CoreAdminHandler.handleWaitForStateAction In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:55320_, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"state":"down","base_url":"https://127.0.0.1:55320","core":"collection1","node_name":"127.0.0.1:55320_"}
   [junit4]   2> 1221642 T6373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1221642 T6382 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1221642 T6413 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1221642 T6395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1221800 T6349 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1221801 T6349 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1221803 T6349 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1221804 T6349 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:53442
   [junit4]   2> 1221805 T6349 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1221805 T6349 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1221806 T6349 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-005
   [junit4]   2> 1221806 T6349 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-005/'
   [junit4]   2> 1221817 T6349 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-005/solr.xml
   [junit4]   2> 1221824 T6349 oasc.CoreContainer.<init> New CoreContainer 1444174777
   [junit4]   2> 1221824 T6349 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-005/]
   [junit4]   2> 1221825 T6349 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1221825 T6349 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1221825 T6349 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1221826 T6349 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1221826 T6349 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1221826 T6349 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1221826 T6349 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1221827 T6349 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1221827 T6349 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1221829 T6349 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1221829 T6349 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1221830 T6349 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1221830 T6349 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55507/solr
   [junit4]   2> 1221831 T6349 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1221831 T6349 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1221856 T6431 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e244ffd name:ZooKeeperConnection Watcher:127.0.0.1:55507 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1221856 T6349 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1221873 T6349 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1221874 T6433 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f93bbdd name:ZooKeeperConnection Watcher:127.0.0.1:55507/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1221874 T6349 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4

[...truncated too long message...]

ause CoreContainer is shutdown
   [junit4]   2> 1269762 T6433 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@526c1d6e
   [junit4]   2> 1269768 T6433 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=366,transaction_logs_total_number=1}
   [junit4]   2> 1269768 T6433 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 1269768 T6433 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1269769 T6433 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1269769 T6433 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 1269769 T6433 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1269770 T6433 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty3/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty3/index;done=false>>]
   [junit4]   2> 1269770 T6433 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty3/index
   [junit4]   2> 1269770 T6433 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty3 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty3;done=false>>]
   [junit4]   2> 1269770 T6433 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001/tempDir-001/jetty3
   [junit4]   2> 1269770 T6433 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1269770 T6433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1269771 T6433 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1269771 T6433 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1269771 T6433 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1269771 T6433 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1269771 T6433 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1269771 T6433 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.AliasIntegrationTest-8B04A221C3480845-001
   [junit4]   2> NOTE: test params are: codec=Lucene46: {other_tl1=PostingsFormat(name=Lucene41WithOrds), _version_=PostingsFormat(name=Lucene41WithOrds), multiDefault=FSTOrd41, a_t=FSTOrd41, intDefault=PostingsFormat(name=Lucene41WithOrds), a_i1=FSTOrd41, id=Lucene41(blocksize=128), text=PostingsFormat(name=FSTOrdPulsing41), range_facet_l=FSTOrd41, timestamp=FSTOrd41}, docValues:{timestamp=DocValuesFormat(name=Disk)}, sim=DefaultSimilarity, locale=zh_CN, timezone=America/Antigua
   [junit4]   2> NOTE: Linux 3.8.0-39-generic amd64/Oracle Corporation 1.8.0_20-ea (64-bit)/cpus=8,threads=1,free=210427352,total=463470592
   [junit4]   2> NOTE: All tests run in this JVM: [RangeFacetTest, TestRequestStatusCollectionAPI, AssignTest, FileBasedSpellCheckerTest, TestCoreContainer, SampleTest, SliceStateTest, TestBM25SimilarityFactory, ReturnFieldsTest, TestElisionMultitermQuery, CacheHeaderTest, TestDefaultSimilarityFactory, TestRandomDVFaceting, AsyncMigrateRouteKeyTest, TestFunctionQuery, DistributedSpellCheckComponentTest, RegexBoostProcessorTest, WordBreakSolrSpellCheckerTest, TestCharFilters, AnalysisErrorHandlingTest, TestFieldTypeResource, BinaryUpdateRequestHandlerTest, TestSolrQueryParserResource, BJQParserTest, ModifyConfFileTest, SuggesterFSTTest, HdfsChaosMonkeySafeLeaderTest, TermsComponentTest, HdfsRecoveryZkTest, BasicFunctionalityTest, QueryEqualityTest, TestSolrXml, TestCustomSort, CoreAdminHandlerTest, TestReplicationHandler, DistributedQueryComponentCustomSortTest, RecoveryZkTest, CustomCollectionTest, DistributedTermsComponentTest, TestCloudInspectUtil, TestWriterPerf, TestLFUCache, OverseerRolesTest, TestBlendedInfixSuggestions, UnloadDistributedZkTest, TestDefaultSearchFieldResource, TestConfig, SoftAutoCommitTest, RAMDirectoryFactoryTest, TestLuceneMatchVersion, CachingDirectoryFactoryTest, TestReloadAndDeleteDocs, StressHdfsTest, UpdateRequestProcessorFactoryTest, ScriptEngineTest, TestExtendedDismaxParser, TestNonNRTOpen, PreAnalyzedUpdateProcessorTest, CircularListTest, SynonymTokenizerTest, TestStressUserVersions, BadCopyFieldTest, TestSearchPerf, CursorMarkTest, TestUtils, TestExpandComponent, HdfsCollectionsAPIDistributedZkTest, HdfsSyncSliceTest, TestConfigSets, ZkCLITest, OverseerStatusTest, SpellPossibilityIteratorTest, HdfsWriteToMultipleCollectionsTest, SearchHandlerTest, CopyFieldTest, TestMergePolicyConfig, DirectUpdateHandlerOptimizeTest, IndexSchemaTest, FastVectorHighlighterTest, SolrIndexSplitterTest, TestCursorMarkWithoutUniqueKey, SolrXmlInZkTest, URLClassifyProcessorTest, TimeZoneUtilsTest, UUIDFieldTest, RankQueryTest, TestReversedWildcardFilterFactory, ShowFileRequestHandlerTest, StatelessScriptUpdateProcessorFactoryTest, TestCopyFieldCollectionResource, MoreLikeThisHandlerTest, TestSimpleQParserPlugin, TestSchemaVersionResource, PrimitiveFieldTypeTest, OverseerTest, SliceStateUpdateTest, TestFaceting, SpatialFilterTest, BasicDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, ShardRoutingTest, ClusterStateUpdateTest, LeaderElectionTest, AutoCommitTest, TermVectorComponentDistributedTest, TestRealTimeGet, TestMultiCoreConfBootstrap, TestStressVersions, TestRangeQuery, SimpleFacetsTest, SpellCheckComponentTest, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestBadConfig, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SpellCheckCollatorTest, TestFoldingMultitermQuery, SuggesterTSTTest, SuggesterWFSTTest, PolyFieldTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, TestSurroundQueryParser, TestQueryUtils, DirectSolrSpellCheckerTest, TestOmitPositions, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, RequiredFieldsTest, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, MBeansHandlerTest, JsonLoaderTest, CSVRequestHandlerTest, CoreContainerCoreInitFailuresTest, TestQuerySenderListener, TestSolrIndexConfig, TestQuerySenderNoQuery, SolrIndexConfigTest, TestStressRecovery, TestSolrXMLSerializer, PreAnalyzedFieldTest, TestSystemIdResolver, TestSuggestSpellingConverter, DateFieldTest, SpellingQueryConverterTest, ClusterStateTest, TestLRUCache, ZkNodePropsTest, TestRTGBase, CursorPagingTest, TestDistributedMissingSort, TestHighlightDedupGrouping, ExpressionTest, AbstractAnalyticsFacetTest, FieldFacetTest, QueryFacetTest, FunctionTest, AliasIntegrationTest]
   [junit4] Completed on J0 in 64.63s, 1 test, 1 error <<< FAILURES!

[...truncated 211 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 406 suites, 1688 tests, 1 error, 36 ignored (15 assumptions)

Total time: 61 minutes 11 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0_20-ea-b15 -XX:+UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message