lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Miller <markrmil...@gmail.com>
Subject Re: [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_60-ea-b02) - Build # 9047 - Still Failing!
Date Sun, 19 Jan 2014 17:33:21 GMT
Since there is almost ever at most 1 fail for this, I’ll probably raise it to 2 or 3. Fails are actually fine, we just want to make sure that there are not that many fails.

- Mark

On Jan 18, 2014, at 10:24 PM, Policeman Jenkins Server <jenkins@thetaphi.de> wrote:

> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9047/
> Java: 32bit/jdk1.7.0_60-ea-b02 -server -XX:+UseG1GC
> 
> 1 tests failed.
> REGRESSION:  org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.testDistribSearch
> 
> Error Message:
> There were expected update fails expected:<0> but was:<1>
> 
> Stack Trace:
> java.lang.AssertionError: There were expected update fails expected:<0> but was:<1>
> 	at __randomizedtesting.SeedInfo.seed([747E9B12B5171E73:F598150AC2487E4F]:0)
> 	at org.junit.Assert.fail(Assert.java:93)
> 	at org.junit.Assert.failNotEquals(Assert.java:647)
> 	at org.junit.Assert.assertEquals(Assert.java:128)
> 	at org.junit.Assert.assertEquals(Assert.java:472)
> 	at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:202)
> 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at java.lang.Thread.run(Thread.java:744)
> 
> 
> 
> 
> Build Log:
> [...truncated 10186 lines...]
>   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
>   [junit4]   2> 208472 T995 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
>   [junit4]   2> 208477 T995 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
>   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeyNothingIsSafeTest-1390100758605
>   [junit4]   2> 208477 T995 oasc.ZkTestServer.run STARTING ZK TEST SERVER
>   [junit4]   2> 208478 T996 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
>   [junit4]   2> 208578 T995 oasc.ZkTestServer.run start zk server on port:54105
>   [junit4]   2> 208579 T995 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 208804 T1002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a8e005 name:ZooKeeperConnection Watcher:127.0.0.1:54105 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 208805 T995 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 208805 T995 oascc.SolrZkClient.makePath makePath: /solr
>   [junit4]   2> 208810 T995 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 208818 T1004 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18ac3ec name:ZooKeeperConnection Watcher:127.0.0.1:54105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 208818 T995 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 208819 T995 oascc.SolrZkClient.makePath makePath: /collections/collection1
>   [junit4]   2> 208822 T995 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
>   [junit4]   2> 208825 T995 oascc.SolrZkClient.makePath makePath: /collections/control_collection
>   [junit4]   2> 208827 T995 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
>   [junit4]   2> 208830 T995 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
>   [junit4]   2> 208831 T995 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
>   [junit4]   2> 208835 T995 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
>   [junit4]   2> 208836 T995 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
>   [junit4]   2> 208839 T995 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>   [junit4]   2> 208840 T995 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>   [junit4]   2> 208842 T995 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
>   [junit4]   2> 208843 T995 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
>   [junit4]   2> 208846 T995 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
>   [junit4]   2> 208847 T995 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
>   [junit4]   2> 208851 T995 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
>   [junit4]   2> 208852 T995 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
>   [junit4]   2> 208854 T995 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
>   [junit4]   2> 208855 T995 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
>   [junit4]   2> 208858 T995 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
>   [junit4]   2> 208859 T995 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
>   [junit4]   2> 208862 T995 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
>   [junit4]   2> 208863 T995 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
>   [junit4]   2> 208866 T995 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
>   [junit4]   2> 208867 T995 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
>   [junit4]   2> 208870 T995 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
>   [junit4]   2> 208871 T995 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
>   [junit4]   2> 208990 T995 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 208994 T995 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56478
>   [junit4]   2> 208995 T995 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 208996 T995 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 208996 T995 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1390100759002
>   [junit4]   2> 208997 T995 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1390100759002/'
>   [junit4]   2> 209015 T995 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1390100759002/solr.xml
>   [junit4]   2> 209055 T995 oasc.CoreContainer.<init> New CoreContainer 2798915
>   [junit4]   2> 209056 T995 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1390100759002/]
>   [junit4]   2> 209057 T995 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
>   [junit4]   2> 209058 T995 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
>   [junit4]   2> 209059 T995 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
>   [junit4]   2> 209059 T995 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 209059 T995 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 209060 T995 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 209060 T995 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 209061 T995 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 209061 T995 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 209066 T995 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 209067 T995 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 209067 T995 oasc.CoreContainer.load Host Name: 127.0.0.1
>   [junit4]   2> 209068 T995 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54105/solr
>   [junit4]   2> 209068 T995 oasc.ZkController.checkChrootPath zkHost includes chroot
>   [junit4]   2> 209069 T995 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 209072 T1015 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e25b70 name:ZooKeeperConnection Watcher:127.0.0.1:54105 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 209072 T995 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 209076 T995 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 209077 T1017 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12c99ba name:ZooKeeperConnection Watcher:127.0.0.1:54105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 209078 T995 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 209080 T995 oascc.SolrZkClient.makePath makePath: /overseer/queue
>   [junit4]   2> 209083 T995 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
>   [junit4]   2> 209087 T995 oascc.SolrZkClient.makePath makePath: /live_nodes
>   [junit4]   2> 209089 T995 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56478_
>   [junit4]   2> 209091 T995 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56478_
>   [junit4]   2> 209094 T995 oascc.SolrZkClient.makePath makePath: /overseer_elect
>   [junit4]   2> 209097 T995 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
>   [junit4]   2> 209103 T995 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
>   [junit4]   2> 209106 T995 oasc.Overseer.start Overseer (id=91101643316068355-127.0.0.1:56478_-n_0000000000) starting
>   [junit4]   2> 209111 T995 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
>   [junit4]   2> 209115 T995 oascc.SolrZkClient.makePath makePath: /clusterstate.json
>   [junit4]   2> 209116 T1019 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
>   [junit4]   2> 209118 T1019 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
>   [junit4]   2> 209119 T995 oascc.SolrZkClient.makePath makePath: /aliases.json
>   [junit4]   2> 209121 T995 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 209127 T1020 oasc.ZkController.publish publishing core=collection1 state=down
>   [junit4]   2> 209127 T1018 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
>   [junit4]   2> 209129 T1020 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 209132 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 209132 T1020 oasc.ZkController.waitForCoreNodeName look for our core node name
>   [junit4]   2> 209133 T1018 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 209135 T1018 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"down",
>   [junit4]   2> 	  "base_url":"http://127.0.0.1:56478",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:56478_",
>   [junit4]   2> 	  "shard":null,
>   [junit4]   2> 	  "shard_range":null,
>   [junit4]   2> 	  "shard_state":"active",
>   [junit4]   2> 	  "shard_parent":null,
>   [junit4]   2> 	  "collection":"control_collection",
>   [junit4]   2> 	  "numShards":"1",
>   [junit4]   2> 	  "core_node_name":null}
>   [junit4]   2> 209135 T1018 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
>   [junit4]   2> 209135 T1018 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
>   [junit4]   2> 209138 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 209139 T1017 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 210134 T1020 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
>   [junit4]   2> 210135 T1020 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1390100759002/collection1
>   [junit4]   2> 210135 T1020 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
>   [junit4]   2> 210136 T1020 oasc.ZkController.createCollectionZkNode Collection zkNode exists
>   [junit4]   2> 210136 T1020 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
>   [junit4]   2> 210137 T1020 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1390100759002/collection1/'
>   [junit4]   2> 210137 T1020 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1390100759002/collection1/lib/classes/' to classloader
>   [junit4]   2> 210138 T1020 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1390100759002/collection1/lib/README' to classloader
>   [junit4]   2> 210165 T1020 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
>   [junit4]   2> 210188 T1020 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
>   [junit4]   2> 210190 T1020 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
>   [junit4]   2> 210200 T1020 oass.IndexSchema.readSchema [collection1] Schema name=test
>   [junit4]   2> 210557 T1020 oass.IndexSchema.readSchema default search field in schema is text
>   [junit4]   2> 210560 T1020 oass.IndexSchema.readSchema unique key field: id
>   [junit4]   2> 210562 T1020 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 210566 T1020 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 210599 T1020 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
>   [junit4]   2> 210599 T1020 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1390100759002/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/control/data/
>   [junit4]   2> 210600 T1020 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a47bf9
>   [junit4]   2> 210601 T1020 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/control/data
>   [junit4]   2> 210601 T1020 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/control/data/index/
>   [junit4]   2> 210601 T1020 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/control/data/index' doesn't exist. Creating new index...
>   [junit4]   2> 210602 T1020 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/control/data/index
>   [junit4]   2> 210603 T1020 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=11, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
>   [junit4]   2> 210606 T1020 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
>   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/control/data/index,segFN=segments_1,generation=1}
>   [junit4]   2> 210606 T1020 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 210610 T1020 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
>   [junit4]   2> 210610 T1020 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
>   [junit4]   2> 210610 T1020 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
>   [junit4]   2> 210611 T1020 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 210611 T1020 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 210611 T1020 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>   [junit4]   2> 210612 T1020 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 210612 T1020 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 210613 T1020 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
>   [junit4]   2> 210613 T1020 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
>   [junit4]   2> 210614 T1020 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
>   [junit4]   2> 210614 T1020 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
>   [junit4]   2> 210614 T1020 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
>   [junit4]   2> 210615 T1020 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
>   [junit4]   2> 210615 T1020 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
>   [junit4]   2> 210616 T1020 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
>   [junit4]   2> 210619 T1020 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 210621 T1020 oasu.CommitTracker.<init> Hard AutoCommit: disabled
>   [junit4]   2> 210622 T1020 oasu.CommitTracker.<init> Soft AutoCommit: disabled
>   [junit4]   2> 210623 T1020 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=13, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8021686745258141]
>   [junit4]   2> 210624 T1020 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
>   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/control/data/index,segFN=segments_1,generation=1}
>   [junit4]   2> 210624 T1020 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 210624 T1020 oass.SolrIndexSearcher.<init> Opening Searcher@23c864 main
>   [junit4]   2> 210629 T1020 oasc.CoreContainer.registerCore registering core: collection1
>   [junit4]   2> 210629 T995 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
>   [junit4]   2> 210630 T995 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
>   [junit4]   2> 210630 T1021 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@23c864 main{StandardDirectoryReader(segments_1:1:nrt)}
>   [junit4]   2> 210629 T1024 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56478 collection:control_collection shard:shard1
>   [junit4]   2> 210631 T995 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 210632 T1024 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
>   [junit4]   2> 210633 T1026 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@172c9b4 name:ZooKeeperConnection Watcher:127.0.0.1:54105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 210634 T995 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 210635 T995 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 210639 T1024 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
>   [junit4]   2> 210641 T1024 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
>   [junit4]   2> 210642 T1024 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
>   [junit4]   2> ASYNC  NEW_CORE C216 name=collection1 org.apache.solr.core.SolrCore@c4f00e url=http://127.0.0.1:56478/collection1 node=127.0.0.1:56478_ C216_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:56478, core=collection1, node_name=127.0.0.1:56478_}
>   [junit4]   2> 210642 T1024 C216 P56478 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56478/collection1/
>   [junit4]   2> 210642 T1024 C216 P56478 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
>   [junit4]   2> 210642 T1024 C216 P56478 oasc.SyncStrategy.syncToMe http://127.0.0.1:56478/collection1/ has no replicas
>   [junit4]   2> 210643 T1024 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56478/collection1/ shard1
>   [junit4]   2> 210643 T1024 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
>   [junit4]   2> 210644 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 210644 T995 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
>   [junit4]   2> 210646 T1018 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 210650 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 210651 T1017 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 210653 T1026 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 210655 T1018 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 210659 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 210754 T995 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 210756 T995 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52868
>   [junit4]   2> 210757 T995 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 210757 T995 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 210758 T995 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1390100760773
>   [junit4]   2> 210758 T995 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1390100760773/'
>   [junit4]   2> 210761 T1026 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 210761 T1017 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 210777 T995 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1390100760773/solr.xml
>   [junit4]   2> 210800 T1024 oasc.ZkController.register We are http://127.0.0.1:56478/collection1/ and leader is http://127.0.0.1:56478/collection1/
>   [junit4]   2> 210801 T1024 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56478
>   [junit4]   2> 210801 T1024 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
>   [junit4]   2> 210801 T1024 oasc.ZkController.publish publishing core=collection1 state=active
>   [junit4]   2> 210802 T1024 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 210803 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 210803 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 210803 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 210803 T1024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 210805 T1018 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 210806 T1018 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"active",
>   [junit4]   2> 	  "base_url":"http://127.0.0.1:56478",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:56478_",
>   [junit4]   2> 	  "shard":"shard1",
>   [junit4]   2> 	  "shard_range":null,
>   [junit4]   2> 	  "shard_state":"active",
>   [junit4]   2> 	  "shard_parent":null,
>   [junit4]   2> 	  "collection":"control_collection",
>   [junit4]   2> 	  "numShards":"2",
>   [junit4]   2> 	  "core_node_name":"core_node1"}
>   [junit4]   2> 210808 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 210819 T995 oasc.CoreContainer.<init> New CoreContainer 4639155
>   [junit4]   2> 210819 T995 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1390100760773/]
>   [junit4]   2> 210821 T995 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
>   [junit4]   2> 210821 T995 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
>   [junit4]   2> 210822 T995 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
>   [junit4]   2> 210822 T995 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 210822 T995 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 210823 T995 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 210823 T995 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 210824 T995 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 210824 T995 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 210828 T995 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 210829 T995 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 210829 T995 oasc.CoreContainer.load Host Name: 127.0.0.1
>   [junit4]   2> 210830 T995 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54105/solr
>   [junit4]   2> 210830 T995 oasc.ZkController.checkChrootPath zkHost includes chroot
>   [junit4]   2> 210831 T995 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 210833 T1037 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1642de4 name:ZooKeeperConnection Watcher:127.0.0.1:54105 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 210834 T995 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 210837 T995 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 210838 T1039 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16c9a98 name:ZooKeeperConnection Watcher:127.0.0.1:54105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 210838 T995 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 210842 T995 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 210910 T1026 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 210910 T1017 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 210911 T1039 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 211846 T995 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52868_
>   [junit4]   2> 211847 T995 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52868_
>   [junit4]   2> 211850 T1026 oascc.ZkStateReader$3.process Updating live nodes... (2)
>   [junit4]   2> 211850 T1017 oascc.ZkStateReader$3.process Updating live nodes... (2)
>   [junit4]   2> 211850 T1039 oascc.ZkStateReader$3.process Updating live nodes... (2)
>   [junit4]   2> 211855 T1040 oasc.ZkController.publish publishing core=collection1 state=down
>   [junit4]   2> 211856 T1040 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 211856 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 211857 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 211857 T1040 oasc.ZkController.waitForCoreNodeName look for our core node name
>   [junit4]   2> 211857 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 211858 T1018 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 211859 T1018 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"down",
>   [junit4]   2> 	  "base_url":"http://127.0.0.1:52868",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:52868_",
>   [junit4]   2> 	  "shard":null,
>   [junit4]   2> 	  "shard_range":null,
>   [junit4]   2> 	  "shard_state":"active",
>   [junit4]   2> 	  "shard_parent":null,
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"2",
>   [junit4]   2> 	  "core_node_name":null}
>   [junit4]   2> 211859 T1018 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
>   [junit4]   2> 211859 T1018 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
>   [junit4]   2> 211861 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 211964 T1017 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 211964 T1026 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 211964 T1039 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 212857 T1040 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
>   [junit4]   2> 212858 T1040 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1390100760773/collection1
>   [junit4]   2> 212858 T1040 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
>   [junit4]   2> 212859 T1040 oasc.ZkController.createCollectionZkNode Collection zkNode exists
>   [junit4]   2> 212859 T1040 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
>   [junit4]   2> 212860 T1040 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1390100760773/collection1/'
>   [junit4]   2> 212861 T1040 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1390100760773/collection1/lib/classes/' to classloader
>   [junit4]   2> 212861 T1040 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1390100760773/collection1/lib/README' to classloader
>   [junit4]   2> 212888 T1040 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
>   [junit4]   2> 212912 T1040 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
>   [junit4]   2> 212913 T1040 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
>   [junit4]   2> 212922 T1040 oass.IndexSchema.readSchema [collection1] Schema name=test
>   [junit4]   2> 213148 T1040 oass.IndexSchema.readSchema default search field in schema is text
>   [junit4]   2> 213150 T1040 oass.IndexSchema.readSchema unique key field: id
>   [junit4]   2> 213151 T1040 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 213154 T1040 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 213176 T1040 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
>   [junit4]   2> 213177 T1040 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1390100760773/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty1/
>   [junit4]   2> 213177 T1040 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a47bf9
>   [junit4]   2> 213178 T1040 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty1
>   [junit4]   2> 213178 T1040 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty1/index/
>   [junit4]   2> 213178 T1040 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty1/index' doesn't exist. Creating new index...
>   [junit4]   2> 213179 T1040 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty1/index
>   [junit4]   2> 213179 T1040 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=11, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
>   [junit4]   2> 213181 T1040 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
>   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty1/index,segFN=segments_1,generation=1}
>   [junit4]   2> 213181 T1040 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 213184 T1040 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
>   [junit4]   2> 213185 T1040 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
>   [junit4]   2> 213185 T1040 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
>   [junit4]   2> 213185 T1040 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 213186 T1040 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 213186 T1040 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>   [junit4]   2> 213186 T1040 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 213186 T1040 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 213187 T1040 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
>   [junit4]   2> 213187 T1040 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
>   [junit4]   2> 213188 T1040 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
>   [junit4]   2> 213188 T1040 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
>   [junit4]   2> 213188 T1040 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
>   [junit4]   2> 213189 T1040 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
>   [junit4]   2> 213189 T1040 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
>   [junit4]   2> 213189 T1040 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
>   [junit4]   2> 213192 T1040 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 213193 T1040 oasu.CommitTracker.<init> Hard AutoCommit: disabled
>   [junit4]   2> 213193 T1040 oasu.CommitTracker.<init> Soft AutoCommit: disabled
>   [junit4]   2> 213194 T1040 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=13, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8021686745258141]
>   [junit4]   2> 213195 T1040 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
>   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty1/index,segFN=segments_1,generation=1}
>   [junit4]   2> 213195 T1040 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 213195 T1040 oass.SolrIndexSearcher.<init> Opening Searcher@de8dcb main
>   [junit4]   2> 213198 T1041 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@de8dcb main{StandardDirectoryReader(segments_1:1:nrt)}
>   [junit4]   2> 213200 T1040 oasc.CoreContainer.registerCore registering core: collection1
>   [junit4]   2> 213201 T995 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
>   [junit4]   2> 213201 T995 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
>   [junit4]   2> 213201 T1044 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52868 collection:collection1 shard:shard2
>   [junit4]   2> 213203 T1044 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
>   [junit4]   2> 213208 T1044 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
>   [junit4]   2> 213210 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 213210 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 213210 T1044 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
>   [junit4]   2> 213211 T1044 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
>   [junit4]   2> 213210 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> ASYNC  NEW_CORE C217 name=collection1 org.apache.solr.core.SolrCore@1c45307 url=http://127.0.0.1:52868/collection1 node=127.0.0.1:52868_ C217_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:52868, core=collection1, node_name=127.0.0.1:52868_}
>   [junit4]   2> 213211 T1044 C217 P52868 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52868/collection1/
>   [junit4]   2> 213211 T1044 C217 P52868 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
>   [junit4]   2> 213211 T1018 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 213212 T1044 C217 P52868 oasc.SyncStrategy.syncToMe http://127.0.0.1:52868/collection1/ has no replicas
>   [junit4]   2> 213212 T1044 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52868/collection1/ shard2
>   [junit4]   2> 213212 T1044 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
>   [junit4]   2> 213214 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 213217 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 213222 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 213279 T995 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 213281 T995 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46058
>   [junit4]   2> 213282 T995 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 213282 T995 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 213283 T995 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1390100763330
>   [junit4]   2> 213283 T995 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1390100763330/'
>   [junit4]   2> 213295 T995 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1390100763330/solr.xml
>   [junit4]   2> 213319 T995 oasc.CoreContainer.<init> New CoreContainer 7280394
>   [junit4]   2> 213320 T995 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1390100763330/]
>   [junit4]   2> 213321 T995 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
>   [junit4]   2> 213321 T995 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
>   [junit4]   2> 213321 T995 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
>   [junit4]   2> 213322 T995 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 213322 T995 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 213322 T995 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 213323 T995 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 213323 T995 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 213323 T995 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 213325 T1026 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 213325 T1017 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 213325 T1039 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 213326 T995 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 213327 T995 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 213327 T995 oasc.CoreContainer.load Host Name: 127.0.0.1
>   [junit4]   2> 213328 T995 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54105/solr
>   [junit4]   2> 213328 T995 oasc.ZkController.checkChrootPath zkHost includes chroot
>   [junit4]   2> 213329 T995 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 213331 T1055 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1357b name:ZooKeeperConnection Watcher:127.0.0.1:54105 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 213331 T995 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 213333 T995 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 213335 T1057 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@89279c name:ZooKeeperConnection Watcher:127.0.0.1:54105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 213335 T995 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 213339 T995 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 213368 T1044 oasc.ZkController.register We are http://127.0.0.1:52868/collection1/ and leader is http://127.0.0.1:52868/collection1/
>   [junit4]   2> 213368 T1044 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52868
>   [junit4]   2> 213368 T1044 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
>   [junit4]   2> 213368 T1044 oasc.ZkController.publish publishing core=collection1 state=active
>   [junit4]   2> 213368 T1044 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 213370 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 213370 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 213370 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 213370 T1044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 213371 T1018 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 213372 T1018 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"active",
>   [junit4]   2> 	  "base_url":"http://127.0.0.1:52868",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:52868_",
>   [junit4]   2> 	  "shard":"shard2",
>   [junit4]   2> 	  "shard_range":null,
>   [junit4]   2> 	  "shard_state":"active",
>   [junit4]   2> 	  "shard_parent":null,
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"2",
>   [junit4]   2> 	  "core_node_name":"core_node1"}
>   [junit4]   2> 213375 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 213477 T1026 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 213478 T1017 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 213478 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 213477 T1039 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 214342 T995 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46058_
>   [junit4]   2> 214343 T995 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46058_
>   [junit4]   2> 214345 T1057 oascc.ZkStateReader$3.process Updating live nodes... (3)
>   [junit4]   2> 214346 T1017 oascc.ZkStateReader$3.process Updating live nodes... (3)
>   [junit4]   2> 214345 T1026 oascc.ZkStateReader$3.process Updating live nodes... (3)
>   [junit4]   2> 214346 T1039 oascc.ZkStateReader$3.process Updating live nodes... (3)
>   [junit4]   2> 214351 T1058 oasc.ZkController.publish publishing core=collection1 state=down
>   [junit4]   2> 214352 T1058 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 214353 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 214353 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 214353 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 214353 T1058 oasc.ZkController.waitForCoreNodeName look for our core node name
>   [junit4]   2> 214355 T1018 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 214356 T1018 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"down",
>   [junit4]   2> 	  "base_url":"http://127.0.0.1:46058",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:46058_",
>   [junit4]   2> 	  "shard":null,
>   [junit4]   2> 	  "shard_range":null,
>   [junit4]   2> 	  "shard_state":"active",
>   [junit4]   2> 	  "shard_parent":null,
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"2",
>   [junit4]   2> 	  "core_node_name":null}
>   [junit4]   2> 214356 T1018 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
>   [junit4]   2> 214356 T1018 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
>   [junit4]   2> 214358 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 214460 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 214460 T1026 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 214461 T1017 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 214460 T1039 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 215354 T1058 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
>   [junit4]   2> 215355 T1058 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1390100763330/collection1
>   [junit4]   2> 215355 T1058 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
>   [junit4]   2> 215355 T1058 oasc.ZkController.createCollectionZkNode Collection zkNode exists
>   [junit4]   2> 215356 T1058 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
>   [junit4]   2> 215357 T1058 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1390100763330/collection1/'
>   [junit4]   2> 215357 T1058 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1390100763330/collection1/lib/classes/' to classloader
>   [junit4]   2> 215358 T1058 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1390100763330/collection1/lib/README' to classloader
>   [junit4]   2> 215384 T1058 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
>   [junit4]   2> 215408 T1058 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
>   [junit4]   2> 215410 T1058 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
>   [junit4]   2> 215417 T1058 oass.IndexSchema.readSchema [collection1] Schema name=test
>   [junit4]   2> 215640 T1058 oass.IndexSchema.readSchema default search field in schema is text
>   [junit4]   2> 215641 T1058 oass.IndexSchema.readSchema unique key field: id
>   [junit4]   2> 215643 T1058 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 215646 T1058 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 215664 T1058 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
>   [junit4]   2> 215665 T1058 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1390100763330/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty2/
>   [junit4]   2> 215665 T1058 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a47bf9
>   [junit4]   2> 215666 T1058 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty2
>   [junit4]   2> 215666 T1058 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty2/index/
>   [junit4]   2> 215666 T1058 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty2/index' doesn't exist. Creating new index...
>   [junit4]   2> 215666 T1058 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty2/index
>   [junit4]   2> 215667 T1058 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=11, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
>   [junit4]   2> 215669 T1058 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
>   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty2/index,segFN=segments_1,generation=1}
>   [junit4]   2> 215669 T1058 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 215672 T1058 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
>   [junit4]   2> 215673 T1058 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
>   [junit4]   2> 215673 T1058 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
>   [junit4]   2> 215673 T1058 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 215674 T1058 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 215674 T1058 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>   [junit4]   2> 215674 T1058 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 215674 T1058 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 215675 T1058 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
>   [junit4]   2> 215675 T1058 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
>   [junit4]   2> 215676 T1058 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
>   [junit4]   2> 215676 T1058 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
>   [junit4]   2> 215676 T1058 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
>   [junit4]   2> 215676 T1058 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
>   [junit4]   2> 215677 T1058 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
>   [junit4]   2> 215677 T1058 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
>   [junit4]   2> 215679 T1058 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 215681 T1058 oasu.CommitTracker.<init> Hard AutoCommit: disabled
>   [junit4]   2> 215681 T1058 oasu.CommitTracker.<init> Soft AutoCommit: disabled
>   [junit4]   2> 215682 T1058 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=13, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8021686745258141]
>   [junit4]   2> 215683 T1058 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
>   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty2/index,segFN=segments_1,generation=1}
>   [junit4]   2> 215683 T1058 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 215683 T1058 oass.SolrIndexSearcher.<init> Opening Searcher@9874ec main
>   [junit4]   2> 215686 T1059 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9874ec main{StandardDirectoryReader(segments_1:1:nrt)}
>   [junit4]   2> 215688 T1058 oasc.CoreContainer.registerCore registering core: collection1
>   [junit4]   2> 215688 T995 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
>   [junit4]   2> 215689 T995 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
>   [junit4]   2> 215688 T1062 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46058 collection:collection1 shard:shard1
>   [junit4]   2> 215690 T1062 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
>   [junit4]   2> 215696 T1062 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
>   [junit4]   2> 215697 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 215698 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 215698 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 215698 T1062 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
>   [junit4]   2> 215698 T1062 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
>   [junit4]   2> ASYNC  NEW_CORE C218 name=collection1 org.apache.solr.core.SolrCore@cde2d3 url=http://127.0.0.1:46058/collection1 node=127.0.0.1:46058_ C218_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:46058, core=collection1, node_name=127.0.0.1:46058_}
>   [junit4]   2> 215698 T1062 C218 P46058 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46058/collection1/
>   [junit4]   2> 215699 T1062 C218 P46058 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
>   [junit4]   2> 215699 T1062 C218 P46058 oasc.SyncStrategy.syncToMe http://127.0.0.1:46058/collection1/ has no replicas
>   [junit4]   2> 215699 T1018 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 215699 T1062 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46058/collection1/ shard1
>   [junit4]   2> 215700 T1062 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
>   [junit4]   2> 215703 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 215705 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 215708 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 215760 T995 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 215762 T995 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37488
>   [junit4]   2> 215763 T995 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 215763 T995 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 215764 T995 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1390100765817
>   [junit4]   2> 215764 T995 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1390100765817/'
>   [junit4]   2> 215779 T995 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1390100765817/solr.xml
>   [junit4]   2> 215809 T995 oasc.CoreContainer.<init> New CoreContainer 29679103
>   [junit4]   2> 215810 T995 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1390100765817/]
>   [junit4]   2> 215811 T995 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
>   [junit4]   2> 215811 T1039 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 215811 T1017 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 215811 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 215811 T1026 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 215811 T995 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
>   [junit4]   2> 215813 T995 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
>   [junit4]   2> 215814 T995 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 215814 T995 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 215814 T995 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 215815 T995 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 215816 T995 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 215816 T995 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 215820 T995 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 215821 T995 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 215821 T995 oasc.CoreContainer.load Host Name: 127.0.0.1
>   [junit4]   2> 215822 T995 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54105/solr
>   [junit4]   2> 215823 T995 oasc.ZkController.checkChrootPath zkHost includes chroot
>   [junit4]   2> 215824 T995 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 215825 T1073 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e02b9 name:ZooKeeperConnection Watcher:127.0.0.1:54105 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 215825 T995 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 215828 T995 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 215829 T1075 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d603e2 name:ZooKeeperConnection Watcher:127.0.0.1:54105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 215829 T995 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 215833 T995 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 215856 T1062 oasc.ZkController.register We are http://127.0.0.1:46058/collection1/ and leader is http://127.0.0.1:46058/collection1/
>   [junit4]   2> 215856 T1062 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46058
>   [junit4]   2> 215857 T1062 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
>   [junit4]   2> 215857 T1062 oasc.ZkController.publish publishing core=collection1 state=active
>   [junit4]   2> 215857 T1062 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 215858 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 215858 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 215858 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 215858 T1062 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 215860 T1018 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 215860 T1018 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"active",
>   [junit4]   2> 	  "base_url":"http://127.0.0.1:46058",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:46058_",
>   [junit4]   2> 	  "shard":"shard1",
>   [junit4]   2> 	  "shard_range":null,
>   [junit4]   2> 	  "shard_state":"active",
>   [junit4]   2> 	  "shard_parent":null,
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"2",
>   [junit4]   2> 	  "core_node_name":"core_node2"}
>   [junit4]   2> 215862 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 215965 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 215965 T1017 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 215965 T1026 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 215965 T1075 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 215965 T1039 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 216836 T995 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37488_
>   [junit4]   2> 216839 T995 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37488_
>   [junit4]   2> 216841 T1057 oascc.ZkStateReader$3.process Updating live nodes... (4)
>   [junit4]   2> 216841 T1017 oascc.ZkStateReader$3.process Updating live nodes... (4)
>   [junit4]   2> 216842 T1075 oascc.ZkStateReader$3.process Updating live nodes... (4)
>   [junit4]   2> 216842 T1039 oascc.ZkStateReader$3.process Updating live nodes... (4)
>   [junit4]   2> 216842 T1026 oascc.ZkStateReader$3.process Updating live nodes... (4)
>   [junit4]   2> 216846 T1076 oasc.ZkController.publish publishing core=collection1 state=down
>   [junit4]   2> 216847 T1076 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 216910 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 216910 T1076 oasc.ZkController.waitForCoreNodeName look for our core node name
>   [junit4]   2> 216910 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 216910 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 216911 T1018 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 216912 T1018 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"down",
>   [junit4]   2> 	  "base_url":"http://127.0.0.1:37488",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:37488_",
>   [junit4]   2> 	  "shard":null,
>   [junit4]   2> 	  "shard_range":null,
>   [junit4]   2> 	  "shard_state":"active",
>   [junit4]   2> 	  "shard_parent":null,
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"2",
>   [junit4]   2> 	  "core_node_name":null}
>   [junit4]   2> 216912 T1018 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
>   [junit4]   2> 216912 T1018 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
>   [junit4]   2> 216916 T1017 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 217018 T1075 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
>   [junit4]   2> 217018 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
>   [junit4]   2> 217018 T1026 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
>   [junit4]   2> 217018 T1017 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
>   [junit4]   2> 217018 T1039 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
>   [junit4]   2> 217910 T1076 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
>   [junit4]   2> 217911 T1076 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1390100765817/collection1
>   [junit4]   2> 217911 T1076 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
>   [junit4]   2> 217912 T1076 oasc.ZkController.createCollectionZkNode Collection zkNode exists
>   [junit4]   2> 217912 T1076 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
>   [junit4]   2> 217913 T1076 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1390100765817/collection1/'
>   [junit4]   2> 217914 T1076 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1390100765817/collection1/lib/classes/' to classloader
>   [junit4]   2> 217914 T1076 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1390100765817/collection1/lib/README' to classloader
>   [junit4]   2> 217955 T1076 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
>   [junit4]   2> 218014 T1076 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
>   [junit4]   2> 218016 T1076 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
>   [junit4]   2> 218028 T1076 oass.IndexSchema.readSchema [collection1] Schema name=test
>   [junit4]   2> 218313 T1076 oass.IndexSchema.readSchema default search field in schema is text
>   [junit4]   2> 218315 T1076 oass.IndexSchema.readSchema unique key field: id
>   [junit4]   2> 218317 T1076 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 218321 T1076 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 218349 T1076 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
>   [junit4]   2> 218350 T1076 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1390100765817/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty3/
>   [junit4]   2> 218350 T1076 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a47bf9
>   [junit4]   2> 218351 T1076 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty3
>   [junit4]   2> 218351 T1076 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty3/index/
>   [junit4]   2> 218351 T1076 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty3/index' doesn't exist. Creating new index...
>   [junit4]   2> 218352 T1076 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty3/index
>   [junit4]   2> 218353 T1076 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=11, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
>   [junit4]   2> 218356 T1076 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
>   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cl
> 
> [...truncated too long message...]
> 
> verInterceptor.getAttribute(DefaultMBeanServerInterceptor.java:644)
>   [junit4]   2> 		at com.sun.jmx.mbeanserver.JmxMBeanServer.getAttribute(JmxMBeanServer.java:678)
>   [junit4]   2> 		at org.apache.solr.core.JmxMonitoredMap.unregister(JmxMonitoredMap.java:174)
>   [junit4]   2> 		at org.apache.solr.core.JmxMonitoredMap.clear(JmxMonitoredMap.java:116)
>   [junit4]   2> 		at org.apache.solr.core.SolrCore.close(SolrCore.java:1018)
>   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:268)
>   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
>   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
>   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
>   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
>   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
>   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
>   [junit4]   2> 	
>   [junit4]   2> 250201 T1153 oasc.SolrException.log ERROR IO error while trying to get the size of the Directory:org.apache.lucene.store.NoSuchDirectoryException: directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty7/index' does not exist
>   [junit4]   2> 		at org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:219)
>   [junit4]   2> 		at org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:243)
>   [junit4]   2> 		at org.apache.solr.core.DirectoryFactory.sizeOfDirectory(DirectoryFactory.java:191)
>   [junit4]   2> 		at org.apache.solr.handler.ReplicationHandler.getIndexSize(ReplicationHandler.java:521)
>   [junit4]   2> 		at org.apache.solr.handler.ReplicationHandler.getStatistics(ReplicationHandler.java:562)
>   [junit4]   2> 		at org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.getStatistics(RequestHandlers.java:318)
>   [junit4]   2> 		at org.apache.solr.core.JmxMonitoredMap$SolrDynamicMBean.getMBeanInfo(JmxMonitoredMap.java:236)
>   [junit4]   2> 		at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
>   [junit4]   2> 		at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
>   [junit4]   2> 		at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
>   [junit4]   2> 		at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
>   [junit4]   2> 		at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
>   [junit4]   2> 		at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
>   [junit4]   2> 		at org.apache.solr.core.JmxMonitoredMap.unregister(JmxMonitoredMap.java:175)
>   [junit4]   2> 		at org.apache.solr.core.JmxMonitoredMap.clear(JmxMonitoredMap.java:116)
>   [junit4]   2> 		at org.apache.solr.core.SolrCore.close(SolrCore.java:1018)
>   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:268)
>   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
>   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
>   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
>   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
>   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
>   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
>   [junit4]   2> 	
>   [junit4]   2> 250206 T1153 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=56,cumulative_deletesById=27,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=1}
>   [junit4]   2> 250207 T1153 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
>   [junit4]   2> 250207 T1153 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
>   [junit4]   2> 250207 T1153 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
>   [junit4]   2> 250208 T1153 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
>   [junit4]   2> 250208 T1153 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
>   [junit4]   2> 250208 T1153 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty7/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty7/index;done=false>>]
>   [junit4]   2> 250209 T1153 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty7/index
>   [junit4]   2> 250209 T1153 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty7 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty7;done=false>>]
>   [junit4]   2> 250209 T1153 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1390100758605/jetty7
>   [junit4]   2> 250209 T1153 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
>   [junit4]   2> 250209 T1153 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 250210 T1153 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
>   [junit4]   2> 250210 T1153 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 250210 T1153 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 250210 T1153 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=fi_FI, timezone=America/Mazatlan
>   [junit4]   2> NOTE: Linux 3.8.0-35-generic i386/Oracle Corporation 1.7.0_60-ea (32-bit)/cpus=8,threads=1,free=201364768,total=365953024
>   [junit4]   2> NOTE: All tests run in this JVM: [TestJmxIntegration, TestSolrXmlPersistor, SuggesterTSTTest, AlternateDirectoryTest, TestCSVResponseWriter, DirectSolrConnectionTest, TestWordDelimiterFilterFactory, TestStressRecovery, AliasIntegrationTest, ShardRoutingCustomTest, FileUtilsTest, FieldAnalysisRequestHandlerTest, TestCollationField, TestQueryTypes, HdfsBasicDistributedZkTest, TestNoOpRegenerator, TestIndexingPerformance, TestNumberUtils, FullSolrCloudDistribCmdsTest, TestFuzzyAnalyzedSuggestions, TestSolrJ, TestUniqueKeyFieldResource, PreAnalyzedUpdateProcessorTest, TestRTGBase, DeleteReplicaTest, TestUtils, SpellCheckComponentTest, TestCSVLoader, NumericFieldsTest, HdfsChaosMonkeySafeLeaderTest, BadIndexSchemaTest, TestDFRSimilarityFactory, NotRequiredUniqueKeyTest, SpellingQueryConverterTest, HighlighterConfigTest, MigrateRouteKeyTest, OutputWriterTest, TestPartialUpdateDeduplication, TestStressLucene, ZkSolrClientTest, TestDistributedMissingSort, ChaosMonkeyNothingIsSafeTest]
>   [junit4] Completed on J1 in 42.68s, 1 test, 1 failure <<< FAILURES!
> 
> [...truncated 802 lines...]
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 354 suites, 1540 tests, 1 failure, 34 ignored (6 assumptions)
> 
> Total time: 45 minutes 51 seconds
> Build step 'Invoke Ant' marked build as failure
> Description set: Java: 32bit/jdk1.7.0_60-ea-b02 -server -XX:+UseG1GC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message