lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dawid Weiss (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-4174) Some test statistics (mean, stddev).
Date Thu, 28 Jun 2012 07:18:42 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402898#comment-13402898
] 

Dawid Weiss commented on LUCENE-4174:
-------------------------------------

I calculated simple stats from a dozen test runs on my build machine (trunk at Jun 28, 2012).

h3. The slowest tests (mean time, stddev)

{noformat}
name                                       | mean    | stddev | min    | max
BasicDistributedZkTest                     | 168155  | 12697  | 136591 | 192507
FullSolrCloudTest                          | 95912   | 5867   | 76449  | 102628
OverseerTest                               | 95801   | 9025   | 82868  | 108840
RecoveryZkTest                             | 82924   | 13524  | 63800  | 115504
TestJoinUtil                               | 69328   | 74451  | 7358   | 268199
SpellCheckComponentTest                    | 65744   | 14222  | 38798  | 85575
FullSolrCloudDistribCmdsTest               | 49543   | 2837   | 45376  | 53916
TestReplicationHandler                     | 45352   | 1863   | 41645  | 48253
LeaderElectionIntegrationTest              | 42893   | 5400   | 33565  | 50718
TestLBHttpSolrServer                       | 35746   | 704    | 34841  | 37133
LeaderElectionTest                         | 33766   | 6039   | 23574  | 45419
DistributedSpellCheckComponentTest         | 30688   | 3500   | 23605  | 36914
TestRealTimeGet                            | 30642   | 3960   | 24503  | 39594
TestJapaneseTokenizer                      | 27920   | 5575   | 22090  | 48021
TestDuelingAnalyzers                       | 26972   | 4330   | 18522  | 33446
ZkControllerTest                           | 26740   | 8703   | 16446  | 45590
TestSynonymMapFilter                       | 24929   | 3784   | 19259  | 31461
NGramTokenizerTest                         | 22886   | 8533   | 13972  | 49923
TestIndexWriterWithThreads                 | 22195   | 7698   | 14150  | 46912
TestExtendedMode                           | 19029   | 5525   | 12693  | 38139
TestDistributedGrouping                    | 18384   | 3128   | 12726  | 24952
TestRandomFaceting                         | 17223   | 5578   | 7514   | 27142
SamplingAccumulatorTest                    | 16966   | 7418   | 8858   | 30789
CloudStateUpdateTest                       | 16611   | 2728   | 10203  | 21394
TestDistributedSearch                      | 15850   | 2450   | 12915  | 22035
TestPackedInts                             | 15469   | 3433   | 11274  | 25217
SamplingWrapperTest                        | 14782   | 6307   | 7890   | 28589
AdaptiveAccumulatorTest                    | 14672   | 4603   | 8838   | 26736
SpellCheckCollatorTest                     | 13402   | 3775   | 5068   | 18996
SolrExampleStreamingBinaryTest             | 12692   | 1110   | 11701  | 15060
TestJapaneseAnalyzer                       | 12538   | 3785   | 7372   | 24728
SolrExampleStreamingTest                   | 12441   | 882    | 11635  | 14698
UIMAUpdateRequestProcessorTest             | 12053   | 346    | 11135  | 12807
TestNorms                                  | 11652   | 8949   | 1861   | 35629
TestFSTs                                   | 11421   | 3263   | 6679   | 16884
SoftAutoCommitTest                         | 11157   | 794    | 9906   | 12756
TestExtendedDismaxParser                   | 11149   | 1469   | 8410   | 13435
AutoCommitTest                             | 10827   | 752    | 9228   | 11822
TestPhoneticFilterFactory                  | 10273   | 2269   | 8453   | 17129
BasicZkTest                                | 10001   | 1108   | 7167   | 11637
TestFaceting                               | 9927    | 3660   | 6748   | 19713
TestPerfTasksLogic                         | 9842    | 768    | 8519   | 11465
TestGraphTokenizers                        | 9379    | 2526   | 5502   | 13915
TestAnalyzers                              | 9378    | 4605   | 5109   | 22722
TestHashPartitioner                        | 9351    | 3664   | 6645   | 22686
ZkSolrClientTest                           | 9290    | 824    | 7845   | 10847
UIMATypeAwareAnnotationsTokenizerFactoryTe | 8883    | 240    | 8540   | 9393
UIMAAnnotationsTokenizerFactoryTest        | 8748    | 393    | 7883   | 9308
TestGrouping                               | 8656    | 1154   | 6909   | 11361
TestSmartChineseAnalyzer                   | 8594    | 2904   | 6694   | 18657
WordBreakSolrSpellCheckerTest              | 8501    | 2056   | 4204   | 12071
TestIndexWriterReader                      | 8303    | 3168   | 4899   | 14695
TestRecovery                               | 8247    | 3132   | 5854   | 17090
DistributedTermsComponentTest              | 8132    | 797    | 6736   | 9315
TestLookaheadTokenFilter                   | 7896    | 3085   | 3992   | 14377
StatsComponentTest                         | 7767    | 1015   | 6230   | 9364
TestJoin                                   | 7764    | 2381   | 5615   | 14003
{noformat}

h3. Largest test execution variance 

{noformat}
name                          | mean   | stddev | min   | max
TestJoinUtil                  | 69328  | 74451  | 7358  | 268199
SpellCheckComponentTest       | 65744  | 14222  | 38798 | 85575
RecoveryZkTest                | 82924  | 13524  | 63800 | 115504
BasicDistributedZkTest        | 168155 | 12697  | 136591| 192507
OverseerTest                  | 95801  | 9025   | 82868 | 108840
TestNorms                     | 11652  | 8949   | 1861  | 35629
ZkControllerTest              | 26740  | 8703   | 16446 | 45590
TestTypePromotion             | 6467   | 8554   | 761   | 26213
NGramTokenizerTest            | 22886  | 8533   | 13972 | 49923           
{noformat}
                
> Some test statistics (mean, stddev).
> ------------------------------------
>
>                 Key: LUCENE-4174
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4174
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: general/test
>            Reporter: Dawid Weiss
>            Assignee: Dawid Weiss
>            Priority: Trivial
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message