lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (Reopened) (JIRA)" <j...@apache.org>
Subject [jira] [Reopened] (LUCENE-3994) some nightly tests take hours
Date Wed, 18 Apr 2012 13:17:42 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Robert Muir reopened LUCENE-3994:
---------------------------------


This still occurs.

I profiled the slow tests and found its because of the huge 1GB linedocs file. The problem
is opening this 1GB zipped file and seeking to a random place (which is what LineDocs does),
is really costly.

so all the time is spent in GZIPInputStream.inflateBytes!

I will temporary disable the huge file for nightly builds.


                
> some nightly tests take hours
> -----------------------------
>
>                 Key: LUCENE-3994
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3994
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: general/build
>    Affects Versions: 4.0
>            Reporter: Robert Muir
>             Fix For: 4.0
>
>         Attachments: LUCENE-3994.patch
>
>
> The nightly builds are taking 4-7 hours.
> This is caused by a few bad apples (can be seen https://builds.apache.org/job/Lucene-trunk/1896/testReport/).
> The top 5 are (all in analysis):
> * TestSynonymMapFilter: 1 hr 54 min
> * TestRandomChains: 1 hr 22 min
> * TestRemoveDuplicatesTokenFilter: 32 min
> * TestMappingCharFilter: 28 min
> * TestWordDelimiterFilter: 22 min
> so thats 4.5 hours right there for that run....

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message