lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael McCandless (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-4451) Memory leak per unique thread caused by RandomizedContext.contexts static map
Date Mon, 01 Oct 2012 10:33:07 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13466727#comment-13466727
] 

Michael McCandless commented on LUCENE-4451:
--------------------------------------------

bq. Could we temporarily make a pool of threads for this test and reuse these? 

I already committed a fix (to use static Thread subclass, and to null out the "heavy stuff"
after the thread is done), and it seemed to work around the issue in my testing ... however,
I don't re-use (pool) the threads.
                
> Memory leak per unique thread caused by RandomizedContext.contexts static map
> -----------------------------------------------------------------------------
>
>                 Key: LUCENE-4451
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4451
>             Project: Lucene - Core
>          Issue Type: Bug
>            Reporter: Michael McCandless
>            Assignee: Dawid Weiss
>
> In digging on the hard-to-understand OOMEs with
> TestDirectPostingsFormat ... I found (thank you YourKit) that
> RandomizedContext (in randomizedtesting JAR) seems to be holding onto
> all threads created by the test.  The test does create many very short
> lived threads (testing the thread safety of the postings format), in
> BasePostingsFormatTestCase.testTerms), and somehow these seem to tie
> up a lot (~100 MB) of RAM in RandomizedContext.contexts static map.
> For now I've disabled all thread testing (committed {{false &&}} inside
> {{BPFTC.testTerms}}), but hopefully we can fix the root cause here, eg
> when a thread exits can we clear it from that map?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message