lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (JIRA)" <j...@apache.org>
Subject [jira] [Created] (LUCENE-4071) DWStallControl can deadlock IW if no flushes are running / pending
Date Mon, 21 May 2012 09:08:41 GMT
Simon Willnauer created LUCENE-4071:
---------------------------------------

             Summary: DWStallControl can deadlock IW if no flushes are running / pending
                 Key: LUCENE-4071
                 URL: https://issues.apache.org/jira/browse/LUCENE-4071
             Project: Lucene - Java
          Issue Type: Bug
          Components: core/index
    Affects Versions: 4.0
            Reporter: Simon Willnauer
            Assignee: Simon Willnauer
            Priority: Critical
             Fix For: 4.0


DWStallControl currently only checks if the net bytes used by all the DWPT and deletes exceeds
the stall limit (2*MAX_RAM_BUFFER). This is generally a very good default but in certain situations
we can exceed this limit even without an ongoing flush. Stalling is used to prevent IW overloading
due to slow flushes etc. which should not happen too often in practice. With a smallish RAM
Buffer and a bigger document we can easily get into the stage where we stall the DW without
a chance to free up the memory.  

I think we should make sure that a pending or running flush can free up enough memory to unstall.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message