lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (LUCENE-4071) DWStallControl can deadlock IW if no flushes are running / pending
Date Mon, 21 May 2012 09:10:40 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Simon Willnauer updated LUCENE-4071:
------------------------------------

    Attachment: LUCENE-4071.patch

here is a patch 
                
> DWStallControl can deadlock IW if no flushes are running / pending
> ------------------------------------------------------------------
>
>                 Key: LUCENE-4071
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4071
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: core/index
>    Affects Versions: 4.0
>            Reporter: Simon Willnauer
>            Assignee: Simon Willnauer
>            Priority: Critical
>             Fix For: 4.0
>
>         Attachments: LUCENE-4071.patch
>
>
> DWStallControl currently only checks if the net bytes used by all the DWPT and deletes
exceeds the stall limit (2*MAX_RAM_BUFFER). This is generally a very good default but in certain
situations we can exceed this limit even without an ongoing flush. Stalling is used to prevent
IW overloading due to slow flushes etc. which should not happen too often in practice. With
a smallish RAM Buffer and a bigger document we can easily get into the stage where we stall
the DW without a chance to free up the memory.  
> I think we should make sure that a pending or running flush can free up enough memory
to unstall.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message