lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-3090) DWFlushControl does not take active DWPT out of the loop on fullFlush
Date Fri, 13 May 2011 13:08:47 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13033024#comment-13033024
] 

Simon Willnauer commented on LUCENE-3090:
-----------------------------------------

bq. Could we add an assert that net flushPending + active RAM never exceeds some multiplier
(2X?) of the configured max RAM?
net flush pending means? we only differ between flushing ram and active ram so flushing ram
can easily get above such a limit if IO is slow...


> DWFlushControl does not take active DWPT out of the loop on fullFlush
> ---------------------------------------------------------------------
>
>                 Key: LUCENE-3090
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3090
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 4.0
>            Reporter: Simon Willnauer
>            Assignee: Simon Willnauer
>            Priority: Critical
>             Fix For: 4.0
>
>         Attachments: LUCENE-3090.patch, LUCENE-3090.patch
>
>
> We have seen several OOM on TestNRTThreads and all of them are caused by DWFlushControl
missing DWPT that are set as flushPending but can't full due to a full flush going on. Yet
that means that those DWPT are filling up in the background while they should actually be
checked out and blocked until the full flush finishes. Even further we currently stall on
the maxNumThreadStates while we should stall on the num of active thread states. I will attach
a patch tomorrow.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message