lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (LUCENE-3090) DWFlushControl does not take active DWPT out of the loop on fullFlush
Date Fri, 13 May 2011 10:23:47 GMT

     [ https://issues.apache.org/jira/browse/LUCENE-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Simon Willnauer updated LUCENE-3090:
------------------------------------

    Attachment: LUCENE-3090.patch

here is a patch. I fixed DWFlushControl to block flushes while a fullflush is happening and
make them available once the fullflush is done. I also ensure that incoming threads help out
flushing if there are DWPT about to flush but not taken yet before indexing their document.
All tests pass (I run them lots of times :)

> DWFlushControl does not take active DWPT out of the loop on fullFlush
> ---------------------------------------------------------------------
>
>                 Key: LUCENE-3090
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3090
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: Index
>    Affects Versions: 4.0
>            Reporter: Simon Willnauer
>            Assignee: Simon Willnauer
>            Priority: Critical
>             Fix For: 4.0
>
>         Attachments: LUCENE-3090.patch
>
>
> We have seen several OOM on TestNRTThreads and all of them are caused by DWFlushControl
missing DWPT that are set as flushPending but can't full due to a full flush going on. Yet
that means that those DWPT are filling up in the background while they should actually be
checked out and blocked until the full flush finishes. Even further we currently stall on
the maxNumThreadStates while we should stall on the num of active thread states. I will attach
a patch tomorrow.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message