Return-Path: X-Original-To: apmail-lucene-dev-archive@www.apache.org Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F0616921D for ; Mon, 21 May 2012 18:11:42 +0000 (UTC) Received: (qmail 25505 invoked by uid 500); 21 May 2012 18:11:41 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 25460 invoked by uid 500); 21 May 2012 18:11:41 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 25442 invoked by uid 99); 21 May 2012 18:11:41 -0000 Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 May 2012 18:11:41 +0000 Received: from isssues-vm.apache.org (localhost [127.0.0.1]) by issues-vm (Postfix) with ESMTP id 57D0014281C for ; Mon, 21 May 2012 18:11:41 +0000 (UTC) Date: Mon, 21 May 2012 18:11:41 +0000 (UTC) From: "Uwe Schindler (JIRA)" To: dev@lucene.apache.org Message-ID: <1403342241.4081.1337623901361.JavaMail.jiratomcat@issues-vm> In-Reply-To: <1147203059.2741.1337591321118.JavaMail.jiratomcat@issues-vm> Subject: [jira] [Commented] (LUCENE-4071) DWStallControl can deadlock IW if no flushes are running / pending MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/LUCENE-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13280323#comment-13280323 ] Uwe Schindler commented on LUCENE-4071: --------------------------------------- Thanks to SDDS-Jenkins :-) > DWStallControl can deadlock IW if no flushes are running / pending > ------------------------------------------------------------------ > > Key: LUCENE-4071 > URL: https://issues.apache.org/jira/browse/LUCENE-4071 > Project: Lucene - Java > Issue Type: Bug > Components: core/index > Affects Versions: 4.0 > Reporter: Simon Willnauer > Assignee: Simon Willnauer > Priority: Critical > Fix For: 4.0 > > Attachments: LUCENE-4071.patch > > > DWStallControl currently only checks if the net bytes used by all the DWPT and deletes exceeds the stall limit (2*MAX_RAM_BUFFER). This is generally a very good default but in certain situations we can exceed this limit even without an ongoing flush. Stalling is used to prevent IW overloading due to slow flushes etc. which should not happen too often in practice. With a smallish RAM Buffer and a bigger document we can easily get into the stage where we stall the DW without a chance to free up the memory. > I think we should make sure that a pending or running flush can free up enough memory to unstall. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org