Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 97899 invoked from network); 27 Aug 2009 15:50:13 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 27 Aug 2009 15:50:13 -0000 Received: (qmail 42006 invoked by uid 500); 27 Aug 2009 15:50:11 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 41934 invoked by uid 500); 27 Aug 2009 15:50:11 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 41924 invoked by uid 99); 27 Aug 2009 15:50:11 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Aug 2009 15:50:11 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of erickerickson@gmail.com designates 209.85.223.200 as permitted sender) Received: from [209.85.223.200] (HELO mail-iw0-f200.google.com) (209.85.223.200) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Aug 2009 15:50:00 +0000 Received: by iwn38 with SMTP id 38so606414iwn.29 for ; Thu, 27 Aug 2009 08:49:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=cYf8xUtM/ss9UhfZMs1SMlBCshEBABlZWIHLO/WJrxo=; b=dwaEQJlIK2tpC9ihacBysXSLlGkG0IyzkYpsZRiEyjX9JYxsKassgJfp3p7UhMx7Fm gTTyAFdoKykUg/XR4Rl1depjKVEoDhxVXXNUndo4QHW+K1qzHLd/6sohLozvgzuBeRlH bt1pGiswu8DjOurJaKhQ28a2cbcxjUad+ctJY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=CUTLvfcHCF0ufQuBVEyPFrplx86caSFlZ04vo2tvMz/FSFvAB0mzQNG7kdQ+m/90aZ rIqaG5r1OXaDb+O7SlWMIeSSGvY6JjHiRiDaITkskjLa9p6+CbYhrs/DcW2XqgqQWwlB fFmaQK5XWPAzaET/pnJc4cEEbhVC6rl+ibzps= MIME-Version: 1.0 Received: by 10.231.6.79 with SMTP id 15mr199199iby.36.1251388177784; Thu, 27 Aug 2009 08:49:37 -0700 (PDT) In-Reply-To: <895923651.19581251378658048.JavaMail.root@mail.uk.scalix.com> References: <9ac0c6aa0908260626m5e2d8a32kbb40ae010f922e7c@mail.gmail.com> <895923651.19581251378658048.JavaMail.root@mail.uk.scalix.com> Date: Thu, 27 Aug 2009 11:49:37 -0400 Message-ID: <359a92830908270849n374130ebnf872d0d12e7f5828@mail.gmail.com> Subject: Re: Lucene gobbling file descriptors From: Erick Erickson To: java-user@lucene.apache.org Content-Type: multipart/alternative; boundary=00151774123ed02fa2047221835a X-Virus-Checked: Checked by ClamAV on apache.org --00151774123ed02fa2047221835a Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Note that for search speed reasons, you really, really want to share your readers and NOT open/close for every request. FWIW Erick On Thu, Aug 27, 2009 at 9:10 AM, Chris Bamford wrote: > I'm glad its not normal. That means we can fix it! I will conduct a > review of IndexReader/Searcher open/close ops. > > Thanks! > > Chris > > ----- Original Message ----- > From: Michael McCandless > Sent: Wed, 26/8/2009 2:26pm > To: java-user@lucene.apache.org > Subject: Re: Lucene gobbling file descriptors > > This is not normal. As long as you are certain you close every > IndexReader/Searcher that you opened, the number of file descriptors > should stay "contained". > > Though: how many files are there in your index directory? > > Mike > > On Wed, Aug 26, 2009 at 9:18 AM, Chris Bamford > wrote: > > Hi there, > > > > I wonder if someone can help? We have a successful Lucene app deployed > on Tomcat which works well. As far as we can tell, our developers have > observed all the guidelines in the Lucene FAQ, but on some of our > installations, Tomcat eventually runs out of file descriptors and needs a > restart to clear it. We know Lucene is the culprit because use lsof -p > and the vast majority (usually tens of thousands) of files > reported are Lucene index files. > > > > I am hoping to get some tips on how this can be avoided. Is it simply > the case that as time goes by, more and more descriptors are left open and > no matter how high ulimit is set, you will run out? Or is there a policy of > recycling that we are failing to utilise properly? > > > > I am happy to provide more information, just don't know what at this > point! Please ask.... > > > > Thanks in advance > > > > - Chris > > > > Chris Bamford > > Senior Development Engineer > > Scalix > > chris.bamford@scalix.com > > Tel: +44 (0)1344 381814 > > www.scalix.com > > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > > --00151774123ed02fa2047221835a--