Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 30776 invoked from network); 3 Feb 2009 17:25:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 3 Feb 2009 17:25:44 -0000 Received: (qmail 6313 invoked by uid 500); 3 Feb 2009 17:25:36 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 6287 invoked by uid 500); 3 Feb 2009 17:25:36 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 6275 invoked by uid 99); 3 Feb 2009 17:25:36 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Feb 2009 09:25:36 -0800 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of stopman@gmail.com designates 209.85.146.179 as permitted sender) Received: from [209.85.146.179] (HELO wa-out-1112.google.com) (209.85.146.179) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Feb 2009 17:25:26 +0000 Received: by wa-out-1112.google.com with SMTP id m33so1104131wag.5 for ; Tue, 03 Feb 2009 09:25:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=k+L1cSfz72dtfiLvfK5AMr/SJXJohq28LPcU0vzYPn0=; b=gDu1erJaPb0f6Cj1FzzONvTJqY6eKrL5vuJLPCfZGPb76UQCPrblDFleD66bRR/ExH qlTh4g6hSvUh/7EsDr3l4lTkey9A/EqgK4xy6fYf15lCvdrdpr6sUaHLRJYGlNYNIAvB gi4FUlLn+1vzfDOwZoIAJQ8b7tYoYa84iNWWg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=WeJnhRDLT9RGg+k217U/cdbJv6tLGuWulJ63ovecOuNagADmbnXR2xfdGuoUnde3qo kEpBrrsD11bn2Mdt1z2DzJ8Ov0xVXtWLXIbaz/nt0dPb6ylFXc20tR7Lqw6K2HQPFJsD DMeNHcxxohJZ2CP7Iwr1Dns6WhfuesUhmM4U0= MIME-Version: 1.0 Received: by 10.114.124.1 with SMTP id w1mr3812439wac.135.1233681905124; Tue, 03 Feb 2009 09:25:05 -0800 (PST) In-Reply-To: <4988621A.40207@propylon.com> References: <4988621A.40207@propylon.com> Date: Tue, 3 Feb 2009 09:25:05 -0800 Message-ID: <652776090902030925h574f0166iff1a77328e1326db@mail.gmail.com> Subject: Re: waaaay too many files in the index! From: Michael Stoppelman To: java-user@lucene.apache.org Content-Type: multipart/alternative; boundary=00163646c600b88588046206f312 X-Virus-Checked: Checked by ClamAV on apache.org --00163646c600b88588046206f312 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit On Tue, Feb 3, 2009 at 7:26 AM, John Byrne wrote: > Hi, > > I've got a weird problem with a lucene index, using 2.3.1. The index > contains 6660 files. I don't know how this happened.Maybe somone can tell me > something about the files themselves? (examples below) > > On one day, between 10 and 40 of these files were being created every > minute. The index updates are triggered by updates to an SVN repository, but > I can't find any corresponding activity in the SVN logs. > > The lucene files all have names like this: > > _1qsw.cfs > _1qsx.cfs > _1qsy.cfs > _1qsz.cfs > _1qt0.cfs > > and are mostly < 5K in size. > > My application uses just one instance each of > IndexReader/IndexWriter/IndexSearcher. From looking at > > Can anyone shed any light on these files? I'm not too hopeful about fixing > this index because we are getting "too many open files", even with an > unlimited ulimit, but any info/suggestions would be great. Thanks. > If you're using linux you can up the number of file descriptors by writing a value to proc: echo 100000 > /proc/sys/fs/file-max ( http://lists.plug.phoenix.az.us/pipermail/plug-discuss/2000-September/005508.html ) > > -John > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > > --00163646c600b88588046206f312--