lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Stoppelman <stop...@gmail.com>
Subject Re: waaaay too many files in the index!
Date Tue, 03 Feb 2009 17:25:05 GMT
On Tue, Feb 3, 2009 at 7:26 AM, John Byrne <john.byrne@propylon.com> wrote:

> Hi,
>
> I've got a weird problem with a lucene index, using 2.3.1. The index
> contains 6660 files. I don't know how this happened.Maybe somone can tell me
> something about the files themselves? (examples below)
>
> On one day, between 10 and 40 of these files were being created every
> minute. The index updates are triggered by updates to an SVN repository, but
> I can't find any corresponding activity in the SVN logs.
>
> The lucene files all have names like this:
>
> _1qsw.cfs
> _1qsx.cfs
> _1qsy.cfs
> _1qsz.cfs
> _1qt0.cfs
>
> and are mostly < 5K in size.
>
> My application uses just one instance each of
> IndexReader/IndexWriter/IndexSearcher. From looking at
>
> Can anyone shed any light on these files? I'm not too hopeful about fixing
> this index because we are getting "too many open files", even with an
> unlimited ulimit, but any info/suggestions would be great. Thanks.
>

If you're using linux you can up the number of file descriptors by writing a
value to proc:

   echo 100000 > /proc/sys/fs/file-max  (
http://lists.plug.phoenix.az.us/pipermail/plug-discuss/2000-September/005508.html
)


>
> -John
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message