lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yonik Seeley" <yo...@apache.org>
Subject Re: too many open files
Date Mon, 14 Jul 2008 14:32:27 GMT
On Mon, Jul 14, 2008 at 10:17 AM, Alexey Shakov <alexey.shakov@menta.de> wrote:
> Yonik Seeley schrieb:
>>
>> On Mon, Jul 14, 2008 at 5:14 AM, Alexey Shakov <alexey.shakov@menta.de>
>>> now we have set the limt to ~10000 files
>>> but this is not the solution - the amount of open files increases
>>> permanantly.
>>> Earlier or later, this limit will be exhausted.
>>>
>>
>> How can you tell? Are you seeing descriptor use continually growing?
>>
>> -Yonik
>
> 'deleted' index files, listed with lsof-command today, was listed (also as
> deleted)
> several days ago...
>
> But the amount of this 'deleted' files increases. So, I make a conclusion,
> that this is the question of time, when the limit of 10000 will be reached.

You are probably just seeing growth in the number of segments in the
index... which means that any IndexReader will be holding open a
larger number of files at any one time (and become deleted when the
IndexWriter removes old segments).

This growth in the number of segments isn't unbounded though (because
of segment merges).  Your 10,000 descriptors should be sufficient.

-Yonik


> Fortunately, the check-ins of new documents are seldom. The server (Tomcat)
> was restarted (due to different software updates) relatively oft in the last
> weeks...  So, we had no yet the possibility to reach this limit. But the
> default open file limit (1024) was already reached several times (before we
> increase it)…
>
> Thanks for your help !
> Alexey

Mime
View raw message