Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: <AANLkTikehTReVUVhMYZB=riCjrd-9+K_SzYrT=Ww3KYA@mail.gmail.com>
References: <4CDD1BCA.5000700@mufin.com>
	<AANLkTikehTReVUVhMYZB=riCjrd-9+K_SzYrT=Ww3KYA@mail.gmail.com>
Date: Mon, 15 Nov 2010 13:14:43 -0500
Message-ID: <AANLkTik7JfVBubbp+wc-xYd-n4C1i5NBM=9kYGhHqF2H@mail.gmail.com>
Subject: Re: Deleted File Handles - Index Writer
From: Michael McCandless <lucene@mikemccandless.com>
To: java-user@lucene.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

OK I opened https://issues.apache.org/jira/browse/LUCENE-2762 for this issu=
e.

Mike

On Fri, Nov 12, 2010 at 5:21 PM, Michael McCandless
<lucene@mikemccandless.com> wrote:
> Are you using compound file format (the default)?
>
> If you turn that off (just for this test) do you still see that
> IndexWriter is holding open the files (35 in your example) after you
> close all readers?
>
> I've found a case, only with compound file, where IndexWriter holds
> open a SegmentReader on the pre-compound-file files... I'm working on
> a test case & fix.
>
> Mike
>
> On Fri, Nov 12, 2010 at 5:49 AM, Thomas Rewig <trewig@mufin.com> wrote:
>> =A0Hello,
>>
>> I use the searcherManager for LiveIndexing. With =A0watch -n 60 "lsof | =
grep
>> indexname | grep deleted | wc -l" I see the number of deleted file handl=
es.
>> The number of handles fluctuates during the indexing. =A00 -> 35 -> 53 -=
> 135
>> -> 40 -> 85 ... Uwe said that this is expected because segments are stil=
l
>> referenced by the open IndexReaders, but files were already deleted by
>> IndexWriter.
>>
>> But something puzzles me:
>>
>> Let's say we have a deleted file handle number of 85. If I switch the
>> NearRealTime Searcher to the readOnlySearcher the file handle number is
>> still 85. If i close afterwards the no more used indexwriter, the number
>> drops to 35. =A0I think that means, that the indexwriter referenced dele=
ted
>> files that are not referenced by the readers. =A0It seems, that with eve=
ry
>> commit the number of deleted file handles (which maybe are "caused" by t=
he
>> indexwriter) grows.
>> Is that possible and if yes why does the indexwriter do it? Is there a m=
ax
>> Value of deleted handles an IndexWriter could own, because I don't want =
to
>> chrash the system because of too much open filehandles?
>>
>> Thanks in advance.
>> Thomas
>> --
>>
>>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org