Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of erickerickson@gmail.com
 designates 209.85.160.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <SNT139-W7C012329C9AE3BB791A2DBD2E0@phx.gbl>
References: <SNT139-W7C012329C9AE3BB791A2DBD2E0@phx.gbl>
Date: Wed, 24 Aug 2011 12:34:25 -0400
Message-ID: 
 <CAN4YXvfVOPC9emQZDNATHd1E3bqBQ6BrLrBqYVXeApLYPkUBAQ@mail.gmail.com>
Subject: Re: Need help with lucene 3.2/3.2
From: Erick Erickson <erickerickson@gmail.com>
To: dev@lucene.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

This question is probably better suited to the user's list, this list is fo=
r
internal Lucene developers...

But at a guess, your'e on a *nix system, and you're not closing the old
searchers correctly, leaving open files around. A quick check would be
to see if the files disappear when you restart your server....

If you use reopen, be sure you close the old searcher, that's not done
automatically by reopen you have to do it yourself if the underlying
reader, there's an example in the API at:

http://lucene.apache.org/java/3_0_0/api/core/org/apache/lucene/index/IndexR=
eader.html#reopen()

And if this turns out to not to help, could you post further questions over=
 on
the user's list?

Best
Erick

On Tue, Aug 23, 2011 at 7:05 PM, Wilson Penha Jr.
<wilsonpenha@hotmail.com> wrote:
>
>
> Hello there
> I need some help with a odd behave with Lucene since version 2.9
> I have a project with Lucene 2.41 that runs fine with 600k document where=
 I
> use two index folder to separate two set of index, one primary and anothe=
r
> one secondary, this allow me to switch the indexreader/indexsearcher by t=
he
> time I want to build a fresh index and also keep a safe copy of it,
> While I am using Lucene 2.4.1 I have no problem with my application
> regarding have a web application hitting many time the searcher, which is
> shared, when I have to switch the index, I do check which one is stale an=
d
> then close the old one and open the new one, even having many threads int=
o
> my container, it can=A0safely close and open this, without having any
> problem.
> This days, since version 3 arrives, I've being trying to upgrade my
> application for all matters, by the end of this, everything seems OK, BUT
> DID NOT,
> I used JMeter to put it to burn, then I got this :
> java =A0 =A012650 root =A0290r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 70277718 =A0 =A06193160
> /index/secondary/spell/_12.frq (deleted)
> java =A0 =A012650 root =A0291r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 31312083 =A0 =A06193167
> /index/secondary/spell/_10.prx
> java =A0 =A012650 root =A0292r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 24031741 =A0 =A06193158
> //index/secondary/spell/_12.tis (deleted)
> java =A0 =A012650 root =A0293r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 24031741 =A0 =A06193158
> /index/secondary/spell/_12.tis (deleted)
> java =A0 =A012650 root =A0294r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 70277718 =A0 =A06193160
> /index/secondary/spell/_12.frq (deleted)
> java =A0 =A012650 root =A0295r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 24031741 =A0 =A06193158
> /index/secondary/spell/_12.tis (deleted)
> java =A0 =A012650 root =A0296r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 25261490 =A0 =A06193159
> /index/secondary/spell/_10.fdt
> java =A0 =A012650 root =A0297r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 =A06180968 =A0 =A06193162
> /index/secondary/spell/_12.nrm (deleted)
> java =A0 =A012650 root =A0298r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 12366572 =A0 =A06193163
> /index/secondary/spell/_10.fdx
> java =A0 =A012650 root =A0299r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 31296075 =A0 =A06193161
> /index/secondary/spell/_12.prx (deleted)
> java =A0 =A012650 root =A0300r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 25249792 =A0 =A06193156
> /index/secondary/spell/_12.fdt (deleted)
> java =A0 =A012650 root =A0301r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 12361932 =A0 =A06193157
> /index/secondary/spell/_12.fdx (deleted)
> java =A0 =A012650 root =A0311r =A0 REG =A0 =A0 =A0 =A0 =A0 =A0 253,11 =A0=
 =A06183288 =A0 =A06193168
> /index/secondary/spell/_10.nrm
> etc.......
> so, somehow my container keeps old indexsearcher/indexreader opened, even
> the files no longer exists, that making it to reach max open files from t=
he
> System, and you know what comes next.
> Even look like complex, for the time it grown the many file opened is inv=
ert
> when use Lucene 2.4.1, which manage and close all old
> indexsearcher/indexreader and keeping clean the opened files from lsof
> command from linux, where I run this application
> As I can not change my entire application to use Solr, which seems to hav=
e a
> good approach, and I also can not walk back to Lucene 2.4.1 and let it th=
ere
> forever, I ask for help here.
> If anyone from there can help me, please let me know
> Best regards and very thanks in advanced
> Wilson
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org