lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: Need help with lucene 3.2/3.2
Date Wed, 24 Aug 2011 16:34:25 GMT
This question is probably better suited to the user's list, this list is for
internal Lucene developers...

But at a guess, your'e on a *nix system, and you're not closing the old
searchers correctly, leaving open files around. A quick check would be
to see if the files disappear when you restart your server....

If you use reopen, be sure you close the old searcher, that's not done
automatically by reopen you have to do it yourself if the underlying
reader, there's an example in the API at:

http://lucene.apache.org/java/3_0_0/api/core/org/apache/lucene/index/IndexReader.html#reopen()

And if this turns out to not to help, could you post further questions over on
the user's list?

Best
Erick

On Tue, Aug 23, 2011 at 7:05 PM, Wilson Penha Jr.
<wilsonpenha@hotmail.com> wrote:
>
>
> Hello there
> I need some help with a odd behave with Lucene since version 2.9
> I have a project with Lucene 2.41 that runs fine with 600k document where I
> use two index folder to separate two set of index, one primary and another
> one secondary, this allow me to switch the indexreader/indexsearcher by the
> time I want to build a fresh index and also keep a safe copy of it,
> While I am using Lucene 2.4.1 I have no problem with my application
> regarding have a web application hitting many time the searcher, which is
> shared, when I have to switch the index, I do check which one is stale and
> then close the old one and open the new one, even having many threads into
> my container, it can safely close and open this, without having any
> problem.
> This days, since version 3 arrives, I've being trying to upgrade my
> application for all matters, by the end of this, everything seems OK, BUT
> DID NOT,
> I used JMeter to put it to burn, then I got this :
> java    12650 root  290r   REG             253,11   70277718    6193160
> /index/secondary/spell/_12.frq (deleted)
> java    12650 root  291r   REG             253,11   31312083    6193167
> /index/secondary/spell/_10.prx
> java    12650 root  292r   REG             253,11   24031741    6193158
> //index/secondary/spell/_12.tis (deleted)
> java    12650 root  293r   REG             253,11   24031741    6193158
> /index/secondary/spell/_12.tis (deleted)
> java    12650 root  294r   REG             253,11   70277718    6193160
> /index/secondary/spell/_12.frq (deleted)
> java    12650 root  295r   REG             253,11   24031741    6193158
> /index/secondary/spell/_12.tis (deleted)
> java    12650 root  296r   REG             253,11   25261490    6193159
> /index/secondary/spell/_10.fdt
> java    12650 root  297r   REG             253,11    6180968    6193162
> /index/secondary/spell/_12.nrm (deleted)
> java    12650 root  298r   REG             253,11   12366572    6193163
> /index/secondary/spell/_10.fdx
> java    12650 root  299r   REG             253,11   31296075    6193161
> /index/secondary/spell/_12.prx (deleted)
> java    12650 root  300r   REG             253,11   25249792    6193156
> /index/secondary/spell/_12.fdt (deleted)
> java    12650 root  301r   REG             253,11   12361932    6193157
> /index/secondary/spell/_12.fdx (deleted)
> java    12650 root  311r   REG             253,11    6183288    6193168
> /index/secondary/spell/_10.nrm
> etc.......
> so, somehow my container keeps old indexsearcher/indexreader opened, even
> the files no longer exists, that making it to reach max open files from the
> System, and you know what comes next.
> Even look like complex, for the time it grown the many file opened is invert
> when use Lucene 2.4.1, which manage and close all old
> indexsearcher/indexreader and keeping clean the opened files from lsof
> command from linux, where I run this application
> As I can not change my entire application to use Solr, which seems to have a
> good approach, and I also can not walk back to Lucene 2.4.1 and let it there
> forever, I ask for help here.
> If anyone from there can help me, please let me know
> Best regards and very thanks in advanced
> Wilson
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message