Mailing-List: contact lucene-user-help@jakarta.apache.org; run by ezmlm
Precedence: bulk
Reply-To: "Lucene Users List" <lucene-user@jakarta.apache.org>
Received-SPF: pass (hermes.apache.org: local policy)
Message-ID: <20040922153750.80116.qmail@web53008.mail.yahoo.com>
Date: Wed, 22 Sep 2004 08:37:50 -0700 (PDT)
From: Edwin Tang <emttang@yahoo.com>
Subject: Fwd: Questions related to closing the searcher
To: lucene-user@jakarta.apache.org
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii

Hello,

In my testing, it seems like if the searcher (in my
case ParallelMultiSearcher) is not closed, the
searcher will not pick up any new data that has been
added to the index since it was opened. I'm wondering
if this is a correct statement.

Assuming the above is true, I went about closing the
searcher with searcher.close(), then setting both the
searcher and QueryParser to null, then did a
System.gc(). The application will sleep for a set
period of time, then resumes to process another batch
of queries against the index. When the application
resumes, the following method is ran:

    /**
     * Creates a {@link ParallelMultiSearcher} and
{@link QueryParser} if they
     * do not already exist.
     *
     * @return  0 if successful or the objects already
exist; -1 if failed.
     */
    private int getSearcher() {
        Analyzer analyzer;
        IndexSearcher[] searchers;
        int iReturn;
        Vector vector;
        if (logger.isDebugEnabled())
            logger.debug("Entering getSearcher()");
        if (searcher == null || parser == null) {
            analyzer = new
CIAnalyzer(utility.sStopWordsFile);
            try {
                vector = new Vector();
                if (utility.bSearchAMX)
                    vector.add(new
IndexSearcher(utility.amxIndexDir));
                if (utility.bSearchCOMTEX)
                    vector.add(new
IndexSearcher(utility.comtexIndexDir));
                if (utility.bSearchDJNW)
                    vector.add(new
IndexSearcher(utility.djnwIndexDir));
                if (utility.bSearchMoreover)
                    vector.add(new
IndexSearcher(utility.moreoverIndexDir));
                searchers = (IndexSearcher[])
vector.toArray(new IndexSearcher[vector.size()]);
                searcher = new
ParallelMultiSearcher(searchers);
                parser = new QueryParser("body",
analyzer);
                iReturn = 0;
            } catch (IOException ioe) {
                logger.error("Error creating
searcher", ioe);
                iReturn = -1;
            } catch (Exception e) {
                logger.error("Unexpected error while
creating searcher", e);
                iReturn = -1;
            }
        } else
            iReturn = 0;
        if (logger.isDebugEnabled())
            logger.debug("Exitng getSearcher() with "
+ iReturn);
        return iReturn;
    } // End method getSearcher()

This seems to get me around the problem where the
searcher was not picking up new data from the index.
However, I would run out of memory after 8 iterations
of the application processing a batch query, sleeping,
process another batch query, sleep, etc.

I'm probably missing something completely obvious, but
I'm just not seeing it. Can someone please tell me
what I'm doing wrong?

Thanks,
Ed


__________________________________
Do you Yahoo!?
Yahoo! Mail - 50x more storage than other providers!
http://promotions.yahoo.com/new_mail

---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org