Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of torindan@gmail.com designates
 209.85.216.48 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type;
        b=QEXblrh70tCV4s3wdbTT/znCs9oBF59sQAKgxMqVPpNG8eGwJxaw70KID4aCeYmAT3
         tFfoUYcvdOmNQ4ULaNYiFtH7rqRl2rxPmGavGc9+LFpS2ET9eBHxQ8MGW3YyYsAyeIir
         /mMaoVYN/7uB/N14eDOeyHlpUt/QhYNMK5sr4=
MIME-Version: 1.0
In-Reply-To: 
 <ED081AC9AEEE0248BBCCDE9989AAE3FC02CB1695@rw-ex2003.BROADVISION.COM>
References: 
 <ED081AC9AEEE0248BBCCDE9989AAE3FC02CB1694@rw-ex2003.BROADVISION.COM>
 <ED081AC9AEEE0248BBCCDE9989AAE3FC02CB1695@rw-ex2003.BROADVISION.COM>
From: =?UTF-8?B?RGFuaWwgxaJPUklO?= <torindan@gmail.com>
Date: Fri, 24 Sep 2010 10:01:08 +0300
Message-ID: <AANLkTimJgBaTkr8+fS3NoyS2c63VD_UZncZsUQk+EKmK@mail.gmail.com>
Subject: Re: In lucene 2.3.2, needs to stop optimization?
To: java-user@lucene.apache.org
Content-Type: text/plain; charset=UTF-8

Is it possible for you to migrate to 2.9.x ? Or even 3.x ?
There are some huge optimization in 2.9 on reopening indexes that
significantly improve search speed.

I'm not sure..but I think indexWriter.getReader() for almost realtime
was added to 2.9, so you can keep your writer always open and get very
cheaply a new reader on each search request.

On Fri, Sep 24, 2010 at 09:47, Zhang, Lisheng
<Lisheng.Zhang@broadvision.com> wrote:
> Hi,
>
> I read document/code and did some experiments, one possibility
> is to raise mergeFactor to high value, say close to 2Billion,
> then a lot of small files are created and after >500 docs are
> created separately, search speed dropped sharply.
>
> I noticed with our current data, if I add one doc then call
> optimize(), it took about 7s, this is too slow for real time
> search.
>
> If I keep mergeFactor as 10 and donot call optimize(), does it
> mean from time to time IndexWriter would optimize on background,
> when it happens, it may take a few seconds (so Index will delay
> a few seconds)?
>
> Should I use high mergeFactor and optimize once a day, or use
> default mergeFactor and donot call optimize? maybe latter is
> better, but I am concerned about occasional slowness?
>
> Currently I donot plan to keep IndexWriter constantly open, but
> open/close for each index request.
>
> Any suggestion to improve would be appreciated,
>
> Lisheng
>
> -----Original Message-----
> From: Zhang, Lisheng [mailto:Lisheng.Zhang@BroadVision.com]
> Sent: Thursday, September 23, 2010 6:11 PM
> To: java-user@lucene.apache.org
> Subject: In lucene 2.3.2, needs to stop optimization?
>
>
> Hi,
>
> We are using lucene 2.3.2, now we need to index each document as
> fast as possible, so user can almost immediately search it.
>
> So I am considering stop IndexWriter optimization during real time,
> then in relatively off-time like late night we may call IndexWriter optimize
> method explicitly once.
>
> What is the most efficient way to completely turn off IndexWriter merge
> in lucene 2.3.2?
>
> Thanks very much for helps, Lisheng
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org