Mailing-List: contact java-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-dev@lucene.apache.org
Received-SPF: pass (herse.apache.org: domain of mike.klaas@gmail.com
 designates 66.249.92.170 as permitted sender)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
        s=beta; d=gmail.com;
        h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references;
        b=B993EMYCDkLtxokd7lrN2ab07KsdGEIe5wt05k0t8YHiZ7WH1cCmD3k5w/8QN9sZ4xG36fLAsUaoFHEIxWJfTvUaXVKiVEijCc1sI4bZD4c7GfJnXU0Tz7bwHyTVLixrsIlwwwfpLWTv3rePs5UgwjHPd1DJUrI7/RY8Sy+rGJo=
Message-ID: <3d2ce8cb0612151036s2bfcfc36i63f3c5003d5df0e@mail.gmail.com>
Date: Fri, 15 Dec 2006 10:36:52 -0800
From: "Mike Klaas" <mike.klaas@gmail.com>
To: java-dev@lucene.apache.org
Subject: Re: potential indexing perormance improvement for compound index -
 cut IO - have more files though
In-Reply-To: 
 <OF5B8C5104.C7E909AD-ON88257245.0023029F-88257245.00294C38@il.ibm.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
References: 
 <OF5B8C5104.C7E909AD-ON88257245.0023029F-88257245.00294C38@il.ibm.com>

On 12/14/06, Doron Cohen <DORONC@il.ibm.com> wrote:

> But anyhow, this is not a negligible difference, and for real large
> indexes, and busy systems, when the just written non-compound segment is
> not in the system caches, it might have more effect. Possibly, search
> performance during indexing would be improved by less indexing IO. Also,
> delay for addDocument call that triggers a merge should become smaller.
>
> Thanks for your comments, also (but not only) on (1) an (3) above.

My main comment is that the benefits of this change can be achieved by
using the non-compound index format.  For people that care about the
difference in performance, it isn't difficult to configure your system
to mitigate the problems of the non-compound format, and they probably
have already done so.

It would help the people who are file-descriptor conscious, but it
also increases lucene's fd footprint by a factor of four.

-Mike

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org