lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Erick Erickson" <>
Subject Re: index file size threshold affecting search performance?
Date Wed, 28 Mar 2007 19:11:06 GMT
This surprises me, I'm currently working with a 4G index, and the
improvement from when it was an 8G index was only 10% or so.
And it's plenty speedy.

Are you hitting hardware limitations and perhaps swapping like
crazy? In which case, unless you split things across several
machines, I doubt it would help to make two smaller indexes.

In sum, I really suspect that you're NOT hitting a Lucene limitation,
but it's something else about your system....


On 3/28/07, Scott Oshima <> wrote:
> So I assumed a linear decay of performance as an index got bigger.
> For some reason when going from an index size of 1.89 to 1.95 gigs
> dramatically increased cpu across all of our servers.
> I was thinking of splitting the 1.95 index into 2 separate indexes  and
> using a multisearcher on those parts?
> thanks.
> -scott

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message