lucene-solr-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yonik Seeley <>
Subject Re: indexing slowdown with latest lucene udpate
Date Sun, 09 Aug 2009 16:57:12 GMT
OK, I've isolated (magnified) the effect with a test I just checked in.
Indexing documents directly at the UpdateHandler was 85% faster before
the latest lucene update.

Run the test like this:

ant test -Dtestcase=TestIndexingPerformance -Dargs="-server
-Diter=100000"; grep throughput

To run on an older trunk version, just copy over

I had a throughput of 10946 docs/sec before the lucene update, and 5849 after.


On Sun, Aug 9, 2009 at 12:10 PM, Yonik Seeley<> wrote:
> On Sun, Aug 9, 2009 at 12:01 PM, Grant Ingersoll<> wrote:
>> Or bite the bullet and upgrade to the incrementToken() method.
> Right - I'm not sure if that would fix it or not - I haven't been
> involved in the new Token attribute stuff...
> I'm currently writing a basic indexing unit test that we can use to
> measure this (the standard solrconfig does stuff that slows down
> indexing a lot, but helps in catching bugs on edge cases by creating
> many segments).
> -Yonik

View raw message