lucene-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <ted.dunn...@gmail.com>
Subject Re: Performance Optimizations and Expected Benchmark Results
Date Sun, 29 Aug 2010 18:03:21 GMT
I think you missed Jenny's point.

She was asking whether you could buffer up a hundred or a thousand (or more)
items and index
them all at once.  This doesn't require that you go to the data store, just
that you have a buffer
that sticks around for a few minutes (or seconds from your apparent indexing
rate).

On Sun, Aug 29, 2010 at 1:06 AM, Ron Ratovsky <ronr@correlsense.com> wrote:

> The indexing is done synchronously to saving the data.
> Doing it asynchronously works slower since then the data to be indexed
> needs
> to be read from the data store, which is slower.
>
> On Thu, Aug 26, 2010 at 18:58, Jenny Brown <skywind@gmail.com> wrote:
>
> > Do you index as you go along, or do you batch your updates to the
> > index?  Sometimes doing a large batch at once can improve total
> > throughput, compared with singles.
> >
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message