lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (JIRA)" <>
Subject [jira] [Commented] (LUCENE-2571) Indexing performance tests with realtime branch
Date Thu, 14 Apr 2011 16:23:05 GMT


Simon Willnauer commented on LUCENE-2571:

I run batch indexing benchmarks trunk vs. realtime branch with addDocument and with updateDocument.

For add document I indexed 10M wikipedia docs into a spinning disk reading from a separate

Here is the realtime graph:

vs. trunk:

This graph shows how DWPT is flushing to disk over time:


for updateDocument I build a 10M docs wiki index and indexed the exact same documents with
updateDocument here are the results:
Realtime Branch:


> Indexing performance tests with realtime branch
> -----------------------------------------------
>                 Key: LUCENE-2571
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Task
>          Components: Index
>            Reporter: Michael Busch
>            Priority: Minor
>             Fix For: Realtime Branch
>         Attachments: wikimedium.realtime.Standard.nd10M_dps.png, wikimedium.realtime.Standard.nd10M_dps_addDocuments.png,
wikimedium.realtime.Standard.nd10M_dps_addDocuments_flush.png, wikimedium.trunk.Standard.nd10M_dps.png,
> We should run indexing performance tests with the DWPT changes and compare to trunk.
> We need to test both single-threaded and multi-threaded performance.
> NOTE:  flush by RAM isn't implemented just yet, so either we wait with the tests or flush
by doc count.

This message is automatically generated by JIRA.
For more information on JIRA, see:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message