lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (JIRA)" <>
Subject [jira] [Commented] (LUCENE-2571) Indexing performance tests with realtime branch
Date Fri, 15 Apr 2011 08:04:06 GMT


Simon Willnauer commented on LUCENE-2571:

bq. Well.. merges tie up IO (especially if not on fancy SSDs/RAIDs), which in turn lags flushes
-> bigger delays for stop the world flushes / lower bandwith cap (after which they are
forced to stop the world) for parallel flushes.

True it will make a difference in certain situations but not for this benchmark RT does way
more merges here since we are flushing way more segments. the time windows I used here is
where we almost don't merge at all in the trunk run so it should not make a difference.

I ran those benchmarks again with BalancedSegmentMergePolicy and it doesn't make any difference
really. see below

> Indexing performance tests with realtime branch
> -----------------------------------------------
>                 Key: LUCENE-2571
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Task
>          Components: Index
>            Reporter: Michael Busch
>            Priority: Minor
>             Fix For: Realtime Branch
>         Attachments: wikimedium.realtime.Standard.nd10M_dps.png, wikimedium.realtime.Standard.nd10M_dps_addDocuments.png,
wikimedium.realtime.Standard.nd10M_dps_addDocuments_flush.png, wikimedium.trunk.Standard.nd10M_dps.png,
wikimedium.trunk.Standard.nd10M_dps_BalancedSegmentMergePolicy.png, wikimedium.trunk.Standard.nd10M_dps_addDocuments.png
> We should run indexing performance tests with the DWPT changes and compare to trunk.
> We need to test both single-threaded and multi-threaded performance.
> NOTE:  flush by RAM isn't implemented just yet, so either we wait with the tests or flush
by doc count.

This message is automatically generated by JIRA.
For more information on JIRA, see:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message