lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-2571) Indexing performance tests with realtime branch
Date Fri, 15 Apr 2011 06:29:05 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13020206#comment-13020206
] 

Simon Willnauer commented on LUCENE-2571:
-----------------------------------------

bq. Would you consider trying other MergePolicy objects on trunk? The BalancedSegment MP tries
to avoid these long stoppages.

I think there is a misunderstanding on your side. The long stoppages on trunk are not due
to merges at all. They are due to flushing the DocumentsWriter which essentially means stop
the world. This is why we can not make any progress. Merges are NOT blocking indexing on trunk
no matter which MP you use. The Balanced MP is rather suited for RT environments to make reopening
the reader quicker. 

you should maybe look at this blog entry for a more complete explanation: http://blog.jteam.nl/2011/04/01/gimme-all-resources-you-have-i-can-use-them/

> Indexing performance tests with realtime branch
> -----------------------------------------------
>
>                 Key: LUCENE-2571
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2571
>             Project: Lucene - Java
>          Issue Type: Task
>          Components: Index
>            Reporter: Michael Busch
>            Priority: Minor
>             Fix For: Realtime Branch
>
>         Attachments: wikimedium.realtime.Standard.nd10M_dps.png, wikimedium.realtime.Standard.nd10M_dps_addDocuments.png,
wikimedium.realtime.Standard.nd10M_dps_addDocuments_flush.png, wikimedium.trunk.Standard.nd10M_dps.png,
wikimedium.trunk.Standard.nd10M_dps_addDocuments.png
>
>
> We should run indexing performance tests with the DWPT changes and compare to trunk.
> We need to test both single-threaded and multi-threaded performance.
> NOTE:  flush by RAM isn't implemented just yet, so either we wait with the tests or flush
by doc count.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message