lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adrien Grand <jpou...@gmail.com>
Subject Re: Merging ordered segments without re-sorting.
Date Thu, 24 Oct 2013 09:08:49 GMT
Hi,

On Thu, Oct 24, 2013 at 12:20 AM, Arvind Kalyan <base16@gmail.com> wrote:
> I will benchmark the available approach itself then, in that case. Will
> revert back if the performance in unacceptable.

For the record, last time I checked, indexing was 2x slower on average
on a 10M document collection (see
https://issues.apache.org/jira/browse/LUCENE-4752?focusedCommentId=13605896&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13605896)
and most of the time was not actually spent in sorting the doc IDs but
merging stored fields (because we by-pass the specialized sequential
merging impl which is usually used when merging segment without
sorting).

-- 
Adrien

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message