lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Earwin Burrfoot <ear...@gmail.com>
Subject Re: Optimization and Corruption Issues
Date Thu, 01 Oct 2009 18:56:03 GMT
>> If you're doing a full optimize, you're still using a single thread. Am I wrong?
>
> Depends on how many merges are required, and, the merge scheduler.  In
> this case (w/ 7000 segments, which is way too many, normally!),
> assuming ConcurrentMergeScheduler, multiple threads will be used since
> many merges will be pending.
>
> When it gets down to the last (enormous) merge, it's only one thread.
I'm speaking about full optimize. Is there any way to do it more
efficiently then running a single, last (enormous) merge?
If you try to parallelize, you're merging some documents several times
(more work) and killing your disks, as merges are mostly IO-bound.


-- 
Kirill Zakharenko/Кирилл Захаренко (earwin@gmail.com)
Home / Mobile: +7 (495) 683-567-4 / +7 (903) 5-888-423
ICQ: 104465785

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message