lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael McCandless <>
Subject Re: Throttling merges
Date Sat, 18 Jul 2009 16:12:14 GMT
The goal is to be like "ionice" right?  Meaning, lower the priority of
IO caused by merging?  I agree that makes sense.

I wonder if we could implement it in the Directory level, so that when
openInput/createOutput is called we can optionally specify the
"context" (reader, merging, writer, etc.), and then somehow add
throttling in there.


On Sat, Jul 18, 2009 at 10:37 AM, Jason
Rutherglen<> wrote:
> It may be useful to allow users to throttle merges. A callback
> that IW passes into SegmentMerger would suffice where individual
> SM methods make use of the callback. I suppose this could slow
> down overall merging by adding a potentially useless method
> call. However if merging typically consumes IO resources for an
> extended period of time, this offers a way for the user to tune
> IO consumption and at preferred times free up IO for other
> tasks.
> ---------------------------------------------------------------------
> To unsubscribe, e-mail:
> For additional commands, e-mail:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message