Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of earwin@gmail.com designates
 209.85.216.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=liUenmQF3QilFhXXvuMlTfQHs23HORT1cmmlYyZ8wBjgxFEQcjpJMUjEp2Yl1YRRc1
         GL52k9GRRN7qhtuvx9IjA6+Qt2Ixx5/MzHK2vDhZF7+LANQOyVzlGruwMTiEPxAoJcCa
         MHLyULR2t+RR7Obh/7hYwyc//gQpxhCUssoN8=
MIME-Version: 1.0
In-Reply-To: <BANLkTik7SKQ_H=yYNZerccxtmBuHbB2_1w@mail.gmail.com>
References: <BANLkTi=Hfij8uMNnVPu1v9QbktSKRzpYvg@mail.gmail.com>
	<BANLkTimKzfU6uOmAu=-NP-Nf00gMbcx2Hw@mail.gmail.com>
	<BANLkTimu8xcUXiAStijs_8z0YDfo9Pz_jg@mail.gmail.com>
	<BANLkTinRxGpFU5q5easQoXu4wjUc8fKUmA@mail.gmail.com>
	<BANLkTik7SKQ_H=yYNZerccxtmBuHbB2_1w@mail.gmail.com>
Date: Thu, 14 Apr 2011 21:23:26 +0400
Message-ID: <BANLkTimUSAUhmAdzV+zMD0Ajaev4XDDhyA@mail.gmail.com>
Subject: Re: Setting the max number of merge threads across IndexWriters
From: Earwin Burrfoot <earwin@gmail.com>
To: dev@lucene.apache.org, simon.willnauer@gmail.com
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Can't remember. Probably no. I started an experimental MS api rewrite
(incorporating ability to share MSs between IWs) some time ago, but
never had the time to finish it.

On Thu, Apr 14, 2011 at 19:56, Simon Willnauer
<simon.willnauer@googlemail.com> wrote:
> On Thu, Apr 14, 2011 at 5:52 PM, Earwin Burrfoot <earwin@gmail.com> wrote=
:
>> I proposed to decouple MergeScheduler from IW (stop keeping a
>> reference to it). Then you can create a single CMS and pass it to all
>> your IWs.
> Yep that was it... is there an issue for this?
>
> simon
>>
>> On Thu, Apr 14, 2011 at 19:40, Jason Rutherglen
>> <jason.rutherglen@gmail.com> wrote:
>>> I think the proposal involved using a ThreadPoolExecutor, which seemed
>>> to not quite work as well as what we have. =C2=A0I think it'll be easie=
r to
>>> simply pass a global context that keeps a counter of the actively
>>> running threads, and pass that into each IW's CMS?
>>>
>>> On Thu, Apr 14, 2011 at 8:25 AM, Simon Willnauer
>>> <simon.willnauer@googlemail.com> wrote:
>>>> On Thu, Apr 14, 2011 at 5:20 PM, Jason Rutherglen
>>>> <jason.rutherglen@gmail.com> wrote:
>>>>> Today the ConcurrentMergeScheduler allows setting the max thread
>>>>> count and is bound to a single IndexWriter.
>>>>>
>>>>> However in the [common] case of multiple IndexWriters running in
>>>>> the same process, this disallows one from managing the aggregate
>>>>> number of merge threads executing at any given time.
>>>>>
>>>>> I think this can be fixed, shall I open an issue?
>>>>
>>>> go ahead! I think I have seen this suggestion somewhere maybe you need
>>>> to see if there is one already
>>>>
>>>> simon
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>>>>
>>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>>>
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>>
>>>
>>
>>
>>
>> --
>> Kirill Zakharenko/=D0=9A=D0=B8=D1=80=D0=B8=D0=BB=D0=BB =D0=97=D0=B0=D1=
=85=D0=B0=D1=80=D0=B5=D0=BD=D0=BA=D0=BE
>> E-Mail/Jabber: earwin@gmail.com
>> Phone: +7 (495) 683-567-4
>> ICQ: 104465785
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>


--=20
Kirill Zakharenko/=D0=9A=D0=B8=D1=80=D0=B8=D0=BB=D0=BB =D0=97=D0=B0=D1=85=
=D0=B0=D1=80=D0=B5=D0=BD=D0=BA=D0=BE
E-Mail/Jabber: earwin@gmail.com
Phone: +7 (495) 683-567-4
ICQ: 104465785

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org