Return-Path: Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: (qmail 44342 invoked from network); 14 Apr 2011 15:56:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 14 Apr 2011 15:56:55 -0000 Received: (qmail 17008 invoked by uid 500); 14 Apr 2011 15:56:54 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 16956 invoked by uid 500); 14 Apr 2011 15:56:54 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 16949 invoked by uid 99); 14 Apr 2011 15:56:54 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Apr 2011 15:56:54 +0000 X-ASF-Spam-Status: No, hits=2.1 required=5.0 tests=FREEMAIL_FROM,FREEMAIL_REPLYTO,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of simon.willnauer@googlemail.com designates 209.85.212.48 as permitted sender) Received: from [209.85.212.48] (HELO mail-vw0-f48.google.com) (209.85.212.48) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Apr 2011 15:56:47 +0000 Received: by vws7 with SMTP id 7so2242598vws.35 for ; Thu, 14 Apr 2011 08:56:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:mime-version:reply-to:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=bkdQ8z6sQs9miJUYH6etsyz07hzKGe08/TId35E4d84=; b=xgObjvnwgTYGxyZBvPivusIhN7aP2pw/csqEbDny0o03zwFvZ0T27Q1SbBjOA0ZwbT CdGpYFvFYIKpm4xNsrOlxnvWKjp6CMxSO1ZQR0FHeynyvys5KWncAvYu8sHaAqm/PQmt Cn6avnTdr5TwzjR6B2pCG1pCHIBZSfiQYBDYI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=mime-version:reply-to:in-reply-to:references:date:message-id :subject:from:to:content-type:content-transfer-encoding; b=dXpH6IeYTDARJqme+bOBMzPBTxGkHBcTF9JLsRPccdCKlspaO7Ud63J4b9oFdDMhDg 3CzCcZL1M5TisDsGXpYFgHQejbqL70VXYSCOAAHjjqdsO4IjBfNzqJR3vvJzxLKt9Ep1 GCx5nY/V95gr0e2NbQlwD4zkcSkRJ/axFhf1o= MIME-Version: 1.0 Received: by 10.52.18.103 with SMTP id v7mr1394375vdd.64.1302796585782; Thu, 14 Apr 2011 08:56:25 -0700 (PDT) Received: by 10.52.165.35 with HTTP; Thu, 14 Apr 2011 08:56:25 -0700 (PDT) Reply-To: simon.willnauer@gmail.com In-Reply-To: References: Date: Thu, 14 Apr 2011 17:56:25 +0200 Message-ID: Subject: Re: Setting the max number of merge threads across IndexWriters From: Simon Willnauer To: dev@lucene.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org On Thu, Apr 14, 2011 at 5:52 PM, Earwin Burrfoot wrote: > I proposed to decouple MergeScheduler from IW (stop keeping a > reference to it). Then you can create a single CMS and pass it to all > your IWs. Yep that was it... is there an issue for this? simon > > On Thu, Apr 14, 2011 at 19:40, Jason Rutherglen > wrote: >> I think the proposal involved using a ThreadPoolExecutor, which seemed >> to not quite work as well as what we have. =C2=A0I think it'll be easier= to >> simply pass a global context that keeps a counter of the actively >> running threads, and pass that into each IW's CMS? >> >> On Thu, Apr 14, 2011 at 8:25 AM, Simon Willnauer >> wrote: >>> On Thu, Apr 14, 2011 at 5:20 PM, Jason Rutherglen >>> wrote: >>>> Today the ConcurrentMergeScheduler allows setting the max thread >>>> count and is bound to a single IndexWriter. >>>> >>>> However in the [common] case of multiple IndexWriters running in >>>> the same process, this disallows one from managing the aggregate >>>> number of merge threads executing at any given time. >>>> >>>> I think this can be fixed, shall I open an issue? >>> >>> go ahead! I think I have seen this suggestion somewhere maybe you need >>> to see if there is one already >>> >>> simon >>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org >>>> For additional commands, e-mail: dev-help@lucene.apache.org >>>> >>>> >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org >>> For additional commands, e-mail: dev-help@lucene.apache.org >>> >>> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org >> For additional commands, e-mail: dev-help@lucene.apache.org >> >> > > > > -- > Kirill Zakharenko/=D0=9A=D0=B8=D1=80=D0=B8=D0=BB=D0=BB =D0=97=D0=B0=D1=85= =D0=B0=D1=80=D0=B5=D0=BD=D0=BA=D0=BE > E-Mail/Jabber: earwin@gmail.com > Phone: +7 (495) 683-567-4 > ICQ: 104465785 > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org > For additional commands, e-mail: dev-help@lucene.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org