Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type;
  b=Xfm+CJ8kaxhl9vF8LL5Niny5kxwA6BkZF7IXpAQ4aFoIWnIbemLZTCln5bWTvHlKmlmqms2krbVFrUQTLpJRn00G2sS1SX4iktGDWOQF2Iz7yMCdisoJ5h3RIcT8F3mN6XrcNggJLi5pOn5eTWb2WZgHFNZav3bNdscAh94+ZTs=;
References: <1352285913.38911.YahooMailNeo@web120703.mail.ne1.yahoo.com>
 <1352378424.28023.YahooMailNeo@web120703.mail.ne1.yahoo.com>
 <CAEY5pxW-+bCeiRRDRqxh2X8G7ciCLAr10ZXpFG4QqUvzLVhNMg@mail.gmail.com>
Message-ID: <1352475709.80385.YahooMailNeo@web120704.mail.ne1.yahoo.com>
Date: Fri, 9 Nov 2012 07:41:49 -0800 (PST)
From: kiwi clive <kiwi_clive@yahoo.com>
Reply-To: kiwi clive <kiwi_clive@yahoo.com>
Subject: Re: Lucene 3.6.0 high CPU usage
To: "java-user@lucene.apache.org" <java-user@lucene.apache.org>
In-Reply-To: 
 <CAEY5pxW-+bCeiRRDRqxh2X8G7ciCLAr10ZXpFG4QqUvzLVhNMg@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
 boundary="1167350687-1285890873-1352475709=:80385"

--1167350687-1285890873-1352475709=:80385
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

Hi Ian,=0AYes I/O ->CPU, but read on...=0A=0AThe throughput is about the sa=
me with similar i/o and 20% higher CPU. We have plenty of CPU and I would r=
ather be cpu bound, thean i/o bound.=0A=0A=0AHowever, we have increased the=
 number of indexing threads in our application. On Lucene 2.3.2, this gave =
no performance improvement as the I/O just increased. However,=A0 lucene 3.=
6.0 ramps up the CPU (user) usage while I/O only increases marginally. =0A=
=0A=0AOur throughput has trebled !! - amazing improvement, and all in CPU s=
pace.=0A=0A=0ASo it appears there have been a lot of performance improvemen=
ts made in the new version that I was not previously using, the Ferrari was=
 in first gear and now we are taking advantage of these features.=0A=0AThis=
 is truly phenominal step-change in throughput, thank you Lucene developers=
 !=0A=0AClive=0A=0A=0A=0A________________________________=0A From: Ian Lea =
<ian.lea@gmail.com>=0ATo: java-user@lucene.apache.org; kiwi clive <kiwi_cli=
ve@yahoo.com> =0ASent: Friday, November 9, 2012 10:04 AM=0ASubject: Re: Luc=
ene 3.6.0 high CPU usage=0A =0AAre you getting the same, improved or worse =
performance/throughput?=0AHas the bottleneck switched from IO to CPU?=0A=0A=
=0A--=0AIan.=0A=0A=0AOn Thu, Nov 8, 2012 at 12:40 PM, kiwi clive <kiwi_cliv=
e@yahoo.com> wrote:=0A> Having played with merge parameters and various ind=
ex parameters, it seems possible to change the I/O usage at the cost of the=
 number of index files. However, it does appear that this version of lucene=
 is using more CPU.=A0 Is there any reason for this ? is it normal ? We can=
 push a large amount of documents through the indexer and it seams to work =
admirably although I would be happier if the load average came down.=0A>=0A=
> Any lucene devs out there who could shed some light on this behaviour ?=
=0A>=0A>=0A> Thanks,=0A> Clive=0A>=0A>=0A> ________________________________=
=0A>=A0 From: kiwi clive <kiwi_clive@yahoo.com>=0A> To: "java-user@lucene.a=
pache.org" <java-user@lucene.apache.org>=0A> Sent: Wednesday, November 7, 2=
012 10:58 AM=0A> Subject: Lucene 3.6.0 high CPU usage=0A>=0A> Hi Guys,=0A>=
=0A> Having upgraded from lucene2.3.2 to lucene3.6.0 and jumping through a =
few hoops, we note that the CPU usage on the new version is perhaps 20-30% =
higher. The i/o wait appears about the same on both versions.=0A>=0A> Can a=
nyone suggest why this should be so or is the newer lucene version just mor=
e CPU hungry? If not, any tuning suggestions to reduce CPU usage would be g=
ratefully received !=0A>=0A> Thanks=0A> Clive=0A=0A------------------------=
---------------------------------------------=0ATo unsubscribe, e-mail: jav=
a-user-unsubscribe@lucene.apache.org=0AFor additional commands, e-mail: jav=
a-user-help@lucene.apache.org
--1167350687-1285890873-1352475709=:80385--