Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (asf.osuosl.org: domain of peterlkeegan@gmail.com
 designates 64.233.184.196 as permitted sender)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
        s=beta; d=gmail.com;
        h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references;
        b=rzhJ9G9Z58Eu9PXFaa2TifER8pzzDaWpaM6evtecr+CRlRhr5qIWLScp9KrWu+LWNJag22/GHWTw5/vi/ZE9Gy0HRydvPeWCSHXlzCWykSBnez+MqBJ/o5Rs3oFo/j8sHg/JQr35xwysVzJgBxv89APTc0lvZFFa363YCR55CWs=
Message-ID: <e994873a0602221152q1bad1e52gdeb3477611d31916@mail.gmail.com>
Date: Wed, 22 Feb 2006 14:52:21 -0500
From: "Peter Keegan" <peterlkeegan@gmail.com>
To: java-user@lucene.apache.org
Subject: Re: Throughput doesn't increase when using more concurrent threads
In-Reply-To: <e994873a0601300615p5f46dab6qfb4b4504bfb2bd7f@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_871_9515906.1140637941351"
References: <GJEMKBFALLAJKLGINBHHKEHAKOAA.jbooth@net-temps.com>
	 <43820731.5000806@apache.org>
	 <fb9748c90601260043m3ed5e7fbh78ac7e23947a488f@mail.gmail.com>
	 <e994873a0601260756o58fb3b1ap3aa87df6de1ac0d7@mail.gmail.com>
	 <43D92935.1000809@apache.org> <43D92A28.6050501@apache.org>
	 <e994873a0601261320r753d864cwcb37b72e54539d09@mail.gmail.com>
	 <43DD6821.8020302@nuix.com.au>
	 <e994873a0601300615p5f46dab6qfb4b4504bfb2bd7f@mail.gmail.com>

------=_Part_871_9515906.1140637941351
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

I am doing a performance comparison of Lucene on Linux vs Windows.

I have 2 identically configured servers (8-CPUs (real) x 3GHz Xeon
processors, 64GB RAM). One is running CentOS 4 Linux, the other is running
Windows server 2003 Enterprise Edition x64. Both have 64-bit JVMs from Sun.
The Lucene server is using MMapDirectory. I'm running the jvm with
-Xmx16000M. Peak memory usage of the jvm on Linux is about 6GB and 7.8GB on
windows.

I'm observing query rates of 330 queries/sec on the Wintel server, but only
200 qps on the Linux box. At first, I suspected a network bottleneck, but
when I 'short-circuited' Lucene, the query rates were identical.

I suspect that there are some things to be tuned in Linux, but I'm not sure
what. Any advice would be appreciated.

Peter


On 1/30/06, Peter Keegan <peterlkeegan@gmail.com> wrote:
>
> I cranked up the dial on my query tester and was able to get the rate up
> to 325 qps. Unfortunately, the machine died shortly thereafter (memory
> errors :-( ) Hopefully, it was just a coincidence. I haven't measured 64-=
bit
> indexing speed, yet.
>
> Peter
>
> On 1/29/06, Daniel Noll <daniel@nuix.com.au> wrote:
> >
> > Peter Keegan wrote:
> > > I tried the AMD64-bit JVM from Sun and with MMapDirectory and I'm now
> > > getting 250 queries/sec and excellent cpu utilization (equal
> > concurrency on
> > > all cpus)!! Yonik, thanks for the pointer to the 64-bit jvm. I wasn't
> > aware
> > > of it.
> > >
> > Wow.  That's fast.
> >
> > Out of interest, does indexing time speed up much on 64-bit hardware?
> > I'm particularly interested in this side of things because for our own
> > application, any query response under half a second is good enough, but
> > the indexing side could always be faster. :-)
> >
> > Daniel
> >
> > --
> > Daniel Noll
> >
> > Nuix Australia Pty Ltd
> > Suite 79, 89 Jones St, Ultimo NSW 2007, Australia
> > Phone: (02) 9280 0699
> > Fax:   (02) 9212 6902
> >
> > This message is intended only for the named recipient. If you are not
> > the intended recipient you are notified that disclosing, copying,
> > distributing or taking any action in reliance on the contents of this
> > message or attachment is strictly prohibited.
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: java-user-help@lucene.apache.org
> >
> >
>

------=_Part_871_9515906.1140637941351--