Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of thomas.becker@net-m.de
 designates 62.214.145.243 as permitted sender)
Message-ID: <4AAFB9C7.90508@net-m.de>
Date: Tue, 15 Sep 2009 17:59:03 +0200
From: Thomas Becker <thomas.becker@net-m.de>
User-Agent: Thunderbird 2.0.0.23 (Macintosh/20090812)
MIME-Version: 1.0
To: java-user@lucene.apache.org
Subject: Re: lucene 2.9.0RC4 slower than 2.4.1?
References: <4AAF96E6.7000909@net-m.de> <4AAF9700.9010509@net-m.de>
 <4AAF98D1.5010207@net-m.de> <4AAF9B03.1040708@gmail.com>
 <4AAF9F17.2030307@net-m.de> <4AAFA0EA.2090300@gmail.com>
 <4AAFA800.5040600@net-m.de> <4AAFAA41.1070103@gmail.com>
 <4AAFAC95.4050307@gmail.com> <4AAFB183.4070006@net-m.de>
 <4AAFB2EB.4020403@gmail.com>
In-Reply-To: <4AAFB2EB.4020403@gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit


Mark Miller wrote:
> Thomas Becker wrote:
>> Hey Mark,
>>
>> yes. I'm running the app on unix. You see the difference between 2.9 and 2.4 here:
>>
>> http://ankeschwarzer.de/tmp/graph.jpg
>>   
> Right - I know your measurements showed a difference (and will keep that
> in mind) - but the profiling results then seem
> oddly similar.
Ok, got your point and agree.
> 
>> 2.4 responds much quicker thus increasing throughput severly. I'm having a
>> single segment only:
>>
>> -rw-r--r-- 1 asuser asgroup         20 Sep  9 16:40 segments.gen
>> -rw-r--r-- 1 asuser asgroup        294 Sep  9 16:44 segments_1o
>> -rw-r--r-- 1 asuser asgroup 2810603184 Sep  9 16:44 _7c.cfs
>>
>> The FileChannel.read hotspot is indeed strange. Especially if taking into
>> account that the index is lying on a tmpfs (in memory). And 2.4 should be using
>> NIOFSDirectory as well?! Will check that.
>>   
> 2.4 did not use NIOFSDirectory by default - you would have had to
> manually specified it. Now its used by default if its detects a non
> Windows OS.
Yes, I've checked that in the sources. I'm right now building the app and will
try it with SimpleFSDirectory. FSDirectory.open is replaced with new
SimpleFSDirectory. Will collect and post the results tomorrow. Seems to be a tad
faster. Details and new profiling data tomorrow. Have to leave now, sorry.
> 
> Any particular reason your profiling output does not show invocations?
> Its not essential most likely, but I've found it to be helpful in
> comparisons.
Yes, I reduced the profiler's impact on performance. It got horribly slow with
my usual profiling settings as soon as I included the org.apache.lucene files.
> 
> We are about to release 2.9, and its been such a long haul, I'd hate to
> see a release with an unknown performance trap.
> 
And me too. Doing my best to find the issue. :)
-- 
Thomas Becker
Senior JEE Developer

net mobile AG
Zollhof 17
40221 D�sseldorf
GERMANY

Phone:    +49 211 97020-195
Fax:      +49 211 97020-949
Mobile:   +49 173 5146567 (private)
E-Mail:   mailto:thomas.becker@net-m.de
Internet: http://www.net-m.de

Registergericht:  Amtsgericht D�sseldorf, HRB 48022
Vorstand:         Theodor Niehues (Vorsitzender), Frank Hartmann,
                 Kai Markus Kulas, Dieter Plassmann
Vorsitzender des
Aufsichtsrates:   Dr. Michael Briem

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org