lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Miller <markrmil...@gmail.com>
Subject Re: lucene 2.9.0RC4 slower than 2.4.1?
Date Tue, 15 Sep 2009 20:18:00 GMT
Okay - using a smaller file, I get better results. I had about 2+ gig
available to cache the 700mb file, but I probably had fragmentation
issues - I just grabbed the first big file I had.

So its gets a little better for ChannelPread with the smaller file
(approx 160mb vs approx 700mb for the old tests). It goes up a bit over
400MB/sec - but oddly, I lose approx 400MB/sec from my SeparateFile score:


ramdisk results:

config: impl=ChannelPread serial=false nThreads=4 iterations=100
bufsize=1024 poolsize=2 filelen=164956707
answer=-31115427, ms=68940, MB/sec=957.1030287206268

config: impl=SeparateFile serial=false nThreads=4 iterations=100
bufsize=1024 poolsize=2 filelen=164956707
answer=-31115729, ms=45691, MB/sec=1444.106778140115


Mark Miller wrote:
> I'm jealous of your 4 3.0Ghz to my 2.0Ghz.
>
> I was on dynamic scaling frequency and switched to 2.0Ghz hard.
>
> On ramdisk, my puny 2.0's almost catch you and get a bit over 1800MB/s
> with SeparateFile.
>
> I'm smoked on PooledPread and ChannelPread though. Still sub 500 for
> both, even
> on the ramdisk.
>
> Its an absurd comparison though - everyone knows a jackalope is faster
> than a koala.
>
> - Mark
>
> Yonik Seeley wrote:
>   
>> Here's my results in my quad core phenom, with ondemand CPU freq
>> scaling disabled (clocks locked at 3GHz)
>>
>> Ubuntu 9.04, filesystem=ext4 on 7200RPM IDE drive, testfile=95MB fully cached.
>>
>> Linux odin 2.6.28-15-generic #49-Ubuntu SMP Tue Aug 18 19:25:34 UTC
>> 2009 x86_64 GNU/Linux
>> Java(TM) SE Runtime Environment (build 1.6.0_14-b08)
>> Java HotSpot(TM) 64-Bit Server VM (build 14.0-b16, mixed mode)
>>
>>
>> config: impl=ClassicFile serial=false nThreads=4 iterations=20
>> bufsize=1024 poolsize=2 filelen=95610240
>> answer=1165427971, ms=15610, MB/sec=489.99482383087764
>>
>> config: impl=SeparateFile serial=false nThreads=4 iterations=20
>> bufsize=1024 poolsize=2 filelen=95610240
>> answer=1165427672, ms=4115, MB/sec=1858.7652976913728
>>
>> config: impl=PooledPread serial=false nThreads=4 iterations=20
>> bufsize=1024 poolsize=2 filelen=95610240
>> answer=1165427971, ms=6352, MB/sec=1204.15919395466
>>
>> config: impl=ChannelFile serial=false nThreads=4 iterations=20
>> bufsize=1024 poolsize=2 filelen=95610240
>> answer=1165427971, ms=20347, MB/sec=375.91876935174713
>>
>> config: impl=ChannelPread serial=false nThreads=4 iterations=20
>> bufsize=1024 poolsize=2 filelen=95610240
>> answer=1165427971, ms=5189, MB/sec=1474.0449412218154
>>
>> config: impl=ChannelTransfer serial=false nThreads=4 iterations=20
>> bufsize=1024 poolsize=2 filelen=95610240
>> answer=1165427971, ms=14794, MB/sec=517.021711504664
>>
>> -Yonik
>> http://www.lucidimagination.com
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>   
>>     
>
>
>   


-- 
- Mark

http://www.lucidimagination.com




---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message