jackrabbit-oak-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Mueller <muel...@adobe.com>
Subject Re: Some more benchmarks
Date Mon, 03 Jun 2013 08:09:21 GMT
Hi,

A bit weird is, when I run the tests separately I get different numbers:

java -mx1g -jar target/oak-run-0.9-SNAPSHOT.jar benchmark
SmallFileReadTest Oak-Tar
# SmallFileReadTest              min     10%     50%     90%     max
N
Oak-Tar                           53      54      55      57      72
1085


java -mx1g -jar target/oak-run-0.9-SNAPSHOT.jar benchmark
SmallFileReadTest Oak-Mongo
# SmallFileReadTest              min     10%     50%     90%     max
N
Oak-Mongo                        102     104     113     122     310
528

In your case, the N was 304 versus 3574 (more than 10 times different), in
my case it was 528 versus 1085 (factor 2).

How did you run the test? I will try the same command line and post my
results.

Regards,
Thomas





On 5/31/13 2:14 PM, "Jukka Zitting" <jukka.zitting@gmail.com> wrote:

>Hi,
>
>On Fri, Apr 26, 2013 at 2:12 PM, Jukka Zitting <jukka.zitting@gmail.com>
>wrote:
>> On Wed, Mar 27, 2013 at 11:41 AM, Jukka Zitting
>><jukka.zitting@gmail.com> wrote:
>>> Here's a few more simple benchmark results to show where we are:
>>
>> Updated numbers with latest Oak:
>
>And another one:
>
>    Apache Jackrabbit Oak 0.9-SNAPSHOT
>    # ReadPropertyTest               min     10%     50%     90%     max
>     N
>    Jackrabbit                        41      41      42      43      90
>  1428
>    Oak-Default                       58      58      59      60      69
>  1018
>    Oak-Mongo                         66      67      67      68      74
>   889
>    Oak-Segment                      278     279     281     285     321
>   213
>    Oak-Tar                          114     114     115     117     136
>   520
>    # SmallFileReadTest              min     10%     50%     90%     max
>     N
>    Jackrabbit                        56      57      61      84     194
>   895
>    Oak-Default                       57      57      59     304     353
>   594
>    Oak-Mongo                        148     148     158     406     479
>   304
>    Oak-Segment                       33      33      36      37      73
>  1701
>    Oak-Tar                           15      15      16      18      31
>  3574
>    # SmallFileWriteTest             min     10%     50%     90%     max
>     N
>    Jackrabbit                       184     196     248     444    2084
>   115
>    Oak-Default                      136     138     181     433    1789
>   162
>    Oak-Mongo                        595     617     795    1020    1075
>    31
>    Oak-Segment                      156     161     172     225     660
>   100
>    Oak-Tar                          101     102     108     116     270
>   167
>
>(also available at https://gist.github.com/jukka/5684506 if the above
>gets mangled with a variable-width font)
>
>It looks like we have a performance regression in ReadPropertyTest.
>Quick profiling shows a lot of the time seems to be going to
>MemoryNodeBuilder$ConnectedHead.update(), which is weird since we're
>only reading and thus the related MNB head should be unconnected. I'll
>investigate.
>
>BR,
>
>Jukka Zitting


Mime
View raw message