jackrabbit-oak-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Mueller <muel...@adobe.com>
Subject Re: Some more benchmarks
Date Wed, 03 Jul 2013 08:22:45 GMT
Hi,

Thanks a lot!

> I've only included the 90th percentile

I usually look at "N" first :-)

There is one strange result: SmallFileWriteTest; Oak-Segment: 90%=257,
max=14763 - Maybe the warmup phase is too short, or the test isn't that
great?

As for SmallFileReadTest and SmallFileWriteTest with Oak-Mongo: I think I
know what the problem is; it doesn't seem to be related to BLOB handling
at all (actually performance is the same without the BLOB), but partially
related to the "split documents" that should be added in the near future.
Also, it seems to be partially related to what the test does (repeatedly
adding and removing the same nodes).

Regards,
Thomas


On 7/2/13 10:11 PM, "Jukka Zitting" <jukka.zitting@gmail.com> wrote:

>Hi,
>
>On Fri, May 31, 2013 at 3:14 PM, Jukka Zitting <jukka.zitting@gmail.com>
>wrote:
>> On Fri, Apr 26, 2013 at 2:12 PM, Jukka Zitting
>><jukka.zitting@gmail.com> wrote:
>>> On Wed, Mar 27, 2013 at 11:41 AM, Jukka Zitting
>>><jukka.zitting@gmail.com> wrote:
>>>> Here's a few more simple benchmark results to show where we are:
>>>
>>> Updated numbers with latest Oak:
>>
>> And another one:
>
>Here we go again:
>
>    # ReadPropertyTest               90%
>    Jackrabbit                        48
>    Oak-Default                       38
>    Oak-Mongo                         39
>    Oak-Segment                       41
>    Oak-Tar                           40
>
>    # SmallFileReadTest              90%
>    Jackrabbit                        94
>    Oak-Default                      258
>    Oak-Mongo                        421
>    Oak-Segment                       23
>    Oak-Tar                           20
>
>    # SmallFileWriteTest             90%
>    Jackrabbit                       424
>    Oak-Default                      349
>    Oak-Mongo                       1376
>    Oak-Segment                      257
>    Oak-Tar                          116
>
>For simplicy I've only included the 90th percentile figure (smaller is
>better). See https://gist.github.com/jukka/5912460 for the full
>details.
>
>The ReadPropertyTest figures were again lagging behind those of
>Jackrabbit, but my changes earlier today got us back to the same
>range. However, we've still regressed somewhat from the level we
>reached in early June.
>
>BR,
>
>Jukka Zitting


Mime
View raw message