jackrabbit-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jukka Zitting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (JCR-2695) Jackrabbit performance test suite
Date Wed, 04 Aug 2010 10:54:15 GMT

    [ https://issues.apache.org/jira/browse/JCR-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12895216#action_12895216
] 

Jukka Zitting commented on JCR-2695:
------------------------------------

Currently the jcr-benchmark suite currently uses the commons-math class SummaryStatistics
which doesn't do percentiles, but it should be pretty straightforward to switch to using DescriptiveStatistics
instead. The above plots show the mean value and standard deviations. But switching to something
like the median plus 10th and 90th percentiles might give a more accurate picture. Alternatively
we could just  do a scatter plot of the entire data set.

About the 2.x figures, the increase in session startup times is probably due to the extra
JCR 2.0 features (access control?) we're starting up. Note that the performance drop starts
already in 1.6 where we started introducing new JCR 2.0 features. In any case starting up
a single session still takes only about 0.1ms on my computer, which seems OK to me.

The switch to using the FileDataStore by default in Jackrabbit 2.0 seems to explain the changes
in file handling performance. We're pretty good with both reading and writing large files,
but the handling of smaller files suffers somewhat from the way the FileDataStore uses intermediate
directories. Perhaps we should consider putting all smaller binaries inside one big file instead.

> Jackrabbit performance test suite
> ---------------------------------
>
>                 Key: JCR-2695
>                 URL: https://issues.apache.org/jira/browse/JCR-2695
>             Project: Jackrabbit Content Repository
>          Issue Type: Improvement
>          Components: jackrabbit-core
>            Reporter: Jukka Zitting
>            Assignee: Jukka Zitting
>             Fix For: 2.2.0
>
>         Attachments: bigread.png, bigwrite.png, login.png, logout.png, smallread.png,
smallwrite.png
>
>
> I'd like to set up a multi-version performance test suite inside jackrabbit-core/src/test/performance,
similar to the compatibility test suite we added in JCR-2631. This performance test suite
would produce comparable performance numbers for a number of simple benchmark tests across
different Jackrabbit versions, including the latest snapshot.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message