directory-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Emmanuel Lecharny (JIRA)" <j...@apache.org>
Subject [jira] Commented: (DIRSERVER-1459) Adding members to a groupOfNames results in polynomial increase in JDBM partition size
Date Fri, 19 Feb 2010 18:32:28 GMT

    [ https://issues.apache.org/jira/browse/DIRSERVER-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12835873#action_12835873
] 

Emmanuel Lecharny commented on DIRSERVER-1459:
----------------------------------------------

Hi Ben,

as a coincidence, we discussed this exact issue just this morning. Alex is currently working
this out, but it seems to be a bug in the backend we are using. We are really doing our best
to determinate which part of the code is causing this issue, and have successfully been able
to write a small piece of code that demonstrates the bug (out of the server). 

It will probably take a bit more time, I have no idea how much, but be sure that we are realizing
how big is the bug, and we want to get it fix, and probably release another version before
2.0 as soon as the bug is fixed.

Sorry for the delay... Life is not that simple :/

> Adding members to a groupOfNames results in polynomial increase in JDBM partition size
> --------------------------------------------------------------------------------------
>
>                 Key: DIRSERVER-1459
>                 URL: https://issues.apache.org/jira/browse/DIRSERVER-1459
>             Project: Directory ApacheDS
>          Issue Type: Bug
>    Affects Versions: 1.5.5
>         Environment: Any (tested on Linux and Mac OS X)
>            Reporter: Ben Hoyt
>            Assignee: Alex Karasulu
>            Priority: Blocker
>             Fix For: 1.5.6
>
>         Attachments: DIRSERVER-1459.tar.gz, screenshot-1.jpg
>
>
> I noticed a polynomial increase JDBM partition size and therefore disk usage when adding
users to groups in my ApacheDS instance.  The vast majority of the usage (95+% once you hit
a couple thousand users) is in workingDirectory/partitionId/master.db  
> Further testing showed that simply adding a user is linear, as one would expect, and
as 'apacheds-tools capacity' confirms.  It is only when a user is made a member of a group
that the JDBM partition size shoots up.
> Example statistics:
> Add 16,000 users - JDBM partition size = ~70 megabytes
> Now add those same 16,000 users to a single group (all in the same group) - JDBM partition
size = ~19 GIGABYTES
> I'll work to attach a test case and some more numbers from my tests

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message