directory-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ben Hoyt (JIRA)" <j...@apache.org>
Subject [jira] Commented: (DIRSERVER-1459) Adding members to a groupOfNames results in polynomial increase in JDBM partition size
Date Thu, 21 Jan 2010 17:29:54 GMT

    [ https://issues.apache.org/jira/browse/DIRSERVER-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803377#action_12803377
] 

Ben Hoyt commented on DIRSERVER-1459:
-------------------------------------

That class is from commons-math.  I added that as a dependency in the pom.xml inside the attached
archive.  I also tweaked the pom to up the memory for the test to 1GB.  You could either run
the test directly from the pom, or add commons-math to your classpath (and maybe bump your
memory setting up however you are running it)

> Adding members to a groupOfNames results in polynomial increase in JDBM partition size
> --------------------------------------------------------------------------------------
>
>                 Key: DIRSERVER-1459
>                 URL: https://issues.apache.org/jira/browse/DIRSERVER-1459
>             Project: Directory ApacheDS
>          Issue Type: Bug
>    Affects Versions: 1.5.5
>         Environment: Any (tested on Linux and Mac OS X)
>            Reporter: Ben Hoyt
>            Priority: Blocker
>             Fix For: 2.0.0-RC1
>
>         Attachments: DIRSERVER-1459.tar.gz, screenshot-1.jpg
>
>
> I noticed a polynomial increase JDBM partition size and therefore disk usage when adding
users to groups in my ApacheDS instance.  The vast majority of the usage (95+% once you hit
a couple thousand users) is in workingDirectory/partitionId/master.db  
> Further testing showed that simply adding a user is linear, as one would expect, and
as 'apacheds-tools capacity' confirms.  It is only when a user is made a member of a group
that the JDBM partition size shoots up.
> Example statistics:
> Add 16,000 users - JDBM partition size = ~70 megabytes
> Now add those same 16,000 users to a single group (all in the same group) - JDBM partition
size = ~19 GIGABYTES
> I'll work to attach a test case and some more numbers from my tests

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message