directory-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Emmanuel Lecharny (JIRA)" <j...@apache.org>
Subject [jira] Commented: (DIRSERVER-1555) LDIF import very slow
Date Thu, 23 Sep 2010 13:24:46 GMT

    [ https://issues.apache.org/jira/browse/DIRSERVER-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12914029#action_12914029
] 

Emmanuel Lecharny commented on DIRSERVER-1555:
----------------------------------------------

Ok, even in DEBUG mode, the difference should not be that huge...

Checking on the logs, I see :
...
[14:22:33] DEBUG [org.apache.mina.core.filterchain.IoFilterEvent] - Event MESSAGE_RECEIVED
has been fired for session 1^M
[14:22:39] DEBUG [org.apache.mina.filter.codec.ProtocolCodecFilter] - Processing a MESSAGE_RECEIVED
for session 1^M
...

That means there is a 5 seconds wait between the moment we receive the first bytes and the
moment the last bytes ofr this messag have been received.

There is something really bad in your network settings, or in the way you send data to the
server. Each time a PDU is split in more than one packet, you have a 5 seconds delay before
you get the next packet, and this is the reason why it takes so long to process.

How do you embed ADS in your code ?

> LDIF import very slow 
> ----------------------
>
>                 Key: DIRSERVER-1555
>                 URL: https://issues.apache.org/jira/browse/DIRSERVER-1555
>             Project: Directory ApacheDS
>          Issue Type: Bug
>    Affects Versions: 1.5.7
>            Reporter: Jean-Fran├žois Melian
>         Attachments: import_groups.zip, import_users.zip, test_import.ldif, test_import.ldif.log,
test_import.ldif.pamarcelot.log, test_import_157_xp.ldif.log, test_import_pamarcelot_win7.ldif.log
>
>
> I work with an embedded ApacheDS but for this test I used a standard standalone ApacheDS
whith the system Partition :
>     <systemPartition>
>       <!-- use the following partitionConfiguration to override defaults for -->
>       <!-- the system partition                                              -->
>       <jdbmPartition id="system" cacheSize="100" suffix="ou=system" optimizerEnabled="true"
syncOnWrite="true">
>         <indexedAttributes>
>           <jdbmIndex attributeId="1.3.6.1.4.1.18060.0.4.1.2.1" cacheSize="100"/>
>           <jdbmIndex attributeId="1.3.6.1.4.1.18060.0.4.1.2.2" cacheSize="100"/>
>           <jdbmIndex attributeId="1.3.6.1.4.1.18060.0.4.1.2.3" cacheSize="100"/>
>           <jdbmIndex attributeId="1.3.6.1.4.1.18060.0.4.1.2.4" cacheSize="100"/>
>           <jdbmIndex attributeId="1.3.6.1.4.1.18060.0.4.1.2.5" cacheSize="10"/>
>           <jdbmIndex attributeId="1.3.6.1.4.1.18060.0.4.1.2.6" cacheSize="10"/>
>           <jdbmIndex attributeId="1.3.6.1.4.1.18060.0.4.1.2.7" cacheSize="10"/>
>           <jdbmIndex attributeId="ou" cacheSize="100"/>
>           <jdbmIndex attributeId="uid" cacheSize="100"/>
>           <jdbmIndex attributeId="objectClass" cacheSize="100"/>
>         </indexedAttributes>
>       </jdbmPartition>
>     </systemPartition>
> I have generated a ldif file :  400 users and 20 groups with 100 user per group
>  - The 400 users have been imported rapidly :< 15 secondes for the 400 users   =>
0.03 second per user
>  - The 20 groups have been imported very more slowly : : > 5 minutes             
      => 15.5 seconds per group

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message