directory-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <Carlo.Acco...@ibs-ag.com>
Subject Update 2.0.0-M7 and indexes
Date Fri, 13 Apr 2012 20:03:07 GMT
Hi Folks, we've made a lot of progress but it wouldn't be fun if there wasn't one more gotcha.

We Built 2.0.0-M7 SHAPSHOT from the trunk and it installs and runs fine with 1GB memory /
32 bit JVM  (Thanks Kiran for pointers last night)
I create a partition and index several attributes. When the server restarts the user attribute
 DBM databases appear ! (Thanks Emmanuel)
I load my ldif file with 80 k users. When the ldif is loaded, I can see all 80k users, everything
seems fine, the indexes are populated I can search and it all works.

Once I shut down the server, it will not restart. The wrapper fails with the error below.
The size of the JVM goes from zero to 1.3GB, pauses and exists.
I'm sure there's an OutOfMemory exception occurring but even with Debug it's not appearing
in the logs.

The question I have is with a partition this size, with this number of users, what can I do
to make the jvm as small as possible to start?

I've reset all my attribute indexes to 100, partition cache is set to 1000 BEFORE I loaded
all the users. Still having same result.
Any ideas?  Many thanks.

BTW, those index delete warnings were there before I put any users in the system.


D:\Program Files\ApacheDSm7\bin>wrapper.exe ..\conf\wrapper.conf "set.INSTANCE_DIRECTORY=D:\Program
files\apachedsm7\inst
ances\default" "set.INSTANCE=default"
wrapper  | --> Wrapper Started as Console
wrapper  | Using tick timer.
wrapperp | server listening on port 32000.
wrapper  | Launching a JVM...
wrapper  | command: "C:\Program Files (x86)\Java\jdk1.6.0_31\bin\java.exe" -Dlog4j.configuration="file:///D:\Program
file
s\apachedsm7\instances\default/conf/log4j.properties" -Dapacheds.var.dir="D:\Program files\apachedsm7\instances\default"
-Dapacheds.log.dir="D:\Program files\apachedsm7\instances\default/log" -Dapacheds.run.dir="D:\Program
files\apachedsm7\in
stances\default/run" -Dapacheds.instance="default" -Ddefault.controls="org.apache.directory.shared.ldap.codec.controls.ca
scade.CascadeFactory,org.apache.directory.shared.ldap.codec.controls.manageDsaIT.ManageDsaITFactory,org.apache.directory.
shared.ldap.codec.controls.search.entryChange.EntryChangeFactory,org.apache.directory.shared.ldap.codec.controls.search.p
agedSearch.PagedResultsFactory,org.apache.directory.shared.ldap.codec.controls.search.persistentSearch.PersistentSearchFa
ctory,org.apache.directory.shared.ldap.codec.controls.search.subentries.SubentriesFactory"
-Dextra.controls="org.apache.d
irectory.shared.ldap.extras.controls.ppolicy_impl.PasswordPolicyFactory,org.apache.directory.shared.ldap.extras.controls.
syncrepl_impl.SyncDoneValueFactory,org.apache.directory.shared.ldap.extras.controls.syncrepl_impl.SyncInfoValueFactory,or
g.apache.directory.shared.ldap.extras.controls.syncrepl_impl.SyncRequestValueFactory,org.apache.directory.shared.ldap.ext
ras.controls.syncrepl_impl.SyncStateValueFactory" -Ddefault.extendedOperation.requests="org.apache.directory.shared.ldap.
extras.extended.ads_impl.cancel.CancelFactory,org.apache.directory.shared.ldap.extras.extended.ads_impl.certGeneration.Ce
rtGenerationFactory,org.apache.directory.shared.ldap.extras.extended.ads_impl.gracefulShutdown.GracefulShutdownFactory,or
g.apache.directory.shared.ldap.extras.extended.ads_impl.storedProcedure.StoredProcedureFactory"
-Ddefault.extendedOperati
on.responses="org.apache.directory.shared.ldap.extras.extended.ads_impl.gracefulDisconnect.GracefulDisconnectFactory"
-Xm
s1024m -Xmx1300m -Djava.library.path="../lib" -classpath "../lib/apacheds-all-2.0.0-M7-SNAPSHOT.jar;../lib/apacheds-servi
ce-2.0.0-M7-SNAPSHOT.jar;../lib/apacheds-wrapper-2.0.0-M7-SNAPSHOT.jar;../lib/wrapper-3.2.3.jar"
-Dwrapper.key="idVWuG6KW
XIDWvWZ" -Dwrapper.port=32000 -Dwrapper.jvm.port.min=31000 -Dwrapper.jvm.port.max=31999 -Dwrapper.debug="TRUE"
-Dwrapper.
pid=2056 -Dwrapper.version="3.2.3" -Dwrapper.native_library="wrapper" -Dwrapper.cpu.timeout="10"
-Dwrapper.jvmid=1 org.ap
ache.directory.server.wrapper.ApacheDsTanukiWrapper "D:\Program files\apachedsm7\instances\default"
wrapper  | JVM started (PID=8520)
jvm 1    | WrapperManager class initialized by thread: main  Using classloader: sun.misc.Launcher$AppClassLoader@f4a24a
jvm 1    | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
jvm 1    |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
jvm 1    |
jvm 1    | Wrapper Manager: JVM #1
jvm 1    | Running a 32-bit JVM.
jvm 1    | Wrapper Manager: Registering shutdown hook
jvm 1    | Wrapper Manager: Using wrapper
jvm 1    | Load native library.  One or more attempts may fail if platform specific libraries
do not exist.
jvm 1    | Loaded native library: wrapper-windows-x86-32.dll
jvm 1    | Calling native initialization method.
jvm 1    | Initializing WrapperManager native library.
jvm 1    | Java Executable: C:\Program Files (x86)\Java\jdk1.6.0_31\bin\java.exe
jvm 1    | Windows version: 6.1.7601
jvm 1    | Java Version   : 1.6.0_31-b05 Java HotSpot(TM) Client VM
jvm 1    | Java VM Vendor : Sun Microsystems Inc.
jvm 1    |
jvm 1    | Control event monitor thread started.
jvm 1    | Startup runner thread started.
jvm 1    | WrapperManager.start(org.apache.directory.server.wrapper.ApacheDsTanukiWrapper@1ce2dd4,
args["D:\Program files
\apachedsm7\instances\default"]) called by thread: main
jvm 1    | Communications runner thread started.
jvm 1    | Open socket to wrapper...Wrapper-Connection
jvm 1    | Opened Socket from 31000 to 32000
jvm 1    | Send a packet KEY : idVWuG6KWXIDWvWZ
jvm 1    | handleSocket(Socket[addr=/127.0.0.1,port=32000,localport=31000])
wrapperp | accepted a socket from 127.0.0.1 on port 31000
wrapperp | read a packet KEY : idVWuG6KWXIDWvWZ
wrapper  | Got key from JVM: idVWuG6KWXIDWvWZ
wrapperp | send a packet LOW_LOG_LEVEL : 1
wrapperp | send a packet PING_TIMEOUT : 24000
wrapperp | send a packet PROPERTIES : (Property Values)
wrapper  | Start Application.
wrapperp | send a packet START : start
jvm 1    | Received a packet LOW_LOG_LEVEL : 1
jvm 1    | Wrapper Manager: LowLogLevel from Wrapper is 1
jvm 1    | Received a packet PING_TIMEOUT : 24000
jvm 1    | PingTimeout from Wrapper is 24000000
jvm 1    | Received a packet PROPERTIES : (Property Values)
jvm 1    | Received a packet START : start
jvm 1    | calling WrapperListener.start()
jvm 1    | Waiting for WrapperListener.start runner thread to complete.
jvm 1    | WrapperListener.start runner thread started.
jvm 1    | [15:59:15] WARN [org.apache.directory.server.core.partition.impl.btree.jdbm.JdbmPartition]
- Failed to delete
unused index file D:\Program files\apachedsm7\instances\default\partitions\system\0.9.2342.19200300.100.1.1.db
jvm 1    | [15:59:15] WARN [org.apache.directory.server.core.partition.impl.btree.jdbm.JdbmPartition]
- Failed to delete
unused index file D:\Program files\apachedsm7\instances\default\partitions\system\1.3.6.1.4.1.18060.0.4.1.2.4.db
jvm 1    | [15:59:15] WARN [org.apache.directory.server.core.partition.impl.btree.jdbm.JdbmPartition]
- Failed to delete
unused index file D:\Program files\apachedsm7\instances\default\partitions\system\2.5.4.11.db
jvm 1    | [15:59:15] WARN [org.apache.directory.server.core.partition.impl.btree.jdbm.JdbmPartition]
- Failed to delete
unused index file D:\Program files\apachedsm7\instances\default\partitions\example\0.9.2342.19200300.100.1.1.db
jvm 1    | [15:59:15] WARN [org.apache.directory.server.core.partition.impl.btree.jdbm.JdbmPartition]
- Failed to delete
unused index file D:\Program files\apachedsm7\instances\default\partitions\example\0.9.2342.19200300.100.1.25.db
jvm 1    | [15:59:15] WARN [org.apache.directory.server.core.partition.impl.btree.jdbm.JdbmPartition]
- Failed to delete
unused index file D:\Program files\apachedsm7\instances\default\partitions\example\1.3.6.1.4.1.18060.0.4.1.2.4.db
jvm 1    | [15:59:15] WARN [org.apache.directory.server.core.partition.impl.btree.jdbm.JdbmPartition]
- Failed to delete
unused index file D:\Program files\apachedsm7\instances\default\partitions\example\1.3.6.1.4.1.5322.10.1.1.db
jvm 1    | [15:59:15] WARN [org.apache.directory.server.core.partition.impl.btree.jdbm.JdbmPartition]
- Failed to delete
unused index file D:\Program files\apachedsm7\instances\default\partitions\example\2.5.4.11.db
wrapper  | Startup failed: Timed out waiting for signal from JVM.
wrapper  | JVM did not exit on request, terminated
wrapperp | server listening on port 32000.
wrapper  | JVM was only running for 30 seconds leading to a failed restart count of 1.
wrapper  | There were 1 failed launches in a row, each lasting less than 300 seconds.  Giving
up.
wrapper  |   There may be a configuration problem: please check the logs.
wrapper  | <-- Wrapper Stopped

D:\Program Files\ApacheDSm7\bin>pause
Press any key to continue . . .




Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message