Mailing-List: contact users-help@directory.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@directory.apache.org
Received-SPF: pass (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding;
  b=3jxs8R5SSkq0KqI8PXghD4iND5MCkvyi86+I2gLhUbGXOpt8yEB+w4tyZYpEHV4gTMDoeo1zfemO79ZFwsFCB2OtK4Judixe3xciTMv9Bo7qx8FMXSu4GhBp2KJQTn5XQGsiDF/MJa75Dem3SPcgPBzbUHtvO75LU+1FsElUO7A=;
References: <1317240674.31337.YahooMailNeo@web113504.mail.gq1.yahoo.com>
 <CABzFU-doAV63sMcjUFv2yvJUq17A_5PSQ3SXExbx1ajG1MC7Gg@mail.gmail.com>
 <1317305852.92536.YahooMailNeo@web113512.mail.gq1.yahoo.com>
 <CABzFU-f1P41KeObU4Ce0wvWVak0ru_JprcLuG_grEwga8vW9SQ@mail.gmail.com>
 <1317742314.68646.YahooMailNeo@web113516.mail.gq1.yahoo.com>
 <CABzFU-cpS047WL+_p+ugZ+eTS0bzn8hTRCtOnBv7-Nf8fZEE1Q@mail.gmail.com>
 <1317746102.55646.YahooMailNeo@web113519.mail.gq1.yahoo.com>
 <CABzFU-emvYXF+o7rro8B9NrbGMryC+r_d4b57w5VC7yFw58CxQ@mail.gmail.com>
 <1317840615.50856.YahooMailNeo@web113510.mail.gq1.yahoo.com>
 <CABzFU-d2C8pHNwHTF8kvxF8v5KEMXtK4HQE22+z0Q6WTrARXPQ@mail.gmail.com>
Message-ID: <1317873730.50090.YahooMailNeo@web113520.mail.gq1.yahoo.com>
Date: Wed, 5 Oct 2011 21:02:10 -0700 (PDT)
From: Steve Hayden <hshayden@yahoo.com>
Reply-To: Steve Hayden <hshayden@yahoo.com>
Subject: Re: ApacheDS "Tools" "dump" question
To: Kiran Ayyagari <kayyagari@apache.org>
Cc: "users@directory.apache.org" <users@directory.apache.org>
In-Reply-To: 
 <CABzFU-d2C8pHNwHTF8kvxF8v5KEMXtK4HQE22+z0Q6WTrARXPQ@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

Greetings,=0A=0AI attempted to import the data you defined in your earlier =
email (I placed the following in a file named "Apache--Master-LDAP.ldif") a=
s follows:=0A=0Adn: ads-serverId=3DldapServer,ou=3Dservers,ads-directorySer=
viceId=3Ddefault,ou=3Dconfig=0Achangetype: modify=0Aadd: ads-replReqHandler=
=0Aads-replReqHandler: =0Aorg.apache.directory.server.ldap.replication.prov=
ider.SyncReplRequestHandler=0A=0A=0AIn Apache Directory Studio ("Version: 1=
.5.3.v20100330"), I attempted to import the above file and received the fol=
lowing exception:=0A=0A************** Begin of exception ****************=
=0AError while importing LDIF=0A=A0- Record is invalid=0A=A0 javax.naming.N=
amingException: Record is invalid=0A=A0=A0=A0 at org.apache.directory.studi=
o.ldapbrowser.core.jobs.ImportLdifJob.importLdifRecord(ImportLdifJob.java:4=
03)=0A=A0=A0=A0 at org.apache.directory.studio.ldapbrowser.core.jobs.Import=
LdifJob.importLdif(ImportLdifJob.java:267)=0A=A0=A0=A0 at org.apache.direct=
ory.studio.ldapbrowser.core.jobs.ImportLdifJob.executeNotificationJob(Impor=
tLdifJob.java:204)=0A=A0=A0=A0 at org.apache.directory.studio.ldapbrowser.c=
ore.jobs.AbstractNotificationJob.executeAsyncJob(AbstractNotificationJob.ja=
va:43)=0A=A0=A0=A0 at org.apache.directory.studio.ldapbrowser.core.jobs.Abs=
tractEclipseJob.run(AbstractEclipseJob.java:101)=0A=A0=A0=A0 at org.eclipse=
.core.internal.jobs.Worker.run(Worker.java:55)=0A=0A=A0 Record is invalid=
=0A=0A=0A************** End of exception ****************=0A=0A(I pretty mu=
ch just cut/pasted the above LDIF file contents from your earlier note. Is =
the syntax correct?)=0A=0ATo assure I have created/started the servers prop=
erly, please give me a sanity check on my method.=0A=0A1) I made a copy of =
the folder "~\ApacheDS\instances\default", and copied that whole folder hie=
rarchy to another folder.=0A=0A2) In the new "ApacheDS\instances" folder I =
made a copy of the "default" folder, renamed it "instances\ApacheDS_Server2=
" (the "master"), and in the "instances\ApacheDS_Server2\conf\config.ldif" =
file, changed the "ads-systemport" to the following:=0A=0Adn: ads-transport=
id=3Dldap,ou=3Dtransports,ads-serverId=3DldapServer,ou=3Dservers,ads-direct=
oryServiceId=3Ddefault,ou=3Dconfig=0Aads-systemport: 20389=0A=0A3) I succes=
sfully started this server by (from CLI prompt) issuing the command:=0A=0Aj=
ava -jar apacheds-service-2.0.0-M3.jar instances/ApacheDS_Server2/=0A=0Aand=
 could successfully connect to it with Apache Directory Studio using the po=
rt 20389.=0A=0A4) I repeated step 2 above and created a new instance "insta=
nces\ApacheDS_Server3" (the "slave"), and changed it's "ads-systemport" to =
the following: =0A=0Adn: ads-transportid=3Dldap,ou=3Dtransports,ads-serverI=
d=3DldapServer,ou=3Dservers,ads-directoryServiceId=3Ddefault,ou=3Dconfig=0A=
ads-systemport: 30389=0A=0AAnd started this server by (from CLI prompt) iss=
uing the command:=0A=0Ajava -jar apacheds-service-2.0.0-M3.jar instances/Ap=
acheDS_Server3/=0A=0AI then used the Apache Directory Studio to import the =
LDIF file above to the "ApacheDS_Server2" and got the exceptions posted abo=
ve. Upon review of what I had done in the above steps, I noticed that in th=
e "config.ldif" files, there were several occurrences of the text "default"=
, so was wondering if I should have replaced all occurrences of "ads-direct=
oryServiceId=3Ddefault" with "ads-directoryServiceId=3DApacheDS_Server2" fo=
r the "master", (and "ApacheDS_Server3" for the slave in it's "config.ldif"=
 file).=0A=0AAgain, thanks for any insight/advice/comments.=0A=0AKindest re=
gards,=0ASteve=0A=0A=0A=0A----- Original Message -----")apache.org>=0ATo: S=
teve Hayden <hshayden@yahoo.com>; "users@directory.apache.org" <users@direc=
tory.apache.org>=0ACc: =0ASent: Wednesday, October 5, 2011 7:04 PM=0ASubjec=
t: Re: ApacheDS "Tools" "dump" question=0A=0AOn Wed, Oct 5, 2011 at 2:50 PM=
, Steve Hayden <hshayden@yahoo.com> wrote:=0A> Greetings,=0A>=0A> First, le=
t me say I'm sorry to keep pestering you with additional questions and expr=
ess my gratitude for your help.=0A>=0Anp, you are welcome!=0A> With regard =
to your statements "the config reader won't support at the moment", and "wi=
ll fix this in the trunk", please help me understand these.=0A>=0A>=0A> 1) =
Is the "config reader" the "utility" within Apache Directory Studio that wi=
ll be reading in the LDIF snippets you provided, and that data will be adde=
d to the "ou=3Dconfig" within the LDAP as seen in Apache Directory Studio (=
more specifically, where in hierarchy as seen in Apache Directory Studio do=
es the replication configuration data go)?=0Aconsider Studio as just an 'ed=
itor' for this scenario, the config=0Areader that am talking about is the o=
ne present inside the server that=0Areads=0Athe configuration from config.l=
dif file=0AAnd coming to the location where the config data/entry goes, I h=
ave=0Agiven the DN in the earlier mail=0A(ou=3DreplConsumers,ads-serverId=
=3DldapServer,ou=3Dservers,ads-directoryServiceId=3Ddefault,ou=3Dconfig)=0A=
=0ANote that you can also edit the configuration file config.ldif with a=0A=
text editor but it is ideal to use Studio cause it is easy and also=0Apreve=
nts=0Asome editing mistakes=0A> 2) As far as the "will fix this in the trun=
k", how/when could one lay hands on the update?=0Agrab the sources from tru=
nk and build it [1]=0A> 3) Is there an "alternate" way to (for lack of bett=
er word) "ingest" the LDIF into a directory other than Apache Directory Stu=
dio "import LDIF" (e.g could a Java program/method "populate" that data int=
o a directory)?=0Ayou can use ldapadd command or any other ldap client prog=
ram=0A> 4) And if one can "programmatically" add (or update existing) "repl=
ication" data, one could do this anytime (for example, once I've populated =
the LDAP with the data in step 2 below (the slave), if I wanted the slave t=
o become the master, and create another server to become a new slave, could=
 I simply apply the associated #1 and #2 LDIF files to the appropriate serv=
ers/machines?=0Ayes=0A> 5) Would you consider ApacheDS 2.0 ready for produc=
tion?=0A>=0Athere are no serious bugs that would prevent its usage in produ=
ction,=0Aif you want to use it then I would suggest to have some safe backu=
p=0Amechanism=0Afor the data. Having said all this personally I won't hesit=
ate to use=0Athis in production environment.=0A>=0A> (I apologize if I've u=
sed the wrong/confusing jargon, please bear with me.)=0A>=0Aagain you are w=
elcome, and glad that you have asked these questions=0A=0A> Kindest regards=
/thanks,=0A> Steve=0A>=0A>=0A=0A[1] svn checkout=0Ahttp://svn.apache.org/re=
pos/asf/directory/apacheds/trunk-with-dependencies=0A=A0 =A0 Let us know if=
 you have issues in building it=0A=0A>=0A> ----- Original Message -----=0A>=
 From: Kiran Ayyagari <kayyagari@apache.org>=0A> To: Steve Hayden <hshayden=
@yahoo.com>; users@directory.apache.org=0A> Cc:=0A> Sent: Tuesday, October =
4, 2011 12:57 PM=0A> Subject: Re: ApacheDS "Tools" "dump" question=0A>=0A> =
On Tue, Oct 4, 2011 at 12:35 PM, Steve Hayden <hshayden@yahoo.com> wrote:=
=0A>> Greetings,=0A>> Thanks for prompt response and information.=0A>>=0A>>=
 As far as the steps below,=0A>>=0A>> 1) is the first step performed on the=
 "master", and the second performed on the (for lack of better term) "slave=
"?=0A> yes=0A>> 2) if the answer to the first question is "yes", then I pre=
sume that in the second step, as it indicates "localhost", that both server=
s are running on the same machine in this case?=0A> yeah, I just provided t=
hat as an example, it can be a different host name=0A>> 3) as both steps be=
low include LDIF, I presume I could "import" the associated LDIF's using th=
e import function in Apache Directory Studio (once modified to the specific=
s of my environment)?=0A> yeap=0A>> 4) for the parameter/value "ads-replRef=
reshInterval: 60000", what is the time increment (does "60000" equal 60 (e.=
g. "refresh every 60 seconds)?=0A> yes, the value is given in milli seconds=
=0A>> 5) for the parameter/value "ads-searchBaseDN: ou=3Dsystem", does that=
 mean "only update/replicate data/updates in the "ou=3Dsystem" part of the =
DIT? (and if so, how does one replicate both "ou=3Dsystem" and "ou=3Dschema=
" for example)=0A>>=0A> again this was just an example, you can give any pa=
rtition that you=0A> want to replicate.with and currently there exists supp=
ort for=0A> replicating=0A> with multiple partitions, however I think the c=
onfig reader won't=0A> support at the moment (thanks for bringing this up, =
this reminded me=0A> about the=0A> forgotten issue with the config reader),=
 will fix this in the trunk=0A>>=0A>> Thanks in advance for your invaluable=
 information.=0A>>=0A>> Kindest regards,=0A>> Steve=0A>>=0A>> ----- Origina=
l Message -----=0A>> From: Kiran Ayyagari <kayyagari@apache.org>=0A>> To: S=
teve Hayden <hshayden@yahoo.com>; users@directory.apache.org=0A>> Cc:=0A>> =
Sent: Tuesday, October 4, 2011 12:05 PM=0A>> Subject: Re: ApacheDS "Tools" =
"dump" question=0A>>=0A>> Hi Steve,=0A>>=0A>> =A0 =A0 The configuration for=
 version 2.0 is stored in an LDIF file. This=0A>> configuration is also exp=
osed as a partition named ou=3Dconfig=0A>>=0A>> =A0 =A0 1. To make a server=
 respond to replication requests add the=0A>> attribute ads-replReqHandler =
with the value=0A>> =A0 =A0 =A0 =A0 org.apache.directory.server.ldap.replic=
ation.provider.SyncReplRequestHandler=0A>>=0A>> =A0 =A0 (you can also direc=
tly execute the below LDIF directly )=0A>>=0A>> dn: ads-serverId=3DldapServ=
er,ou=3Dservers,ads-directoryServiceId=3Ddefault,ou=3Dconfig=0A>> changetyp=
e: modify=0A>> add: ads-replReqHandler=0A>> ads-replReqHandler:=0A>> org.ap=
ache.directory.server.ldap.replication.provider.SyncReplRequestHandler=0A>>=
=0A>>=0A>> =A0 =A0 2. To replicate with another server add an entry with th=
e=0A>> objectclass 'ads-replConsumer' under=0A>> ou=3DreplConsumers,ads-ser=
verId=3DldapServer,ou=3Dservers,ads-directoryServiceId=3Ddefault,ou=3Dconfi=
g=0A>>=0A>> =A0 an example would be=0A>>=0A>> dn: ads-replConsumerId=3D1,ou=
=3DreplConsumers,ads-serverId=3DldapServer,ou=3Dservers,ads-directoryServic=
eId=3Ddefault,ou=3Dconfig=0A>> objectClass: ads-base=0A>> objectClass: ads-=
replConsumer=0A>> objectClass: top=0A>> ads-replAliasDerefMode: never=0A>> =
ads-replAttributes: *=0A>> ads-replConsumerId: 1=0A>> ads-replProvHostName:=
 localhost=0A>> ads-replProvPort: 1090=0A>> ads-replRefreshInterval: 60000=
=0A>> ads-replRefreshNPersist: true=0A>> ads-replSearchFilter: (objectClass=
=3D*)=0A>> ads-replSearchScope: sub=0A>> ads-replSearchSizeLimit: 0=0A>> ad=
s-replSearchTimeOut: 0=0A>> ads-replUserDn: uid=3Dadmin,ou=3Dsystem=0A>> ad=
s-replUserPassword:: c2VjcmV0=0A>> ads-searchBaseDN: ou=3Dsystem=0A>>=0A>>=
=0A>> =A0 =A0 =A0 =A0 finally the server needs to be restarted to make thes=
e changes effective=0A>>=0A>> Let us know if you have any other questions=
=0A>>=0A>> On Tue, Oct 4, 2011 at 11:31 AM, Steve Hayden <hshayden@yahoo.co=
m> wrote:=0A>>>=0A>>>=0A>>> Greetings,=0A>>>=0A>>> I am pursuing the option=
 you suggested of going to ApacheDS 2.0, and in the documentation ("http://=
directory.apache.org/apacheds/1.5/mitosis-development-guide.html") it indic=
ates the way to setup replication is as follows:=0A>>>=0A>>>=0A>>> Configur=
ation=0A>>> The replication system is a Multi-Master replication, ie, each =
server can=0A>>> update any server it is connected to. The way you tell a s=
erver to replicate to=0A>>> others is simple :=0A>>> <replicationIntercepto=
r>=0A>>> <configuration>=0A>>> <replicationConfiguration logMaxAge=3D"5"=0A=
>>> replicaId=3D"instance_a"=0A>>> replicationInterval=3D"2"=0A>>> response=
Timeout=3D"10"=0A>>> serverPort=3D"10390">=0A>>> <s:property name=3D"peerRe=
plicas">=0A>>> <s:set>=0A>>> <s:value>instance_b@localhost:1234</s:value>=
=0A>>> <s:value>instance_c@localhost:1234</s:value>=0A>>> </s:set>=0A>>> </=
s:property>=0A>>> </replicationConfiguration>=0A>>> </configuration>=0A>>> =
</replicationInterceptor>=0A>>>=0A>>>=0A>>>=0A>>> However, it does not indi=
cate where this code should go (or am I blind?).=0A>>> This looks like norm=
al XML, but I do not find any XML files in the ApacheDS 2.0 folders/directo=
ries=A0=A0(or again, am I blind?).=0A>>>=0A>>> Any insight would be appreci=
ated.=0A>>>=0A>>> Kindest regards/thanks,=0A>>> Steve=0A>>>=0A>>>=0A>>> ___=
_____________________________=0A>>> From: Kiran Ayyagari <kayyagari@apache.=
org>=0A>>> To: Steve Hayden <hshayden@yahoo.com>=0A>>> Sent: Thursday, Sept=
ember 29, 2011 10:33 AM=0A>>> Subject: Re: ApacheDS "Tools" "dump" question=
=0A>>>=0A>>> replication in 1.5.7 is broken, version 2.0-M2 has support for=
=0A>>> replication(it is an implementation of RFC4533 (a.k.a syncrepl ) )=
=0A>>> If upgrading to 2.0-M2 is not an option then I would suggest you to=
=0A>>> write a program to take the dump of the directory data(in LDIF)=0A>>=
> Implementing this using ApacheDirectory project's client-api [1] is=0A>>>=
 quite easy, let me know if you have any questions.=0A>>>=0A>>> [1] http://=
directory.apache.org/api/java-api.html=0A>>> On Thu, Sep 29, 2011 at 10:17 =
AM, Steve Hayden <hshayden@yahoo.com> wrote:=0A>>>> Greetings,=0A>>>> Thank=
s for your prompt reply and information.=0A>>>> Unfortunately using the Stu=
dio export/import is not an option in my=0A>>>> application. What I am actu=
ally trying to do is to create a failover=0A>>>> mechanism for when a "mast=
er" directory fails and must switch to another=0A>>>> LDAP server (perhaps =
a sloave) that contains the same (or most of) the data=0A>>>> contained in =
the master.=A0 In the ApacheDS source code, there is some=0A>>>> "replicati=
on" code, but it does not seem to do much/anything.=0A>>>>=0A>>>> Do you ha=
ve any advice on how to implement failover/redundancy?=0A>>>> Thanks in adv=
ance.=0A>>>> Steve=0A>>>> ________________________________=0A>>>> From: Kir=
an Ayyagari <kayyagari@apache.org>=0A>>>> To: users@directory.apache.org; S=
teve Hayden <hshayden@yahoo.com>=0A>>>> Sent: Wednesday, September 28, 2011=
 5:58 PM=0A>>>> Subject: Re: ApacheDS "Tools" "dump" question=0A>>>>=0A>>>>=
 the tools project is quite old(broken) and not maintained at the moment=0A=
>>>> if you want to take a dump would suggest to use Studio's export featur=
e=0A>>>>=0A>>>> HTH=0A>>>> On Wed, Sep 28, 2011 at 4:11 PM, Steve Hayden <h=
shayden@yahoo.com> wrote:=0A>>>>> Greetings,=0A>>>>>=0A>>>>> I am attemptin=
g to use the "dump" utility contained in the=0A>>>>> "apacheds-tools.jar"an=
d am having some=0A>>>>> difficulties. I am attempting this on a Windows 7 =
environment (and will=0A>>>>> also need to do it on Linux).=0A>>>>> I have =
tried this with the 1.5.5 and 1.5.7 versions of ApacheDS, and=0A>>>>> "dump=
" does not seems to work on=0A>>>>> either.=A0 I have the "apacheds-tools.j=
ar" in the folder:=0A>>>>>=0A>>>>> "C:\Software_Downloads\ApacheDS\apacheds=
_1.5.7\bin"=0A>>>>>=0A>>>>> and am using using the command:=0A>>>>>=0A>>>>>=
 java -jar apacheds-tools.jar dump -p system -i C:\app\data\ldap=0A>>>>>=0A=
>>>>>=0A>>>>> (the "schema" and "system" files that ApacheDS creates are in=
 that "ldap"=0A>>>>> folder). Executing the command=0A>>>>> above results i=
n the following exception:=0A>>>>>=0A>>>>> ***************** Begin of outpu=
t/exceptions *************=0A>>>>> =A0=A0=A0=A0=A0=A0 _=A0=A0=A0=A0=A0=A0=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 _=A0=A0=A0=A0=A0=A0=A0=A0=A0 ___=
_=A0 ____=A0=A0=A0 _____=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 _=0A>>>>> =A0=A0=A0=
=A0=A0 / \=A0=A0 _ __=A0=A0 __ _=A0 ___| |__=A0=A0 ___|=A0 _ \/ ___|=A0 |_=
=A0=A0 _|__=A0=A0 ___ |=0A>>>>> |___=0A>>>>> =A0=A0=A0=A0 / _ \ | '_ \ / _`=
 |/ __| '_ \ / _ \ | | \___ \=A0=A0=A0 | |/ _ \ / _ \| /=0A>>>>> __|=0A>>>>=
> =A0=A0=A0 / ___ \| |_) | (_| | (__| | | |=A0 __/ |_| |___) |=A0=A0 | | (_=
) | (_) | \__=0A>>>>> \=0A>>>>> =A0=A0 /_/=A0=A0 \_\ .__/ \__,_|\___|_| |_|=
\___|____/|____/=A0=A0=A0 |_|\___/=0A>>>>> \___/|_|___/=0A>>>>> =A0=A0=A0=
=A0=A0=A0=A0=A0=A0=A0 |_|=0A>>>>>=0A>>>>> Exception in thread "main" java.l=
ang.IllegalStateException:=0A>>>>> C:\ofm\data\ldap\bin does not exist!=0A>=
>>>> =A0=A0=A0=A0=A0=A0=A0 at=0A>>>>> org.apache.directory.daemon.Installat=
ionLayout.verifyInstallation(InstallationLayout.java:294)=0A>>>>> =A0=A0=A0=
=A0=A0=A0=A0 at=0A>>>>> org.apache.directory.server.tools.DumpCommand.execu=
te(DumpCommand.java:156)=0A>>>>> =A0=A0=A0=A0=A0=A0=A0 at=0A>>>>> org.apach=
e.directory.server.tools.ApachedsTools.main(ApachedsTools.java:112)=0A>>>>>=
=0A>>>>> ******************* End of output/exceptions *************=0A>>>>>=
=0A>>>>> As there does not appear to be a "bin" folder created by the Apach=
eDS=0A>>>>> startup (or upon creation of a=0A>>>>> new LDAP), it seems that=
 the tool (given the ouput above) is expecting=0A>>>>> that folder to exist=
.=0A>>>>>=0A>>>>> Is there something I'm doing wrong?=0A>>>>>=0A>>>>> Any i=
nsight/clue would be appreciated.=0A>>>>>=0A>>>>> Kindest regards/thanks,=
=0A>>>>> Steve=0A>>>>>=0A>>>>=0A>>>>=0A>>>>=0A>>>> --=0A>>>> Kiran Ayyagari=
=0A>>>>=0A>>>>=0A>>>>=0A>>>=0A>>>=0A>>>=0A>>> --=0A>>> Kiran Ayyagari=0A>>>=
=0A>>=0A>>=0A>>=0A>> --=0A>> Kiran Ayyagari=0A>>=0A>>=0A>=0A>=0A>=0A> --=0A=
> Kiran Ayyagari=0A>=0A=0A=0A=0A-- =0AKiran Ayyagari=0A