Return-Path: Delivered-To: apmail-directory-dev-archive@www.apache.org Received: (qmail 53317 invoked from network); 30 Jul 2006 06:15:45 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 30 Jul 2006 06:15:45 -0000 Received: (qmail 92646 invoked by uid 500); 30 Jul 2006 06:15:44 -0000 Delivered-To: apmail-directory-dev-archive@directory.apache.org Received: (qmail 92608 invoked by uid 500); 30 Jul 2006 06:15:44 -0000 Mailing-List: contact dev-help@directory.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: "Apache Directory Developers List" Delivered-To: mailing list dev@directory.apache.org Received: (qmail 92597 invoked by uid 99); 30 Jul 2006 06:15:44 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 29 Jul 2006 23:15:44 -0700 X-ASF-Spam-Status: No, hits=0.5 required=10.0 tests=DNS_FROM_RFC_ABUSE,HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (asf.osuosl.org: domain of ajayup@gmail.com designates 66.249.82.201 as permitted sender) Received: from [66.249.82.201] (HELO wx-out-0102.google.com) (66.249.82.201) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 29 Jul 2006 23:15:43 -0700 Received: by wx-out-0102.google.com with SMTP id s7so111861wxc for ; Sat, 29 Jul 2006 23:15:22 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references; b=dgSr1pxabnoBD5XvTiayrYuV35q79Je6U9ZZFfYP3FcVR9UaxhlxBVZK98emMpZsAwMeWFv97eG5aOh6c1jeLil9/PkOvu2XKkt/Ut3yPtwHXSte2AdWcIw9cyyD7cDaMYJn++bIyPWsXYPRwz7jXX+dBVdktoNhb4w1Wjrzw+g= Received: by 10.70.125.2 with SMTP id x2mr1274741wxc; Sat, 29 Jul 2006 23:15:22 -0700 (PDT) Received: by 10.70.59.1 with HTTP; Sat, 29 Jul 2006 23:15:22 -0700 (PDT) Message-ID: <5f8bff6d0607292315g4d0498d7j7f106eda2970ba2c@mail.gmail.com> Date: Sat, 29 Jul 2006 23:15:22 -0700 From: "Ajay Upadhyaya" To: "Apache Directory Developers List" , elecharny@iktek.com Subject: Re: apacheds dump command - hangs very frequently In-Reply-To: <44CBD091.3010901@gmail.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_6621_14824379.1154240122351" References: <5f8bff6d0607130126wd5a4503ldcced8fc1f2d552a@mail.gmail.com> <5f8bff6d0607280852g4de8f865rbc15ba335741dc6f@mail.gmail.com> <44CBD091.3010901@gmail.com> X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N ------=_Part_6621_14824379.1154240122351 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: quoted-printable Content-Disposition: inline added this in JIRA... -Ajay On 7/29/06, Emmanuel Lecharny wrote: > > Ajay Upadhyaya a =E9crit : > > > Hi, > > Sorry for posting this again... > > np. > > > > > I'd posted this issue sometime back... I didn't get chance afterwards > > to dig deeper into this issue, anyone has any update/idea, or has > > anyone else encountered this issue. > > Well, no... > > > > > Dump is an important aspect for us to deploy ADS in production for the > > backup purposes. I'm currently using other option (like recursively > > traversing the tree using jndi based client) for ADS 0.9, but as our > > ldap entries grow, the jndi-client is a slower option. So I'm looking > > forward to the Dump utility in ADS 1.0RC3 > > The dump command has been modified recently, but I don't think it will > fix your issue. > > I have a few questions regarding what is happening : > 1) Are you dumping data while other clients do some searches ? > 2) Is it working well if you try to export data without any client > connected ? > 3) Do you get any result, even partial ? > 4) Is it working 100% with tools like LdapBrowser or JXplorer ? > > I think that somebody may spend some time on your problem on monday. > > Btw, It would be much better if you fill a JIRA about this problem. JIRA > is reliable, we read issues at least once a week, we can build a roadmap > based on JIRAs. On the opposite, mail are just like fire and forget > weapons. If you catch somebody on the other side, perfect. Otherwise, > you may have to post again, and again... Last point: with JIRA, we can't > loose a piece of information. If I need to check for any piece of > information, it will be related to the JIRA issue. If I have to do the > same with mail, there is a good chance that I miss at least one or two > mails. And it's not very funny to check a lot of unrelated mails, too ... > > Run JIRA, run !!! :) > > Emmanuel > > > > > Thanks, > > Ajay > > > > On 7/13/06, *Ajay Upadhyaya* > > wrote: > > > > Hi, > > I'm trying out apacheds1.0-RC3 > > > > here is my env details > > Linux 2.4.20-8smp, 2CPU HT, jdk1.5.0_07 > > > > I've a custom schema extension defined (works fine), and a data > > partition. ADS is working fine. When I try the dump command using > > apacheds-tools the dump is produced sometimes successfully (there > > are 2227 entries in the exported file... so its not huge), but > > many times the command just hangs. Jstack shows blocked threads, > > thread dump is shown below. I looked around for this type of > > issue, and found this unresolved issue > > http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=3D5104239 > > , but > > it was reported against 1.4.1, Anybody faced this issue, or have > > any insight...not sure if this is an issue with sun jvm or ADS code= . > > > > > > The command I'm using is this > > > > (root)/usr/local/apacheds-1.0_RC3/bin#./apacheds-tools.sh dump -i > > /usr/local/apacheds-1.0_RC3 -p etouch -f /home/wikireg/dump > > > > this is how my apacheds-tools.sh looks like. > > > > #!/bin/sh > > # Really simple script to launch apacheds tools with RPM installer > > #JAVA_HOME=3D/usr/java/j2sdk1.4.2_06 > > JAVA_HOME=3D/usr/java/jdk1.5.0_07 > > APACHEDS_HOME=3D/usr/local/apacheds- 1.0_RC3 > > #$JAVA_HOME/bin/java -jar $APACHEDS_HOME/bin/apacheds-tools.jar $@ > > $JAVA_HOME/bin/java -classpath > > $APACHEDS_HOME/bin/apacheds-tools.jar:$APACHEDS_HOME/lib/ext/et.jar > > org.apache.directory.server.tools.ApachedsTools $@ > > > > > > thread dump (using jstack... as kill -3 is not working ) > > > -------------------------------------------------------------------------= ------------------------- > > (root)/usr/java/jdk1.5.0_07/bin#ps -U root | grep java > > 988 ? 00:12:20 java > > 2027 pts/0 00:00:01 java > > (root)/usr/java/jdk1.5.0_07/bin#./jstack 2027 > > Attaching to process ID 2027, please wait... > > Debugger attached successfully. > > Server compiler detected. > > JVM version is 1.5.0_07-b03 > > Thread 2035: (state =3D BLOCKED) > > > > > > Thread 2034: (state =3D BLOCKED) > > - java.lang.Object.wait(long) @bci=3D0 (Interpreted frame) > > - java.lang.ref.ReferenceQueue.remove(long) @bci=3D44, line=3D116 > > (Interpreted fram > > e) > > - java.lang.ref.ReferenceQueue.remove() @bci=3D2, line=3D132 > > (Interpreted frame) > > - java.lang.ref.Finalizer$FinalizerThread.run() @bci=3D3, line=3D1= 59 > > (Interpreted f > > rame) > > > > > > Thread 2033: (state =3D BLOCKED) > > - java.lang.Object.wait(long) @bci=3D0 (Interpreted frame) > > - java.lang.Object.wait() @bci=3D2, line=3D474 (Interpreted frame) > > - java.lang.ref.Reference$ReferenceHandler.run() @bci=3D46, > > line=3D116 (Interpreted > > frame) > > > > > > Thread 2027: (state =3D BLOCKED) > > - sun.misc.Resource.getBytes() @bci=3D16, line=3D75 (Interpreted f= rame) > > - java.net.URLClassLoader.defineClass(java.lang.String, > > sun.misc.Resource) @bci > > =3D219, line=3D256 (Interpreted frame) > > - java.net.URLClassLoader.access$100(java.net.URLClassLoader, > > java.lang.String, > > sun.misc.Resource) @bci=3D3, line=3D56 (Interpreted frame) > > - java.net.URLClassLoader$1.run() @bci=3D43, line=3D195 (Interpret= ed > > frame) > > - > > java.security.AccessController.doPrivileged( > java.security.PrivilegedException > > Action, java.security.AccessControlContext) @bci=3D0 (Interpreted > frame) > > - java.net.URLClassLoader.findClass(java.lang.String) @bci=3D13, > > line=3D188 (Interp > > reted frame) > > - java.lang.ClassLoader.loadClass(java.lang.String, boolean) > > @bci=3D43, line=3D306 > > (Interpreted frame) > > - sun.misc.Launcher$AppClassLoader.loadClass(java.lang.String, > > boolean) @bci=3D36 > > , line=3D268 (Interpreted frame) > > - java.lang.ClassLoader.loadClass(java.lang.String) @bci=3D3, > > line=3D251 (Interpret > > ed frame) > > - java.lang.ClassLoader.loadClassInternal(java.lang.String) > > @bci=3D2, line=3D319 (I > > nterpreted frame) > > - > > > org.springframework.beans.factory.support.AbstractBeanFactory.transformed= Bean > > > > Name(java.lang.String) @bci=3D1, line=3D555 (Interpreted frame) > > - > > > org.springframework.beans.factory.support.AbstractBeanFactory.getType( > > java.la > > ng.String) @bci=3D2, line=3D303 (Interpreted frame) > > - > > > org.springframework.context.support.AbstractApplicationContext.getType( > java.l > > ang.String) @bci=3D5, line=3D552 (Interpreted frame) > > - > > > org.springframework.context.support.AbstractApplicationContext.invokeBean= Fact > > > > oryPostProcessors() @bci=3D80, line=3D357 (Interpreted frame) > > - > > > org.springframework.context.support.AbstractApplicationContext.refresh() > > @bci > > =3D289, line=3D294 (Interpreted frame) > > - > > org.springframework.context.support.FileSystemXmlApplicationContext > > .(ja > > va.lang.String[], boolean) @bci=3D14, line=3D82 (Interpreted frame) > > - > > org.springframework.context.support.FileSystemXmlApplicationContext > .(ja > > va.lang.String[]) @bci=3D3, line=3D67 (Interpreted frame) > > - > > org.springframework.context.support.FileSystemXmlApplicationContext > .(ja > > va.lang.String) @bci=3D9, line=3D58 (Interpreted frame) > > - > > org.apache.directory.server.tools.ApachedsTools.main( > java.lang.String > > []) @bci > > =3D413, line=3D103 (Interpreted frame) > > > > Thanks, > > Ajay > > > > > > ------=_Part_6621_14824379.1154240122351 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline added this in JIRA...

-Ajay

On 7/29/06, Emmanuel Lecharny <elecharny@gmail.com> wrote:<= blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, 2= 04, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"> Ajay Upadhyaya a =E9crit :

> Hi,
> Sorry for posting this a= gain...

np.

>
> I'd posted this issue sometime back.= .. I didn't get chance afterwards
> to dig deeper into this issue, an= yone has any update/idea, or has
> anyone else encountered this issue.

Well, no...

>=
> Dump is an important aspect for us to deploy ADS in production for= the
> backup purposes. I'm currently using other option (like recurs= ively
> traversing the tree using jndi based client) for ADS 0.9, but as o= ur
> ldap entries grow, the jndi-client is a slower option. So I'm lo= oking
> forward to the Dump utility in ADS 1.0RC3

The dump com= mand has been modified recently, but I don't think it will
fix your issue.

I have a few questions regarding what is happeni= ng :
1) Are you dumping data while other clients do some searches ?
2= ) Is it working well if you try to export data without any client
connec= ted ?
3) Do you get any result, even partial ?
4) Is it working 100% with = tools like LdapBrowser or JXplorer ?

I think that somebody may spend= some time on your problem on monday.

Btw, It would be much better i= f you fill a JIRA about this problem. JIRA
is reliable, we read issues at least once a week, we can build a roadma= p
based on JIRAs. On the opposite, mail are just like fire and forgetweapons. If you catch somebody on the other side, perfect. Otherwise,
you may have to post again, and again... Last point: with JIRA, we can'tloose a piece of information. If I need to check for any piece of
infor= mation, it will be related to the JIRA issue. If I have to do the
same w= ith mail, there is a good chance that I miss at least one or two
mails. And it's not very funny to check a lot of unrelated mails, too .= ..

Run JIRA, run !!! :)

Emmanuel

>
> Thanks,<= br>> Ajay
>
> On 7/13/06, *Ajay Upadhyaya* < ajayup@gmail.com
> <mailto:ajayup@gmail.com>> wrote:
>
>    = ; Hi,
>     I'm trying out apacheds1.0-RC3
>= ;
>     here is my env details
>     Linux 2.4.20-8smp, 2CPU HT, jdk1.5.0_07
>= ;
>     I've a custom schema extension defined (w= orks fine), and a data
>     partition. ADS is wo= rking fine. When I try the dump command using
>   &nbs= p; apacheds-tools the dump is produced sometimes successfully (there
>     are 2227 entries in the exported file... s= o its not huge), but
>     many times the command= just hangs. Jstack shows blocked threads,
>     = thread dump is shown below. I looked around for this type of
>     issue, and found this unresolved issue
= >     http://bugs.sun.com/bugdatabase/view_bug.do?bug_= id=3D5104239
>     < http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=3D5104239>, but>     it was reported against 1.4.1, Anybody faced= this issue, or have
>     any insight...not sure= if this is an issue with sun jvm or ADS code.
>
>
>     The command I'm using is t= his
>
>     (root)/usr/local/apacheds-1.0_R= C3/bin#./apacheds-tools.sh dump -i
>     /usr/loc= al/apacheds-1.0_RC3 -p etouch -f /home/wikireg/dump
>
>     this is how my apacheds-tools.sh looks lik= e.
>
>     #!/bin/sh
>  &nb= sp;  # Really simple script to launch apacheds tools with RPM installe= r
>     #JAVA_HOME=3D/usr/java/j2sdk1.4.2_06
&= gt;     JAVA_HOME=3D/usr/java/jdk1.5.0_07
>     APACHEDS_HOME=3D/usr/local/apacheds- 1.0_R= C3
>     #$JAVA_HOME/bin/java -jar $APACHEDS_HOME= /bin/apacheds-tools.jar $@
>     $JAVA_HOME/bin/j= ava -classpath
>     $APACHEDS_HOME/bin/apacheds-= tools.jar:$APACHEDS_HOME/lib/ext/et.jar
>     org.apache.directory.server.tools.Apacheds= Tools $@
>
>
>     thread dump (using= jstack... as kill -3 is not working )
>     ----= ---------------------------------------------------------------------------= -------------------
>     (root)/usr/java/jdk1.5.0_07/bin#ps -U root= | grep java
>       988 ?  &= nbsp;     00:12:20 java
>   &= nbsp;  2027 pts/0    00:00:01 java
>&nb= sp;    (root)/usr/java/jdk1.5.0_07/bin#./jstack 2027
>=      Attaching to process ID 2027, please wait...
>     Debugger attached successfully.
>&nb= sp;    Server compiler detected.
>   &n= bsp; JVM version is 1.5.0_07-b03
>     Thread 203= 5: (state =3D BLOCKED)
>
>
>     Thre= ad 2034: (state =3D BLOCKED)
>      - java.lang.Object.wait(long) @= bci=3D0 (Interpreted frame)
>      - ja= va.lang.ref.ReferenceQueue.remove(long) @bci=3D44, line=3D116
> =     (Interpreted fram
>     e)
= >      - java.lang.ref.ReferenceQueue.remo= ve () @bci=3D2, line=3D132
>     (Interpreted frame)=
>      - java.lang.ref.Finalizer$Final= izerThread.run() @bci=3D3, line=3D159
>     (Inte= rpreted f
>     rame)
>
>
>&nbs= p;    Thread 2033: (state =3D BLOCKED)
>      - java.lang.Object.wait(long) @= bci=3D0 (Interpreted frame)
>      - ja= va.lang.Object.wait() @bci=3D2, line=3D474 (Interpreted frame)
> = ;     - java.lang.ref.Reference$ReferenceHandler.r= un() @bci=3D46,
>     line=3D116 (Interpreted
>  &nb= sp;   frame)
>
>
>    = Thread 2027: (state =3D BLOCKED)
>     &nbs= p;- sun.misc.Resource.getBytes() @bci=3D16, line=3D75 (Interpreted frame)>      - java.net.URLClassLoader.defineC= lass (java.lang.String,
>     sun.misc.Resource) @bci<= br>>     =3D219, line=3D256 (Interpreted frame)
&= gt;      - java.net.URLClassLoader.access$100= (java.net.URLClassLoader,
>     java.lang.String,=
>      sun.misc.Resource ) @bci=3D3, line=3D56 (Interpreted frame)
>    &n= bsp; - java.net.URLClassLoader$1.run() @bci=3D43, line=3D195 (Interpre= ted
>     frame)
>    &= nbsp; -
>     java.security.AccessController= .doPrivileged(java.security.PrivilegedException
>     Action, java.security.AccessControlContext= ) @bci=3D0 (Interpreted frame)
>      -= java.net.URLClassLoader.findClass(java.lang.String) @bci=3D13,
>&nbs= p;    line=3D188 (Interp
>     ret= ed frame)
>      -=20 java.lang.ClassLoader.loadClass(java.lang.String, boolean)
> &nb= sp;   @bci=3D43, line=3D306
>     (Inte= rpreted frame)
>      - sun.misc.Launch= er$AppClassLoader.loadClass(java.lang.String,
>   &nbs= p; boolean) @bci=3D36
>     , line=3D268 (Interpreted frame)
>&n= bsp;     - java.lang.ClassLoader.loadClass(java.la= ng.String) @bci=3D3,
>     line=3D251 (Interpret<= br>>     ed frame)
>    &n= bsp; - java.lang.ClassLoader.loadClassInternal (java.lang.String)
>     @bci=3D2, line=3D319 (I<= br>>     nterpreted frame)
>   =    -
>     org.springframework.bea= ns.factory.support.AbstractBeanFactory.transformedBean
>
> = ;    Name(java.lang.String ) @bci=3D1, line=3D555 (Interpreted frame)
>    &= nbsp; -
>     org.springframework.beans.fact= ory.support.AbstractBeanFactory.getType(
>     java.la <http://= java.la >
>     ng.String) @bci=3D2, line=3D303 (I= nterpreted frame)
>      -
> = ;    org.springframework.context.support.AbstractApplication= Context.getType(java.l
>     ang.String) @bci=3D5= , line=3D552 (Interpreted frame)
>      -
>   &nbs= p; org.springframework.context.support.AbstractApplicationContext.invokeBea= nFact
>
>     oryPostProcessors() @bci=3D80= , line=3D357 (Interpreted frame)
>      = ;-
>     org.springframework.context.support.Abst= ractApplicationContext.refresh ()
>     @bci
>     =3D= 289, line=3D294 (Interpreted frame)
>     &n= bsp;-
>     org.springframework.context.support.F= ileSystemXmlApplicationContext
>     .<init>= ;(ja
>     va.lang.String[], boolean) @bci=3D14, = line=3D82 (Interpreted frame)
>      -
>   &nbs= p; org.springframework.context.support.FileSystemXmlApplicationContext.<= init>(ja
>     va.lang.String[]) @bci=3D3, lin= e=3D67 (Interpreted frame)
>      -
= >     org.springframework.context.support.FileSystem= XmlApplicationContext .<init>(ja
>     va.lang.String) @bci=3D9, = line=3D58 (Interpreted frame)
>      -<= br>>     org.apache.directory.server.tools.ApachedsT= ools.main(java.lang.String
>     []) @bci
>=      =3D413, line=3D103 (Interpreted frame)
>
>     Thanks,
>   &= nbsp; Ajay
>
>


------=_Part_6621_14824379.1154240122351--