To review what was running on the JVM when you perform the kill -3 you can use IBM's Thread and Monitor Dump Analyzer (http://www.alphaworks.ibm.com/tech/jca).
HTH

Luciano

On Tue, Jul 19, 2011 at 11:09 AM, Kevan Miller <kevan.miller@gmail.com> wrote:

On Jul 19, 2011, at 8:04 AM, ranbaab wrote:

> Hi Kevan,
>
> First I would like to thank you for your valuable advice and support.
>
> Below are the steps followed to get the dump, please let me know if I miss
> any steps
>
> 1. Command for undeploy
>
> [root@fc70 bin]# ./deploy.sh --user system --password manager undeploy
> ibm/bhm/application/war
> Using GERONIMO_HOME:   /opt/ibm/BLADEHarmonyManager/webserver
> Using GERONIMO_TMPDIR: var/temp
> Using JRE_HOME:        /usr/java/ibm-java-i386-60/jre
>
> It stuck here, no further message ....
>
>
> 2. Check for the PID (another console)
>
> [root@fc70 ~]# ps -ef | grep java
> root      4716     1  1 16:01 ?        00:00:59 xxxxdataBase
> root      5701     1  6 16:52 pts/1    00:00:33 xxxxApplication
> root      5788  5784  3 16:56 pts/1    00:00:09 xxxxxApplication
> bin/deployer.jar --user system --password manager undeploy /application/war
> root      5844  5546  0 17:00 pts/2    00:00:00 grep java
>
> *This means that the server PID is 5701 and undeploy command PID is 5788.*
>
> 3. Command to generate java stack traces
> [root@fc70 ~]# kill -3 5701
>
> The above command generate a dump in the folder bin.
>
> *Some last line from the file.*
>
> 3CLTEXTCLASS                          org/apache/geronimo/tomcat/model/LocalEjbType(0x0BB75D60)
> 3CLTEXTCLASS                          org/apache/geronimo/tomcat/model/ResourceType(0x0BB75E80)
> 3CLTEXTCLASS
> org/apache/geronimo/tomcat/model/ResourceEnvRefType(0x0BB761C0)
> 3CLTEXTCLASS
> org/apache/geronimo/tomcat/model/ServiceRefType(0x0BB762B0)
> 3CLTEXTCLASS
> org/apache/geronimo/tomcat/model/TransactionType(0x0BB763A0)
> 3CLTEXTCLASS
> org/apache/geronimo/tomcat/model/ConnectorType$JaxbAccessorF_emptySessionPath(0x0BB764C0)
> 3CLTEXTCLASS
> org/apache/geronimo/tomcat/model/ConnectorType$JaxbAccessorF_enableLookups(0x0BB76640)
> 3CLTEXTCLASS
> org/apache/geronimo/tomcat/model/ConnectorType$JaxbAccessorF_maxPostSize(0x0BB767C0)
> 3CLTEXTCLASS
> org/apache/geronimo/tomcat/model/ConnectorType$JaxbAccessorF_maxSavePostSize(0x0BB76940)
> 3CLTEXTCLASS                          org/apache/catalina/connector/Connector(0x0BB69410)
> 3CLTEXTCLASS                          org/apache/catalina/Container(0x0BB6A3F0)
> 3CLTEXTCLASS                          org/apache/catalina/Context(0x0BB6A720)
> 3CLTEXTCLASS                          org/apache/geronimo/tomcat/TomcatContext(0x0BB6B090)
> 3CLTEXTCLASS                          org/apache/geronimo/tomcat/TomcatWebContainer(0x0BA0E7F0)
> 3CLTEXTCLASS                          org/apache/geronimo/tomcat/TomcatContainer(0x0BA0E900)
> 3CLTEXTCLASS                          org/apache/geronimo/tomcat/ObjectRetriever(0x0BA0F0E0)
> 3CLTEXTCLASS                          org/apache/geronimo/tomcat/BaseGBean(0x0BA0F1B0)
> 3CLTEXTCLASS
> org/apache/geronimo/tomcat/LifecycleListenerGBean(0x0BA0F330)
> 3CLTEXTCLASS                          org/apache/catalina/Lifecycle(0x0BA0F670)
> 3CLTEXTCLASS
> org/apache/geronimo/tomcat/TomcatServerConfigManager(0x0BB2B340)
> 3CLTEXTCLASS                          org/apache/catalina/Server(0x0BB2B720)
> 3CLTEXTCLASS                          org/apache/catalina/Service(0x0BB2B8B0)
> 3CLTEXTCLASS                          org/apache/geronimo/tomcat/TomcatServerGBean(0x0BB2ACE0)
> 3CLTEXTCLASS                          org/apache/geronimo/tomcat/TomcatManagerImpl(0x0BA94030)
> 2CLTEXTCLLOAD                 Loader
> org/apache/geronimo/kernel/config/ChildrenConfigurationClassLoader(0xA87926B0)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xA9924328)
> 3CLTEXTCLASS
> sun/reflect/GeneratedSerializationConstructorAccessor139(0x0C809E90)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xA9929C30)
> 3CLTEXTCLASS
> sun/reflect/GeneratedSerializationConstructorAccessor140(0x0C80A240)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xA9935C78)
> 3CLTEXTCLASS
> sun/reflect/GeneratedSerializationConstructorAccessor141(0x0C80B3A0)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xA993B688)
> 3CLTEXTCLASS
> sun/reflect/GeneratedSerializationConstructorAccessor142(0x0C80B6F0)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xA993FD30)
> 3CLTEXTCLASS
> sun/reflect/GeneratedSerializationConstructorAccessor143(0x0C80C440)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xA99486D8)
> 3CLTEXTCLASS
> sun/reflect/GeneratedSerializationConstructorAccessor144(0x0C80C790)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xA994DFC8)
> 3CLTEXTCLASS                          sun/reflect/GeneratedMethodAccessor69(0x0C80CAE0)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xA99581A0)
> 3CLTEXTCLASS
> sun/reflect/GeneratedSerializationConstructorAccessor145(0x0C80F1F0)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA92C7850)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA92D4580)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xAA0E65D8)
> 3CLTEXTCLASS
> sun/reflect/GeneratedSerializationConstructorAccessor146(0x0C7D8530)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xAA0ECB10)
> 3CLTEXTCLASS
> sun/reflect/GeneratedSerializationConstructorAccessor147(0x0C7D88E0)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xAA0F3620)
> 3CLTEXTCLASS
> sun/reflect/GeneratedSerializationConstructorAccessor148(0x0C7D9160)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xAA100AB0)
> 3CLTEXTCLASS
> sun/reflect/GeneratedSerializationConstructorAccessor149(0x0C7D99E0)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xAA105C60)
> 3CLTEXTCLASS                          sun/reflect/GeneratedMethodAccessor70(0x0C7DA900)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA92E12B8)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xAA114AA8)
> 3CLTEXTCLASS
> sun/reflect/GeneratedSerializationConstructorAccessor150(0x0C7DAD90)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA92EE170)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xAA131020)
> 3CLTEXTCLASS                          sun/reflect/GeneratedMethodAccessor71(0x0C7DB610)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA92FAF28)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA9307D90)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA9314B10)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA93218B0)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA932E7D0)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA933B4F0)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xAA17F920)
> 3CLTEXTCLASS                          sun/reflect/GeneratedMethodAccessor72(0x0C7DE160)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xAA18D218)
> 3CLTEXTCLASS                          sun/reflect/GeneratedMethodAccessor73(0x0C7DD8D0)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA9348300)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xAA193790)
> 3CLTEXTCLASS                          sun/reflect/GeneratedMethodAccessor74(0x0C7DF790)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA9355428)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA93635E0)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA9375180)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA9382040)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA938F6A8)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xAA1E0BA0)
> 3CLTEXTCLASS                          sun/reflect/GeneratedMethodAccessor75(0x0C7E0190)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA939C460)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xAA1EEA50)
> 3CLTEXTCLASS                          sun/reflect/GeneratedMethodAccessor76(0x0C7E0730)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA93A9180)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA93B60B8)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA93C57D0)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA93D25B8)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA93DF4D0)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA93EC2F8)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA93F9138)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA9406108)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA9412EB8)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA941FD68)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA942CB38)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA9439948)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA9446810)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA94536C0)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA9462508)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA946F290)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA947EA98)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA94875C8)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA9490E10)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA949A3A8)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA94AED70)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA94B8550)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA94CE570)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA94DE100)
> 2CLTEXTCLLOAD                 Loader
> com/sun/jmx/remote/util/OrderClassLoaders(0xA94EDAD8)
> 2CLTEXTCLLOAD                 Loader sun/reflect/DelegatingClassLoader(0xA979B258)
> 3CLTEXTCLASS                          sun/reflect/GeneratedMethodAccessor77(0x0AA6E170)
> NULL
> ------------------------------------------------------------------------
> 0SECTION       Javadump End section
> NULL           ---------------------- END OF DUMP
> -------------------------------------
>
>
> I am not able to understand anything from the dump.
>
> Note: - Our application has its own jre.
>           The UI cannot be launch.
>           No clue in the geronimo.log

That's obviously an IBM JRE. There's a section int the dump with the Thread stack traces. Agreed that it's not easy to read... But the data should be in there. If you can post the dump where we can download it, I expect someone can take a look at it. Two choices -- a site of your own choosing or create a Geronimo Jira and attach the dump file to the Jira issue. Here's a pointer to the Geronimo Jira -- https://issues.apache.org/jira/browse/GERONIMO

--kevan