activemq-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From pfid12 ...@informationsdesign.de>
Subject ActiveMQ-cpp client hangs in receiving messages from queue
Date Mon, 01 Aug 2011 13:58:07 GMT
Hello,

we're using activemq for about 4 years now, and recently started to have
severe problems with the product. We were using the software on a RHEL3
host, but migrated to a RHEL5 virtual machine like 2 months ago. Since then,
our consumer-program hangs in receiving messages from the activemq-broker
randomly once a week. Since the receiving of messages is done in a seperate
thread by the activemq-cpp library, the programm itself will work still, but
there is just no more messages coming in. A self-implemented keep alive
mechanism will detect this, and try to recover the connection. But this will
also fail, because the programm will completely get stuck in closing the
activemq connection/objects, where it can only be killed (SIGKILL). We also
have a surveillance mechanism for such cases, but its causing a downtime of
a couple of minutes for us.

As for the versions, we are currently using version 2.1.1 of the
activemq-cpp library, as well as version 4.1.2 of the activemq-broker. This
is the versions we found to be most stable, since we had major problems with
the activemq software in the past (we even restart the activemq-broker via
cronjob every night for stability reasons).

When we started to have this problem, we ported our programs to version
3.4.0 of the activemq-cpp library, and also upgraded to the latest activemq
broker version 5.5.0. There was, however, no change, and our program still
hangs in receiving messages.
The backtrace of the program, which will get stuck in closing the
activemq-objects, looks like this:


#0  0x0000003cc9007b35 in pthread_join () from /lib64/libpthread.so.0
#1  0x00000000004e4f91 in activemq::concurrent::Thread::join
(this=0x2aaaac026290) at activemq/concurrent/Thread.cpp:102
#2  0x00000000004da652 in activemq::core::ActiveMQSessionExecutor::close
(this=0x2aaaac0267a0) at activemq/core/ActiveMQSessionExecutor.cpp:64
#3  0x00000000004da924 in
activemq::core::ActiveMQSessionExecutor::~ActiveMQSessionExecutor
(this=0x4a85a9d0, __in_chrg=<value optimized out>) at
activemq/core/ActiveMQSessionExecutor.cpp:46
#4  0x00000000004cf14f in activemq::core::ActiveMQSession::close
(this=0x2aaaac026640) at activemq/core/ActiveMQSession.cpp:130
#5  0x0000000000418f07 in ActiveMqQueue::close (this=0x357fe50) at
activemqqueue.cc:442

Full backtrace of all threads is attached after the post.

Note: this is a backtrace of the 2.1.1 version. When we realized the upgrade
to the latest version would not improve the situation, we decided to do a
fallback to the old versions. Therefore, I unfortunately don't have a
backtrace for the 3.4.0 version of the program (I'm sorry for this).

Our program is managing 27 connections (read-mode only), where it receives
messages from 27 external systems (all 27 connections go to queues on the
same=our broker). In the backtrace above, 8 of the 27 connections were
already closed/destroyed, and connection 9 is getting closed.
If i should post the sourcecode of my custom wrapper-class (ActiveMqQueue),
please let me know.

The broker and our programs are running in a high-availability operational
environment of our customer, and we cannot switch back/forth between
versions easily, so I cannot provide any more information I'm afraid. The
problems and restarts cause a critical downtime to our system, which we have
to avoid at any cost, so any help will be much appreciated.


Backtrace of all threads:


(gdb) thread apply all bt

Thread 39 (Thread 5799):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac022900, buffer=0x2aaaac02a4f0 "<some data here>", 
    bufferSize=<value optimized out>) at
activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac022a40) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac022a40, targetBuffer=0x49e58ec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac02c350) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac02c350) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac02b5b0, dis=0x2aaaac02c350) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac02a2c0) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 38 (Thread 5802):
#8  0x0000000000424b77 in AmqInAdapter::onMessage (this=0x357fe50,
message=0x3537990) at inadapter.cc:167
#9  0x000000000053fa47 in activemq::core::ActiveMQConsumer::dispatch
(this=0x2aaaac026b90, data=<value optimized out>) at
activemq/core/ActiveMQConsumer.cpp:429
#10 0x00000000004d9108 in activemq::core::ActiveMQSessionExecutor::dispatch
(this=<value optimized out>, data=...) at
activemq/core/ActiveMQSessionExecutor.cpp:188
#11 0x00000000004dac77 in
activemq::core::ActiveMQSessionExecutor::dispatchAll (this=0x2aaaac0267a0)
at activemq/core/ActiveMQSessionExecutor.cpp:273
#12 0x00000000004db035 in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac0267a0) at activemq/core/ActiveMQSessionExecutor.cpp:211
#13 0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#14 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#15 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 37 (Thread 5803):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac02bf90, buffer=0x2aaaac027410 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac02c090) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac02c090, targetBuffer=0x40d2dec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac029150) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac029150) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac026cf0, dis=0x2aaaac029150) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac0271e0) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 36 (Thread 5806):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac0236a0, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x4b25af34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac023670) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 35 (Thread 5807):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac023b40, buffer=0x2aaaac0242e0 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac028db0) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac028db0, targetBuffer=0x4bc5bec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac025f50) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac025f50) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac0251d0, dis=0x2aaaac025f50) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac0240b0) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 34 (Thread 5810):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac0199e0, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x4c65cf34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac0199b0) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 33 (Thread 5811):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac025c50, buffer=0x2aaaac01a3f0 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac025d50) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac025d50, targetBuffer=0x4d05dec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac01c1d0) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac01c1d0) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac01b560, dis=0x2aaaac01c1d0) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac01a1c0) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 32 (Thread 5814):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac01cae0, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x4da5ef34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac01cab0) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 31 (Thread 5815):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac01d7b0, buffer=0x2aaaac01d990 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac01d8f0) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac01d8f0, targetBuffer=0x4e45fec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac01f450) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac01f450) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac01e770, dis=0x2aaaac01f450) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac01d490) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 30 (Thread 5818):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac000e10, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x4ee60f34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac000de0) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 29 (Thread 5819):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac001860, buffer=0x2aaaac001a00 "", bufferSize=<value optimized
out>)
    at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac001960) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac001960, targetBuffer=0x4f861ec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac003580) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac003580) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac0028e0, dis=0x2aaaac003580) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac001540) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 28 (Thread 5822):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac003f00, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x50262f34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac003ed0) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 27 (Thread 5823):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac004a60, buffer=0x2aaaac004c00 "\n", bufferSize=<value
optimized out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac004b60) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac004b60, targetBuffer=0x50c63ec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac0067a0) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac0067a0) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac005b20, dis=0x2aaaac0067a0) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac004740) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 26 (Thread 5826):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac007120, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x51664f34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac0070f0) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 25 (Thread 5827):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac007c80, buffer=0x2aaaac007e20 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac007d80) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac007d80, targetBuffer=0x52065ec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac0099d0) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac0099d0) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac008d70, dis=0x2aaaac0099d0) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac007960) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 24 (Thread 5830):
#8  0x0000000000424b77 in AmqInAdapter::onMessage (this=0x3677e00,
message=0x3538370) at inadapter.cc:167
#9  0x000000000053fa47 in activemq::core::ActiveMQConsumer::dispatch
(this=0x2aaaac00a710, data=<value optimized out>) at
activemq/core/ActiveMQConsumer.cpp:429
#10 0x00000000004d9108 in activemq::core::ActiveMQSessionExecutor::dispatch
(this=<value optimized out>, data=...) at
activemq/core/ActiveMQSessionExecutor.cpp:188
#11 0x00000000004dac77 in
activemq::core::ActiveMQSessionExecutor::dispatchAll (this=0x2aaaac00a320)
at activemq/core/ActiveMQSessionExecutor.cpp:273
#12 0x00000000004db035 in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac00a320) at activemq/core/ActiveMQSessionExecutor.cpp:211
#13 0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#14 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#15 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 23 (Thread 5831):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac00aeb0, buffer=0x2aaaac00b050 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac00afb0) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac00afb0, targetBuffer=0x53467ec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac00cbc0) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac00cbc0) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac00c090, dis=0x2aaaac00cbc0) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac00ab90) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 22 (Thread 5834):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac00d5a0, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x53e68f34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac00d570) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 21 (Thread 5835):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac00ca20, buffer=0x2aaaac00e1d0 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac00e130) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac00e130, targetBuffer=0x54869ec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac00fe10) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac00fe10) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac00f250, dis=0x2aaaac00fe10) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac00dd50) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 20 (Thread 5838):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac010790, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x5526af34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac010760) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 19 (Thread 5839):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac057fe0, buffer=0x2aaaac058180 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac0580e0) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac0580e0, targetBuffer=0x55c6bec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac059e00) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac059e00) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac059280, dis=0x2aaaac059e00) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac057db0) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 18 (Thread 5842):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac05a680, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x5666cf34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac05a650) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 17 (Thread 5843):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac05b200, buffer=0x2aaaac05b3e0 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac05b340) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac05b340, targetBuffer=0x5706dec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac05d020) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac05d020) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac05c4e0, dis=0x2aaaac05d020) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac05af80) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 16 (Thread 5846):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac05d8a0, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x57a6ef34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac05d870) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 15 (Thread 5847):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac05e470, buffer=0x2aaaac05e610 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac05e570) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac05e570, targetBuffer=0x5846fec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac060230) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac060230) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac05f710, dis=0x2aaaac060230) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac05e1a0) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 14 (Thread 5850):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac060ab0, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x58e70f34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac060a80) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 13 (Thread 5851):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac061680, buffer=0x2aaaac061860 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac0617c0) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac0617c0, targetBuffer=0x59871ec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac063460) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac063460) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac062960, dis=0x2aaaac063460) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac0613b0) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 12 (Thread 5854):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac063cc0, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x5a272f34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac063c90) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 11 (Thread 5855):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac064890, buffer=0x2aaaac064a70 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac0649d0) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac0649d0, targetBuffer=0x5ac73ec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac066670) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac066670) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac065b70, dis=0x2aaaac066670) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac0645c0) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 10 (Thread 5858):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac066ed0, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x5b674f34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac066ea0) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 9 (Thread 5859):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac067aa0, buffer=0x2aaaac067c80 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac067be0) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac067be0, targetBuffer=0x5c075ec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac069880) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac069880) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac068d80, dis=0x2aaaac069880) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac0677d0) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 8 (Thread 5862):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac06a0e0, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x5ca76f34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac06a0b0) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 7 (Thread 5863):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac06ac90, buffer=0x2aaaac06ae70 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac06add0) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac06add0, targetBuffer=0x5d477ec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac06ca70) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac06ca70) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac06bf70, dis=0x2aaaac06ca70) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac06a9c0) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 6 (Thread 5866):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac06d2f0, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x5de78f34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac06d2c0) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 5 (Thread 5867):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac06dea0, buffer=0x2aaaac06e080 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac06dfe0) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac06dfe0, targetBuffer=0x5e879ec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac06fc80) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac06fc80) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac06f180, dis=0x2aaaac06fc80) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac06dbd0) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 4 (Thread 5870):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac070500, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x5f27af34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac0704d0) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 3 (Thread 5871):
#0  0x0000003cc900dc81 in recv () from /lib64/libpthread.so.0
#1  0x00000000005d9d72 in activemq::network::SocketInputStream::read
(this=0x2aaaac0710d0, buffer=0x2aaaac0712b0 "", bufferSize=<value optimized
out>) at activemq/network/SocketInputStream.cpp:148
#2  0x0000000000540fcb in activemq::io::BufferedInputStream::bufferData
(this=0x2aaaac071210) at activemq/io/BufferedInputStream.cpp:190
#3  0x000000000054145b in activemq::io::BufferedInputStream::read
(this=0x2aaaac071210, targetBuffer=0x5fc7bec0 "", targetBufferSize=4) at
activemq/io/BufferedInputStream.cpp:123
#4  0x00000000004dee89 in readAllData (this=0x2aaaac072eb0) at
./activemq/io/DataInputStream.h:369
#5  activemq::io::DataInputStream::readInt (this=0x2aaaac072eb0) at
activemq/io/DataInputStream.cpp:166
#6  0x0000000000546ae5 in
activemq::connector::openwire::OpenWireFormat::unmarshal
(this=0x2aaaac0723b0, dis=0x2aaaac072eb0) at
activemq/connector/openwire/OpenWireFormat.cpp:218
#7  0x0000000000548d31 in
activemq::connector::openwire::OpenWireCommandReader::readCommand
(this=<value optimized out>) at
activemq/connector/openwire/OpenWireCommandReader.cpp:71
#8  0x00000000004c3f90 in activemq::transport::IOTransport::run
(this=0x2aaaac070e00) at activemq/transport/IOTransport.cpp:166
#9  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#10 0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#11 0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 2 (Thread 5875):
#0  0x0000003cc900aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00000000004e4ad3 in activemq::concurrent::Mutex::wait
(this=0x2aaaac073710, millisecs=4294967295) at
activemq/concurrent/Mutex.cpp:151
#2  0x00000000004e46cf in activemq::concurrent::Mutex::wait
(this=0x61343f34) at activemq/concurrent/Mutex.cpp:102
#3  0x00000000004db08a in activemq::core::ActiveMQSessionExecutor::run
(this=0x2aaaac0736e0) at activemq/core/ActiveMQSessionExecutor.cpp:230
#4  0x00000000004e5160 in activemq::concurrent::Thread::runCallback
(param=<value optimized out>) at activemq/concurrent/Thread.cpp:152
#5  0x0000003cc900673d in start_thread () from /lib64/libpthread.so.0
#6  0x0000003cc88d44bd in clone () from /lib64/libc.so.6

Thread 1 (Thread 1954):
#0  0x0000003cc9007b35 in pthread_join () from /lib64/libpthread.so.0
#1  0x00000000004e4f91 in activemq::concurrent::Thread::join
(this=0x2aaaac026290) at activemq/concurrent/Thread.cpp:102
#2  0x00000000004da652 in activemq::core::ActiveMQSessionExecutor::close
(this=0x2aaaac0267a0) at activemq/core/ActiveMQSessionExecutor.cpp:64
#3  0x00000000004da924 in
activemq::core::ActiveMQSessionExecutor::~ActiveMQSessionExecutor
(this=0x4a85a9d0, __in_chrg=<value optimized out>) at
activemq/core/ActiveMQSessionExecutor.cpp:46
#4  0x00000000004cf14f in activemq::core::ActiveMQSession::close
(this=0x2aaaac026640) at activemq/core/ActiveMQSession.cpp:130
#5  0x0000000000418f07 in ActiveMqQueue::close (this=0x357fe50) at
activemqqueue.cc:442
...
#11 0x00000000004183e9 in main (argc=2, argv=0x7fff232cbd18) at main.cc:28
(gdb) 


--
View this message in context: http://activemq.2283324.n4.nabble.com/ActiveMQ-cpp-client-hangs-in-receiving-messages-from-queue-tp3709719p3709719.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Mime
View raw message