activemq-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrei Shakirin (JIRA)" <>
Subject [jira] [Created] (AMQ-6894) Excessive number of connections by failover transport with priorityBackup
Date Tue, 30 Jan 2018 14:54:00 GMT
Andrei Shakirin created AMQ-6894:

             Summary: Excessive number of connections by failover transport with priorityBackup
                 Key: AMQ-6894
             Project: ActiveMQ
          Issue Type: Bug
          Components: Broker
    Affects Versions: 5.14.5
            Reporter: Andrei Shakirin

My clients connect to AMQ with this connection string:


 It works - for some time. But sooner or later my AMQ server becomes unresponsive because
the host it runs on runs out of resources (threads).

Suddenly AMQ Server log explodes with the messages like:


2018-01-26 09:26:16,909 | WARN  | Failed to register MBean org.apache.activemq :type=Broker,brokerName=activemq-vm-primary,connector=clientConnectors,connect


7-1516883370639-0_22 |

on | ActiveMQ Transport: tcp:///


2018-01-26 09:26:21,375 | WARN  | Ignoring ack received before dispatch; result of failover
with an outstanding ack. Acked messages will be replayed if present on this broker. Ignored
ack: MessageAck \{commandId = 157, responseRequired = false, ackType = 2, consumerId = ID:ca8f70e115d0-37087-1516883370639-1:22:10:1,
firstMessageId = ID:a95345a9c0df-33771-1516883685728-1:17:5:1:23, lastMessageId = ID:a95345a9c0df-33771-1516883685728-1:17:5:1:23,
destination = queue://Q.CHECKOUT.AUFTRAG_OUT, transactionId = null, messageCount = 1, poisonCause
= null} | | ActiveMQ Transport: tcp:///


2018-01-26 09:26:39,211 | WARN  | Transport Connection to: tcp:// failed: Connection reset |
| ActiveMQ InactivityMonitor Worker


2018-01-26 09:26:47,175 | WARN  | Transport Connection to: tcp:// failed: Broken pipe (Write failed) |
| ActiveMQ InactivityMonitor Worker


After short period of time AMQ server comes out of resources with "java.lang.OutOfMemoryError:
unable to create new native thread" error. The AMQ service process in this case has a huge
number of threads (some thousands)


The client side log contains a lot of reconnection attempts messages like:


2018-01-26 00:10:31,387 WARN    [\{{,org.apache.activemq.activemq-osgi}{bundle.version,5.14.1}\{,181}}]    
[null]  org.apache.activemq.transport.failover.FailoverTransport      Failed to connect
to [tcp://activemq-vm-primary:61616, tcp://activemq-vm-secondary:61616] after: 810 attempt(s)
continuing to retry.


It seems that client creates a huge number of connections by failover retry and after some
time kills the server.

Issue looks very similar to described in, however
server isn't configured with access control settings.

I found the description of similar problem into [], 
but without concrete suggestion.


Part of server log is attached

This message was sent by Atlassian JIRA

View raw message