activemq-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From simpel <meliye...@yahoo.com>
Subject Brigded brokers wont reconnect
Date Tue, 02 Feb 2010 20:52:13 GMT

I have 3 broker instances, with two of the brokers (BROKER-2 and BROKER-3)
connected to a third broker (BROKER-1) with duplex bridged connection.

After a period of inactivity, the bridged connection to one of the brokers
fails to reconnect and never gets reestablished.

Using ActiveMQ 5.3.0

The brokers are configured as follows:
BROKER-1
 <broker xmlns="http://activemq.apache.org/schema/core" brokerName="0.0.0.0"
dataDirectory="${activemq.base}/data">
    <managementContext>
      <managementContext createConnector="false"/>
    </managementContext>

    <networkConnectors>
      <networkConnector name="BROKER1" uri="static://(tcp://0.0.0.0:61616)">
      </networkConnector>
    </networkConnectors>

    <persistenceAdapter>
      <kahaDB directory="${activemq.base}/data/kahadb"/>
    </persistenceAdapter>

    <systemUsage>
      <systemUsage>
        <storeUsage>
          <storeUsage limit="1 gb" name="foo"/>
        </storeUsage>
      </systemUsage>
    </systemUsage>

    <transportConnectors>
      <transportConnector name="openwire" uri="tcp://0.0.0.0:61616"/>
    </transportConnectors>
  </broker>

BROKER-2 and BROKER-3: have duplex bridge to BROKER1
  <broker xmlns="http://activemq.apache.org/schema/core"
brokerName="0.0.0.0" dataDirectory="${activemq.base}/data">
    <managementContext>
      <managementContext createConnector="false"/>
    </managementContext>

    <networkConnectors>
      <networkConnector name="BROKER-2" duplex="true"
uri="static://(tcp://0.0.0.0:61616,tcp://IP-OF-BROKER-1:61616)">
      </networkConnector>
    </networkConnectors>

    <persistenceAdapter>
      <kahaDB directory="${activemq.base}/data/kahadb"/>
    </persistenceAdapter>

    <systemUsage>
      <systemUsage>
        <storeUsage>
          <storeUsage limit="1 gb" name="foo"/>
        </storeUsage>
      </systemUsage>
    </systemUsage>

    <transportConnectors>
      <transportConnector name="openwire" uri="tcp://0.0.0.0:61616"/>
    </transportConnectors>

  </broker>

-----------------
LOG from BROKER-1
-----------------
2010-01-29 15:55:33,635 | INFO  | ActiveMQ Message Broker (0.0.0.0,
ID:localhost.localdomain-42531-1264721549109-0:0) is shutting down |
org.apache.activemq.broker.BrokerService | ActiveMQ ShutdownHook
2010-01-29 15:55:33,757 | INFO  | Network Connector MA Stopped |
org.apache.activemq.network.NetworkConnector | ActiveMQ ShutdownHook
2010-01-29 15:55:35,303 | INFO  | Connector vm://0.0.0.0 Stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ Transport Stopper:
/IP-OF-BROKER-2:49289
2010-01-29 15:55:35,303 | INFO  | 0.0.0.0 bridge to 0.0.0.0 stopped |
org.apache.activemq.network.DemandForwardingBridge | ActiveMQ Transport
Stopper: /IP-OF-BROKER-2:49289
2010-01-29 15:55:35,306 | INFO  | Connector openwire Stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ ShutdownHook
2010-01-29 15:55:36,680 | INFO  | ActiveMQ JMS Message Broker (0.0.0.0,
ID:localhost.localdomain-42531-1264721549109-0:0) stopped |
org.apache.activemq.broker.BrokerService | ActiveMQ ShutdownHook
2010-01-29 15:55:53,620 | INFO  | Using Persistence Adapter:
org.apache.activemq.store.kahadb.KahaDBPersistenceAdapter@19fe451 |
org.apache.activemq.broker.BrokerService | main
2010-01-29 15:55:54,820 | INFO  | Replayed 1 operations from the journal in
0.014 seconds. | org.apache.activemq.store.kahadb.MessageDatabase | main
2010-01-29 15:55:54,885 | INFO  | ActiveMQ 5.3.0 JMS Message Broker
(0.0.0.0) is starting | org.apache.activemq.broker.BrokerService | main
2010-01-29 15:55:54,885 | INFO  | For help or more information please see:
http://activemq.apache.org/ | org.apache.activemq.broker.BrokerService |
main
2010-01-29 15:55:55,320 | INFO  | Listening for connections at:
tcp://localhost.localdomain:61616 |
org.apache.activemq.transport.TransportServerThreadSupport | main
2010-01-29 15:55:55,321 | INFO  | Connector openwire Started |
org.apache.activemq.broker.TransportConnector | main
2010-01-29 15:55:55,321 | INFO  | Establishing network connection from
vm://0.0.0.0 to tcp://0.0.0.0:61616 |
org.apache.activemq.network.DiscoveryNetworkConnector | main
2010-01-29 15:55:55,356 | INFO  | Connector vm://0.0.0.0 Started |
org.apache.activemq.broker.TransportConnector | main
2010-01-29 15:55:55,417 | INFO  | Network Connector MA Started |
org.apache.activemq.network.NetworkConnector | main
2010-01-29 15:55:55,418 | INFO  | ActiveMQ JMS Message Broker (0.0.0.0,
ID:localhost.localdomain-36451-1264780554912-0:0) started |
org.apache.activemq.broker.BrokerService | main
2010-01-29 15:55:55,541 | INFO  | Logging to
org.slf4j.impl.JCLLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog | org.mortbay.log | main
2010-01-29 15:55:55,548 | INFO  | jetty-6.1.9 | org.mortbay.log | main
2010-01-29 15:55:56,002 | INFO  | Connector vm://0.0.0.0 Stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ Transport:
tcp://localhost.localdomain/127.0.0.1:61616
2010-01-29 15:55:56,002 | INFO  | 0.0.0.0 bridge to 0.0.0.0 stopped |
org.apache.activemq.network.DemandForwardingBridge | ActiveMQ Transport:
tcp://localhost.localdomain/127.0.0.1:61616
2010-01-29 15:55:56,657 | INFO  | ActiveMQ WebConsole initialized. |
org.apache.activemq.web.WebConsoleStarter | main
2010-01-29 15:55:56,877 | INFO  | Initializing Spring FrameworkServlet
'dispatcher' | /admin | main
2010-01-29 15:55:57,004 | INFO  | ActiveMQ Console at
http://0.0.0.0:8161/admin | org.mortbay.log | main
2010-01-29 15:55:57,048 | INFO  | Started
SelectChannelConnector@0.0.0.0:8161 | org.mortbay.log | main
2010-01-29 15:56:07,803 | INFO  | Connector vm://0.0.0.0 Started |
org.apache.activemq.broker.TransportConnector | ActiveMQ Transport:
tcp:///IP-OF-BROKER-2:37841
2010-01-29 15:56:07,911 | INFO  | Created Duplex Bridge back to 0.0.0.0 |
org.apache.activemq.broker.TransportConnection | ActiveMQ Transport:
tcp:///IP-OF-BROKER-2:37841
2010-01-29 15:56:07,965 | INFO  | Network connection between vm://0.0.0.0#2
and tcp:///IP-OF-BROKER-2:37841(0.0.0.0) has been established. |
org.apache.activemq.network.DemandForwardingBridge | StartLocalBridge:
localBroker=vm://0.0.0.0#2
2010-01-29 16:03:28,802 | WARN  | Network connection between vm://0.0.0.0#2
and tcp:///IP-OF-BROKER-2:37841 shutdown due to a remote error:
java.io.EOFException | org.apache.activemq.network.DemandForwardingBridge |
ActiveMQ Transport: tcp:///IP-OF-BROKER-2:37841
2010-01-29 16:03:28,805 | INFO  | Connector vm://0.0.0.0 Stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ Transport Stopper:
/IP-OF-BROKER-2:37841
2010-01-29 16:03:28,805 | INFO  | 0.0.0.0 bridge to 0.0.0.0 stopped |
org.apache.activemq.network.DemandForwardingBridge | ActiveMQ Transport
Stopper: /IP-OF-BROKER-2:37841
2010-01-29 16:04:18,702 | INFO  | Connector vm://0.0.0.0 Started |
org.apache.activemq.broker.TransportConnector | ActiveMQ Transport:
tcp:///IP-OF-BROKER-2:37964
2010-01-29 16:04:18,709 | INFO  | Created Duplex Bridge back to 0.0.0.0 |
org.apache.activemq.broker.TransportConnection | ActiveMQ Transport:
tcp:///IP-OF-BROKER-2:37964
2010-01-29 16:04:18,711 | INFO  | Network connection between vm://0.0.0.0#4
and tcp:///IP-OF-BROKER-2:37964(0.0.0.0) has been established. |
org.apache.activemq.network.DemandForwardingBridge | StartLocalBridge:
localBroker=vm://0.0.0.0#4
2010-01-29 19:39:51,776 | INFO  | Created Duplex Bridge back to 0.0.0.0 |
org.apache.activemq.broker.TransportConnection | ActiveMQ Transport:
tcp:///IP-OF-BROKER-3:52602
2010-01-29 19:39:51,777 | INFO  | Network connection between vm://0.0.0.0#6
and tcp:///IP-OF-BROKER-3:52602(0.0.0.0) has been established. |
org.apache.activemq.network.DemandForwardingBridge | StartLocalBridge:
localBroker=vm://0.0.0.0#6
2010-01-29 20:03:03,015 | WARN  | Network connection between vm://0.0.0.0#6
and tcp:///IP-OF-BROKER-3:52602 shutdown due to a remote error:
java.io.EOFException | org.apache.activemq.network.DemandForwardingBridge |
ActiveMQ Transport: tcp:///IP-OF-BROKER-3:52602
2010-01-29 20:03:03,120 | INFO  | 0.0.0.0 bridge to 0.0.0.0 stopped |
org.apache.activemq.network.DemandForwardingBridge | ActiveMQ Transport
Stopper: /IP-OF-BROKER-3:52602
2010-01-29 20:03:19,085 | INFO  | Network connection between vm://0.0.0.0#8
and tcp:///IP-OF-BROKER-3:44049(0.0.0.0) has been established. |
org.apache.activemq.network.DemandForwardingBridge | StartLocalBridge:
localBroker=vm://0.0.0.0#8
2010-01-29 20:03:19,086 | INFO  | Created Duplex Bridge back to 0.0.0.0 |
org.apache.activemq.broker.TransportConnection | ActiveMQ Transport:
tcp:///IP-OF-BROKER-3:44049
2010-01-29 20:03:19,445 | WARN  | Failed to add Connection |
org.apache.activemq.broker.TransportConnection | ActiveMQ Transport
Initiator: vm://0.0.0.0#8
javax.jms.InvalidClientIDException: Broker: 0.0.0.0 - Client:
NC_0.0.0.0_inbound_0.0.0.0 already connected from vm://0.0.0.0#4
	at
org.apache.activemq.broker.region.RegionBroker.addConnection(RegionBroker.java:216)
	at
org.apache.activemq.broker.BrokerFilter.addConnection(BrokerFilter.java:82)
	at
org.apache.activemq.broker.BrokerFilter.addConnection(BrokerFilter.java:82)
	at
org.apache.activemq.advisory.AdvisoryBroker.addConnection(AdvisoryBroker.java:77)
	at
org.apache.activemq.broker.BrokerFilter.addConnection(BrokerFilter.java:82)
	at
org.apache.activemq.broker.MutableBrokerFilter.addConnection(MutableBrokerFilter.java:89)
	at
org.apache.activemq.broker.TransportConnection.processAddConnection(TransportConnection.java:666)
	at
org.apache.activemq.command.ConnectionInfo.visit(ConnectionInfo.java:134)
	at
org.apache.activemq.broker.TransportConnection.service(TransportConnection.java:297)
	at
org.apache.activemq.broker.TransportConnection$1.onCommand(TransportConnection.java:175)
	at
org.apache.activemq.transport.ResponseCorrelator.onCommand(ResponseCorrelator.java:109)
	at
org.apache.activemq.transport.TransportFilter.onCommand(TransportFilter.java:68)
	at org.apache.activemq.transport.vm.VMTransport.start(VMTransport.java:128)
	at
org.apache.activemq.transport.TransportFilter.start(TransportFilter.java:57)
	at
org.apache.activemq.transport.TransportFilter.start(TransportFilter.java:57)
	at
org.apache.activemq.broker.TransportConnection.start(TransportConnection.java:857)
	at
org.apache.activemq.broker.TransportConnector$1$1.run(TransportConnector.java:211)
2010-01-29 20:03:19,705 | WARN  | Async error occurred:
javax.jms.InvalidClientIDException: Broker: 0.0.0.0 - Client:
NC_0.0.0.0_inbound_0.0.0.0 already connected from vm://0.0.0.0#4 |
org.apache.activemq.broker.TransportConnection.Service | ActiveMQ Transport
Initiator: vm://0.0.0.0#8
javax.jms.InvalidClientIDException: Broker: 0.0.0.0 - Client:
NC_0.0.0.0_inbound_0.0.0.0 already connected from vm://0.0.0.0#4
	at
org.apache.activemq.broker.region.RegionBroker.addConnection(RegionBroker.java:216)
	at
org.apache.activemq.broker.BrokerFilter.addConnection(BrokerFilter.java:82)
	at
org.apache.activemq.broker.BrokerFilter.addConnection(BrokerFilter.java:82)
	at
org.apache.activemq.advisory.AdvisoryBroker.addConnection(AdvisoryBroker.java:77)
	at
org.apache.activemq.broker.BrokerFilter.addConnection(BrokerFilter.java:82)
	at
org.apache.activemq.broker.MutableBrokerFilter.addConnection(MutableBrokerFilter.java:89)
	at
org.apache.activemq.broker.TransportConnection.processAddConnection(TransportConnection.java:666)
	at
org.apache.activemq.command.ConnectionInfo.visit(ConnectionInfo.java:134)
	at
org.apache.activemq.broker.TransportConnection.service(TransportConnection.java:297)
	at
org.apache.activemq.broker.TransportConnection$1.onCommand(TransportConnection.java:175)
	at
org.apache.activemq.transport.ResponseCorrelator.onCommand(ResponseCorrelator.java:109)
	at
org.apache.activemq.transport.TransportFilter.onCommand(TransportFilter.java:68)
	at org.apache.activemq.transport.vm.VMTransport.start(VMTransport.java:128)
	at
org.apache.activemq.transport.TransportFilter.start(TransportFilter.java:57)
	at
org.apache.activemq.transport.TransportFilter.start(TransportFilter.java:57)
	at
org.apache.activemq.broker.TransportConnection.start(TransportConnection.java:857)
	at
org.apache.activemq.broker.TransportConnector$1$1.run(TransportConnector.java:211)
2010-01-29 20:03:19,706 | INFO  | Network connection between vm://0.0.0.0#8
and tcp:///IP-OF-BROKER-3:44049 shutdown due to a local error:
javax.jms.InvalidClientIDException: Broker: 0.0.0.0 - Client:
NC_0.0.0.0_inbound_0.0.0.0 already connected from vm://0.0.0.0#4 |
org.apache.activemq.network.DemandForwardingBridge | ActiveMQ Connection
Dispatcher: vm://0.0.0.0#8
2010-01-29 20:03:19,722 | INFO  | 0.0.0.0 bridge to 0.0.0.0 stopped |
org.apache.activemq.network.DemandForwardingBridge | ActiveMQ Transport
Stopper: /IP-OF-BROKER-3:44049
2010-01-29 20:03:20,886 | INFO  | Network connection between vm://0.0.0.0#10
and tcp:///IP-OF-BROKER-3:44050(0.0.0.0) has been established. |
org.apache.activemq.network.DemandForwardingBridge | StartLocalBridge:
localBroker=vm://0.0.0.0#10
2010-01-29 20:03:20,886 | INFO  | Created Duplex Bridge back to 0.0.0.0 |
org.apache.activemq.broker.TransportConnection | ActiveMQ Transport:
tcp:///IP-OF-BROKER-3:44050
2010-01-30 22:33:58,979 | WARN  | Network connection between vm://0.0.0.0#4
and tcp:///IP-OF-BROKER-2:37964 shutdown due to a remote error:
org.apache.activemq.transport.InactivityIOException: Channel was inactive
for too long: /IP-OF-BROKER-2:37964 |
org.apache.activemq.network.DemandForwardingBridge | InactivityMonitor Async
Task: java.util.concurrent.ThreadPoolExecutor$Worker@a3a8e9
2010-01-30 22:33:59,090 | INFO  | 0.0.0.0 bridge to 0.0.0.0 stopped |
org.apache.activemq.network.DemandForwardingBridge | ActiveMQ Transport
Stopper: /IP-OF-BROKER-2:37964
2010-01-31 03:54:44,348 | WARN  | Network connection between vm://0.0.0.0#10
and tcp:///IP-OF-BROKER-3:44050 shutdown due to a remote error:
java.io.EOFException | org.apache.activemq.network.DemandForwardingBridge |
ActiveMQ Transport: tcp:///IP-OF-BROKER-3:44050
2010-01-31 03:54:50,687 | INFO  | Connector vm://0.0.0.0 Stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ Transport Stopper:
/IP-OF-BROKER-3:44050
2010-01-31 03:54:50,688 | INFO  | 0.0.0.0 bridge to 0.0.0.0 stopped |
org.apache.activemq.network.DemandForwardingBridge | ActiveMQ Transport
Stopper: /IP-OF-BROKER-3:44050
2010-01-31 03:55:29,073 | INFO  | Connector vm://0.0.0.0 Started |
org.apache.activemq.broker.TransportConnector | ActiveMQ Transport:
tcp:///IP-OF-BROKER-3:47416
2010-01-31 03:55:42,630 | INFO  | Created Duplex Bridge back to 0.0.0.0 |
org.apache.activemq.broker.TransportConnection | ActiveMQ Transport:
tcp:///IP-OF-BROKER-3:47416
2010-01-31 03:55:43,738 | INFO  | Network connection between vm://0.0.0.0#12
and tcp:///IP-OF-BROKER-3:47416(0.0.0.0) has been established. |
org.apache.activemq.network.DemandForwardingBridge | StartLocalBridge:
localBroker=vm://0.0.0.0#12
2010-01-31 03:57:32,831 | WARN  | Network connection between vm://0.0.0.0#12
and tcp:///IP-OF-BROKER-3:47416 shutdown due to a remote error:
java.io.EOFException | org.apache.activemq.network.DemandForwardingBridge |
ActiveMQ Transport: tcp:///IP-OF-BROKER-3:47416
2010-01-31 03:57:35,129 | INFO  | Connector vm://0.0.0.0 Stopped |
org.apache.activemq.broker.TransportConnector | ActiveMQ Transport Stopper:
/IP-OF-BROKER-3:47416
2010-01-31 03:57:35,159 | INFO  | 0.0.0.0 bridge to 0.0.0.0 stopped |
org.apache.activemq.network.DemandForwardingBridge | ActiveMQ Transport
Stopper: /IP-OF-BROKER-3:47416
2010-01-31 03:57:35,488 | INFO  | Connector vm://0.0.0.0 Started |
org.apache.activemq.broker.TransportConnector | ActiveMQ Transport:
tcp:///IP-OF-BROKER-3:47461
2010-01-31 03:57:36,629 | INFO  | Network connection between vm://0.0.0.0#14
and tcp:///IP-OF-BROKER-3:47461(0.0.0.0) has been established. |
org.apache.activemq.network.DemandForwardingBridge | StartLocalBridge:
localBroker=vm://0.0.0.0#14
2010-01-31 03:57:36,638 | INFO  | Created Duplex Bridge back to 0.0.0.0 |
org.apache.activemq.broker.TransportConnection | ActiveMQ Transport:
tcp:///IP-OF-BROKER-3:47461


-----------------
LOG from BROKER-2
-----------------
2010-01-30 22:33:17,547 | INFO  | Establishing network connection from
vm://0.0.0.0 to tcp://0.0.0.0:61616 |
org.apache.activemq.network.DiscoveryNetworkConnector | Simple Discovery
Agent: java.util.concurrent.ThreadPoolExecutor$Worker@185d657
2010-01-30 22:34:09,602 | WARN  | Could not start network bridge between:
vm://0.0.0.0 and: tcp://0.0.0.0:61616 due to:
java.net.SocketTimeoutException: connect timed out |
org.apache.activemq.network.DiscoveryNetworkConnector | Simple Discovery
Agent: java.util.concurrent.ThreadPoolExecutor$Worker@185d657
2010-01-30 22:34:29,660 | INFO  | Establishing network connection from
vm://0.0.0.0 to tcp://0.0.0.0:61616 |
org.apache.activemq.network.DiscoveryNetworkConnector | Simple Discovery
Agent: java.util.concurrent.ThreadPoolExecutor$Worker@1561cdc
2010-01-30 22:34:53,316 | WARN  | Caught an exception processing local
command | org.apache.activemq.network.DemandForwardingBridge | ActiveMQ
Connection Dispatcher: vm://0.0.0.0#2
java.net.SocketException: Broken pipe
	at java.net.SocketOutputStream.socketWrite0(Native Method)
	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
	at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
	at
org.apache.activemq.transport.tcp.TcpBufferedOutputStream.flush(TcpBufferedOutputStream.java:115)
	at java.io.DataOutputStream.flush(DataOutputStream.java:106)
	at
org.apache.activemq.transport.tcp.TcpTransport.oneway(TcpTransport.java:167)
	at
org.apache.activemq.transport.InactivityMonitor.oneway(InactivityMonitor.java:237)
	at
org.apache.activemq.transport.TransportFilter.oneway(TransportFilter.java:83)
	at
org.apache.activemq.transport.WireFormatNegotiator.oneway(WireFormatNegotiator.java:104)
	at
org.apache.activemq.transport.MutexTransport.oneway(MutexTransport.java:40)
	at
org.apache.activemq.transport.ResponseCorrelator.oneway(ResponseCorrelator.java:60)
	at
org.apache.activemq.network.DemandForwardingBridgeSupport.serviceLocalCommand(DemandForwardingBridgeSupport.java:691)
	at
org.apache.activemq.network.DemandForwardingBridgeSupport$1.onCommand(DemandForwardingBridgeSupport.java:156)
	at
org.apache.activemq.transport.ResponseCorrelator.onCommand(ResponseCorrelator.java:109)
	at
org.apache.activemq.transport.TransportFilter.onCommand(TransportFilter.java:68)
	at
org.apache.activemq.transport.vm.VMTransport.oneway(VMTransport.java:114)
	at
org.apache.activemq.transport.MutexTransport.oneway(MutexTransport.java:40)
	at
org.apache.activemq.transport.ResponseCorrelator.oneway(ResponseCorrelator.java:60)
	at
org.apache.activemq.broker.TransportConnection.dispatch(TransportConnection.java:1190)
	at
org.apache.activemq.broker.TransportConnection.processDispatch(TransportConnection.java:779)
	at
org.apache.activemq.broker.TransportConnection.iterate(TransportConnection.java:815)
	at
org.apache.activemq.thread.DedicatedTaskRunner.runTask(DedicatedTaskRunner.java:98)
	at
org.apache.activemq.thread.DedicatedTaskRunner$1.run(DedicatedTaskRunner.java:36)
2010-01-30 22:34:53,969 | INFO  | Network connection between vm://0.0.0.0#2
and tcp:///IP-OF-BROKER-1:61616 shutdown due to a local error:
java.net.SocketException: Broken pipe |
org.apache.activemq.network.DemandForwardingBridge | ActiveMQ Connection
Dispatcher: vm://0.0.0.0#2
2010-01-30 22:34:53,970 | WARN  | Network connection between vm://0.0.0.0#2
and tcp:///IP-OF-BROKER-1:61616 shutdown due to a remote error:
java.net.SocketException: Broken pipe |
org.apache.activemq.network.DemandForwardingBridge | InactivityMonitor Async
Task: java.util.concurrent.ThreadPoolExecutor$Worker@4b705d

-- 
View this message in context: http://old.nabble.com/Brigded-brokers-wont-reconnect-tp27427208p27427208.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.


Mime
View raw message