activemq-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nathan Bryant (JIRA)" <j...@apache.org>
Subject [jira] Updated: (AMQ-2533) OutOfMemory provoked by Advisory messages
Date Wed, 02 Jun 2010 14:45:52 GMT

     [ https://issues.apache.org/activemq/browse/AMQ-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nathan Bryant updated AMQ-2533:
-------------------------------

    Attachment: SlowConsumerTest.java

regression test

> OutOfMemory provoked by Advisory messages
> -----------------------------------------
>
>                 Key: AMQ-2533
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2533
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.2.0, 5.3.0
>            Reporter: Philippe Mouawad
>            Assignee: Rob Davies
>            Priority: Critical
>             Fix For: 5.3.1, 5.4.0
>
>         Attachments: activemq-OOM-ADVISORY.xml, activemq-Workaround-OOM-ADVISORY.xml,
activemq.xml, Image 11.png, SlowConsumerTest.java, ThreadDump.txt, TopicListener.java, TopicPublisher.java
>
>
> Hello,
> We are in an environment where we have 1 Broker and 6 clients listener to one Topic.
> We enabled advisory messages through:
> <policyEntry topic=">" memoryLimit="5mb" producerFlowControl="true"  advisoryWhenFull="true"
advisoryForSlowConsumers="true"
>                       sendAdvisoryIfNoConsumers="true">
> And sendFailIfNoSpace:
> <systemUsage>
>             <systemUsage sendFailIfNoSpace="true">
>                 <memoryUsage>
>                     <memoryUsage limit="50 mb"/>
>                 </memoryUsage>
>                 <storeUsage>
>                     <storeUsage limit="1 gb" name="foo" store="#store"/>
>                 </storeUsage>
>                 <tempUsage>
>                     <tempUsage limit="100 mb"/>
>                 </tempUsage>
>             </systemUsage>
>         </systemUsage>
> We also have a monitoring process that listens to advisory messages related to the concerned
TOPIC.
> After some run, we end up with OutOfMemory.
> OutOfMemory analysis shows:
> - 3372 instances of org.apache.activemq.command.ActiveMQTopic occupying 23,7%
> Names of Topic contain ActiveMQ.Advisory.FULL.Topic:
> - ActiveMQ.Advisory.FULL.Topic.ActiveMQ.Advisory.FULL.Topic.ActiveMQ.Advisory.FULL.....ActiveMQ.Advisory.Producer.Topic.OFBTopic
> 1069 instances of org.apache.activemq.thread.DedicatedTaskRunner$1 holding 12% through
the names of the thread that are soooooo long.
> Debuging ActiveMQ, I noticed that AMQ didn't check when sending advisory messages that
advisory concerns an advisory.
> Example, suppose you set a listener for advisory message ActiveMQ.Advisory.FULL.Topic.OFBTopic
and this listener becomes slow for a reason, then AMQ will send an advisory on this advisory
provoking more and more traffic 
> on the broker only for this advisory.
> I attached a Stack Trace showing that an advisory will be sent for the advisory.
> I will be checking to see if this issue also exists on 5.3.0.
> Thanks in advance.
> Philippe.
> http://www.ubik-ingenierie.com

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message