Return-Path: Delivered-To: apmail-geronimo-activemq-users-archive@www.apache.org Received: (qmail 76266 invoked from network); 15 Jun 2006 14:08:54 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 15 Jun 2006 14:08:54 -0000 Received: (qmail 26206 invoked by uid 500); 15 Jun 2006 14:08:42 -0000 Delivered-To: apmail-geronimo-activemq-users-archive@geronimo.apache.org Received: (qmail 26162 invoked by uid 500); 15 Jun 2006 14:08:42 -0000 Mailing-List: contact activemq-users-help@geronimo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: activemq-users@geronimo.apache.org Delivered-To: mailing list activemq-users@geronimo.apache.org Received: (qmail 26138 invoked by uid 99); 15 Jun 2006 14:08:42 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 15 Jun 2006 07:08:42 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received-SPF: neutral (asf.osuosl.org: local policy) Received: from [193.96.150.26] (HELO itchy.airbus.de) (193.96.150.26) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 15 Jun 2006 07:08:38 -0700 Received: from de0-mailsp02.res.airbus.corp (unknown [44.159.50.177]) by itchy.airbus.de (Postfix) with ESMTP id 208E824024C for ; Thu, 15 Jun 2006 15:59:30 +0200 (CEST) Received: from de0-mailsp02.res.airbus.corp (localhost.localdomain [127.0.0.1]) by de0-mailsp02.res.airbus.corp (8.12.11/8.12.10) with ESMTP id k5FE8Gd4012215 for ; Thu, 15 Jun 2006 16:08:16 +0200 Received: from de0-mailrt10.res.airbus.corp ([44.159.50.164]) by de0-mailsp02.res.airbus.corp (8.12.11/8.12.10) with ESMTP id k5FE7w18011966 for ; Thu, 15 Jun 2006 16:08:15 +0200 Received: from de0-mailrt01.res.airbus.corp ([44.159.50.162]) by de0-mailrt10.res.airbus.corp with Microsoft SMTPSVC(5.0.2195.6713); Thu, 15 Jun 2006 16:08:03 +0200 Received: from de0-mailmb02.res.airbus.corp ([44.159.50.152]) by de0-mailrt01.res.airbus.corp with Microsoft SMTPSVC(5.0.2195.6713); Thu, 15 Jun 2006 16:08:03 +0200 X-MimeOLE: Produced By Microsoft Exchange V6.0.6603.0 content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Subject: AW: limit the number of messages per second Date: Thu, 15 Jun 2006 16:08:03 +0200 Message-ID: <001FD7EB9646934B9237F09DE8E1F07C02F8C148@DE0-MAILMB02.res.airbus.corp> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: limit the number of messages per second Thread-Index: AcaQhMeshw/2SqrQTQu2ZRsaGMwxpQAADUUA From: "Gerdes, Mike" To: X-OriginalArrivalTime: 15 Jun 2006 14:08:03.0454 (UTC) FILETIME=[1DF8E9E0:01C69085] X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N I guess that should be possible, because I manage to reproduce it on= another machine. I will try to do it tomorrow. cya and thanks -----Urspr=FCngliche Nachricht----- Von: James Strachan [mailto:james.strachan@gmail.com] Gesendet: Donnerstag, 15. Juni 2006 16:04 An: activemq-users@geronimo.apache.org Betreff: Re: limit the number of messages per second Is there any way you can create a test case that manages to crash the= broker? On 6/15/06, Gerdes, Mike wrote: > > hm I will try to use prefetch and see if it works, but mostly the problem= is not the consumer, but the sender and the broker having to manage= everything. > > The broker crashes or better it gets a deadlock. So the usagemanagers for= the queues request more memory and get it, at some point in time all= memory is used up and they request more and wait till they get it. That= never happens, because the reference co=FAnters don'T get reduced and they= think the queue is totally full. At that point the sender also stops and= waits for the queue to free. > > I am using SSL and JAAS to allow only nodes that I trust to publish to= the system, but when systems get bigger a misconfiguration might occure or= somebody finds a trick or a way around it. It is not that critical but= would be very nice to have. > > I am using AMQ4.0 the SNAPSHOT 01.05.2006. I have tried to use persistent= and non-persistent messages, that makes no change. > > I haven't found the options on how to set it, that was before you added= the warning and send this email, so I will try it and hope thats the= problem. > > > -----Urspr=FCngliche Nachricht----- > Von: James Strachan [mailto:james.strachan@gmail.com] > Gesendet: Donnerstag, 15. Juni 2006 15:45 > An: activemq-users@geronimo.apache.org > Betreff: Re: limit the number of messages per second > > > > On 6/15/06, Gerdes, Mike wrote: > > > > I want this feature to make AMQ a bit more stable, to reduce network= traffic and prevent flooding and to avoid that a software with errors= kills my system. > > You can use the prefetch for that... > http://incubator.apache.org/activemq/what-is-the-prefetch-limit-for.html > > to limit how many messages are dispatched to a consumer. > > > > From what I noticed is that AMQ does have some memory problems and that= it hits under certain circumstances 100 used memory and crashes then. > > Whats the crash? Is this the broker or client? > > > But thats the smaller reason. The major reason is just for security.= In my testing and application I need to have a system that is more or less= stable and secure. And DoS and flooding of queues seems to me a big= problem. > > How about using security so only nodes you trust can publish to your= queues? > > > One thing about the memory problem, I have encountered. With more then= one consumer and using queue, AMQ crashes with 100% used memory if I send= as fast as possible. This happens with and without async messages. What I= noticed is that the usageManagers request more and more memory and at some= point don't get it and then block. When a message from a queue is read,= its memory is not freed. With only on consumer this haven'T been the case.= There has the memory be freed. > > (I put reference counter System.out.println into the usageManger) > > Which version of ActiveMQ are you using? Also are you using persistent > queues? (I'm guessing not as that is not memory bound). > > If you are using 4.0 have you disabled optimizeAck? (see the known= issues) > http://incubator.apache.org/activemq/activemq-40-release.html > > -- > > James > ------- > http://radio.weblogs.com/0112098/ > > > This mail has originated outside your organization, > either from an external partner or the Global Internet. > Keep this in mind if you answer this message. > > This mail has originated outside your organization, either from an= external partner or the Global Internet. Keep this in mind if you answer= this message. > -- James ------- http://radio.weblogs.com/0112098/ This mail has originated outside your organization, either from an external partner or the Global Internet. Keep this in mind if you answer this message. This mail has originated outside your organization, either from an external= partner or the Global Internet. Keep this in mind if you answer this= message.