From users-return-18289-apmail-activemq-users-archive=activemq.apache.org@activemq.apache.org Thu Mar 12 11:16:30 2009 Return-Path: Delivered-To: apmail-activemq-users-archive@www.apache.org Received: (qmail 80137 invoked from network); 12 Mar 2009 11:16:30 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 12 Mar 2009 11:16:30 -0000 Received: (qmail 34168 invoked by uid 500); 12 Mar 2009 11:16:29 -0000 Delivered-To: apmail-activemq-users-archive@activemq.apache.org Received: (qmail 34137 invoked by uid 500); 12 Mar 2009 11:16:29 -0000 Mailing-List: contact users-help@activemq.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@activemq.apache.org Delivered-To: mailing list users@activemq.apache.org Received: (qmail 34126 invoked by uid 99); 12 Mar 2009 11:16:28 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Mar 2009 04:16:28 -0700 X-ASF-Spam-Status: No, hits=2.6 required=10.0 tests=DNS_FROM_OPENWHOIS,SPF_HELO_PASS,SPF_PASS,WHOIS_MYPRIVREG X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of lists@nabble.com designates 216.139.236.158 as permitted sender) Received: from [216.139.236.158] (HELO kuber.nabble.com) (216.139.236.158) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Mar 2009 11:16:17 +0000 Received: from isper.nabble.com ([192.168.236.156]) by kuber.nabble.com with esmtp (Exim 4.63) (envelope-from ) id 1LhitH-0002cQ-OD for users@activemq.apache.org; Thu, 12 Mar 2009 04:15:55 -0700 Message-ID: <22473176.post@talk.nabble.com> Date: Thu, 12 Mar 2009 04:15:55 -0700 (PDT) From: Yenki To: users@activemq.apache.org Subject: Re: Fast producers,slow consumer... queue growing forever In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Nabble-From: yanbou@gmail.com References: <22373306.post@talk.nabble.com> <22460136.post@talk.nabble.com> <22463774.post@talk.nabble.com> X-Virus-Checked: Checked by ClamAV on apache.org Ok I will. By that time maybe you want to take a look at this post where I explained the problem in more details.=20 http://www.nabble.com/Possible-defect-in-Message-Eviction-to22415827.html http://www.nabble.com/Possible-defect-in-Message-Eviction-to22415827.html= =20 Yannick Andreas Gies-3 wrote: >=20 > Hi, >=20 > I am glad the answer helped a bit. It would be great if you could turn = =20 > your test app into a JUnit test and log a JIRA for your issue. >=20 > Best regards > Andreas >=20 > On Mar 11, 2009, at 9:27 PM, Yenki wrote: >=20 >> >> Hi Andreas, >> >> thanks for your help! We also managed to make memory limit work on =20 >> 5.2. But >> we still have problemes with message eviction. I'v create a small >> application to test it while stepping in ActiveMQ code. What I found =20 >> is that >> one evicted message out of two is redirected to the client. I'm almost >> convinced there is a bug there. >> does Anybody have the same problem? >> >> Yannick >> >> Andreas Gies-3 wrote: >>> >>> Hi there, >>> >>> I have run into a similar issue with a later version of ActiveMQ and >>> have blogged about that. >>> Perhaps that helps you: >>> http://open-source-adventures.blogspot.com/2009/01/limiting-disk-store-= usage-with-active.html >>> >>> Best regards >>> Andreas >>> >>> On Mar 11, 2009, at 6:24 PM, pclovec wrote: >>> >>>> >>>> Make met same problem >>>> >>>> Yenki wrote: >>>>> >>>>> Hi, for the last few days I=E2=80=99ve been trying to solve a fast >>>>> producers / >>>>> slow consumer problem. I want a limited amount of messages fetch on >>>>> the >>>>> consumer (this works) but I also want to have a limited amount of >>>>> messages >>>>> in the queue itself (doesn=E2=80=99t work). I use ActiveMQ 4.1.2 Here= is >>>>> what I >>>>> tried: >>>>> >>>>> #1 Setup destinations policies >>>>> I added this to my activemq.xml >>>>> >>>>> >>>>> >>>>> "> >>>>> >>>>> >>>>> >>>>> =09 >>>>> =09 >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> How can I know if my policies are applied? They don=E2=80=99t seem to= be >>>>> because >>>>> when I run my application my queue is growing until out of memory. >>>>> What I >>>>> see from JMX=E2=80=A6 >>>>> -QueueSize of my queue growing forever (with prefetch of 20 & =20 >>>>> pending >>>>> limit of 10 I would expect a max of 30 right?) >>>>> -MaximumPendingMessageLimit=3D0 for the non-durable subscription to >>>>> this >>>>> queue >>>>> >>>>> >>>>> #2 Queue configurations >>>>> I tried to set MaximumPendingMessageLimit when I create the queue. >>>>> mySession.createQueue(=E2=80=9CMyQueue=E2=80=9D + >>>>> "?=20 >>>>> consumer.prefetchSize=3D20&consumer.maximumPendingMessageLimit=3D10")= ; >>>>> >>>>> What I see from JMX=E2=80=A6 >>>>> -QueueSize of my queue growing forever >>>>> -The value for the non-durable subscription to this queue are: >>>>> MaximumPendingMessageLimit=3D10 >>>>> PrefetchSize=3D20 >>>>> >>>>> #3 Memory limit >>>>> As a last resort I tried to set a memory limit on my policyEntry >>>>> and on my >>>>> broker and it is still growing forever. >>>>> From JMX I see the MemoryPercentageUsed always to 0 for both broker >>>>> and >>>>> Queue. I run Broken embedded in the same VM than my application. >>>>> Maybe it >>>>> can explain why. >>>>> >>>>> Could someone help me make my PendingMessageLimit works so I don=E2= =80=99t >>>>> run out >>>>> of memory. >>>>> Thanks for your help >>>>> >>>>> Yannick >>>>> >>>>> >>>>> >>>> >>>> --=20 >>>> View this message in context: >>>> http://www.nabble.com/Fast-producers%2Cslow-consumer...-queue-growing-= forever-tp22373306p22460136.html >>>> Sent from the ActiveMQ - User mailing list archive at Nabble.com. >>>> >>> >>> --- >>> Mit freundlichen Gr=C3=BCssen - Kind Regards >>> Andreas Gies >>> Principal Consultant >>> Open Source Center of Competence >>> >>> Progress Software GmbH >>> Agrippinawerft 26 >>> 50678 K=C3=B6ln >>> >>> E-Mail =09agies@progress.com >>> Direct Line =09+49 (0)9953 980349 >>> Mobile =09+49 (0)170 5759611 >>> Skype =09+44 (0)20 3239 2922 >>> Skype =09+353 (0)1 443 4971 >>> Skype =09+1 (0)781 262 0168 >>> >>> http://www.progress.com >>> http://fusesource.com >>> http://open-source-adventures.blogspot.com >>> >>> >>> >>> ------------------------------------------------------- >>> Progress Software GmbH >>> Sitz der Gesellschaft: Agrippinawerft 26, 50678 Koeln; >>> Niederlassung: Fuerstenrieder Str. 279, 81377 Muenchen >>> Amtsgericht Koeln, HRB 15620; >>> Geschaeftsfuehrung: David Ireland >>> ------------------------------------------------------- >>> >>> >> >> --=20 >> View this message in context: >> http://www.nabble.com/Fast-producers%2Cslow-consumer...-queue-growing-fo= rever-tp22373306p22463774.html >> Sent from the ActiveMQ - User mailing list archive at Nabble.com. >> >=20 > --- > Mit freundlichen Gr=C3=BCssen - Kind Regards > Andreas Gies > Principal Consultant > Open Source Center of Competence >=20 > Progress Software GmbH > Agrippinawerft 26 > 50678 K=C3=B6ln >=20 > E-Mail =09agies@progress.com > Direct Line =09+49 (0)9953 980349 > Mobile =09+49 (0)170 5759611 > Skype =09+44 (0)20 3239 2922 > Skype =09+353 (0)1 443 4971 > Skype =09+1 (0)781 262 0168 >=20 > http://www.progress.com > http://fusesource.com > http://open-source-adventures.blogspot.com >=20 >=20 >=20 > ------------------------------------------------------- > Progress Software GmbH > Sitz der Gesellschaft: Agrippinawerft 26, 50678 Koeln; > Niederlassung: Fuerstenrieder Str. 279, 81377 Muenchen > Amtsgericht Koeln, HRB 15620; > Geschaeftsfuehrung: David Ireland > ------------------------------------------------------- >=20 >=20 --=20 View this message in context: http://www.nabble.com/Fast-producers%2Cslow-c= onsumer...-queue-growing-forever-tp22373306p22473176.html Sent from the ActiveMQ - User mailing list archive at Nabble.com.