From users-return-30189-apmail-activemq-users-archive=activemq.apache.org@activemq.apache.org Fri Feb 10 22:11:03 2012 Return-Path: X-Original-To: apmail-activemq-users-archive@www.apache.org Delivered-To: apmail-activemq-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E71279BB7 for ; Fri, 10 Feb 2012 22:11:03 +0000 (UTC) Received: (qmail 86864 invoked by uid 500); 10 Feb 2012 22:11:03 -0000 Delivered-To: apmail-activemq-users-archive@activemq.apache.org Received: (qmail 86764 invoked by uid 500); 10 Feb 2012 22:11:02 -0000 Mailing-List: contact users-help@activemq.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@activemq.apache.org Delivered-To: mailing list users@activemq.apache.org Received: (qmail 86756 invoked by uid 99); 10 Feb 2012 22:11:02 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 22:11:02 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of mattrpav@gmail.com designates 209.85.214.171 as permitted sender) Received: from [209.85.214.171] (HELO mail-tul01m020-f171.google.com) (209.85.214.171) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2012 22:10:55 +0000 Received: by obcuy19 with SMTP id uy19so5758552obc.2 for ; Fri, 10 Feb 2012 14:10:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type; bh=bMDeGdfVZRkQtwbRaq6a5cOOB+Fi5ixYUpqRYLb8bpc=; b=iyOOywc25Xtozy7dIQoXxzDQJa8p2G532AJVccAxsYvQlGYOLw+F8k7o1u2IGh+RhX ghFOPqedpGnMBcBXqhqCo+8I/DO1igG2wnNaYbfSIRfwqUKtej1/ntLGMCqHKdayBkTQ jswrWnhvGmWjb7yIU6gRnoWgu6xEu0Top9Snc= Received: by 10.60.12.72 with SMTP id w8mr1069832oeb.31.1328911835210; Fri, 10 Feb 2012 14:10:35 -0800 (PST) Received: from macbookpro-2.mediadriver.com ([75.103.13.13]) by mx.google.com with ESMTPS id s6sm1767072obq.0.2012.02.10.14.10.33 (version=SSLv3 cipher=OTHER); Fri, 10 Feb 2012 14:10:34 -0800 (PST) Message-ID: <4F3595D9.9070307@gmail.com> Date: Fri, 10 Feb 2012 16:10:33 -0600 From: Matt Pavlovich User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:9.0) Gecko/20111222 Thunderbird/9.0.1 MIME-Version: 1.0 To: users@activemq.apache.org Subject: Re: Question about activemq queue message events References: <4F309D37.2010007@marketo.com> <4F315FDC.5060702@gmail.com> <4F359135.9080109@marketo.com> In-Reply-To: <4F359135.9080109@marketo.com> Content-Type: multipart/alternative; boundary="------------070700080904040603050102" --------------070700080904040603050102 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit No problem, let us know how it goes. Thanks! Matt Pavlovich On 2/10/12 3:50 PM, Brian Wright wrote: > Hi Matt, > > Thanks for the information. I will pass this response onto the > developer to look into testing (and moving to) 5.5.x in our > environment. I will also forward your FuseSource build suggestions > onto our developer. > > As for the back-end datastore, we are using MySQL for the AMQ and > probably also the transactions. I can confirm this if there's any > issues involving the use of MySQL. > > Thanks. > > On 2/7/12 9:31 AM, Matt Pavlovich wrote: >> Hi Brian- >> >> This list is fine, as it sounds like an ActiveMQ-related issue. >> There are some known issues with AMQ 5.4.2 that could lead to that >> problem. Also, client-side issues such as exhausting connection >> pools, or leaking connections could cause "stuck message" behavior. >> >> I suggest doing some testing against new 5.5.x ActiveMQ releases. >> Specifically, I suggest using the FuseSource builds, since they are >> more frequent than the Apache releases at this time. They are free >> to use. >> >> Are you using KahaDB as a back-end data store for AMQ? Transactions? >> >> Hope this helps, >> Matt Pavlovich >> >> On 2/6/12 9:40 PM, Brian Wright wrote: >>> Hello, >>> >>> I'm actually asking this question on behalf of one of our >>> developers. As I understand ActiveMQ (and Servicemix), when a >>> message is placed into a queue, an event is fired off telling the >>> consumer a new message is now present. It is then the consumer's >>> job to pick up the new message and process it. >>> >>> We had a recent issue where it appeared that new message arrival >>> events were either not firing or firing off very slowly to the >>> consumer as messages were placed into the queue. So, the message >>> queue was backing up and messages were not being processed. Note >>> that we have about 8 different queues on this Servicemix server, but >>> only one of the queues exhibited this behavior. As a result, the >>> processing ground to a halt on this specific queue and queue >>> messages backed up. Once we restarted everything involving >>> servicemix, activemx and the consumer of the queue, everything went >>> back to normal processing speed. >>> >>> I'm trying to determine if there are any known issues that could >>> cause this behavior within ActiveMQ. We are running Apache >>> Servicemix version 4.3.1-fuse-01-09 using ActiveMQ version 5.4.2 >>> (looks like the ActiveMQ packages were included with the Servicemix >>> package). >>> >>> As another question, since it appears ActiveMQ was included in the >>> Servicemix package, should I ask this question on the Servicemix >>> forum instead? >>> >>> Any help would be appreciated. >>> >>> Thanks. >>> >>> -- >>> >>> *Brian Wright* >>> *Sr. UNIX Systems Administrator* >>> 901 Mariners Island Blvd Suite 200 >>> San Mateo, CA 94404 USA >>> *Email *brianw@marketo.com >>> *Phone *+1.650.539.3530** >>> *****www.marketo.com * >>> >>> Marketo Logo >>> >>> > > -- > > *Brian Wright* > *Sr. UNIX Systems Administrator* > 901 Mariners Island Blvd Suite 200 > San Mateo, CA 94404 USA > *Email *brianw@marketo.com > *Phone *+1.650.539.3530** > *****www.marketo.com * > > Marketo Logo > > --------------070700080904040603050102 Content-Type: multipart/related; boundary="------------020601000107050409080003" --------------020601000107050409080003 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit No problem, let us know how it goes.

Thanks!
Matt Pavlovich

On 2/10/12 3:50 PM, Brian Wright wrote:
Hi Matt,

Thanks for the information.  I will pass this response onto the developer to look into testing (and moving to) 5.5.x in our environment.  I will also forward your FuseSource build suggestions onto our developer.

As for the back-end datastore, we are using MySQL for the AMQ and probably also the transactions.  I can confirm this if there's any issues involving the use of MySQL.

Thanks.

On 2/7/12 9:31 AM, Matt Pavlovich wrote:
Hi Brian-

This list is fine, as it sounds like an ActiveMQ-related issue.  There are some known issues with AMQ 5.4.2 that could lead to that problem.  Also, client-side issues such as exhausting connection pools, or leaking connections could cause "stuck message" behavior. 

I suggest doing some testing against new 5.5.x ActiveMQ releases.  Specifically, I suggest using the FuseSource builds, since they are more frequent than the Apache releases at this time.   They are free to use.

Are you using KahaDB as a back-end data store for AMQ?  Transactions? 

Hope this helps,
Matt Pavlovich

On 2/6/12 9:40 PM, Brian Wright wrote:
Hello,

I'm actually asking this question on behalf of one of our developers.  As I understand ActiveMQ (and Servicemix), when a message is placed into a queue, an event is fired off telling the consumer a new message is now present.  It is then the consumer's job to pick up the new message and process it.

We had a recent issue where it appeared that new message arrival events were either not firing or firing off very slowly to the consumer as messages were placed into the queue.  So, the message queue was backing up and messages were not being processed.  Note that we have about 8 different queues on this Servicemix server, but only one of the queues exhibited this behavior.  As a result, the processing ground to a halt on this specific queue and queue messages backed up.  Once we restarted everything involving servicemix, activemx and the consumer of the queue, everything went back to normal processing speed.

I'm trying to determine if there are any known issues that could cause this behavior within ActiveMQ.  We are running Apache Servicemix version 4.3.1-fuse-01-09 using ActiveMQ version 5.4.2 (looks like the ActiveMQ packages were included with the Servicemix package).

As another question, since it appears ActiveMQ was included in the Servicemix package, should I ask this question on the Servicemix forum instead?

Any help would be appreciated.

Thanks.

--
Signature

Brian Wright
Sr. UNIX Systems Administrator
901 Mariners Island Blvd Suite 200
San Mateo, CA 94404 USA
Email  brianw@marketo.com
Phone +1.650.539.3530
www.marketo.com

Marketo Logo



--
Signature

Brian Wright
Sr. UNIX Systems Administrator
901 Mariners Island Blvd Suite 200
San Mateo, CA 94404 USA
Email  brianw@marketo.com
Phone +1.650.539.3530
www.marketo.com

Marketo Logo


--------------020601000107050409080003 Content-Type: image/jpeg Content-Transfer-Encoding: base64 Content-ID: /9j/4AAQSkZJRgABAQEAYABgAAD/2wBDAAoHBwgHBgoICAgLCgoLDhgQDg0NDh0VFhEYIx8l JCIfIiEmKzcvJik0KSEiMEExNDk7Pj4+JS5ESUM8SDc9Pjv/2wBDAQoLCw4NDhwQEBw7KCIo Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozv/wAAR CABdAJ0DASIAAhEBAxEB/8QAHwAAAQUBAQEBAQEAAAAAAAAAAAECAwQFBgcICQoL/8QAtRAA AgEDAwIEAwUFBAQAAAF9AQIDAAQRBRIhMUEGE1FhByJxFDKBkaEII0KxwRVS0fAkM2JyggkK FhcYGRolJicoKSo0NTY3ODk6Q0RFRkdISUpTVFVWV1hZWmNkZWZnaGlqc3R1dnd4eXqDhIWG h4iJipKTlJWWl5iZmqKjpKWmp6ipqrKztLW2t7i5usLDxMXGx8jJytLT1NXW19jZ2uHi4+Tl 5ufo6erx8vP09fb3+Pn6/8QAHwEAAwEBAQEBAQEBAQAAAAAAAAECAwQFBgcICQoL/8QAtREA AgECBAQDBAcFBAQAAQJ3AAECAxEEBSExBhJBUQdhcRMiMoEIFEKRobHBCSMzUvAVYnLRChYk NOEl8RcYGRomJygpKjU2Nzg5OkNERUZHSElKU1RVVldYWVpjZGVmZ2hpanN0dXZ3eHl6goOE hYaHiImKkpOUlZaXmJmaoqOkpaanqKmqsrO0tba3uLm6wsPExcbHyMnK0tPU1dbX2Nna4uPk 5ebn6Onq8vP09fb3+Pn6/9oADAMBAAIRAxEAPwD2aiiigAooooAKKKKACiiigAooooAKKKKA CiiigAooooAKKKKACiiigAooooAKKKKACiiigAooooAKKKKACiiigAooooAKRmVFLMQFAySe wqjrGsW+i2X2m4DsCwVVQck1z994tt9T8O6i1vFLEyIE+fHO447fjWkacpapaCubtv4h0i7u Vt7e/iklc4VQTzWlXmnga0+0eIVlIytvGX/HoP516XVVoKErIEFFFFYjCiiigAooooAKKKKA CiiigAooooAKKKKAOe1fxjY6RftZvDNLIgBYpjAzzjmue8Za3JdtYrbSSwxvAJiobafm6Zx7 CuuufDWj3lw9xcWKSSyHLMWbk/nUd54W0e+kEk1sdwUICrkYAGAK6YTpRadhann19PN/YdhB LK7mRnm+ZicDO0fyNEv+j+GYU6Nd3DSH/dQYH6k12moeCLG98vy7iaExRiNAMMABWRrvhDUv Jtls9lxFbQhNoOGJySTj3JrojWg7K4rFv4eWu20u7sjmRwgPsBk/zrsayfDFi+n6BbQyIUkI LupGCCTmtauKrLmm2NBRRRWYwooooAK8t+Jmq3Da7FYwTyIkEQLKjkZZue3tivUq8buD/bnj LVLn7yRJPIPoikD+lVEmWx0ngjV207wTqGoXczyLBKxQOxPOBgc+prhoLvUtW1qEPeXBmuZ1 GRIRyT2q1Z3Mt9odl4dtT+8urwvJj0wAuf1P4Vo+FLaC58eb0IFrZb3DHoFQYB/rVbEb2O+1 fxpomhXH2S6uJJJ0A3JEm4r9e2am0PxZpHiCRorGZvNQbjHIu1seo9a4OfVNEPiK41HRdJu9 UusvIzTNmEerbcZx9ah8CybdT1XW3ARbW1kkwowAzcgD8jS5dCubU70+N9AF7PaNe7Xtwxdi h28dQD3NcX4/8S/2mmmpp00yQSRtLjlC2W2jI/A4+tVPAfhy28RX93PqKNJBCASoYjc7E9SP oao+JJM+LZksIAY7AiOKMDIVYhz+HBNCSuJttHpEnifSfDVrZ6dqF273aQIrqql2zgdcetT6 x4w0fQ/LW8mfzZFDiJEy4B9R2/GuP+Hemw6zqd5rWoyfaLmGQFQ/PzHJ3H+lc/c6lJeeN5tR WyOoYuSy2+0tvVeAMfQCiyuPmdj07RfGmi67cG3tZpEmwWCSptLAdcV594w8Urq+vxPZ3U6W VvhcqSuTn5mA/wA9KueF9Ovrrx2NSn0uawt8yTbWiKovGAAcD1qt4XtLfXfH8srQIbZZJJvL 2jbjOF4+pFCSQm2zv9R8YaNpNlbT3E7n7RGJIo1TLlT3I7fjUejeOdE1u6FrbyyRzMPlSZNu 76HpXDTqviH4niFlDwJcbNvbZGOR9OD+dFskd/8AFRRaxrHFHdkgRjAwg5/lRZD5mel6brdp qsksdtvzEed64z7itCq9tYWlk0jW1ukRkOWKjrVioLCiiigAooooAhu/N+xzeQA03lt5YJxl scfrXnnhbwhq9tZaxJeWwhnubVoYVZwSxPJPHTtXpNFNMTVzzXwn4O1bTlvdRurUR3SW7paR FxkuRjPt6fjS+HPCGs2eh6y01v5N5dQeTCjOMkdT06Z6V6TRT5mLlR5Lo+i+LrLSNSs7XSRE LpQrvKQrkdCF575NaGmeGNZs/A+q2q2LLfXcqr5ZZcmMY6HP1r0qijmDlOX8CaFdaFoMi3cQ S6nkLlNwOBjABI/zzWF4R8I6mmu3l9rNr5SSRyKMsCWZ+uMdsZ/OvRaKVx2PPvA/h3W9B167 jurbbZyRFDKHBDEH5SB19ayLLRvFfhPVbiSx0z7WZEaNZVG4YJyCOeD9a9Yop8wuU4nwvoPi GOyv7nVbyb7TcwtHBFLKW2E/xHsDms7wT4c8R6Fr7GezijtpE2zSswbIHIC4Pc4r0eilcOU8 r/sLxP4Z8Sz3+n6cL0Oz+W4G4EMe4zkGtfwH4U1DT9Rm1fVYvKldSscZILZJyScdK72inzBy hRRRUlBRRRQAUUUUAFFFFABRRRQAUUUUAFFFFABRRRQAUUUUAFFFFABRRRQAUUUUAf/Z --------------020601000107050409080003 Content-Type: image/jpeg Content-Transfer-Encoding: base64 Content-ID: /9j/4AAQSkZJRgABAQEAYABgAAD/2wBDAAoHBwgHBgoICAgLCgoLDhgQDg0NDh0VFhEYIx8l JCIfIiEmKzcvJik0KSEiMEExNDk7Pj4+JS5ESUM8SDc9Pjv/2wBDAQoLCw4NDhwQEBw7KCIo Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozs7Ozv/wAAR CABdAJ0DASIAAhEBAxEB/8QAHwAAAQUBAQEBAQEAAAAAAAAAAAECAwQFBgcICQoL/8QAtRAA AgEDAwIEAwUFBAQAAAF9AQIDAAQRBRIhMUEGE1FhByJxFDKBkaEII0KxwRVS0fAkM2JyggkK FhcYGRolJicoKSo0NTY3ODk6Q0RFRkdISUpTVFVWV1hZWmNkZWZnaGlqc3R1dnd4eXqDhIWG h4iJipKTlJWWl5iZmqKjpKWmp6ipqrKztLW2t7i5usLDxMXGx8jJytLT1NXW19jZ2uHi4+Tl 5ufo6erx8vP09fb3+Pn6/8QAHwEAAwEBAQEBAQEBAQAAAAAAAAECAwQFBgcICQoL/8QAtREA AgECBAQDBAcFBAQAAQJ3AAECAxEEBSExBhJBUQdhcRMiMoEIFEKRobHBCSMzUvAVYnLRChYk NOEl8RcYGRomJygpKjU2Nzg5OkNERUZHSElKU1RVVldYWVpjZGVmZ2hpanN0dXZ3eHl6goOE hYaHiImKkpOUlZaXmJmaoqOkpaanqKmqsrO0tba3uLm6wsPExcbHyMnK0tPU1dbX2Nna4uPk 5ebn6Onq8vP09fb3+Pn6/9oADAMBAAIRAxEAPwD2aiiigAooooAKKKKACiiigAooooAKKKKA CiiigAooooAKKKKACiiigAooooAKKKKACiiigAooooAKKKKACiiigAooooAKRmVFLMQFAySe wqjrGsW+i2X2m4DsCwVVQck1z994tt9T8O6i1vFLEyIE+fHO447fjWkacpapaCubtv4h0i7u Vt7e/iklc4VQTzWlXmnga0+0eIVlIytvGX/HoP516XVVoKErIEFFFFYjCiiigAooooAKKKKA CiiigAooooAKKKKAOe1fxjY6RftZvDNLIgBYpjAzzjmue8Za3JdtYrbSSwxvAJiobafm6Zx7 CuuufDWj3lw9xcWKSSyHLMWbk/nUd54W0e+kEk1sdwUICrkYAGAK6YTpRadhann19PN/YdhB LK7mRnm+ZicDO0fyNEv+j+GYU6Nd3DSH/dQYH6k12moeCLG98vy7iaExRiNAMMABWRrvhDUv Jtls9lxFbQhNoOGJySTj3JrojWg7K4rFv4eWu20u7sjmRwgPsBk/zrsayfDFi+n6BbQyIUkI LupGCCTmtauKrLmm2NBRRRWYwooooAK8t+Jmq3Da7FYwTyIkEQLKjkZZue3tivUq8buD/bnj LVLn7yRJPIPoikD+lVEmWx0ngjV207wTqGoXczyLBKxQOxPOBgc+prhoLvUtW1qEPeXBmuZ1 GRIRyT2q1Z3Mt9odl4dtT+8urwvJj0wAuf1P4Vo+FLaC58eb0IFrZb3DHoFQYB/rVbEb2O+1 fxpomhXH2S6uJJJ0A3JEm4r9e2am0PxZpHiCRorGZvNQbjHIu1seo9a4OfVNEPiK41HRdJu9 UusvIzTNmEerbcZx9ah8CybdT1XW3ARbW1kkwowAzcgD8jS5dCubU70+N9AF7PaNe7Xtwxdi h28dQD3NcX4/8S/2mmmpp00yQSRtLjlC2W2jI/A4+tVPAfhy28RX93PqKNJBCASoYjc7E9SP oao+JJM+LZksIAY7AiOKMDIVYhz+HBNCSuJttHpEnifSfDVrZ6dqF273aQIrqql2zgdcetT6 x4w0fQ/LW8mfzZFDiJEy4B9R2/GuP+Hemw6zqd5rWoyfaLmGQFQ/PzHJ3H+lc/c6lJeeN5tR WyOoYuSy2+0tvVeAMfQCiyuPmdj07RfGmi67cG3tZpEmwWCSptLAdcV594w8Urq+vxPZ3U6W VvhcqSuTn5mA/wA9KueF9Ovrrx2NSn0uawt8yTbWiKovGAAcD1qt4XtLfXfH8srQIbZZJJvL 2jbjOF4+pFCSQm2zv9R8YaNpNlbT3E7n7RGJIo1TLlT3I7fjUejeOdE1u6FrbyyRzMPlSZNu 76HpXDTqviH4niFlDwJcbNvbZGOR9OD+dFskd/8AFRRaxrHFHdkgRjAwg5/lRZD5mel6brdp qsksdtvzEed64z7itCq9tYWlk0jW1ukRkOWKjrVioLCiiigAooooAhu/N+xzeQA03lt5YJxl scfrXnnhbwhq9tZaxJeWwhnubVoYVZwSxPJPHTtXpNFNMTVzzXwn4O1bTlvdRurUR3SW7paR FxkuRjPt6fjS+HPCGs2eh6y01v5N5dQeTCjOMkdT06Z6V6TRT5mLlR5Lo+i+LrLSNSs7XSRE LpQrvKQrkdCF575NaGmeGNZs/A+q2q2LLfXcqr5ZZcmMY6HP1r0qijmDlOX8CaFdaFoMi3cQ S6nkLlNwOBjABI/zzWF4R8I6mmu3l9rNr5SSRyKMsCWZ+uMdsZ/OvRaKVx2PPvA/h3W9B167 jurbbZyRFDKHBDEH5SB19ayLLRvFfhPVbiSx0z7WZEaNZVG4YJyCOeD9a9Yop8wuU4nwvoPi GOyv7nVbyb7TcwtHBFLKW2E/xHsDms7wT4c8R6Fr7GezijtpE2zSswbIHIC4Pc4r0eilcOU8 r/sLxP4Z8Sz3+n6cL0Oz+W4G4EMe4zkGtfwH4U1DT9Rm1fVYvKldSscZILZJyScdK72inzBy hRRRUlBRRRQAUUUUAFFFFABRRRQAUUUUAFFFFABRRRQAUUUUAFFFFABRRRQAUUUUAf/Z --------------020601000107050409080003-- --------------070700080904040603050102--