From users-return-1055-apmail-qpid-users-archive=qpid.apache.org@qpid.apache.org Tue Mar 10 03:40:24 2009 Return-Path: Delivered-To: apmail-qpid-users-archive@www.apache.org Received: (qmail 95741 invoked from network); 10 Mar 2009 03:40:24 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 10 Mar 2009 03:40:24 -0000 Received: (qmail 61530 invoked by uid 500); 10 Mar 2009 03:40:23 -0000 Delivered-To: apmail-qpid-users-archive@qpid.apache.org Received: (qmail 61515 invoked by uid 500); 10 Mar 2009 03:40:23 -0000 Mailing-List: contact users-help@qpid.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@qpid.apache.org Delivered-To: mailing list users@qpid.apache.org Received: (qmail 61504 invoked by uid 99); 10 Mar 2009 03:40:23 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Mar 2009 20:40:23 -0700 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of gs.chandran.n@gmail.com designates 209.85.162.178 as permitted sender) Received: from [209.85.162.178] (HELO el-out-1112.google.com) (209.85.162.178) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Mar 2009 03:40:17 +0000 Received: by el-out-1112.google.com with SMTP id j27so1095793elf.15 for ; Mon, 09 Mar 2009 20:39:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=bjLAcN1LZEWPFszi48g6wq8O46Tafri9Okhzi0W0ZeE=; b=MBk3knlOhjGgtfMv55ZB6CKVH+U7SuFKg3sURCpQG+8DPp6C2kud+3jbl1jyoewtWq ozqh1y7YCNMykYX+NWNSHNiMsALYxfgv0xjD8LjUM1in7cSevyjF2jzXhPUTBV794e4l PgCUdGvDjX/Akg82rTeBPWA2zPEICAyuC55js= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=aJRaJOCvOxr8C1N+cNcZ+rfhP/gcnt0S0Ghsk3rA7vJOs/UWl4g8KTL6p2VVDTv0sX fCmh8EqRHlt9kpuwbQ7I9y85r2P3MKQJDjWndq1rPX+qCHSVn8qiq+EQk2vRiLSHjFPg d/bGsWpM9lG+cxw4wC5+ss8OeaxbwY1B6ZRGE= MIME-Version: 1.0 Received: by 10.90.65.5 with SMTP id n5mr1314967aga.68.1236656396820; Mon, 09 Mar 2009 20:39:56 -0700 (PDT) In-Reply-To: <49B5751E.2060701@redhat.com> References: <1802abc00903072142p2c5de8a9i5a7048c6f1d9c537@mail.gmail.com> <1802abc00903082316v4194a1a8s5f397ccd7d12f628@mail.gmail.com> <49B4D194.3080600@redhat.com> <1802abc00903090937ja6ff557y4e945927c97f4318@mail.gmail.com> <49B5751E.2060701@redhat.com> Date: Tue, 10 Mar 2009 09:09:56 +0530 Message-ID: <1802abc00903092039n41024756x3648e308a58f8ef0@mail.gmail.com> Subject: Re: Memory pile up on broker From: "GS.Chandra N" To: users@qpid.apache.org Content-Type: multipart/alternative; boundary=0016361e7e7c3de1ae0464bb81a7 X-Virus-Checked: Checked by ClamAV on apache.org --0016361e7e7c3de1ae0464bb81a7 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit >On Tue, Mar 10, 2009 at 1:29 AM, Gordon Sim wrote: >If they don't match any bindings they will be dropped by the exchange. If the dropped count is staying the same as the routed count goes up, then the messages are matching a subscription. My subscription says arguments={ "x-match":"all", "Type" = "Animal", "Species" = "Alien"}. My messages have Type="Animal" and couple of other headers but Species are anything but Alien. And about what you said, about subscriptions being dropped - thats scary. How can subscriptions be dropped by the borker? How would it know if sometime in the future, messages that match those subscriptions are not going to start coming in? >However it sounds like maybe there are queues that you don't expect to be receiving messages that are bound to your exchange. Does 'list binding' show anything up? All those subscriptions are around even after the clients that have created them have exitted and list bindings show that the statistic msgMatched shows a big number against them None of my clients recieve any messages (as i have a print in them to check if they have recieved any) and the queues also show the msgDepth to be zero at all times. Thanks in advance gs On Tue, Mar 10, 2009 at 1:29 AM, Gordon Sim wrote: > GS.Chandra N wrote: > >> On Mon, Mar 9, 2009 at 1:51 PM, Gordon Sim wrote: >>> If you use the tool to look at the subscription queues while the memory >>> is >>> >> climbing you can see the queue depth for these. >> >> That's exactly what I'm confused about because the messages i sent will >> NOT >> match any of the subscriptions as the tests I'm conducting is to establish >> the load due to a high no of subscriptions. >> > > If they don't match any bindings they will be dropped by the exchange. If > the dropped count is staying the same as the routed count goes up, then the > messages are matching a subscription. > > >> The queues show 0 for everything except the binding count and the consumer >> count (1). >> >> Are you accepting the messages after the subscriber receives them (or >>> using >>> >> accept_mode=not_required)? The broker will not dequeue messages from the >> queue until you do so. >> >> I do not do anything special here since i do not accept any messages but >> the >> queu autoDelete property shows false. Not sure what this means or if it >> has >> any significance since msgDepth shows 0. >> >> The python code i use to accept messageslook like this >> >> def dump_queue(queue): >> >> content = "" # Content of the last message read >> message = 0 >> >> while 1: >> try: >> message = queue.get(timeout=10000000000) >> content = message.body >> session.message_accept(RangedSet(message.id)) >> print "Recieved a message and sent ack" >> except Empty: >> continue >> > > > Ok, the message_accept there is what will trigger the dequeues. > > However it sounds like maybe there are queues that you don't expect to be > receiving messages that are bound to your exchange. Does 'list binding' show > anything up? > > > --------------------------------------------------------------------- > Apache Qpid - AMQP Messaging Implementation > Project: http://qpid.apache.org > Use/Interact: mailto:users-subscribe@qpid.apache.org > > --0016361e7e7c3de1ae0464bb81a7--