Return-Path: X-Original-To: apmail-activemq-users-archive@www.apache.org Delivered-To: apmail-activemq-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 67CABE3F5 for ; Wed, 9 Jan 2013 19:20:32 +0000 (UTC) Received: (qmail 73801 invoked by uid 500); 9 Jan 2013 19:20:31 -0000 Delivered-To: apmail-activemq-users-archive@activemq.apache.org Received: (qmail 73752 invoked by uid 500); 9 Jan 2013 19:20:31 -0000 Mailing-List: contact users-help@activemq.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@activemq.apache.org Delivered-To: mailing list users@activemq.apache.org Received: (qmail 73741 invoked by uid 99); 9 Jan 2013 19:20:31 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jan 2013 19:20:31 +0000 X-ASF-Spam-Status: No, hits=0.6 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS,URI_HEX X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of gaurav.cs.sharma@gmail.com designates 209.85.210.46 as permitted sender) Received: from [209.85.210.46] (HELO mail-da0-f46.google.com) (209.85.210.46) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jan 2013 19:20:23 +0000 Received: by mail-da0-f46.google.com with SMTP id p5so889026dak.5 for ; Wed, 09 Jan 2013 11:20:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:subject:references:from:content-type:x-mailer :in-reply-to:message-id:date:to:content-transfer-encoding :mime-version; bh=os4MRrBVbtcpjcYP/TEfd3qKgD5Zs4yPbvHMKpbIRRU=; b=K0+nQvxT8qgQZdZoZ4VhnWToQKGoWgVchAqj9qO50beySigOj+ktQjPckoUsIJ+WBi M20y+AZWIhfH8v/QPnutbUp+6vYHJrJWG0AqGtM2HvRgqzadIOl0GNHvz9/30Du2XnkK lh4EqvL8sXKN0jHhZypH8O0CXzHVES0qh9sBQoLIIHQTFCfZWdNd1WmpVF7EhEOSpf8V 9yrs23TNhBhKkcnW53mmgsLUCRs0mXthWiDvvBws0Aq1rwZOYo5yTix8w6vS4IjUf2nr 3vn6ugRx0h/YDrXHRDwWG/uUmloJRxqUh/7Bodh47F5MeOoKZWG4SwamodloiU6il6fP ypKw== X-Received: by 10.68.230.103 with SMTP id sx7mr213560268pbc.19.1357759202521; Wed, 09 Jan 2013 11:20:02 -0800 (PST) Received: from [172.20.25.104] (fw-rw.shutterfly.com. [74.121.38.141]) by mx.google.com with ESMTPS id d2sm43297905paw.19.2013.01.09.11.20.00 (version=SSLv3 cipher=OTHER); Wed, 09 Jan 2013 11:20:01 -0800 (PST) Subject: Re: Slow starting activemq connection References: <1357756279656-4661562.post@n4.nabble.com> From: Gaurav Sharma Content-Type: text/plain; charset=us-ascii X-Mailer: iPhone Mail (10A523) In-Reply-To: <1357756279656-4661562.post@n4.nabble.com> Message-Id: Date: Wed, 9 Jan 2013 11:20:01 -0800 To: "users@activemq.apache.org" Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (1.0) X-Virus-Checked: Checked by ClamAV on apache.org It could be a number of things. But first, a couple questions:=20 1. how does your network look like - 2/3 level switches in the DC, flat or s= omething else? Where are the producers deployed relative to the broker clust= ers? Do you have tcp keep-alive turned on, spl routing, firewalls, etc? 2. any reason for not using the pooled connection factory? I would immediately write a long running producer->broker test and deploy on= a couple machines in the 'same' network going against the 'same' broker nod= es, let it run continuously overnight, capture packets via wireshark, etc an= d analyze the drops. Loop in your network engg. to help sample-trace the rou= tes during your tests. Hope this helps or maybe you already did these analyses and didn't find anyt= hing? Let us know either way. On Jan 9, 2013, at 10:31, KaZso wrote: > Hi, >=20 > I am facing a strange performance issue with an activemq broker (v. 5.4.0)= .=20 > The setup is very simple: > - 1 broker instance > - no persistence provider > - about 200 consumers and producers using non-persistent messages. The > message size can be anything up to 1-2MB but is usually smaller. > - dedicated task runner has been disabled > - producer flow control enabled >=20 > Most message producers open and close their connections for every message > sent but the number of messages can vary from 5-10 per day to 20-30 every > minute, meaning that we do have thousands of connections being opened and > closed every day.=20 >=20 > This is working well enough with delivery times of up to a few hundred > milliseconds, but every know and then there is a "hiccup". Starting the jm= s > connection slows down to tens of seconds for no apparent reason, then > immediately picks up again. Message delivery of already established > connections are not affected, and the slowdowns seem totally random. Numbe= r > of threads is mostly constant, and the memory levels seem fine as well, wi= th > the total garbage collection time being lower than one single slowdown. >=20 > No exceptions or warnings can be found in the logs, and the slow connectio= ns > do eventually start. The message delivery on them is fast and not > problematic at all. >=20 > Could anyone help me in finding the root cause of this issue? Could the > producer flow control delay the start of a new connection but not the flow= > of messages? >=20 > Thank you, > Zsombor >=20 >=20 >=20 > -- > View this message in context: http://activemq.2283324.n4.nabble.com/Slow-s= tarting-activemq-connection-tp4661562.html > Sent from the ActiveMQ - User mailing list archive at Nabble.com.