Mailing-List: contact users-help@activemq.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@activemq.apache.org
Received-SPF: pass (nike.apache.org: domain of torsten@fusesource.com
 designates 74.125.245.72 as permitted sender)
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1084)
Subject: Re: Backlog data causes producer to slow down.
From: Torsten Mielke <torsten@fusesource.com>
In-Reply-To: <924C8723-0E88-43C0-82CD-2870DDC7E90B@yahoo-inc.com>
Date: Wed, 21 Dec 2011 10:13:57 +0100
Content-Transfer-Encoding: quoted-printable
Message-Id: <9C3D04DB-9989-4134-8DB1-6B2CD369D763@fusesource.com>
References: <924C8723-0E88-43C0-82CD-2870DDC7E90B@yahoo-inc.com>
To: users@activemq.apache.org

Hard to say what exactly the problem is. In the past I got to learn the =
optimizedDispatch=3D"true" isn't always a good choice. Can you try =
without it?

In addition I recently found that enableIndexWriteAsync=3D"true" on your =
kahadb config may not bring any performance improvement. Not sure if you =
have set this.

Also does your test involve queue or topic messages?


Torsten Mielke
torsten@fusesource.com
tmielke@blogspot.com


On Dec 20, 2011, at 10:37 AM, Harish Sharma wrote:

> Hi,
> I tried to reply to =
http://activemq.2283324.n4.nabble.com/Backlog-data-causes-producers-to-slo=
w-down-tt3806018.html post . Because i am facing similar issue.
> Whenever my consumer goes down and there is a data back log the =
production rate goes down significantly.
> Moreover when my consumer is up again , the production rate goes down =
again and this cycle repeats itself.
> Some Info :
> I am using ActiveMQ 5.5.1 , KahaDB message store,  Producer flow =
control =3D FALSE , AsyncSend(true) , persistence =3D true and =
ConcurrentQueueStoreAndDispatch =3D true and false (tried both does not =
make much difference)
> As i read in this post about cursors so i am using the default store =
cursor.
>=20
> Here is snippet from broker.xml
> destinationPolicy>
>      <policyMap>
>        <policyEntries>
>          <policyEntry topic=3D">" optimizedDispatch=3D"true" =
memoryLimit=3D"1gb" producerFlowControl=3D"false"  />
>          <policyEntry queue=3D">" optimizedDispatch=3D"true" =
memoryLimit=3D"1gb" producerFlowControl=3D"false" />
>        </policyEntries>
>      </policyMap>
>    </destinationPolicy>
>=20
> <systemUsage>
>      <systemUsage sendFailIfNoSpace=3D"true">
>        <memoryUsage>
>          <memoryUsage limit=3D"20 gb" />
>        </memoryUsage>
>        <storeUsage>
>          <storeUsage limit=3D"500 gb" name=3D"foo" />
>        </storeUsage>
>        <tempUsage>
>          <tempUsage limit=3D"1 gb" />
>        </tempUsage>
>      </systemUsage>
>    </systemUsage>
>=20
> I am using all the optimizations(i read from =
http://fusesource.com/docs/broker/5.4/tuning/index.html )
> for producer , consumer and broker.
> These optimizations are able to increase message production rate a bit =
but the main issue is the stability of the production rate.(why it goes =
down 10 times and then keep on going down with every time consumers goes =
down or goes up again).
> I am trying to figure out the cause but unable to pinpoint the code in =
activeMQ which is causing this issue.
> When i saw threads state in jconsole i found out that as soon as =
consumer start running , producer thread goes into wait state ( State: =
WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer ).I =
understand the queue these producers write to is blocking queue.But i  =
don't understand why consumers  are affecting producers while flow =
control is off and my store size is 500 GB and memory is 20GB .Why not =
producers are producing at a constant rate until my KahaDB store is =
full.
>=20
> I really need help in this matter and deeply appreciate any help from =
you guys.
>=20
> Thanks & Regards
> Harish Sharma