activemq-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bbansal <bhup...@groupon.com>
Subject Re: Backlog data causes producers to slow down.
Date Wed, 21 Dec 2011 15:29:32 GMT
Gary,

I moved on to HornetQ as our underlying transport technology after we were
not able to debug/fix this particular issue. I tried looking into the code
etc.

Best
Bhupesh


On Wed, Dec 21, 2011 at 2:20 AM, Gary Tully [via ActiveMQ] <
ml-node+s2283324n4221130h13@n4.nabble.com> wrote:

> @Bhupesh,
> the prefetch may be part of the problem, as by default the broker will
> try and dispatch 1000 messages to each consumer. If the consumer
> (stomp connection) is short lived, this is a waste of resources.
>
> A consumers acks, will contend message production to some extent, this
> is expected as they share a resource, the consumer dispatch queue.
> Batching acks either using client ack mode or transactions helps
> reduce the overhead.
>
> If you have not yet tried a 5.6-SNAPSHOT, can you verify it behaves the
> same.
>
>
> On 13 September 2011 08:54, bbansal <[hidden email]<http://user/SendEmail.jtp?type=node&node=4221130&i=0>>
> wrote:
>
> > Hey Folks,
> >
> > I tried the concurrentStoreAndDispatchQueues="false" and it didn't help.
> I
> > still see around 10X drop in producer throughput with backlog.
> >
> > 1 Queue , 8 producers, 2 consumers , No backlog : 1200 QPS (producer),
> 1200
> > QPS (consumer)
> > 1 Queue, 8 Producer, 2 consumer, 4GB backlog (2M events): 120 QPS
> > (producer), 1200 QPS (consumer)
> >
> > I am attaching the scripts I am using, unfortunately I am using stomp
> and a
> > perl based consumer/producer setup.
> >
> > Best
> > Bhupesh
> > http://activemq.2283324.n4.nabble.com/file/n3809392/testcase.tar.gz
> > testcase.tar.gz
> > http://activemq.2283324.n4.nabble.com/file/n3809392/activemq-stomp.xml
> > activemq-stomp.xml
> >
> >
> >
> > --
> > View this message in context:
> http://activemq.2283324.n4.nabble.com/Backlog-data-causes-producers-to-slow-down-tp3806018p3809392.html
>
> > Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>
>
>
> --
> http://fusesource.com
> http://blog.garytully.com
>
>
> ------------------------------
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://activemq.2283324.n4.nabble.com/Backlog-data-causes-producers-to-slow-down-tp3806018p4221130.html
>  To unsubscribe from Backlog data causes producers to slow down., click
> here<http://activemq.2283324.n4.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=3806018&code=Ymh1cGVzaEBncm91cG9uLmNvbXwzODA2MDE4fC0yMDk5OTE3NDIy>
> .
> NAML<http://activemq.2283324.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.InstantMailNamespace&breadcrumbs=instant+emails%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>


--
View this message in context: http://activemq.2283324.n4.nabble.com/Backlog-data-causes-producers-to-slow-down-tp3806018p4222076.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message