activemq-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Bastille" <sean.basti...@gmail.com>
Subject Re: High message rate research
Date Mon, 11 Feb 2008 19:38:00 GMT
Hi Joe,

I didn't pay too much attention to message size.  In production our messages
are 34 bytes plus some headers.  For this testing the average ended up being
26 bytes.

While testing the standalone broker, yes it was a completely default
configuration.

For the embedded brokers, I did not use any config files, so it would be
whatever the code defaulted to.  I set the following:
- Used nio instead of tcp (there was a performance gain)
- deliveryMode NON_PERSISTENT
- AUTO_ACKNOWLEDGE
- consumer.prefetchSize=1

I had forgotten about the prefetch size, so I just ran a 1:1 embedded test
with prefetchSize set to 1000.  No change in throughput.

Thanks,

Sean

On Feb 11, 2008 1:15 PM, ttmdev <joe.fernandez@ttmsolutions.com> wrote:

>
> Hi Sean,
>
> Curious to know the average message size used and whether you used the
> default broker configuration?
>
> Thanks,
> Joe
> www.ttmsolutions.com
>
>
> Sean Bastille-2 wrote:
> >
> > I guess my first message was too long, but that's alright, I ended up
> > getting the answers I needed.  I figured I should let you guys in on the
> > results of my testing.
> >
> > The summary of my initial write up is that my main requirement is
> message
> > throughput per host, so that is what my testing has been focused.  The
> > bottom line is that I was able to sent 4500 messages/sec between two
> hosts
> > using 3 producer processes and 2 consumer processes each using embedded
> > brokers.  That is the highest sustained throughput I was able to
> achieve,
> > and while it was successful, the 2 consumers were consuming ~80% of the
> > CPU
> > on the host (2 2.4G Xeons with HT enabled) leaving little available for
> my
> > processing of the messages.  Interestingly enough, the 3 producers were
> > consuming ~60% of the CPU on the other host.
> >
> > As a sanity check, I compared a standalone broker to embedded brokers in
> a
> > 1:1 configuration.  The standalone maxed out around 1800/sec, and the
> > embedded brokers sustained 2500/sec, so this looks like it might be a
> more
> > capable configuration.
> >
> > Unfortunately, none of this works for our requirements.  To handle our
> > current load on existing hardware we need to support at least 8000/sec,
> > and
> > to allow for future growth, I'd really want 15-20k.
> >
> > -Sean
> >
> >
>
> --
> View this message in context:
> http://www.nabble.com/High-message-rate-research-tp15318063s2354p15417390.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message