kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tom Brown <tombrow...@gmail.com>
Subject Re: Best partition configuration
Date Wed, 21 Aug 2013 16:52:09 GMT
Philip,

How many topics per broker (just one?) And what is the read/write profile
of your setup?

--Tom


On Wed, Aug 21, 2013 at 12:24 PM, Philip O'Toole <philip@loggly.com> wrote:

> On Wed, Aug 21, 2013 at 10:06:50AM -0400, Tom Brown wrote:
> > I have not been able to find reliable advice regarding how many
> partitions
> > should exist on a single broker. How many partitions have you used, and
> > what kind of throughput have you seen?
>
> We settled on 8 per broker, and usually run 3 brokers in production
> environments, giving us a total of 24 partitions. Throughput has been
> superb.
>
> For integration testing however, we usually use just 1 or 2 partitions.
>
> Philip
>
> >
> > Thanks in advance!
> >
> > --Tom
>
> --
> Philip O'Toole
>
> Senior Developer
> Loggly, Inc.
> San Francisco, CA.
> www.loggly.com
>
> Come join us!
> http://loggly.com/company/careers/
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message