kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Philip O'Toole <phi...@loggly.com>
Subject Re: Best partition configuration
Date Wed, 21 Aug 2013 16:24:02 GMT
On Wed, Aug 21, 2013 at 10:06:50AM -0400, Tom Brown wrote:
> I have not been able to find reliable advice regarding how many partitions
> should exist on a single broker. How many partitions have you used, and
> what kind of throughput have you seen?

We settled on 8 per broker, and usually run 3 brokers in production
environments, giving us a total of 24 partitions. Throughput has been superb.

For integration testing however, we usually use just 1 or 2 partitions.

Philip

> 
> Thanks in advance!
> 
> --Tom

-- 
Philip O'Toole

Senior Developer
Loggly, Inc.
San Francisco, CA.
www.loggly.com

Come join us!
http://loggly.com/company/careers/

Mime
View raw message