kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 김정민 <mins...@gmail.com>
Subject RE: partition and consumer stream number
Date Thu, 14 Mar 2013 02:00:02 GMT
If there is no partitions (only one partition), then two consumers exist.
Is it possible only one consumer  to get data from kafka(two broker)?
I can`t understand ... 

-----Original Message-----
From: Jun Rao [mailto:junrao@gmail.com] 
Sent: Tuesday, December 18, 2012 1:39 AM
To: users@kafka.apache.org
Subject: Re: partition and consumer stream number

Currently, partition is the smallest unit that we distribute data among consumers (in the
same consumer group). So, if the # of consumers is larger than the total number of partitions
in a Kafka cluster (across all brokers), some consumers will never get any data.

Thanks,

Jun

On Mon, Dec 17, 2012 at 6:03 AM, 永辉 赵 <zhaoyonghui@gmail.com> wrote:

> Hi all,
>
> In consumer we use a topic count map to set how many stream we want to 
> split the topic.
> What's the relation between kafka partition number and consumer stream 
> number?
> Seems  stream number should be less or equal to partition number?
> Because if we set stream number bigger than partition number then some 
> stream is empty or some partition is split.
>
> Thanks,
> Yonghui
>
>
>
>


Mime
View raw message