storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raphael Hsieh <raffihs...@gmail.com>
Subject Re: Parallelism for KafkaSpout
Date Wed, 23 Jul 2014 22:34:25 GMT
how do you tell how many partitions are used in a specific bolt on the
topology ?


On Wed, Jul 23, 2014 at 2:15 PM, Nathan Leung <ncleung@gmail.com> wrote:

> In your example, five spouts would get data and the other five would not.
> On Jul 23, 2014 5:11 PM, "Kashyap Mhaisekar" <kashyap.m@gmail.com> wrote:
>
>> Hi,
>> Is the no. of executors for KafkaSpout dependent on the partitions for
>> the topic?
>> For E.g.,
>> Say kafka TopicA has 5 partitions.
>> If I have a KafkaSpout that has the parallelism hint set to 10, will all
>> the executors get the data? Or am i constrained by the no. of partitions
>> declared for the topic?
>>
>> Regards,
>> Kashyap
>>
>


-- 
Raphael Hsieh

Mime
View raw message