storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stig Rohde Døssing <s...@apache.org>
Subject Re: KafkaSpout not reading from some kafka partitions !
Date Sat, 04 Nov 2017 10:27:52 GMT
Are you using storm-kafka or storm-kafka-client?

2017-11-04 9:58 GMT+01:00 Arnaud BOS <arnaud.tlse@gmail.com>:

> Shouldn't the KafkaSpout's tasks read from multiple partitions if the
> parallelism is inferior to the number of partitions ?
>
> Did you set the groupId in your KafkaSpoutConfig so that your tasks behave
> as a consumer group ?
>
> I'm new here so I'm just thinking out loud.
>
> On Sat, Nov 4, 2017, 7:21 AM Susheel Kumar Gadalay <skgadalay@gmail.com>
> wrote:
>
>> Change spout parallelism equal to Kafka partitions.
>>
>> On Saturday, November 4, 2017, Sreeram <sreeram.v@gmail.com> wrote:
>> > Hi,
>> >
>> >  I am seeing that storm spout in production is not reading from some
>> > kafka partitions.
>> >
>> > Any clues what can be going wrong?
>> >
>> > Storm version: 1.1.0
>> > Kafka version: 0.9.0
>> > Number of partitions in kafka topic: 12
>> > spout parallelism: 6
>> >
>> > This is quite urgent, will appreciate any help.
>> >
>> > Thank you.
>> >
>> > Regards,
>> > Sreeram
>> >
>
>

Mime
View raw message