storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arnaud BOS <arnaud.t...@gmail.com>
Subject Re: KafkaSpout not reading from some kafka partitions !
Date Sat, 04 Nov 2017 08:58:02 GMT
Shouldn't the KafkaSpout's tasks read from multiple partitions if the
parallelism is inferior to the number of partitions ?

Did you set the groupId in your KafkaSpoutConfig so that your tasks behave
as a consumer group ?

I'm new here so I'm just thinking out loud.

On Sat, Nov 4, 2017, 7:21 AM Susheel Kumar Gadalay <skgadalay@gmail.com>
wrote:

> Change spout parallelism equal to Kafka partitions.
>
> On Saturday, November 4, 2017, Sreeram <sreeram.v@gmail.com> wrote:
> > Hi,
> >
> >  I am seeing that storm spout in production is not reading from some
> > kafka partitions.
> >
> > Any clues what can be going wrong?
> >
> > Storm version: 1.1.0
> > Kafka version: 0.9.0
> > Number of partitions in kafka topic: 12
> > spout parallelism: 6
> >
> > This is quite urgent, will appreciate any help.
> >
> > Thank you.
> >
> > Regards,
> > Sreeram
> >

Mime
View raw message