flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Balaji Rajagopalan <balaji.rajagopa...@olacabs.com>
Subject Re: How to start with the first Kafka Message
Date Fri, 18 Mar 2016 02:02:37 GMT
If it is a one time thing, you could run the kafka consumer script which
has the --from-beginning option, and redirect the output as a socketstream
and consume in flink.

On Thu, Mar 17, 2016 at 7:24 PM, Till Rohrmann <trohrmann@apache.org> wrote:

> Hi Dominique,
>
> have you tried setting the Kafka property props.put("auto.offset.reset",
> "smallest");?
>
> Cheers,
> Till
> ​
>
> On Thu, Mar 17, 2016 at 1:39 PM, Dominique Rondé <
> dominique.ronde@codecentric.de> wrote:
>
>> Hi folks,
>>
>> i have a kafka topic with messages from the last 7 days. Now i have a new
>> flink streaming process and like to consume the messages from the
>> beginning. If I just bring up the topology, the consumer starts from this
>> moment and not from beginning.
>>
>> THX
>>
>> Dominique
>>
>
>

Mime
View raw message