flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Larsson <thomas.lars...@klarna.com>
Subject Can KafkaSource write offsets to Kafka topics
Date Wed, 26 Aug 2015 15:00:20 GMT
Hi,

We are trying out the KafkaSource from Flume 1.6 and it seems that for us
it is storing the consumer offset in zookeeper.
According to
https://cwiki.apache.org/confluence/display/KAFKA/Committing+and+fetching+consumer+offsets+in+Kafka
the proposed method for storing the offset is to store it in a kafka topic.

Is this option available when using the KafkaSource or is it something that
is being considered for the future?

Best Regards
/Thomas

Mime
View raw message