kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jay Kreps <jay.kr...@gmail.com>
Subject Re: S3 Archiving for Kafka topics (with Zookeeper resume)
Date Thu, 31 Jan 2013 17:04:47 GMT
This is super cool. Are we linking the right repo on the ecosystem page?



On Thu, Jan 31, 2013 at 1:29 AM, Jibran Saithi <jibran@qubitdigital.com>wrote:

> Hey,
> I know this has come up a few times, so thought I'd share a bit of code
> we've been using to archive topics to S3.
> Particularly unimaginatively named, but is available here:
> https://github.com/jibs/kafka-s3-consumer
> We needed something with Zookeeper support for storing the offsets, but
> didn't come across anything so I quickly put this together. For the moment
> I've removed graphite stats reporting because it has a few internal
> dependencies, but plan to sort that out soon.
> Hope this helps,
> Jibran

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message