Mailing-List: contact users-help@kafka.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@kafka.apache.org
Received-SPF: pass (athena.apache.org: domain of jay.kreps@gmail.com
 designates 209.85.215.48 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CALOiWaOk9VKBO7L0ROca-CQWs6d4nOi0vp-839jL4RfFuoGhfg@mail.gmail.com>
References: 
 <CALOiWaOk9VKBO7L0ROca-CQWs6d4nOi0vp-839jL4RfFuoGhfg@mail.gmail.com>
Date: Thu, 31 Jan 2013 09:04:47 -0800
Message-ID: 
 <CAOeJiJhGHsDKx7sruTLja60XDdh6iQ7cOXyyM2QWVX4Eszm6Hw@mail.gmail.com>
Subject: Re: S3 Archiving for Kafka topics (with Zookeeper resume)
From: Jay Kreps <jay.kreps@gmail.com>
To: users@kafka.apache.org
Content-Type: multipart/alternative; boundary=f46d04083e0dc69b3c04d4989faa

--f46d04083e0dc69b3c04d4989faa
Content-Type: text/plain; charset=ISO-8859-1

This is super cool. Are we linking the right repo on the ecosystem page?

https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem

-Jay


On Thu, Jan 31, 2013 at 1:29 AM, Jibran Saithi <jibran@qubitdigital.com>wrote:

> Hey,
>
> I know this has come up a few times, so thought I'd share a bit of code
> we've been using to archive topics to S3.
>
> Particularly unimaginatively named, but is available here:
> https://github.com/jibs/kafka-s3-consumer
>
> We needed something with Zookeeper support for storing the offsets, but
> didn't come across anything so I quickly put this together. For the moment
> I've removed graphite stats reporting because it has a few internal
> dependencies, but plan to sort that out soon.
>
> Hope this helps,
> Jibran
>

--f46d04083e0dc69b3c04d4989faa--