samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thiago Souza <tcostaso...@gmail.com>
Subject Re: Samza and Amazon Kinesis
Date Tue, 07 Oct 2014 20:26:38 GMT
Hello all,

I've been doing a little research on this.

It seems that the first obstacle would be with
"SystemAdmin.getOffsetsAfter" as it looks like that Amazon Kinesis does not
provide this information out of the box.

Regards

On Tue, Oct 7, 2014 at 5:02 PM, Scott Clasen <scott@heroku.com> wrote:

> +1
>
> On Tue, Oct 7, 2014 at 12:51 PM, Martin Kleppmann <martin@kleppmann.com>
> wrote:
>
> > I've personally not used Kinesis before, but as far as I know it's very
> > similar to Kafka (it is also based on a total order of messages per
> > partition), so Samza should be able to support it well.
> >
> > If you want to develop a SystemConsumer/SystemProducer for Kinesis, it
> > would be an awesome contribution to Samza :)
> >
> > Thanks,
> > Martin
> >
> > On 7 Oct 2014, at 15:35, Thiago Souza <tcostasouza@gmail.com> wrote:
> >
> > > Hi there,
> > >
> > > I'm quite new to Samza and currently evaluating it for a new project.
> > >
> > > Does it make any sense to implement an alternative to Kafka based on
> > Amazon
> > > Kinesis?
> > >
> > > Thanks,
> > > Thiago Souza
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message