flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aljoscha Krettek <aljos...@apache.org>
Subject Re: Cassandra statebackend
Date Mon, 25 Jul 2016 09:41:05 GMT
Hi,
I thought there was a Jira for that but I looked and couldn't find it. If
you'd like you can create one and we can discuss the design. Do you have
any ideas yet?

The tricky things I see in this are:
 - Knowing which data is the current data. This will require some kind of
timestamps or increasing IDs.
 - Knowing when you can retire data from Cassandra.

Some of these might require some changes to how Flink handles checkpoints
and it somewhat goes into the direction of incremental checkpoints. That
last part is especially important once you deal with savepoints, which can
stay around indefinitely.

Cheers,
Aljoscha

On Mon, 25 Jul 2016 at 08:31 Tai Gordon <tzulitai@gmail.com> wrote:

> Hi Chen,
>
> AFAIK, there currently isn’t any FLIP / JIRA / work currently for a
> Cassandra state backend. I think it’ll definitely by interesting to have
> one in Flink.
>
> Regards,
> Gordon
>
>
> On July 25, 2016 at 10:24:32 AM, Chen Qin (qinnchen@gmail.com) wrote:
>
> ​Hi there,
>
> Is there any design docs or on going efforts there?
>
> Thanks,
> Chen ​
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message