flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh <jof...@gmail.com>
Subject External DB as sink - with processing guarantees
Date Fri, 11 Mar 2016 23:54:44 GMT
Hi all,

I want to use an external data store (DynamoDB) as a sink with Flink. It looks like there's
no connector for Dynamo at the moment, so I have two questions:

1. Is it easy to write my own sink for Flink and are there any docs around how to do this?
2. If I do this, will I still be able to have Flink's processing guarantees? I.e. Can I be
sure that every tuple has contributed to the DynamoDB state either at-least-once or exactly-once?

Thanks for any advice,
View raw message