flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Edward Rojas <edward.roja...@gmail.com>
Subject Re: S3 for state backend in Flink 1.4.0
Date Wed, 31 Jan 2018 16:54:42 GMT
Hi Aljoscha,

Thinking a little bit more about this, although IBM Object storage is
compatible with Amazon's S3, it's not an eventually consistent file system,
but rather immediately consistent. 

So we won't need the support for eventually consistent FS for our use case
to work, but we would only need that the BucketingSink uses the Flink
FileSystem abstraction instead of directly using the Hadoop FileSystem

Is this something that could be released earlier ?  Or do you have any idea
how we could achieve it ?


Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

View raw message