flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jayant Ameta <wittyam...@gmail.com>
Subject Re: Flink with Ceph as the persistent storage
Date Tue, 05 Dec 2017 11:15:00 GMT
If the checkpointing to Ceph happens asynchronously, does it still have any
impact on the stream processing?

Jayant Ameta

On Tue, Dec 5, 2017 at 4:34 PM, Gyula Fóra <gyula.fora@gmail.com> wrote:

> Hi,
>
> To my understanding Ceph as in http://ceph.com/ceph-storage/  is a block
> based object storage system. You can use it mounted to your server and will
> behave as a local file system to most extent but will be shared in the
> cluster.
>
> The performance might not be as good as with HDFS to our experience.
>
> Gyula
>
> Jayant Ameta <wittyameta@gmail.com> ezt írta (időpont: 2017. dec. 5., K,
> 12:00):
>
>> Hi,
>> Flink documents suggests that Ceph can be used as a persistent storage
>> for states. https://ci.apache.org/projects/flink/flink-docs-
>> release-1.3/dev/stream/checkpointing.html
>>
>> Considering that Ceph is a transactional database, wouldn't it have
>> adverse effect on Flink's performance?
>>
>>
>>

Mime
View raw message