flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yun Tang <myas...@live.com>
Subject Re: Improved performance when using incremental checkpoints
Date Tue, 16 Jun 2020 08:56:28 GMT
Hi Nick

It's really strange that performance could improve when checkpoint is enabled.
In general, enable checkpoint might bring a bit performance downside to the whole job.

Could you give more details e.g. Flink version, configurations of RocksDB and simple code
which could reproduce this problem.

Best
Yun Tang
________________________________
From: nick toker <nick.toker.dev@gmail.com>
Sent: Tuesday, June 16, 2020 15:44
To: user@flink.apache.org <user@flink.apache.org>
Subject: Improved performance when using incremental checkpoints

Hello,

We are using RocksDB as the backend state.
At first we didn't enable the checkpoints mechanism.

We observed the following behaviour and we are wondering why ?

When using the rocksDB without checkpoint the performance was very extremely bad.
And when we enabled the checkpoint the performance was improved by a factor of 10.

Could you please explain if this behaviour is expected ?
Could you please explain why enabling the checkpoint significantly improves the performance
?

BR,
Nick

Mime
View raw message