flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Till Rohrmann <trohrm...@apache.org>
Subject Re: high-availability.storageDir clean up?
Date Wed, 27 Jun 2018 09:40:25 GMT
Hi Elias,

Flink will remove these files if the job reached a globally terminal state
(FINISHED, FAILED, CANCELLED). The files should only remain if the cluster
crashed. This should give you the opportunity to restart the cluster which
can then recover the jobs which have not yet reached a globally terminal
state. If you don't intend to recover these jobs, then it should be safe to
delete the files.


On Wed, Jun 27, 2018 at 10:14 AM Fabian Hueske <fhueske@gmail.com> wrote:

> Hi Elias,
> Till (in CC) is familiar with Flink's HA implementation.
> He might be able to answer your question.
> Thanks,
> Fabian
> 2018-06-25 23:24 GMT+02:00 Elias Levy <fearsome.lucidity@gmail.com>:
>> I noticed in one of our cluster that they are relatively old
>> submittedJobGraph* and completedCheckpoint* files.  I was wondering at what
>> point it is save to clean some of these up.

View raw message