flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ufuk Celebi <...@apache.org>
Subject Re: Controlling savepoints from inside an application
Date Tue, 04 Oct 2016 07:32:22 GMT
On Fri, Sep 30, 2016 at 4:19 PM, Astrac <aldo.strac@gmail.com> wrote:
> What I mean by "manually reading the savepoint" is that rather than
> providing the savepoint path via "the --fromSavepoint
> hdfs://some-path/to/savepoint" option I'd like to provide it in the code
> that initialises the StreamExecutionEnvironment. This way I can use my
> versioning strategy to load a savepoint that is compatible with the current
> version of the application (or none if this is a new version of the state,
> effectively rebuilding everything from Kafka).
>
> On the other side, i.e. writing the savepoint somewhere, at the moment I
> would be happy with triggering savepoints via CLI if it was possible to
> configure the path where they are stored via the initialisation code where
> we build the StreamExecutionEnvironment rather than via flink-conf.yml;
> since I don't see mention of this in the FLIP, is this something you would
> be happy to add as well?

I think what you describe makes sense. I will update FLIP-10
accordingly. I'm finishing the initial PR for FLIP-10, which will not
include this yet though. Thanks for your input!

Mime
View raw message