flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4067) Add version header to savepoints
Date Tue, 12 Jul 2016 14:38:20 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372972#comment-15372972

ASF GitHub Bot commented on FLINK-4067:

Github user uce commented on the issue:

    If there are no objections, I would like to merge this.

> Add version header to savepoints
> --------------------------------
>                 Key: FLINK-4067
>                 URL: https://issues.apache.org/jira/browse/FLINK-4067
>             Project: Flink
>          Issue Type: Improvement
>    Affects Versions: 1.0.3
>            Reporter: Ufuk Celebi
>            Assignee: Ufuk Celebi
>             Fix For: 1.1.0
> Adding a header with version information to savepoints ensures that we can migrate savepoints
between Flink versions in the future (for example when changing internal serialization formats
between versions).
> After talking with Till, we propose to add the following meta data:
> - Magic number (int): identify data as savepoint
> - Version (int): savepoint version (independent of Flink version)
> - Data Offset (int): specifies at which point the actual savepoint data starts. With
this, we can allow future Flink versions to add fields to the header without breaking stuff,
e.g. Flink 1.1 could read savepoints of Flink 2.0.
> For Flink 1.0 savepoint support, we have to try reading the savepoints without a header
before failing if we don't find the magic number.

This message was sent by Atlassian JIRA

View raw message