flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stefan Richter (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-6545) Make incremental checkpoints externalizable
Date Thu, 11 May 2017 14:08:04 GMT
Stefan Richter created FLINK-6545:

             Summary: Make incremental checkpoints externalizable
                 Key: FLINK-6545
                 URL: https://issues.apache.org/jira/browse/FLINK-6545
             Project: Flink
          Issue Type: Sub-task
          Components: State Backends, Checkpointing
    Affects Versions: 1.3.0
            Reporter: Stefan Richter
            Priority: Blocker
             Fix For: 1.3.0

Incremental checkpoints are currently not externalizible. The missing piece is familiarizing
the {{SavepointSerializer}}(s) with the new state handles classes that we added for incremental
checkpointing. Currently, some of those (e.g. {{org.apache.flink.contrib.streaming.state.RocksDBIncrementalKeyedStateHandle}})
currently live in the contrib.rocksdb package and need to be migrated. We can also push them
to a different abstraction level, i.e. {{IncrementalKeyedStateHandle}} with some private data,
referenced existing shared data (from previous checkpoints), and (presumably) newly created
shared data (first created by the current checkpoint).

This message was sent by Atlassian JIRA

View raw message