flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sihua Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-8602) Accelerate recover from failover when use incremental checkpoint
Date Thu, 08 Feb 2018 08:22:00 GMT
Sihua Zhou created FLINK-8602:
---------------------------------

             Summary: Accelerate recover from failover when use incremental checkpoint
                 Key: FLINK-8602
                 URL: https://issues.apache.org/jira/browse/FLINK-8602
             Project: Flink
          Issue Type: Improvement
          Components: State Backends, Checkpointing
    Affects Versions: 1.4.0
            Reporter: Sihua Zhou
            Assignee: Sihua Zhou


Currently, when enable incremental checkpoint, if user change the parallelism then `hasExtraKeys`
may be `true`. If this occur, flink will loop all rocksdb instance and iterator all data to
fetch the data that fails into current `KeyGroupRange`, this can be improved because

 if a state handle's `KeyGroupRange` is fully covered by  current `KeyGroupRange`, we can
open the rocksdb it corresponded directly.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message