flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sihua Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-8845) Use WriteBatch to improve performance for recovery in RocksDB backend
Date Wed, 07 Mar 2018 08:41:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sihua Zhou updated FLINK-8845:
------------------------------
    Summary: Use WriteBatch to improve performance for recovery in RocksDB backend  (was:
 Introduce `parallel recovery` mode for full checkpoint (savepoint))

> Use WriteBatch to improve performance for recovery in RocksDB backend
> ---------------------------------------------------------------------
>
>                 Key: FLINK-8845
>                 URL: https://issues.apache.org/jira/browse/FLINK-8845
>             Project: Flink
>          Issue Type: Improvement
>          Components: State Backends, Checkpointing
>    Affects Versions: 1.5.0
>            Reporter: Sihua Zhou
>            Assignee: Sihua Zhou
>            Priority: Major
>             Fix For: 1.6.0
>
>
> Base on {{ingestExternalFile()}} and {{SstFileWriter}} provided by RocksDB, we can restore
from fully checkpoint (savepoint) in parallel. This can also be extended to incremental checkpoint
easily, but for the sake of simple, we do this in two separate tasks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message