flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-6284) Incorrect sorting of completed checkpoints in ZooKeeperCompletedCheckpointStore
Date Mon, 15 May 2017 10:23:04 GMT

    [ https://issues.apache.org/jira/browse/FLINK-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010287#comment-16010287

ASF GitHub Bot commented on FLINK-6284:

Github user tillrohrmann commented on the issue:

    Thanks for the review @StefanRRichter. Merging this PR once Travis gives green light.

> Incorrect sorting of completed checkpoints in ZooKeeperCompletedCheckpointStore
> -------------------------------------------------------------------------------
>                 Key: FLINK-6284
>                 URL: https://issues.apache.org/jira/browse/FLINK-6284
>             Project: Flink
>          Issue Type: Bug
>          Components: State Backends, Checkpointing
>            Reporter: Xiaogang Shi
>            Priority: Blocker
>             Fix For: 1.3.0
> Now all completed checkpoints are sorted in their paths when they are recovered in {{ZooKeeperCompletedCheckpointStore}}
. In the cases where the latest checkpoint's id is not the largest in lexical order (e.g.,
"100" is smaller than "99" in lexical order), Flink will not recover from the latest completed
> The problem can be easily observed by setting the checkpoint ids in {{ZooKeeperCompletedCheckpointStoreITCase#testRecover()}}
to be 99, 100 and 101. 
> To fix the problem, we should explicitly sort found checkpoints in their checkpoint ids,
without the usage of {{ZooKeeperStateHandleStore#getAllSortedByName()}}

This message was sent by Atlassian JIRA

View raw message