flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sihua Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4256) Fine-grained recovery
Date Fri, 10 Nov 2017 09:42:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16247272#comment-16247272

Sihua Zhou commented on FLINK-4256:

Partial recovery seem to more useful for Batch job, for stream job is it also fine to place
`local recovery` under this umbrella? [~StephanEwen]

> Fine-grained recovery
> ---------------------
>                 Key: FLINK-4256
>                 URL: https://issues.apache.org/jira/browse/FLINK-4256
>             Project: Flink
>          Issue Type: Improvement
>          Components: JobManager
>    Affects Versions: 1.1.0
>            Reporter: Stephan Ewen
>            Assignee: Stephan Ewen
> When a task fails during execution, Flink currently resets the entire execution graph
and triggers complete re-execution from the last completed checkpoint. This is more expensive
than just re-executing the failed tasks.
> In many cases, more fine-grained recovery is possible.
> The full description and design is in the corresponding FLIP.
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-1+%3A+Fine+Grained+Recovery+from+Task+Failures
> The detail desgin for version1 is https://docs.google.com/document/d/1_PqPLA1TJgjlqz8fqnVE3YSisYBDdFsrRX_URgRSj74/edit#

This message was sent by Atlassian JIRA

View raw message