flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3492) Allow users to define a min pause between checkpoints
Date Tue, 15 Mar 2016 12:41:33 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195224#comment-15195224

ASF GitHub Bot commented on FLINK-3492:

Github user rmetzger commented on a diff in the pull request:

    --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/environment/StreamExecutionEnvironment.java
    @@ -277,6 +277,29 @@ public StreamExecutionEnvironment enableCheckpointing(long interval)
     	 * Enables checkpointing for the streaming job. The distributed state of the streaming
     	 * dataflow will be periodically snapshotted. In case of a failure, the streaming
    +	 * dataflow will be restarted from the latest completed checkpoint. This method selects
    --- End diff --
    I think its sufficient to have the configuration parameter in the `CheckpointConfig`,
without any convenience methods in the  `StreamExecutionEnvironment`. 
    The `StreamExecutionEnvironment` is getting hard to maintain with those changes.

> Allow users to define a min pause between checkpoints
> -----------------------------------------------------
>                 Key: FLINK-3492
>                 URL: https://issues.apache.org/jira/browse/FLINK-3492
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming
>            Reporter: Robert Metzger
>            Assignee: Chesnay Schepler
> FLINK-3051 introduced already a filed in the {{CheckpointConfig}} to specify a min pause
between checkpoints.
> In high-load situations (big state), jobs might spend their entire time creating snapshots,
not processing data. With a min pause between checkpoints, users can guarantee that there
is a certain time-span the system can use for doing some actual data processing.

This message was sent by Atlassian JIRA

View raw message