flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3492) Allow users to define a min pause between checkpoints
Date Tue, 15 Mar 2016 12:41:33 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195224#comment-15195224
] 

ASF GitHub Bot commented on FLINK-3492:
---------------------------------------

Github user rmetzger commented on a diff in the pull request:

    https://github.com/apache/flink/pull/1794#discussion_r56155661
  
    --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/environment/StreamExecutionEnvironment.java
---
    @@ -277,6 +277,29 @@ public StreamExecutionEnvironment enableCheckpointing(long interval)
{
     	/**
     	 * Enables checkpointing for the streaming job. The distributed state of the streaming
     	 * dataflow will be periodically snapshotted. In case of a failure, the streaming
    +	 * dataflow will be restarted from the latest completed checkpoint. This method selects
    --- End diff --
    
    I think its sufficient to have the configuration parameter in the `CheckpointConfig`,
without any convenience methods in the  `StreamExecutionEnvironment`. 
    The `StreamExecutionEnvironment` is getting hard to maintain with those changes.


> Allow users to define a min pause between checkpoints
> -----------------------------------------------------
>
>                 Key: FLINK-3492
>                 URL: https://issues.apache.org/jira/browse/FLINK-3492
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming
>            Reporter: Robert Metzger
>            Assignee: Chesnay Schepler
>
> FLINK-3051 introduced already a filed in the {{CheckpointConfig}} to specify a min pause
between checkpoints.
> In high-load situations (big state), jobs might spend their entire time creating snapshots,
not processing data. With a min pause between checkpoints, users can guarantee that there
is a certain time-span the system can use for doing some actual data processing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message