flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3492) Allow users to define a min pause between checkpoints
Date Mon, 04 Apr 2016 13:59:25 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15224178#comment-15224178

ASF GitHub Bot commented on FLINK-3492:

Github user StephanEwen commented on the pull request:

    How about adjusting the test such that it works the following way:
      - it polls the number of checkpoint calls (from the atomic integer), say every 100 ms
      - it starts measuring time from when the count goes to `1`
      - it validates that `(numCalls - 2) * pause` is always smaller than the elapsed time
since starting the time measurement

> Allow users to define a min pause between checkpoints
> -----------------------------------------------------
>                 Key: FLINK-3492
>                 URL: https://issues.apache.org/jira/browse/FLINK-3492
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming
>            Reporter: Robert Metzger
>            Assignee: Chesnay Schepler
> FLINK-3051 introduced already a filed in the {{CheckpointConfig}} to specify a min pause
between checkpoints.
> In high-load situations (big state), jobs might spend their entire time creating snapshots,
not processing data. With a min pause between checkpoints, users can guarantee that there
is a certain time-span the system can use for doing some actual data processing.

This message was sent by Atlassian JIRA

View raw message