beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jins George (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-1812) Allow configuring checkpoints in Flink Runner PipelineOptions
Date Tue, 04 Apr 2017 05:00:47 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15954561#comment-15954561
] 

Jins George commented on BEAM-1812:
-----------------------------------

Hi [~aljoscha],
Can you assign this ticket to me. I have analyzed and added external check-pointing configurations
to FlinkPipelineOptions in my forked repo. I was able to resume from the last kafka offset
after a cancel and restart.  I can submit a pull request.

Thanks,
Jins

> Allow configuring checkpoints in Flink Runner PipelineOptions
> -------------------------------------------------------------
>
>                 Key: BEAM-1812
>                 URL: https://issues.apache.org/jira/browse/BEAM-1812
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink
>            Reporter: Aljoscha Krettek
>            Assignee: Aljoscha Krettek
>
> Flink allows fine grained configuration of checkpointing: https://github.com/aljoscha/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/environment/CheckpointConfig.java
> Among other things this allows to configure externalised checkpoints, which is a valuable
feature when running a job in production because it allows restoring a job after a failure
as from a savepoint.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message