flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-7210) Add TwoPhaseCommitSinkFunction (implementing exactly-once semantic in generic way)
Date Mon, 07 Aug 2017 05:28:01 GMT

    [ https://issues.apache.org/jira/browse/FLINK-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16116064#comment-16116064

ASF GitHub Bot commented on FLINK-7210:

Github user tzulitai commented on the issue:

    Alright, this looks good to merge now!
    Merging ..

> Add TwoPhaseCommitSinkFunction (implementing exactly-once semantic in generic way)
> ----------------------------------------------------------------------------------
>                 Key: FLINK-7210
>                 URL: https://issues.apache.org/jira/browse/FLINK-7210
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming Connectors
>            Reporter: Piotr Nowojski
>            Assignee: Piotr Nowojski
> To implement exactly-once sink there is a re-occurring pattern for doing it - two phase
commit algorithm. It is used both in `BucketingSink` and in `Pravega` sink and it will be
used in `Kafka 0.11` connector. It would be good to extract this common logic into one class,
both to improve existing implementation (for exampe `Pravega`'s sink doesn't abort interrupted
transactions) and to make it easier for the users to implement their own custom exactly-once

This message was sent by Atlassian JIRA

View raw message