flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2098) Checkpoint barrier initiation at source is not aligned with snapshotting
Date Tue, 02 Jun 2015 05:21:17 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568542#comment-14568542
] 

ASF GitHub Bot commented on FLINK-2098:
---------------------------------------

Github user aljoscha commented on the pull request:

    https://github.com/apache/flink/pull/742#issuecomment-107811407
  
    I will fix the remaining cancel() races. The twitter stuff I just commented out because
I assumed that the new TwitterSource could be merged right away and I was waiting for that.
    
    As for two Source interfaces. We can certainly do that. The reason I didn't do it is because
there would be a lot of duplication because we have SourceFunction, ParallelSourceFunction,
RichSourceFunction and ParallelRichSourceFunction. With the new Source interface this would
go up to 8 interfaces for the sources. (That's also the reason why I didn't have Kafka derived
from the RichParallelSourceFunction, I thought that maybe we could get rid of the special
interfaces for parallel sources.)
    
    Also, I realize there are many more problems. I just can't address them all in a single
PR. :sweat_smile: 


> Checkpoint barrier initiation at source is not aligned with snapshotting
> ------------------------------------------------------------------------
>
>                 Key: FLINK-2098
>                 URL: https://issues.apache.org/jira/browse/FLINK-2098
>             Project: Flink
>          Issue Type: Bug
>          Components: Streaming
>    Affects Versions: 0.9
>            Reporter: Stephan Ewen
>            Assignee: Aljoscha Krettek
>            Priority: Blocker
>             Fix For: 0.9
>
>
> The stream source does not properly align the emission of checkpoint barriers with the
drawing of snapshots.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message