flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4391) Provide support for asynchronous operations over streams
Date Fri, 04 Nov 2016 11:29:58 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15636096#comment-15636096

ASF GitHub Bot commented on FLINK-4391:

Github user bjlovegithub commented on the issue:

    The case may happen when all elements have arrived. For this case, `StreamTask` will go
to close all operators, which will reach `AsyncCollectorBuffer.waitEmpty`. In this function,
`Emitter Thread` will be waken up.

> Provide support for asynchronous operations over streams
> --------------------------------------------------------
>                 Key: FLINK-4391
>                 URL: https://issues.apache.org/jira/browse/FLINK-4391
>             Project: Flink
>          Issue Type: New Feature
>          Components: DataStream API
>            Reporter: Jamie Grier
>            Assignee: david.wang
> Many Flink users need to do asynchronous processing driven by data from a DataStream.
 The classic example would be joining against an external database in order to enrich a stream
with extra information.
> It would be nice to add general support for this type of operation in the Flink API.
 Ideally this could simply take the form of a new operator that manages async operations,
keeps so many of them in flight, and then emits results to downstream operators as the async
operations complete.

This message was sent by Atlassian JIRA

View raw message