flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aljoscha Krettek <aljos...@apache.org>
Subject Re: Combining streams with static data and using REST API as a sink
Date Tue, 27 Jun 2017 14:24:29 GMT
A quick note on this: the side-input API is still ongoing work and it turns out it’s more
complicated (obviously … 😳) and we will need quite a bit more work on other parts of
Flink before we can provide a good built-in solution.

In the meantime, you can check out the Async I/O operator [1]. I think this fits your use
case of accessing an external system quite well because it allows firing off several request
to external systems at the same time.

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/stream/asyncio.html
> On 21. Jun 2017, at 18:44, Nancy Estrada <nancy.a.estrada@gmail.com> wrote:
> Hi Josh,
> I have a use-case similar to yours. I need to join a stream with data from a
> database to which I have access via a REST API. Since the Side inputs API
> continues begin and ongoing work. I am wondering how did you approached it,
> Did you use the rich function updating it periodically?
> Thank you in advance!
> Nancy
> --
> View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Combining-streams-with-static-data-and-using-REST-API-as-a-sink-tp7083p13902.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

View raw message