flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aljoscha Krettek <aljos...@apache.org>
Subject Re: Java parallel streams vs IterativeStream
Date Wed, 14 Jun 2017 14:35:51 GMT
I see, I’m afraid that is not easily possible except by doing a custom stateful function
that waits for all elements to arrive and combines them again.

Another thing you could look at is the async I/O operator: https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/stream/asyncio.html
<https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/stream/asyncio.html>.
You would not necessarily use it for I/O but spawn threads for processing your data in parallel.

Best,
Aljoscha

> On 13. Jun 2017, at 11:20, nragon <nuno.goncalves@wedotechnologies.com> wrote:
> 
> That would work but after FlatMap<List&lt;T>, T> I would have to downstream
> all elements into one.
> 
> 
> 
> 
> --
> View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Java-parallel-streams-vs-IterativeStream-tp13655p13685.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.


Mime
View raw message