flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gyula Fóra <gyula.f...@gmail.com>
Subject Re: Regarding Broadcast of datasets in streaming context
Date Sun, 15 May 2016 15:55:54 GMT
Hi,

If you haven't done so far please read the respective part of the the
streaming docs:
https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/index.html#iterations

Iterations just allow you to define cyclic flows, there is nothing magic
about it. If your original input stream is finite, there is no guarantee on
the order of your input and feedback stream so it can easily happen that
the original input is consumed before receiving the feedback.

Also the broadcast has again nothing to do with iterations itself. It is a
partitioning patter which just means that the tuple sent will be received
by all downstream instances. You have to work around these abstractions.

Cheers,
Gyula

Biplob Biswas <revolutionisme@gmail.com> ezt írta (időpont: 2016. máj. 15.,
V, 17:01):

> Hi Gyula,
>
> even after trying different things, I can't seem to get the hold of things.
> Also, i asked another question on the working of iteration and streaming
> here
> <
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Unexpected-behaviour-in-datastream-broadcast-td6848.html
> >
>
> Because its not working the way i am expecting it to be and the inputstream
> is completely consumed before anything is sent back and iterated.
>
> Could you please send me to a proper direction and help me in understanding
> the things properly?
>
> Thanks and Regards
> Biplob Biswas
>
>
>
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Regarding-Broadcast-of-datasets-in-streaming-context-tp6456p6928.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>

Mime
View raw message