flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chesnay Schepler <ches...@apache.org>
Subject Re: EASY Friday afternoon question: order of chained sink operator execution in a streaming task
Date Fri, 29 Sep 2017 12:34:50 GMT
Yes, i believe that is correct.

On 29.09.2017 14:01, Martin Eden wrote:
> Hi all,
>
> Just a quick one.
>
> I have a task that looks like this (as printed in the logs):
>
> 17-09-29 0703510695 INFO TaskManager.info: Received task Co-Flat Map 
> -> Process -> (Sink: sink1, Sink: sink2, Sink: sink3) (2/2)
>
> After looking a bit at the code of the streaming task I suppose the 
> sink operators are chained for each subtask and synchronously executed 
> one after the other in the order I specified them in code (which does 
> correspond to the order in the log message).
>
> A particular subtask does something like this on one thread (just 
> focusing on sinks):
>
> time record     invocations
> 0      record1   sink1.invoke(record1)
> 1                     sink2.invoke(record1)
> 2                     sink3.invoke(record1)
> 3      record2   sink1.invoke(record2)
> 4                     sink2.invoke(record2)
> 5                     sink3.invoke(record2)
> .
> .
> .
>
> Is that correct?
>
> Thanks
>


Mime
View raw message