flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: Pointers about internal threads and communication in Flink (streaming)
Date Mon, 17 Aug 2015 14:07:58 GMT
Hi!

We are working on more docs for that. Here is a start that has a section
about the TaskManager task execution.

Until then, here is a bit from our wiki:

Data Exchange:
https://cwiki.apache.org/confluence/display/FLINK/Data+exchange+between+tasks

Serialization for Data Exchange:
https://cwiki.apache.org/confluence/display/FLINK/Type+System%2C+Type+Extraction%2C+Serialization

Coordiation with Actors:
https://cwiki.apache.org/confluence/display/FLINK/Akka+and+Actors



Some WIP documentation on the Task execution:
  -
https://github.com/StephanEwen/incubator-flink/blob/docs/docs/internals/fig/taskmanager_task.svg
  -
https://github.com/StephanEwen/incubator-flink/blob/docs/docs/internals/through_stack.md


Greetings,
Stephan


On Mon, Aug 17, 2015 at 3:38 PM, Vincenzo Gulisano <
vincenzo.gulisano@gmail.com> wrote:

> Hi, is there any document describing how streaming operators are run by
> the TaskManagers and how communication (intra-node and inter-node) is
> managed. The closest documention I found is
> https://ci.apache.org/projects/flink/flink-docs-release-0.9/internals/general_arch.html
> but it is still pretty high-level.
>
> Thank you for your help
>
>
>

Mime
View raw message