flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: Iterative stream processing - cyclic JobGraph?
Date Tue, 08 Jul 2014 14:33:30 GMT
Cyclic graphs are a problem for both the scheduler and the
currently-under-works recovery logic.

General cyclic graphs are a bit of a design problem.

I think what we need in the future is something like a special feedback
edge that closes the cycle and that is synchronized (in batches /
generations) to make it transparent to the recovery and scheduling logic.

Stephan

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message