flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gyula Fóra <gyula.f...@gmail.com>
Subject Re: Send events to parallel operator instances
Date Thu, 04 Jun 2015 19:58:43 GMT
Thanks Stephan for clarifying :)

@kostas: i am just playing around with some ideas. Only in my head so far,
so lets not worry about these things
On Thu, Jun 4, 2015 at 6:33 PM Kostas Tzoumas <ktzoumas@apache.org> wrote:

> Wouldn't this kind of cross-task communication break the whole dataflow
> abstraction? How can recovery be implemented if we allowed something like
> this?
>
> On Thu, Jun 4, 2015 at 5:14 PM, Stephan Ewen <sewen@apache.org> wrote:
>
> > That is not what Ufuk said. You can use a singleton auxiliary task that
> > communicates in both directions with the vertices and acts as a
> coordinator
> > between vertices on the same level.
> >
> > On Thu, Jun 4, 2015 at 2:55 PM, Gyula Fóra <gyula.fora@gmail.com> wrote:
> >
> > > Thank you!
> > > I was aware of the iterations as a possibility, but I was wondering if
> we
> > > might have "lateral" communications.
> > >
> > > Ufuk Celebi <uce@apache.org> ezt írta (időpont: 2015. jún. 4., Cs,
> > 13:29):
> > >
> > > >
> > > > On 04 Jun 2015, at 12:46, Stephan Ewen <sewen@apache.org> wrote:
> > > >
> > > > > There is no "lateral communication" right now. Typical pattern is
> to
> > > > break
> > > > > it up in two operators that communicate in an all-to-all fashion.
> > > >
> > > > You can look at the iteration tasks: the iteration sync task is
> > > > communicating with the iteration heads like this.
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message