flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fabian Hueske <fhue...@gmail.com>
Subject Re: [DISCUSS] Side Outputs and Split/Select
Date Tue, 28 Feb 2017 20:37:02 GMT
Hi Chen and Aljoscha,

thanks for the great proposal and work.

I prefer the WindowedOperator.getLateStream() variant without explicit tags.
I think it is fine to start adding side output to ProcessFunction (keyed
and non-keyed) and window operators and see how it is picked up by users.

Best, Fabian


2017-02-28 15:42 GMT+01:00 Aljoscha Krettek <aljoscha@apache.org>:

> Quick update: I created a branch where I make the result type of
> WindowedStream operations more specific:
> https://github.com/aljoscha/flink/blob/windowed-stream-
> result-specific/flink-streaming-java/src/main/java/
> org/apache/flink/streaming/api/datastream/WindowedStream.java
>
> We would need this for the "lateStream()" API without the explicit
> OutputTag.
>
> It seems the backwards compatibility checker doesn't like this and
> complains about breaking binary backwards compatibility. +Robert Metzger
> <rmetzger@apache.org> Do you have an idea what we could do there?
>
> On Tue, 28 Feb 2017 at 12:39 Ufuk Celebi <uce@apache.org> wrote:
>
> > On Tue, Feb 28, 2017 at 11:38 AM, Aljoscha Krettek <aljoscha@apache.org>
> > wrote:
> > > I see the ProcessFunction as a bit of the generalised future of
> FlatMap,
> > so
> > > to me it makes sense to only allow side outputs on the ProcessFunction
> > but
> > > I'm open for anything. If we decide for this I'm happy with an
> additional
> > > method on Collector.
> >
> > I think it's best to restrict this to ProcessFunction after all (given
> > that we allow it for non-keyed streams, etc.). ;-)
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message