flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Taher Koitawala <taher.koitaw...@gslab.com>
Subject Re: Split Stream on a Split Stream
Date Thu, 28 Feb 2019 06:53:48 GMT
No particular reason for not using the process function, just wanted to
clarify if that was the correct way to do it. Thanks Knauf.


Regards,
Taher Koitawala
GS Lab Pune
+91 8407979163


On Wed, Feb 27, 2019 at 8:23 PM Konstantin Knauf <konstantin@ververica.com>
wrote:

> Hi Taher ,
>
> a ProcessFunction is actually the way to do this. When chained to the
> previous operator the overhead of such a ProcessFunction in negligible.
>
> Any particular reason you don't want to go for a ProcessFunctio?
>
> Cheers,
>
> Konstantin
>
> On Wed, Feb 27, 2019 at 8:36 AM Taher Koitawala <taher.koitawala@gslab.com>
> wrote:
>
>> Hi All,
>>           We are currently working with Flink 1.7.2 version and we are
>> get the below given exception when doing a split on a split.
>>
>> SplitStream<String>splitStream=stream1.split(new SomeSplitLogic());
>>
>> DataStream select1=splitStream.select("1");
>> DataStream select2=splitStream.select("2");
>>
>>
>> select2.split(new AnotherSplitLogic()).select("3");
>>
>>
>> Basically the exception is recommending to use SideOutput, however the
>> only way I see to get a side output is by using a process function. Can
>> someone suggest a better way of doing this?
>>
>> Exception :
>> Caused by: java.lang.IllegalStateException:  Consecutive multiple splits
>> are not supported. Splits are deprecated. Please use side-outputs
>>
>>
>> Regards,
>> Taher Koitawala
>> GS Lab Pune
>> +91 8407979163
>>
>
>
> --
>
> Konstantin Knauf | Solutions Architect
>
> +49 160 91394525
>
> <https://www.ververica.com/>
>
> Follow us @VervericaData
>
> --
>
> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> Conference
>
> Stream Processing | Event Driven | Real Time
>
> --
>
> Data Artisans GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
>
> --
> Data Artisans GmbH
> Registered at Amtsgericht Charlottenburg: HRB 158244 B
> Managing Directors: Dr. Kostas Tzoumas, Dr. Stephan Ewen
>

Mime
View raw message