flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Oliver Buckley-Salmon <oliver.buckley-sal...@db.com>
Subject How to trigger a Global Window with a different Message from the window message
Date Wed, 16 Jan 2019 18:06:07 GMT

I have a Flink job where I receive a stream of AggregationKeys, stored in BroadcastState which
I join in a Tuple2 with a stream of RiskMeasureMessages, which I then wish to aggregate in
a Window.
The RiskMeasureMessages are bounded by CalcStart and CalcEnd messages which come on separate
Kafka topics, we can ignore CalcStart but need to emit the aggregated results after receiving
CalcEnd. The CalcEnd messages are unkeyed.
My issue is how to get the CalcEnd message to the Trigger to use in the onElement() method,
the only way I can see to do it is to create a co-stream but I don't see how to Window and
Trigger that, or merge the co-stream into Tuple3 wich would have Null for the 3rd element
all the time except when EndCalc is received.
Are there better ways for doing this?
I'm running Flink 1.7.1 using the Java API.
Thanks in advance for your help.

Kind regards,
Oliver Buckley-Salmon


This e-mail may contain confidential and/or privileged information. If you are not the intended
recipient (or have received this e-mail in error) please notify the sender immediately and
delete this e-mail. Any unauthorized copying, disclosure or distribution of the material in
this e-mail is strictly forbidden.

Please refer to https://www.db.com/disclosures for additional EU corporate and regulatory
disclosures and to http://www.db.com/unitedkingdom/content/privacy.htm for information about

View raw message