flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From anissa moussaoui <anissa.moussa...@dcbrain.com>
Subject state and Id of job in flatMap
Date Wed, 20 Mar 2019 15:59:47 GMT

I created a process for an anomaly detection with a flatMap. I need to know
the end of each job at the level of the flatMap to be able to flush a
buffer in the output collector.

I saw that it is possible to get status of job by using ExecutionEnvironment,
but i don't know how i can implement it.

Is it possible to recover the end of each job in the flatMap of any
processing source with last iteration of job or to have in advance the size
of the partition that each job must deal ?

Thank's in advance !



 <http://www.dcbrain.com/>   <https://twitter.com/dcbrain_feed?lang=fr>  


 Pensez à la 
planète, imprimer ce papier que si nécessaire 

View raw message