flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From shuwen zhou <jaco...@gmail.com>
Subject ProcessFunction collect and close, when to use?
Date Fri, 29 Nov 2019 04:29:42 GMT
Hi Community,
In ProcessFunction class, ProcessElement function, there is a Collector
that has 2 method: collect() and close(). I would like to know:

1. When to call close() ? After every element processed? Or
on ProcessFunction.close() ? Or never to use it? If it's been closed
already, can the collector collect() anymore data?
2. If processElement received a message but consider it as discard and does
not call collect(), will this block checkpoint's barrier until next element
was sent by collect() ?

Best Wishes,
Shuwen Zhou

View raw message