flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Al-Isawi Rami <Rami.Al-Is...@comptel.com>
Subject Replace Flink job while cluster is down
Date Wed, 07 Dec 2016 12:20:31 GMT

I have faulty flink streaming program running on a cluster that is consuming from kafka,so
I brought the cluster down. Now I have a new version that has the fix. Now if I bring up the
flink cluster again, the old faulty program will be recovered and it will consume and stream
faulty results. How can i cancel it before brining up the cluster again? there is a million
of kafka messages waiting to be consumed and I do not want the old program to consume them.
The cluster is backed by S3 and I found some blobs there that flink will recover the old program
from, but it sounds like bad idea to just delete them.

Any ideas?

Disclaimer: This message and any attachments thereto are intended solely for the addressed
recipient(s) and may contain confidential information. If you are not the intended recipient,
please notify the sender by reply e-mail and delete the e-mail (including any attachments
thereto) without producing, distributing or retaining any copies thereof. Any review, dissemination
or other use of, or taking of any action in reliance upon, this information by persons or
entities other than the intended recipient(s) is prohibited. Thank you.

View raw message