Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
From: Or Sher <or.sher1@gmail.com>
Date: Tue, 29 Aug 2017 12:11:29 +0000
Message-ID: <CAGA8AHYKkbRd6Y4xdvyOBGDKUwbjUmF=K0S7UHbXJQzuKKCgRQ@mail.gmail.com>
Subject: Atomic savepint and cancel
To: user@flink.apache.org
Content-Type: multipart/alternative; boundary="001a113cefd4526aaf0557e3504e"
archived-at: Tue, 29 Aug 2017 12:11:47 -0000

--001a113cefd4526aaf0557e3504e
Content-Type: text/plain; charset="UTF-8"

Hi,

I'm a bit new to Flink and I'm trying to figure out what's the best way to
make an upgrade for my current running topology without having duplicate
messages being sent by the the sink. (One time prior the upgrade and one
time after).

I thought that the "atomic" part of the savepoint & cancel suggested that i
can just take a savepoint and cancel the job at the same time and later on
start from that savepoint and that would be it.

Having tried that, it seems that I got many duplicated messages sent by the
kafka producer sink again after the restore from savepoint.

Is that suppose to happen?
Did I misunderstood the "atomic" meaning?

Thanks,
Or.

--001a113cefd4526aaf0557e3504e
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,<div><br></div><div>I&#39;m a bit new to Flink and I=
9;m trying to figure out what&#39;s the best way to make an upgrade for my =
current running topology without having duplicate messages being sent by th=
e the sink. (One time prior the upgrade and one time after).</div><div><br>=
</div><div>I thought that the &quot;atomic&quot; part of the savepoint &amp=
; cancel suggested that i can just take a savepoint and cancel the job at t=
he same time and later on start from that savepoint and that would be it.</=
div><div><br></div><div>Having tried that, it seems that I got many duplica=
ted messages sent by the kafka producer sink again after the restore from s=
avepoint.</div><div><br></div><div>Is that suppose to happen?</div><div>Did=
 I misunderstood the &quot;atomic&quot; meaning?</div><div><br></div><div>T=
hanks,</div><div>Or.</div></div>

--001a113cefd4526aaf0557e3504e--