Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
In-Reply-To: <CAMruJR-xUp9co2bqGSBuB6RWdcZ5+zxnbGGdk1eHQ86TJWrvAA@mail.gmail.com>
References: <CAMruJR-xUp9co2bqGSBuB6RWdcZ5+zxnbGGdk1eHQ86TJWrvAA@mail.gmail.com>
From: Fabian Hueske <fhueske@gmail.com>
Date: Fri, 4 Nov 2016 11:46:02 +0100
Message-ID: <CAAdrtT3wbYYvYDERF+VkFyaSjxa2yz75Zrw2aPb1UD-ms7182A@mail.gmail.com>
Subject: Re: Flink stream job change and recovery
To: user@flink.apache.org
Content-Type: multipart/alternative; boundary=001a1140800832ebf10540776376
archived-at: Fri, 04 Nov 2016 10:47:11 -0000

--001a1140800832ebf10540776376
Content-Type: text/plain; charset=UTF-8

Yes, that is true for Flink 1.1.x.

The upcoming Flink 1.2.0 release will be able to restore jobs from
savepoints with different parallelism.

2016-11-04 11:24 GMT+01:00 Renjie Liu <liurenjie2008@gmail.com>:

> Hi, all:
> It seems that flink's checkpoint mechanism saves state per partition.
> However, if I want to change configuration of the job and resubmit the job,
> I can not recover from last checkpoint, right? Say I change the parallelism
> of kafka consumer and partitions assigned to each subtask will be
> different, then I'm not able to restart from last checkpoint, right?
> --
> Liu, Renjie
> Software Engineer, MVAD
>

--001a1140800832ebf10540776376
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Yes, that is true for Flink 1.1.x.<br><br></div>The u=
pcoming Flink 1.2.0 release will be able to restore jobs from savepoints wi=
th different parallelism.<br></div><div class=3D"gmail_extra"><br><div clas=
s=3D"gmail_quote">2016-11-04 11:24 GMT+01:00 Renjie Liu <span dir=3D"ltr">&=
lt;<a href=3D"mailto:liurenjie2008@gmail.com" target=3D"_blank">liurenjie20=
08@gmail.com</a>&gt;</span>:<br><blockquote class=3D"gmail_quote" style=3D"=
margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"=
ltr">Hi, all:<div>It seems that flink&#39;s checkpoint mechanism saves stat=
e per partition. However, if I want to change configuration of the job and =
resubmit the job, I can not recover from last checkpoint, right? Say I chan=
ge the parallelism of kafka consumer and partitions assigned to each subtas=
k will be different, then I&#39;m not able to restart from last checkpoint,=
 right?</div></div><span class=3D"HOEnZb"><font color=3D"#888888"><div dir=
=3D"ltr">-- <br></div><div data-smartmail=3D"gmail_signature"><div dir=3D"l=
tr"><div>Liu, Renjie</div>Software Engineer, MVAD</div></div>
</font></span></blockquote></div><br></div>

--001a1140800832ebf10540776376--