Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
In-Reply-To: <CAKiyyaF2=BHN585G2wfU+6-VJVoRy0bbG7-sVx-itUkbnSW+9g@mail.gmail.com>
References: <CAO_f5NBNR1-Y=kK84nV_7q24wRLHWPQvsq=MWQhjE0VQPz2KWQ@mail.gmail.com>
 <CAKiyyaF2=BHN585G2wfU+6-VJVoRy0bbG7-sVx-itUkbnSW+9g@mail.gmail.com>
From: Kathleen Sharp <kathleen.sharp@signavio.com>
Date: Fri, 3 Feb 2017 14:15:04 +0100
Message-ID: <CAO_f5ND=0f+uBbReSfThMBi-bnY4BjGBozo3fzEsZujiovb_-g@mail.gmail.com>
Subject: Re: Restoring from an external checkpoint / savepoint with a local
 stream environment
To: user@flink.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
archived-at: Fri, 03 Feb 2017 13:15:14 -0000

Thanks a lot for the detailed answer. From reading the code i
suspected something would be possible, but this would have taken me a
while to figure out.

On Fri, Feb 3, 2017 at 2:08 PM, Ufuk Celebi <uce@apache.org> wrote:
> Hey Kathleen,
>
> this is not supported "natively" in the APIs but the following is
> possible to work around it:
>
> int jobManagerPort =3D 6123;
> int numTaskSlots =3D 8;
> String savepointPath =3D "/Users/uce/Desktop/savepoint-xAsd";
>
> Configuration config =3D new Configuration();
> config.setInteger(ConfigConstants.JOB_MANAGER_IPC_PORT_KEY, jobManagerPor=
t);
> config.setInteger(ConfigConstants.TASK_MANAGER_NUM_TASK_SLOTS, numTaskSlo=
ts);
>
> LocalFlinkMiniCluster cluster =3D new LocalFlinkMiniCluster(config, false=
);
> cluster.start(true);
>
> // The "remote environment" submits to the local cluster
> StreamExecutionEnvironment env =3D
> StreamExecutionEnvironment.createRemoteEnvironment("localhost",
> jobManagerPort);
>
> // Create your program as usual
> // ...
>
> // Instead of env.execute do the following:
>
> JobGraph jobGraph =3D env.getStreamGraph().getJobGraph();
> jobGraph.setSavepointRestoreSettings(SavepointRestoreSettings.forPath(sav=
epointPath));
>
> boolean printUpdates =3D true;
> cluster.submitJobAndWait(jobGraph, printUpdates);
>
> ----
>
> We could think about exposing the SavepointSettings to the
> StreamGraph. Then you don't need all the boilerplate for this.
>
>
> On Fri, Feb 3, 2017 at 12:20 PM, Kathleen Sharp
> <kathleen.sharp@signavio.com> wrote:
>> Hi,
>>
>> is it possible to restore from an external checkpoint / savepoint
>> while using a local stream environment?
>>
>> I ask because I want to play around with some concepts from within my
>> IDE, without building a jar and deploying my job.
>>
>> Thanks,
>> Kat
>>
>> --
>> _______________________________________________________
>>
>> Besuchen Sie uns / Meet us:
>> OPEX-Woche DACH: January 17-19, Wiesbaden, Germany
>> OPEX Week World Summit: January 23-27, Orlando, USA
>> CIO EDGE Experience: Febuary 22-23, Melbourne, Australia
>> Business Transformation and Operational Excellence World Summit: March
>> 21-24, Orlando, USA
>>
>> Folgen Sie uns / Follow us:
>> Twitter | Facebook | LinkedIn | Xing | Youtube
>> ________________________________________________________
>>
>>
>> HRB 121584 B Amtsgericht Charlottenburg, Ust-ID: DE265675123
>> Gesch=C3=A4ftsf=C3=BChrer: Dr. Gero Decker, Guido Sachs


--=20
_______________________________________________________

Besuchen Sie uns / Meet us:
OPEX-Woche DACH: January 17-19, Wiesbaden, Germany
OPEX Week World Summit: January 23-27, Orlando, USA
CIO EDGE Experience: Febuary 22-23, Melbourne, Australia
Business Transformation and Operational Excellence World Summit: March
21-24, Orlando, USA

Folgen Sie uns / Follow us:
Twitter | Facebook | LinkedIn | Xing | Youtube
________________________________________________________


HRB 121584 B Amtsgericht Charlottenburg, Ust-ID: DE265675123
Gesch=C3=A4ftsf=C3=BChrer: Dr. Gero Decker, Guido Sachs