flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Brelloch <jb.bc....@gmail.com>
Subject Re: Flink Cluster is savepointing jobmanager instead of external filesystem
Date Fri, 14 Oct 2016 17:03:23 GMT
It is a standalone cluster.

On Fri, Oct 14, 2016 at 1:02 PM, Aljoscha Krettek <aljoscha@apache.org>
wrote:

> Hi,
> are you running this standalone or on YARN?
>
> I'm also directly looping in Ufuk because he knows that stuff best. Maybe
> he has an idea what could be going on.
>
> Cheers,
> Aljoscha
>
> On Fri, 14 Oct 2016 at 18:39 Jason Brelloch <jb.bc.flk@gmail.com> wrote:
>
>> Hey all,
>>
>> We are running into an issue where the savepoint command is saving to the
>> jobmanager instead of the filesystem location specified in the
>> flink-conf.yaml.  It saves to the filesystem when we are running in a local
>> standalone flink, but when we deploy the job to our flink cluster it saves
>> to the jobmanager.  The flink-conf is nearly identical in both places.
>> Here are the relevant savepoint parameters.
>>
>> savepoints.state.backend: filesystem
>> savepoints.state.backend.fs.dir: gs://bettercloud-non-prod/
>> flink-savepoints
>>
>> Is there another configuration we have to set that is specific to
>> clusters to make this work?  Or can anyone think of a reason this would
>> occur?
>>
>> --
>> *Jason Brelloch* | Product Developer
>> 3405 Piedmont Rd. NE, Suite 325, Atlanta, GA 30305
>> <http://www.bettercloud.com/>
>> Subscribe to the BetterCloud Monitor
>> <https://www.bettercloud.com/monitor?utm_source=bettercloud_email&utm_medium=email_signature&utm_campaign=monitor_launch>
-
>> Get IT delivered to your inbox
>>
>


-- 
*Jason Brelloch* | Product Developer
3405 Piedmont Rd. NE, Suite 325, Atlanta, GA 30305
<http://www.bettercloud.com/>
Subscribe to the BetterCloud Monitor
<https://www.bettercloud.com/monitor?utm_source=bettercloud_email&utm_medium=email_signature&utm_campaign=monitor_launch>
-
Get IT delivered to your inbox

Mime
View raw message