flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hironori Ogibayashi <ogibaya...@gmail.com>
Subject How to avoid path conflict in zookeeper/HDFS
Date Thu, 04 Aug 2016 00:53:15 GMT
Hello,

I have a question about Zookeeper or HDFS paths in case of running
Flink on YARN.

In my understanding, when I run multiple Flink cluster using the same
zookeeper/HDFS, I have to specify different paths, as e.g.
state.backend.fs.checkpointdir,
recovery.zookeeper.path.root etc.

If I run multiple Flink cluster job on YARN, and want to use checkpoint or
JobManager HA, do I need to specify different paths for each cluster/job? or
does YARN handle this nicely?

Regards,
Hironori Ogibayashi

Mime
View raw message