flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anil <anilsingh....@gmail.com>
Subject Re: Approach to Auto Scaling Flink Job
Date Sun, 12 May 2019 05:12:12 GMT
Thanks Rong. FlinkForward talk was insightful. 
One more question, it's mentioned in the talk that the jobs are running on
Yarn and are monitored by containers running on Docker. Can you explain why
is Docker needed here. When we deploy job to Yarn, one Yarn container is
already dedicated for Job Manager which monitors the job. What additional
functionality does Docker provide here. 
Also when the jobs are deployed on Yarn, the Master Node becomes a Single
point of failure. Are you using a Multi-Master setup or have taken another
approach to handle failover. 

Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

View raw message