flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chakravarthy varaga <chakravarth...@gmail.com>
Subject deploying flink cluster in AWS - Containerized
Date Thu, 23 Mar 2017 16:20:10 GMT
Hi Team,

     We are doing a PoC to deploy Flink cluster on AWS. All runtime
components will be dockerized.

      I have few questions in relation to discover & security:

      1. How does Job Manager discover task managers? Do they talk to over
TCP ?

      2. If the runtime components TM, JM are containerized how are the IPs
resolved dynamically? Basically do I have to configure the JM with the
hostnames of the TMs. If so, if the TMs are on ephemeral IPs and on restart
of TM how does the job manager know the TM's (IP/Host). Before I go into
DNS and subnets, I'd like to understand how they disvoer & talk to each
other !

       3. I went through some Flink materials on the web on security
precisely on kerebros. However how do I ensure that user level
authentication is applied on job management. For ex., only certain users
are allowed to start/stop jobs ? This question is in relation to if flink
is deployed as standalone-cluster

Thanks & Regards
CVP

Mime
View raw message