Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
In-Reply-To: <CAP7S8jspZsqaTFOrm-Q4v6j=sNNWgmA35r1deW9bd48ZrFN0EA@mail.gmail.com>
References: <CAP7S8juUwTKndNvmsZmyO=UiX=7WKZTLS55yUJk_7DJT1mRV=Q@mail.gmail.com>
 <CAP7S8jspZsqaTFOrm-Q4v6j=sNNWgmA35r1deW9bd48ZrFN0EA@mail.gmail.com>
From: Chakravarthy varaga <chakravarthyvp@gmail.com>
Date: Fri, 24 Mar 2017 07:50:47 +0000
Message-ID: <CAP7S8jsBNy-WkCsFp4vQe50G6u8DNh=_MOfA_a-tftNNOqH3cA@mail.gmail.com>
Subject: Re: deploying flink cluster in AWS - Containerized
To: user@flink.apache.org
Content-Type: multipart/alternative; boundary=001a1144403a742d07054b75404b
archived-at: Fri, 24 Mar 2017 07:51:05 -0000

--001a1144403a742d07054b75404b
Content-Type: text/plain; charset=UTF-8

Hi,

    I request someone to help here.

Best Regards
CVP

On Thu, Mar 23, 2017 at 10:13 PM, Chakravarthy varaga <
chakravarthyvp@gmail.com> wrote:

> I'm looking forward to hearing some updates on this...
>
> Any help here is highly appreciated !!
>
> On Thu, Mar 23, 2017 at 4:20 PM, Chakravarthy varaga <
> chakravarthyvp@gmail.com> wrote:
>
>> Hi Team,
>>
>>      We are doing a PoC to deploy Flink cluster on AWS. All runtime
>> components will be dockerized.
>>
>>       I have few questions in relation to discover & security:
>>
>>       1. How does Job Manager discover task managers? Do they talk to
>> over TCP ?
>>
>>       2. If the runtime components TM, JM are containerized how are the
>> IPs resolved dynamically? Basically do I have to configure the JM with the
>> hostnames of the TMs. If so, if the TMs are on ephemeral IPs and on restart
>> of TM how does the job manager know the TM's (IP/Host). Before I go into
>> DNS and subnets, I'd like to understand how they disvoer & talk to each
>> other !
>>
>>        3. I went through some Flink materials on the web on security
>> precisely on kerebros. However how do I ensure that user level
>> authentication is applied on job management. For ex., only certain users
>> are allowed to start/stop jobs ? This question is in relation to if flink
>> is deployed as standalone-cluster
>>
>> Thanks & Regards
>> CVP
>>
>
>

--001a1144403a742d07054b75404b
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div><div>Hi,<br><br></div>=C2=A0=C2=A0=C2=A0 I reque=
st someone to help here.<br><br></div>Best Regards<br></div>CVP<br></div><d=
iv class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Thu, Mar 23, 201=
7 at 10:13 PM, Chakravarthy varaga <span dir=3D"ltr">&lt;<a href=3D"mailto:=
chakravarthyvp@gmail.com" target=3D"_blank">chakravarthyvp@gmail.com</a>&gt=
;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr"><div>I&#=
39;m looking forward to hearing some updates on this...<br><br></div>Any he=
lp here is highly appreciated !!<br></div><div class=3D"HOEnZb"><div class=
=3D"h5"><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Thu, M=
ar 23, 2017 at 4:20 PM, Chakravarthy varaga <span dir=3D"ltr">&lt;<a href=
=3D"mailto:chakravarthyvp@gmail.com" target=3D"_blank">chakravarthyvp@gmail=
.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"ma=
rgin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"lt=
r"><div><div>Hi Team,<br><br></div><div>=C2=A0=C2=A0=C2=A0=C2=A0 We are doi=
ng a PoC to deploy Flink cluster on AWS. All runtime components will be doc=
kerized.<br></div><div>=C2=A0=C2=A0=C2=A0=C2=A0 <br></div><div>=C2=A0=C2=A0=
=C2=A0=C2=A0=C2=A0 I have few questions in relation to discover &amp; secur=
ity:<br><br></div><div>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 1. How does Job Manag=
er discover task managers? Do they talk to over TCP ?<br><br></div><div>=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0 2. If the runtime components TM, JM are contain=
erized how are the IPs resolved dynamically? Basically do I have to configu=
re the JM with the hostnames of the TMs. If so, if the TMs are on ephemeral=
 IPs and on restart of TM how does the job manager know the TM&#39;s (IP/Ho=
st). Before I go into DNS and subnets, I&#39;d like to understand how they =
disvoer &amp; talk to each other !<br></div><div><br></div><div>=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0 3. I went through some Flink materials on the w=
eb on security precisely on kerebros. However how do I ensure that user lev=
el authentication is applied on job management. For ex., only certain users=
 are allowed to start/stop jobs ? This question is in relation to if flink =
is deployed as standalone-cluster<br></div><div>=C2=A0=C2=A0 <br></div>Than=
ks &amp; Regards<br></div>CVP<br></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>

--001a1144403a742d07054b75404b--