Mailing-List: contact user-help@livy.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@livy.incubator.apache.org
From: Vivek Suvarna <vikks77@gmail.com>
Content-Type: multipart/alternative;
	boundary=Apple-Mail-D807AF7D-E0D9-472B-AA34-D61F4AA7057D
Content-Transfer-Encoding: 7bit
Mime-Version: 1.0 (1.0)
Date: Thu, 27 Jul 2017 08:24:28 +0800
Subject: Re: Multiple Livy instances and load balancing
Message-Id: <3C81AB9F-924D-4FB4-8F8B-C8A0E7EB2495@gmail.com>
References: <89AF9504-4607-4B41-BA03-CF0BD9635653@yahoo.co.in> <CANvfmP_XU0t4y=Q3BS29YEG5AXbQYo-ZAVnd6q8g+8_JB41_Mw@mail.gmail.com> <06D022FF-6511-422C-BCD5-2F5EFA9EF5FD@yahoo.co.in> <CAByMnGtWtiPLcdPWsCmaNYW=+eBWAR_KWVkynmJVcQDVdbfTyg@mail.gmail.com>
In-Reply-To: <CAByMnGtWtiPLcdPWsCmaNYW=+eBWAR_KWVkynmJVcQDVdbfTyg@mail.gmail.com>
To: user@livy.incubator.apache.org
archived-at: Thu, 27 Jul 2017 00:24:39 -0000


--Apple-Mail-D807AF7D-E0D9-472B-AA34-D61F4AA7057D
Content-Type: text/plain;
	charset=utf-8
Content-Transfer-Encoding: quoted-printable

Thanks Meisam.=20


Is this code in github?=20
Is there a PR for this?

Regards
Vivek


Sent from my iPhone

> On 27 Jul 2017, at 12:51 AM, Meisam Fathi <meisam.fathi@gmail.com> wrote:
>=20
> Hi Vivek,
>=20
> We are running multiple instances of Livy on our clusters. Our users can c=
reate and access jobs on any of the Livy instances.
>=20
> To answer your particular question
>=20
> 1. Is this feature available in the 0.3 release? No. The feature is not av=
ailable out of the box=E2=80=93we modified Livy to add this feature.=20
> 2. How would I name/number the multiple instances I bring up? The load bal=
ancer knows all the instances. Users only interact with the load balancer.
> 3. How does one load balance and send requests across the multiple instanc=
es? Livy instances do not know that requests come from a load balancer. Each=
 processes requests it receives and updates a shared "session store", which w=
e implemented on top of ZooKeeper.
> 4. Does Livy have a heartbeat mechanism to understand which or how many in=
stances are up? No. There is a heartbeat mechanism in Livy, but we do not us=
ing it to detect live/dead Livy instances. Each instance only reacts to the u=
pdates to the ZooKeeper "session store", which is shared by all instances of=
 Livy.
>=20
> Thanks,
> Meisam
>=20
>> On Wed, Jul 26, 2017 at 1:36 AM Vivek <viveksuvarna@yahoo.co.in> wrote:
>> Ok.so if I start multiple instances how will I know which instance to sen=
d the request to?
>> And multiple instances would then be only controlled by the port id?=20
>>=20
>>=20
>> Sent from my iPhone
>>=20
>>> On 26 Jul 2017, at 4:04 PM, Saisai Shao <sai.sai.shao@gmail.com> wrote:
>>>=20
>>> Current Livy doesn't support the things you mentioned here. You can star=
t multiple Livy in the cluster, but each LivyServer is a standalone service d=
oesn't aware the existence of others.
>>>=20
>>>> On Wed, Jul 26, 2017 at 10:27 AM, Vivek <viveksuvarna@yahoo.co.in> wrot=
e:
>>>> Hi,
>>>>=20
>>>> We are now considering moving into a uat environment using Livy at my c=
ompany.
>>>>=20
>>>> Has anyone implemented multiple Livy instances on a single cluster with=
 load balancing?
>>>>=20
>>>> A few questions.
>>>> 1. Is this feature available in the 0.3 release?
>>>> 2. How would I name/number the multiple instances I bring up?
>>>> 3. How does one load balance and send requests across the multiple inst=
ances?
>>>> 4. Does Livy have a heartbeat mechanism to understand which or how many=
 instances are up?
>>>>=20
>>>> Any answers would be appreciated.
>>>>=20
>>>> Regards
>>>> Vivek
>>>>=20
>>>>=20
>>>> Sent from my iPhone
>>>=20

--Apple-Mail-D807AF7D-E0D9-472B-AA34-D61F4AA7057D
Content-Type: text/html;
	charset=utf-8
Content-Transfer-Encoding: quoted-printable

<html><head><meta http-equiv=3D"content-type" content=3D"text/html; charset=3D=
utf-8"></head><body dir=3D"auto"><div>Thanks Meisam.&nbsp;</div><div id=3D"A=
ppleMailSignature"><br></div><div id=3D"AppleMailSignature"><br></div><div i=
d=3D"AppleMailSignature">Is this code in github?&nbsp;</div><div id=3D"Apple=
MailSignature">Is there a PR for this?</div><div id=3D"AppleMailSignature"><=
br></div><div id=3D"AppleMailSignature">Regards</div><div id=3D"AppleMailSig=
nature">Vivek</div><div id=3D"AppleMailSignature"><br><br>Sent from my iPhon=
e</div><div><br>On 27 Jul 2017, at 12:51 AM, Meisam Fathi &lt;<a href=3D"mai=
lto:meisam.fathi@gmail.com">meisam.fathi@gmail.com</a>&gt; wrote:<br><br></d=
iv><blockquote type=3D"cite"><div><div dir=3D"ltr">Hi Vivek,<div><br></div><=
div>We are running multiple instances of Livy on our clusters. Our users can=
 create and access jobs on any of the Livy instances.</div><div><br></div><d=
iv>To answer your particular question</div><div><br></div><div><div><b>1. Is=
 this feature available in the 0.3 release?</b> No. The feature is not avail=
able out of the box=E2=80=93we modified Livy to add this feature.&nbsp;</div=
><div><b>2. How would I name/number the multiple instances I bring up?</b> T=
he load balancer knows all the instances. Users only interact with the load b=
alancer.</div><div><b>3. How does one load balance and send requests across t=
he multiple instances?</b> Livy instances do not know that requests come fro=
m a load balancer. Each processes requests it receives and updates a shared <=
i>"session store"</i>, which we implemented on top of ZooKeeper.</div><div><=
b>4. Does Livy have a heartbeat mechanism to understand which or how many in=
stances are up?</b> No. There is a heartbeat mechanism in Livy, but we do no=
t using it to detect live/dead Livy instances. Each instance only reacts to t=
he updates to the ZooKeeper&nbsp;<i>"session store"</i>, which is shared by a=
ll instances of Livy.</div></div><div><br></div><div>Thanks,</div><div>Meisa=
m</div></div><br><div class=3D"gmail_quote"><div dir=3D"ltr">On Wed, Jul 26,=
 2017 at 1:36 AM Vivek &lt;<a href=3D"mailto:viveksuvarna@yahoo.co.in">vivek=
suvarna@yahoo.co.in</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote=
" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><d=
iv dir=3D"auto"><div>Ok.so if I start multiple instances how will I know whi=
ch instance to send the request to?</div><div id=3D"m_-9188236228794495365Ap=
pleMailSignature">And multiple instances would then be only controlled by th=
e port id?&nbsp;</div><div id=3D"m_-9188236228794495365AppleMailSignature"><=
br></div><div id=3D"m_-9188236228794495365AppleMailSignature"><br>Sent from m=
y iPhone</div></div><div dir=3D"auto"><div><br>On 26 Jul 2017, at 4:04 PM, S=
aisai Shao &lt;<a href=3D"mailto:sai.sai.shao@gmail.com" target=3D"_blank">s=
ai.sai.shao@gmail.com</a>&gt; wrote:<br><br></div><blockquote type=3D"cite">=
<div><div dir=3D"ltr">Current Livy doesn't support the things you mentioned h=
ere. You can start multiple Livy in the cluster, but each LivyServer is a st=
andalone service doesn't aware the existence of others.</div><div class=3D"g=
mail_extra"><br><div class=3D"gmail_quote">On Wed, Jul 26, 2017 at 10:27 AM,=
 Vivek <span dir=3D"ltr">&lt;<a href=3D"mailto:viveksuvarna@yahoo.co.in" tar=
get=3D"_blank">viveksuvarna@yahoo.co.in</a>&gt;</span> wrote:<br><blockquote=
 class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid=
;padding-left:1ex">Hi,<br>
<br>
We are now considering moving into a uat environment using Livy at my compan=
y.<br>
<br>
Has anyone implemented multiple Livy instances on a single cluster with load=
 balancing?<br>
<br>
A few questions.<br>
1. Is this feature available in the 0.3 release?<br>
2. How would I name/number the multiple instances I bring up?<br>
3. How does one load balance and send requests across the multiple instances=
?<br>
4. Does Livy have a heartbeat mechanism to understand which or how many inst=
ances are up?<br>
<br>
Any answers would be appreciated.<br>
<br>
Regards<br>
Vivek<br>
<br>
<br>
Sent from my iPhone<br>
</blockquote></div><br></div>
</div></blockquote></div></blockquote></div>
</div></blockquote></body></html>=

--Apple-Mail-D807AF7D-E0D9-472B-AA34-D61F4AA7057D--