Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 3128A200CD1 for ; Wed, 26 Jul 2017 10:37:05 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 2FD7416868F; Wed, 26 Jul 2017 08:37:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 4C6B416868C for ; Wed, 26 Jul 2017 10:37:04 +0200 (CEST) Received: (qmail 94662 invoked by uid 500); 26 Jul 2017 08:36:58 -0000 Mailing-List: contact user-help@livy.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@livy.incubator.apache.org Delivered-To: mailing list user@livy.incubator.apache.org Received: (qmail 94637 invoked by uid 99); 26 Jul 2017 08:36:58 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Jul 2017 08:36:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id F1FEA18080B for ; Wed, 26 Jul 2017 08:36:57 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.9 X-Spam-Level: * X-Spam-Status: No, score=1.9 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, MIME_QP_LONG_LINE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=yahoo.co.in Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id z5Qc-peUY9AA for ; Wed, 26 Jul 2017 08:36:53 +0000 (UTC) Received: from nm34-vm6.bullet.mail.sg3.yahoo.com (nm34-vm6.bullet.mail.sg3.yahoo.com [106.10.151.245]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id CE8CA5F3CF for ; Wed, 26 Jul 2017 08:36:52 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.co.in; s=s2048; t=1501058205; bh=c5DkZAUdCOW8OdxhgeSKVwiQH/rb3TehRlYiqvXbkCM=; h=From:Date:Subject:References:In-Reply-To:To:From:Subject; b=ThUWquB/ysvBiWo8UrucOzd4s/qGg2A08QsB+pJdSCwuIejZdVh48pNUBOkmaNIe+GqjG5KqolBGZCzYij6KdUeyPZseKZnUuVARb+iJDmlR1J8qGx/wSL7VHCTv348b1BEHvV4THFLT3pSW9HOnYrVRkveBK80OiJkXOg4Hy3pwTqVR9LlXmH8iMB6bw7HI/aIB7j7EMZ/w+3aXMb3rmWYl9pKdMcIyInZGTb3fsFMMs0Upl2zvvKIOyebV3LGInRdQ/TqIM7SIxQg1uatcY23j8LF+2r7mWsHBI9rCcvj7DKPZaAkH1vXITfHtaGC8XbxjnxKvdPl4cUj2urh73g== Received: from [106.10.166.62] by nm34.bullet.mail.sg3.yahoo.com with NNFMP; 26 Jul 2017 08:36:45 -0000 Received: from [106.10.167.128] by tm19.bullet.mail.sg3.yahoo.com with NNFMP; 26 Jul 2017 08:36:45 -0000 Received: from [127.0.0.1] by smtp101.mail.sg3.yahoo.com with NNFMP; 26 Jul 2017 08:36:45 -0000 X-Yahoo-Newman-Id: 178566.63923.bm@smtp101.mail.sg3.yahoo.com X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: 27wxaB8VM1nkCLQtyVLx1OQjQhhh6seRySq_70ZXRzuYfns daPY9usIZTt43i3zYkSff_.wHZAoGZ6DootpLolXRmD4C2ZY0YHAEOfQ9bZD OX8dbXGiEH.6L9j0ANThCtg8DuX0f6hN.2L6Ksk5l1zvTnFTy6nzQp01Mqld ZTA.W.yTzptfGS2d2KLhjcD7Jp8amc4gDBdeXSwAKeeuYE2XgJfGNDzi7Ush tlONTs.hTKi3LDtTnJULblhfq2uvFjE.OuFd2YGIK6FIG6EGROwIev04Fj.D 5UQIrCxiD50LFV1racKr6OV4Un2H2vPzJHT5kSOTmkBVWxq8ZqY_Cv2edki3 Ua7J57i2wMt.olA_MFFqm0QHMHfeTO_X50ae6eNb2NQswvKHhvJJ.arerlpG pYZtK9j6rmBdU5asq1SS4EIi3oQU1272Tp3AOsaDPsqcpC9D3ucT12_xkK7a PnleILy7husL3dwpk6QURe5cmrF0zwqvWM_A.9SPnr3FT1_HgLjed9ufCsO5 HGGowkwdtvjwyze0d3LSMV9jt_S9fY9twjzXUCkUS1wGGhq7BxjG5zR4J55k sXUOB4EBSOExNWw-- X-Yahoo-SMTP: Wom..hqswBCqyZe0sJwbiYeeNENIiJZeBQ-- From: Vivek Content-Type: multipart/alternative; boundary=Apple-Mail-37DF0D33-D3CC-494E-BF96-81BFDA1425BA Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (1.0) Date: Wed, 26 Jul 2017 16:36:44 +0800 Subject: Re: Multiple Livy instances and load balancing Message-Id: <06D022FF-6511-422C-BCD5-2F5EFA9EF5FD@yahoo.co.in> References: <89AF9504-4607-4B41-BA03-CF0BD9635653@yahoo.co.in> In-Reply-To: To: user@livy.incubator.apache.org X-Mailer: iPhone Mail (14F89) archived-at: Wed, 26 Jul 2017 08:37:05 -0000 --Apple-Mail-37DF0D33-D3CC-494E-BF96-81BFDA1425BA Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Ok.so if I start multiple instances how will I know which instance to send t= he request to? And multiple instances would then be only controlled by the port id?=20 Sent from my iPhone > On 26 Jul 2017, at 4:04 PM, Saisai Shao wrote: >=20 > Current Livy doesn't support the things you mentioned here. You can start m= ultiple Livy in the cluster, but each LivyServer is a standalone service doe= sn't aware the existence of others. >=20 >> On Wed, Jul 26, 2017 at 10:27 AM, Vivek wrote:= >> Hi, >>=20 >> We are now considering moving into a uat environment using Livy at my com= pany. >>=20 >> Has anyone implemented multiple Livy instances on a single cluster with l= oad balancing? >>=20 >> A few questions. >> 1. Is this feature available in the 0.3 release? >> 2. How would I name/number the multiple instances I bring up? >> 3. How does one load balance and send requests across the multiple instan= ces? >> 4. Does Livy have a heartbeat mechanism to understand which or how many i= nstances are up? >>=20 >> Any answers would be appreciated. >>=20 >> Regards >> Vivek >>=20 >>=20 >> Sent from my iPhone >=20 --Apple-Mail-37DF0D33-D3CC-494E-BF96-81BFDA1425BA Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
Ok.so if I start multiple instances ho= w will I know which instance to send the request to?
And multiple instances would then be only controlled by the por= t id? 


Sent from my iPhone

On 26 Jul 2017, at 4:04 P= M, Saisai Shao <sai.sai.shao@gm= ail.com> wrote:

Current Livy doesn't support the things you mentioned here. You can st= art multiple Livy in the cluster, but each LivyServer is a standalone servic= e doesn't aware the existence of others.
On Wed, Jul 26, 2017 at 10:27 AM, Vivek <= viveksuvarna@yahoo.co.in> wrote:
Hi,

We are now considering moving into a uat environment using Livy at my compan= y.

Has anyone implemented multiple Livy instances on a single cluster with load= balancing?

A few questions.
1. Is this feature available in the 0.3 release?
2. How would I name/number the multiple instances I bring up?
3. How does one load balance and send requests across the multiple instances= ?
4. Does Livy have a heartbeat mechanism to understand which or how many inst= ances are up?

Any answers would be appreciated.

Regards
Vivek


Sent from my iPhone

= --Apple-Mail-37DF0D33-D3CC-494E-BF96-81BFDA1425BA--