Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2DE2B200C1C for ; Wed, 15 Feb 2017 12:41:36 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 2C9B4160B5E; Wed, 15 Feb 2017 11:41:36 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 78CDD160B46 for ; Wed, 15 Feb 2017 12:41:35 +0100 (CET) Received: (qmail 22763 invoked by uid 500); 15 Feb 2017 11:41:33 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 22753 invoked by uid 99); 15 Feb 2017 11:41:33 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2017 11:41:33 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 271321A045A for ; Wed, 15 Feb 2017 11:41:33 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id zPp-J8IJwb8x for ; Wed, 15 Feb 2017 11:41:32 +0000 (UTC) Received: from mail-ua0-f170.google.com (mail-ua0-f170.google.com [209.85.217.170]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id E5B2B5FD84 for ; Wed, 15 Feb 2017 11:41:31 +0000 (UTC) Received: by mail-ua0-f170.google.com with SMTP id y9so104573789uae.2 for ; Wed, 15 Feb 2017 03:41:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=h6eFYdtrDqjWLcBIaI2v/shjE14k9L9SW5DVy3GHiRU=; b=n17u5tsdk2NapWzNdpzeOthBw4wnAi4aordHo4IigxJOEtqI5grhHW6LpsovAK0EuD E2iKeYtcQ8a+FsFWo072+zzOyySktZacxyh0+U2qqJE47JtOUurk5/TU5Sj7LT4TIiG/ PtE+NpV9Skt8JX13gDHGPpVBysT0m79pNiMLKBbWW67wqujpvrovnp9+IYsprIDVFpC5 Pc4NXcjkOwvSIE7FvuXWzPM/B5DCb/FAYzBLkirw/2onf3kRHyRNK5aTFT6KNoZo5F4q 8krSWC30i1vWStzcOrldKV/y5pBO92Kmo/XWbGCCERphbyCy+OY7bcGHwUT7w7is46w6 W4/w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=h6eFYdtrDqjWLcBIaI2v/shjE14k9L9SW5DVy3GHiRU=; b=ee8zlXl4rC/RdUdtjB7E0n8DhEiddN2Bp5ZURCMXyEaYYTcrVmg9MmDNRNbr29x6vK aAbJM1lnIp8zTp2tN+9Cy5WqRi9iWcogkmEOHcvRJwkCkKcJfGzbuvF4VATKXHYaPj84 A7PZ8yJ7upa2LRlWbeIHt4bOkGlDGuEkASQ/+VSC/mFZr7hCAHIu3grQmmQUjJuoLH00 jLOszkkDwd/4zLldoKIUyyZ5UodC7SJS8dhiLZA0OAvxjbvu1slxIaH8IDuQuHu37FQP CW16EwZY7IievPz1L3dr7fAJP0kAep+oXYIJBl4IHZqxd23b+8WrZWRjMwOao6oGVbsQ XhCQ== X-Gm-Message-State: AMke39mYDammdaxhE1GdkkzG5jqzR9Vh5sgvGTiMxoUo9t6nmk4cLMNmg4Ql+P8IQQt8KqwBPwgSvfW26kseRQ== X-Received: by 10.176.0.169 with SMTP id 38mr18464250uaj.46.1487158891129; Wed, 15 Feb 2017 03:41:31 -0800 (PST) MIME-Version: 1.0 Received: by 10.103.45.216 with HTTP; Wed, 15 Feb 2017 03:41:10 -0800 (PST) From: Sachin Aggarwal Date: Wed, 15 Feb 2017 17:11:10 +0530 Message-ID: Subject: notebook connecting Spark On Yarn To: user Content-Type: multipart/alternative; boundary=001a11c169da6e362605489029eb archived-at: Wed, 15 Feb 2017 11:41:36 -0000 --001a11c169da6e362605489029eb Content-Type: text/plain; charset=UTF-8 Hi, I am trying to create multiple notebooks connecting to spark on yarn. After starting few jobs my cluster went out of containers. All new notebook request are in busy state as Jupyter kernel gateway is not getting any containers for master to be started. Some job are not leaving the containers for approx 10-15 mins. so user is not able to figure out what is wrong, why his kernel is still in busy state Is there any property or hack by which I can return valid response to users that there are no containers left. can I label/mark few containers for master equal to max kernel execution I am allowing in my cluster. so that if new kernel starts he will at least one container for master. it can be dynamic on priority based. if there is no container left then yarn can preempt some containers and provide them to new requests. -- Thanks & Regards Sachin Aggarwal 7760502772 --001a11c169da6e362605489029eb Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi,

I am trying to create multiple note= books connecting to spark on yarn. After starting few jobs my cluster went = out of containers. All new notebook request are in busy state as Jupyter ke= rnel gateway is not getting any containers for master to be started.
<= div>
Some job are not leaving the containers for approx 10-15= mins. so user is not able to figure out what is wrong, why his kernel is s= till in busy state=C2=A0

Is there any property or = hack by which I can return valid response to users that there are no contai= ners left.

can I label/mark few containers for mas= ter equal to max kernel execution I am allowing in my cluster. so that if n= ew kernel starts he will at least one container for master. it can be dynam= ic on priority based. if there is no container left then yarn can preempt s= ome containers and provide them to new requests.
=C2=A0

--

Thanks & Regards

Sachin Aggarwal
7760502772
--001a11c169da6e362605489029eb--