Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 29D00200BA8 for ; Mon, 24 Oct 2016 10:47:54 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 2856C160AEB; Mon, 24 Oct 2016 08:47:54 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 468B2160AE1 for ; Mon, 24 Oct 2016 10:47:53 +0200 (CEST) Received: (qmail 53079 invoked by uid 500); 24 Oct 2016 08:47:52 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 53063 invoked by uid 99); 24 Oct 2016 08:47:52 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Oct 2016 08:47:52 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id AB03FC2003 for ; Mon, 24 Oct 2016 08:47:51 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.779 X-Spam-Level: * X-Spam-Status: No, score=1.779 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gridgain-com.20150623.gappssmtp.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 3sIauCJ4PzUc for ; Mon, 24 Oct 2016 08:47:49 +0000 (UTC) Received: from mail-qk0-f179.google.com (mail-qk0-f179.google.com [209.85.220.179]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 58E595F3F5 for ; Mon, 24 Oct 2016 08:47:49 +0000 (UTC) Received: by mail-qk0-f179.google.com with SMTP id o68so226102951qkf.3 for ; Mon, 24 Oct 2016 01:47:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gridgain-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=0CKiT1Em6A2vz80yVj89pUEN9PX6CttdFWB/daCPMpY=; b=mYdC4h+gcaAeu70QjIqGBUTIZ2FyzYxMhDAfw0ATq6rpyS1jaVBEQcJ3Sj7BAh3QCE ifVb802Zu9bDToMlzCekDeCHUlWeopi2X7N+xd5UrD7+bClSQEYzjTgjQhJ4dVpL6PK5 DMssXsHgYJe3iLAkewF76mpNxn2EuJHOPka/7Ugzl7LVq4GtTSxETwCpeg6MBAH5ugb1 C6n+ux0Ri1svdH2M/52qFY9dhGX8U7/R8SBgGEF60mgqv9QVz4Zc6vF7AkenAYvPzVpy FQIruGIwXNYF/FtbQrBZ1Fjd25oSvmyJsuphhNBKU2c4JCchxWMAR1P4TNeitp0n9bO8 Wx9w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=0CKiT1Em6A2vz80yVj89pUEN9PX6CttdFWB/daCPMpY=; b=e+Cynl2VjmxXk4rlpF9HHNCjip7Mj0FbHtDsdYGOtsrZcECZBVLCrmLZSl2BD7bT19 hwWHx+9hQ9ltuNUJ3QOo3/Itv/fyT7mMZzkW8N6K+o+qRfuF+TebXCw+9ePWpBIuWfYe ZUbFIAIxv4zY7/R4N86nvrrLG3gQxFgjRwYoaTzjT1HsJzf+200jFpqwqxEFYEzFaHGg C2gIXUQ+NOtKcllTzN/7utabQbQolbCh/edYzUCMDQHQBu9XYe3UbRg+TNMZNcvlQ//v xpzG8ezMAQR+XcIOCx3qQjjuAZkdtRAhZ6vGdPvgMfSdTJpXV6vV8EqzdU8V9+0AywI9 +l0w== X-Gm-Message-State: ABUngvemnw5ej1fn1vvOM7LBNutEIPbHaRgomr380m4AzCuBq/2VQMqpfC5ysfkoAfszKBc+82Z7HK3kv9RsSLwE X-Received: by 10.55.18.7 with SMTP id c7mr14957121qkh.246.1477298868801; Mon, 24 Oct 2016 01:47:48 -0700 (PDT) MIME-Version: 1.0 Received: by 10.55.183.195 with HTTP; Mon, 24 Oct 2016 01:47:48 -0700 (PDT) In-Reply-To: References: From: Sergey Kozlov Date: Mon, 24 Oct 2016 11:47:48 +0300 Message-ID: Subject: Re: Create separate thread pool for query execution To: dev@ignite.apache.org Content-Type: multipart/alternative; boundary=001a113ad9084d72dd053f98728b archived-at: Mon, 24 Oct 2016 08:47:54 -0000 --001a113ad9084d72dd053f98728b Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi It seems we need a set of dedicated pools for various purposes. Could we design a general apporach for this like following: - define dedicated pools in the grid configuration - run a query/compute/etc in the particular pool On Mon, Oct 24, 2016 at 9:49 AM, Vladimir Ozerov wrote: > Romain, > We do not pre-start threads in our pools on Ignite start. Moreover, idle > threads are stopped after some timeout. > > 24 =D0=BE=D0=BA=D1=82. 2016 =D0=B3. 8:57 =D0=BF=D0=BE=D0=BB=D1=8C=D0=B7= =D0=BE=D0=B2=D0=B0=D1=82=D0=B5=D0=BB=D1=8C "Gilles, Romain" < > romain.gilles@misys.com> > =D0=BD=D0=B0=D0=BF=D0=B8=D1=81=D0=B0=D0=BB: > > Hi igniters, > I'm not against to create a thread pool for each features but I have some > difficulty to minimize the number of threads required to start ignite... = If > you add too many thread pools does this will not increase the number of > threads at startup? > > Thanks. > > Romain > > > ________________________________ > De: Dmitriy Setrakyan > Envoy=C3=A9: 23 oct. 2016 23:00 > =C3=80: dev@ignite.apache.org > Objet: Re: Create separate thread pool for query execution > > How about long running compute? Do we need a separate thread pool for it = as > well? > > On Sun, Oct 23, 2016 at 3:57 AM, Sergi Vladykin > wrote: > > > +1 > > > > Sergi > > > > 2016-10-23 11:52 GMT+03:00 Vladimir Ozerov : > > > > > Igniters, > > > > > > Currently if several long-running queries are submitted, it may stall > all > > > cache operations because all theads in the system pool will be busy > with > > > queries. > > > > > > I think it makes sense to move queries execution into separate > dedicated > > > thread pool. As we have timeouts for core pool threads now, it should > not > > > affect memory consumption or startup time anyhow. Thoughts? > > > > > > Vladimir. > > > > > > "Misys" is the trade name of the Misys group of companies. This email and > any attachments have been scanned for known viruses using multiple > scanners. This email message is intended for the named recipient only. It > may be privileged and/or confidential. If you are not the named recipient > of this email please notify us immediately and do not copy it or use it f= or > any purpose, nor disclose its contents to any other person. This email do= es > not constitute the commencement of legal relations between you and Misys. > Please refer to the executed contract between you and the relevant member > of the Misys group for the identity of the contracting party with which y= ou > are dealing. > --=20 Sergey Kozlov GridGain Systems www.gridgain.com --001a113ad9084d72dd053f98728b--