From dev-return-43669-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Fri Dec 21 09:22:28 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id C3C22180627 for ; Fri, 21 Dec 2018 09:22:27 +0100 (CET) Received: (qmail 99324 invoked by uid 500); 21 Dec 2018 08:22:26 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 99312 invoked by uid 99); 21 Dec 2018 08:22:26 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Dec 2018 08:22:25 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 8C6E4180D9A for ; Fri, 21 Dec 2018 08:22:25 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.904 X-Spam-Level: * X-Spam-Status: No, score=1.904 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FROM_EXCESS_BASE64=0.105, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id tBOPOPWrofu8 for ; Fri, 21 Dec 2018 08:22:24 +0000 (UTC) Received: from mail-vs1-f45.google.com (mail-vs1-f45.google.com [209.85.217.45]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 8D21960D2F for ; Fri, 21 Dec 2018 08:22:23 +0000 (UTC) Received: by mail-vs1-f45.google.com with SMTP id t17so2742349vsc.8 for ; Fri, 21 Dec 2018 00:22:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=PXx0ODnq5Ghez6rC1A1cTqcZz9jVvecG920COIhKx/I=; b=bUY3T/6iH+VTHO0ZvoLiiRVuxnCVOmu/CKjcc9iXvV9t3ThImP32wL+aDQxSDMzl+5 VWGi4mCP7WD7Rk/ryJYDnp3wDKBokrs/iCwZsPoCScDBSZIfFfGOs+BRuEqEA1BhMtoJ My2LlFDCQtqeiz6fdLdqHWB0d4Kg89ndKQuWmSgb5jWSio7SG+wuSlE6LKALUQvhKJf6 BIclaK4QY65D/09TRYDb7mWtoiSZgd8HHuKJwsVv2P8smj4UwFMXTwe6TgU/h2kdPJQo cWdBrytrP+b8qmdEIohqayHfQOMOib4ihaDZYNU6t+IwsAfC2oq5TWcuAAYTlByjFMry Y91A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=PXx0ODnq5Ghez6rC1A1cTqcZz9jVvecG920COIhKx/I=; b=ewKyzHAWkDK0wqj3jkG1nogZWnzZNg9rIDFKZo4h+UqpKe7Y47l1j9a+E/DBXWRKr2 dhC7jszqS6vmmjhJJ5A7Bj3Idu+YgLOVceOjAcLjCckVzQJc/8jQRbx1ZMjf81C6nVDD GeLQAVt+Y60chJ0ttLsTBOrQw2aoJ/dlk84CBM65ojBcG74IOUPze9dD9omkJhe9dVRX gixQeLeRMjV15/iahAPGFqUyFu3yLjRvjapYT8j2s7o7ZMmeP0LfTF9+QlTNgDrt2IB6 qN3C7RzeXzzpGlykbM/phxjh+4M9mHfgH2KliHdiHuW4nF+Zn8I1wfAwRWyGnwEy1k3b mg7w== X-Gm-Message-State: AA+aEWY5bGThjprvq/cZg79F6g7va/FI3h0spjUrj225hHl/WK7UkdDQ mc7NgT+TAk8n8qFg2zpKIkCdIMpEhmtr1ZV1LHzTOeGC X-Google-Smtp-Source: AFSGD/UV+TKJ/zrWeE7/v1g+MmMP9+Qwa6HY8aBeWDbqthkYREbP2zKyE2iU188IIM+cS0Hfy1umsCfLGaOcPa8F3is= X-Received: by 2002:a67:98c3:: with SMTP id g64mr636571vsh.225.1545380541937; Fri, 21 Dec 2018 00:22:21 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: =?UTF-8?B?0K7RgNC40Lk=?= Date: Fri, 21 Dec 2018 11:22:10 +0300 Message-ID: Subject: Re: Query history statistics API To: dev@ignite.apache.org Content-Type: multipart/alternative; boundary="0000000000003ebbd1057d83f22a" --0000000000003ebbd1057d83f22a Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Alexey, Yes, such property to configuration history size will be added. I think default value should be 0 and history by default shouldn't be gather at all, and can be switched on by property in case when it required. Currently I planned use the same way to evicting old data as for queryMetrics - scheduled task will evict will old data by oldest start time of query. Will be gathered statistics for only initial clients queries, so internal queries will not including. For the same queries we will have one record in history with merged statistics. All above points just my proposal. Please revert back in case you think anything should be implemented by another way. =D1=87=D1=82, 20 =D0=B4=D0=B5=D0=BA. 2018 =D0=B3. =D0=B2 18:23, Alexey Kuzn= etsov : > Yuriy, > > I have several questions: > > Are we going to add some properties to cluster configuration for history > size? > > And what will be default history size? > > Will the same queries count as same item of historical data? > > How we will evict old data that not fit into history? > > Will we somehow count "reduce" queries? Or only final "map" ones? > > -- > Alexey Kuznetsov > --=20 =D0=96=D0=B8=D0=B2=D0=B8 =D1=81 =D1=83=D0=BB=D1=8B=D0=B1=D0=BA=D0=BE=D0=B9!= :D --0000000000003ebbd1057d83f22a--