From dev-return-36664-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Wed Jul 18 11:52:33 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id E042E180636 for ; Wed, 18 Jul 2018 11:52:32 +0200 (CEST) Received: (qmail 82207 invoked by uid 500); 18 Jul 2018 09:52:31 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 82195 invoked by uid 99); 18 Jul 2018 09:52:31 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Jul 2018 09:52:31 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id BD208C97AA for ; Wed, 18 Jul 2018 09:52:30 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.869 X-Spam-Level: * X-Spam-Status: No, score=1.869 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id uQFHScFkYnUM for ; Wed, 18 Jul 2018 09:52:28 +0000 (UTC) Received: from mail-oi0-f42.google.com (mail-oi0-f42.google.com [209.85.218.42]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 796385F3B4 for ; Wed, 18 Jul 2018 09:52:28 +0000 (UTC) Received: by mail-oi0-f42.google.com with SMTP id q11-v6so7600725oic.12 for ; Wed, 18 Jul 2018 02:52:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=w4HE17rWEo1Y2KrrS/l/ZaC5pTGx0FtYOxa6dovN+HU=; b=hPoXmRnXcb7841zhorZttCywQhCxSAw/YzGu0D5lABpHvBFdx8zkQxh42VsHIBJUjr /9iCP+aD74bIOTVo8vqUOysXkaILI1Xetml1nnW5sigMvXmp5y6ApOA2q1v5OPu2S67m rtjk5GTVa9cEYAorVVMuUyP8wiq542zOt71aalAQr5Ga2Cm5LRNyplMDCxHfZz4VcDum jhXuZ7sedSZR3P7xl76X1pNiedYnQUJEmhV4dWnjK6wymKJeyTBU90NgeU/Mi6q5q6vG eHqOCEmMdRUrPHITRbRFXH4v1h/yoD/a9Jz6rckP6GjGeTeMu1WrzMyFNXsYxh+5cx+n qq7A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=w4HE17rWEo1Y2KrrS/l/ZaC5pTGx0FtYOxa6dovN+HU=; b=o+srggCimguspTaHkhApR1pY3W79o/xrpU+EfXppLCl/rVF7Ymk4g7y2keBDxFb9UW DKVlcBz/4KLM3UB4yfSgFL+ZKStFe5Lanxir8n5Y6bJKGC9l70gcYBbDsumf60bJ/Wdl DBAQZONLoT87jUBV8dSTnUhkcxiviH/eBPwwxf53VHoNrLJLOkfz86yVdRD0MWFb1zQc Nv97/EQjy4RddSnJwx0YlJVBdun2chdvWSPVFj4iayEgr+hA/MItt+R37c+mdun1IlQw raHxfdyoEUOfXuQSfYvyKsq1G1rjHZbXLbB6qOzApKfV0B8OjeL8FIogHRFAMTwm+K2H IHMA== X-Gm-Message-State: AOUpUlH9w/YWj/L7dwXbiOYfakNAO3r8pc0vT4xoCp16xSfs8gHlpC6g YO/gOMaQh+PGV4mu4MFYYYbE9oSiH1NInH7+eiQ= X-Google-Smtp-Source: AAOMgpcXtnxSAQcKTxJtE3rPHyf8j4lS0Ef0X3BplpwYSMzeBYddkmNRDhuLOU5Plh2yL1412zEASPTUUdrF51rb6kY= X-Received: by 2002:aca:bbc4:: with SMTP id l187-v6mr5097280oif.278.1531907541996; Wed, 18 Jul 2018 02:52:21 -0700 (PDT) MIME-Version: 1.0 References: <1494570112.5.1531782411520.JavaMail.dpavlov@app02> In-Reply-To: From: Dmitry Pavlov Date: Wed, 18 Jul 2018 12:52:12 +0300 Message-ID: Subject: Re: [MTCGA]: new failures in builds [1499957] needs to be handled To: dev@ignite.apache.org Content-Type: multipart/alternative; boundary="000000000000de983b057143045a" --000000000000de983b057143045a Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Maxim, Notification will be send for each sequential group of builds having failures 3+ times in a row. Let's define 0 as success, 1 as failure. So history 0000011100000111 will generate two notifications. First transition 0->1 can be bug introduced test failure. This bug can be fixed with some changes after 111->0. And second transition can be potentially new problem, and test failure would be re-notified. But if transition 0->1 ocurred only once, and failure continues to happen, than no new notifcation will be generated. As always, I appreciate feedback and proposals. Sincerely, Dmitriy Pavlov =D1=81=D1=80, 18 =D0=B8=D1=8E=D0=BB. 2018 =D0=B3. =D0=B2 12:45, Maxim Muzaf= arov : > Dmitry, > > Will this notification continously send on new failure fot particular > test-case if we already have JIRA ticket for investigation? Should we mut= e > this test on TC to stop notifications? > > =D0=B2=D1=82, 17 =D0=B8=D1=8E=D0=BB. 2018 =D0=B3. =D0=B2 22:30, Dmitry Pa= vlov : > > > Odd flaky tests notifications were fixed. > > > > If test changes its status more than 6 times in last 50 runs, than it i= s > > required to fail 7 times in a row to be considered as new failure. Norm= al > > test can be considered as new failure if it fails 3 times. > > > > I would appreciate any feedback and proposals of rules change to make > > MTCGA.Bot as useful as it humanly possible. > > > > =D0=B2=D1=82, 17 =D0=B8=D1=8E=D0=BB. 2018 =D0=B3. =D0=B2 10:26, Dmitry = Pavlov : > > > > > Hi Igniters, > > > > > > Seems this test is flaky: it has frequent changes of its status. This > can > > > be detected in Bot. and I'll update Bot once issue > > > https://github.com/dspavlov/ignite-teamcity-helper/issues/14 is > > completed. > > > > > > So please ignore this failure for now, as it is not new. Of course if > you > > > know how to fix flakiness, fix is always preferred. > > > > > > Sincerely, > > > Dmitriy Pavlov > > > > > > > > > =D0=B2=D1=82, 17 =D0=B8=D1=8E=D0=BB. 2018 =D0=B3. =D0=B2 2:06, : > > > > > >> Hi Ignite Developer, > > >> > > >> I am MTCGA.Bot, and I've detected some issue on TeamCity to be > > addressed. > > >> I hope you can help. > > >> > > >> * New test failure in master > > >> CacheStopAndDestroySelfTest.testTckStyleCreateDestroyClose > > >> > > > https://ci.ignite.apache.org/project.html?projectId=3DIgniteTests24Java8&= testNameId=3D139506597706397620&branch=3D%3Cdefault%3E&tab=3DtestDetails > > >> Changes may led to failure were done by - ivandasch > > >> > > > http://ci.ignite.apache.org/viewModification.html?modId=3D825683&personal= =3Dfalse > > >> > > >> - If your changes can led to this failure(s), please create > > issue > > >> with label MakeTeamCityGreenAgain and assign it to you. > > >> -- If you have fix, please set ticket to PA state and write = to > > >> dev list fix is ready > > >> -- For case fix will require some time please mute test and > set > > >> label Muted_Test to issue > > >> - If you know which change caused failure please contact > change > > >> author directly > > >> - If you don't know which change caused failure please send > > >> message to dev list to find out > > >> Should you have any questions please contact dpavlov@apache.org or > > write > > >> to dev.list > > >> Best Regards, > > >> MTCGA.Bot > > >> Notification generated at Tue Jul 17 02:06:49 MSK 2018 > > >> > > > > > > -- > -- > Maxim Muzafarov > --000000000000de983b057143045a--