Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 80C1B2009C6 for ; Tue, 17 May 2016 01:19:15 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 7F8AB160A19; Mon, 16 May 2016 23:19:15 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id CFACE160A16 for ; Tue, 17 May 2016 01:19:14 +0200 (CEST) Received: (qmail 40134 invoked by uid 500); 16 May 2016 23:19:13 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 39825 invoked by uid 99); 16 May 2016 23:19:13 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 May 2016 23:19:13 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id ABC842C1F61 for ; Mon, 16 May 2016 23:19:13 +0000 (UTC) Date: Mon, 16 May 2016 23:19:13 +0000 (UTC) From: "Appy (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (HBASE-15651) Add report-flakies.py to use jenkins api to get failing tests MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 16 May 2016 23:19:15 -0000 [ https://issues.apache.org/jira/browse/HBASE-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Appy resolved HBASE-15651. -------------------------- Resolution: Fixed > Add report-flakies.py to use jenkins api to get failing tests > ------------------------------------------------------------- > > Key: HBASE-15651 > URL: https://issues.apache.org/jira/browse/HBASE-15651 > Project: HBase > Issue Type: Sub-task > Reporter: Appy > Assignee: Appy > Fix For: master > > Attachments: HBASE-15651-master-v2.patch, HBASE-15651-master-v3.patch, HBASE-15651-master-v4.patch, HBASE-15651-master.patch, flakies.py > > > So i have written this simple script (attached) which looks at history of the [post commit build|https://builds.apache.org/view/All/job/HBase-Trunk_matrix] and outputs a list of flaky tests with some numbers. > Next steps: > 1. Setup a jenkins job (say *find-flaky-tests*) to run this script daily. We can either directly pull these results into other jobs using curl on this job's artifacts, or commit the list of flaky test to repo (idk if it's possible to commit something from jenkins job). > We'll collect results from both *post-commit* job (to add new flakies) and *flaky-tests* job (to delete tests which are no more flaky). > 2. Change *pre-commit* and *post-commit* jobs to ignore these tests using --exclude maven flag. Someone familiar with yetus might be able to do it easily. > 3. Setup a new job (say *flaky-tests*) to run only these flaky tests. -- This message was sent by Atlassian JIRA (v6.3.4#6332)