Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8698F19479 for ; Wed, 20 Apr 2016 17:44:26 +0000 (UTC) Received: (qmail 23120 invoked by uid 500); 20 Apr 2016 17:44:26 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 23083 invoked by uid 500); 20 Apr 2016 17:44:26 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 23059 invoked by uid 99); 20 Apr 2016 17:44:26 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Apr 2016 17:44:26 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id D0BB92C1F54 for ; Wed, 20 Apr 2016 17:44:25 +0000 (UTC) Date: Wed, 20 Apr 2016 17:44:25 +0000 (UTC) From: "Hadoop QA (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-15651) Track our flaky tests and use them to improve our build environment MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250353#comment-15250353 ] Hadoop QA commented on HBASE-15651: ----------------------------------- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 2m 47s {color} | {color:blue} Docker mode activated. {color} | | {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 0s {color} | {color:green} Patch does not have any anti-patterns. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s {color} | {color:green} The patch does not contain any @author tags. {color} | | {color:red}-1{color} | {color:red} hbaseprotoc {color} | {color:red} 0m 17s {color} | {color:red} root in the patch failed. {color} | | {color:red}-1{color} | {color:red} pylint {color} | {color:red} 0m 3s {color} | {color:red} The applied patch generated 20 new + 0 unchanged - 0 fixed = 20 total (was 0) {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s {color} | {color:green} Patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 33m 30s {color} | {color:green} Patch does not cause any errors with Hadoop 2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.1 2.6.2 2.6.3 2.7.1. {color} | | {color:red}-1{color} | {color:red} hbaseprotoc {color} | {color:red} 0m 12s {color} | {color:red} root in the patch failed. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 16s {color} | {color:green} Patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 37m 15s {color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Docker | Client=1.9.1 Server=1.9.1 Image:yetus/hbase:date2016-04-20 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12799663/HBASE-15651-master-v3.patch | | JIRA Issue | HBASE-15651 | | Optional Tests | asflicense pylint | | uname | Linux d658e995e916 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build@2/component/dev-support/hbase-personality.sh | | git revision | master / fa215a6 | | hbaseprotoc | https://builds.apache.org/job/PreCommit-HBASE-Build/1518/artifact/patchprocess/patch-hbaseprotoc-root.txt | | pylint | v1.5.5 | | pylint | https://builds.apache.org/job/PreCommit-HBASE-Build/1518/artifact/patchprocess/diff-patch-pylint.txt | | hbaseprotoc | https://builds.apache.org/job/PreCommit-HBASE-Build/1518/artifact/patchprocess/patch-hbaseprotoc-root.txt | | modules | C: . U: . | | Console output | https://builds.apache.org/job/PreCommit-HBASE-Build/1518/console | | Powered by | Apache Yetus 0.3.0-SNAPSHOT http://yetus.apache.org | This message was automatically generated. > Track our flaky tests and use them to improve our build environment > ------------------------------------------------------------------- > > Key: HBASE-15651 > URL: https://issues.apache.org/jira/browse/HBASE-15651 > Project: HBase > Issue Type: Improvement > Reporter: Appy > Assignee: Appy > Attachments: HBASE-15651-master-v2.patch, HBASE-15651-master-v3.patch, HBASE-15651-master.patch, flakies.py > > > So i have written this simple script (attached) which looks at history of the [post commit build|https://builds.apache.org/view/All/job/HBase-Trunk_matrix] and outputs a list of flaky tests with some numbers. > Next steps: > 1. Setup a jenkins job (say *find-flaky-tests*) to run this script daily. We can either directly pull these results into other jobs using curl on this job's artifacts, or commit the list of flaky test to repo (idk if it's possible to commit something from jenkins job). > We'll collect results from both *post-commit* job (to add new flakies) and *flaky-tests* job (to delete tests which are no more flaky). > 2. Change *pre-commit* and *post-commit* jobs to ignore these tests using --exclude maven flag. Someone familiar with yetus might be able to do it easily. > 3. Setup a new job (say *flaky-tests*) to run only these flaky tests. -- This message was sent by Atlassian JIRA (v6.3.4#6332)