Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5A9C718EFE for ; Thu, 21 Jan 2016 12:21:40 +0000 (UTC) Received: (qmail 38394 invoked by uid 500); 21 Jan 2016 12:21:40 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 38347 invoked by uid 500); 21 Jan 2016 12:21:40 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 38330 invoked by uid 99); 21 Jan 2016 12:21:40 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Jan 2016 12:21:40 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id EC4C82C1F55 for ; Thu, 21 Jan 2016 12:21:39 +0000 (UTC) Date: Thu, 21 Jan 2016 12:21:39 +0000 (UTC) From: "Hadoop QA (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-15128) Disable region splits and merges in HBCK MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-15128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110500#comment-15110500 ] Hadoop QA commented on HBASE-15128: ----------------------------------- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 0s {color} | {color:green} Patch does not have any anti-patterns. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s {color} | {color:green} The patch does not contain any @author tags. {color} | | {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s {color} | {color:green} The patch appears to include 1 new or modified test files. {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 20s {color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m 5s {color} | {color:green} master passed with JDK v1.8.0 {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 23s {color} | {color:green} master passed with JDK v1.7.0_79 {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 10m 14s {color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 49s {color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} hbaseprotoc {color} | {color:green} 0m 58s {color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m 53s {color} | {color:red} hbase-server in master has 1 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 24s {color} | {color:green} master passed with JDK v1.8.0 {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 8s {color} | {color:green} master passed with JDK v1.7.0_79 {color} | | {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m 15s {color} | {color:red} hbase-client in the patch failed. {color} | | {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m 22s {color} | {color:red} hbase-server in the patch failed. {color} | | {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m 24s {color} | {color:red} hbase-server in the patch failed with JDK v1.8.0. {color} | | {color:red}-1{color} | {color:red} cc {color} | {color:red} 0m 24s {color} | {color:red} hbase-server in the patch failed with JDK v1.8.0. {color} | | {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 24s {color} | {color:red} hbase-server in the patch failed with JDK v1.8.0. {color} | | {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m 22s {color} | {color:red} hbase-server in the patch failed with JDK v1.7.0_79. {color} | | {color:red}-1{color} | {color:red} cc {color} | {color:red} 0m 22s {color} | {color:red} hbase-server in the patch failed with JDK v1.7.0_79. {color} | | {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 22s {color} | {color:red} hbase-server in the patch failed with JDK v1.7.0_79. {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 2m 3s {color} | {color:red} Patch generated 6 new checkstyle issues in hbase-client (total was 473, now 478). {color} | | {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 4m 11s {color} | {color:red} Patch generated 7 new checkstyle issues in hbase-server (total was 339, now 345). {color} | | {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 49s {color} | {color:green} the patch passed {color} | | {color:blue}0{color} | {color:blue} rubocop {color} | {color:blue} 20m 57s {color} | {color:blue} Rubocop was not available. {color} | | {color:blue}0{color} | {color:blue} ruby-lint {color} | {color:blue} 20m 57s {color} | {color:blue} Ruby-lint was not available. {color} | | {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m 0s {color} | {color:red} The patch has 4 line(s) that end in whitespace. Use git apply --whitespace=fix. {color} | | {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 21m 55s {color} | {color:green} Patch does not cause any errors with Hadoop 2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.1 2.6.2 2.6.3 2.7.1. {color} | | {color:green}+1{color} | {color:green} hbaseprotoc {color} | {color:green} 0m 54s {color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 2m 5s {color} | {color:red} hbase-server introduced 5 new FindBugs issues. {color} | | {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 3m 28s {color} | {color:red} hbase-server-jdk1.8.0 with JDK v1.8.0 generated 5 new issues (was 1, now 6). {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 23s {color} | {color:green} the patch passed with JDK v1.8.0 {color} | | {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 4m 37s {color} | {color:red} hbase-server-jdk1.7.0_79 with JDK v1.7.0_79 generated 5 new issues (was 1, now 6). {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 8s {color} | {color:green} the patch passed with JDK v1.7.0_79 {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 52s {color} | {color:green} hbase-client in the patch passed with JDK v1.8.0. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 37s {color} | {color:green} hbase-protocol in the patch passed with JDK v1.8.0. {color} | | {color:red}-1{color} | {color:red} unit {color} | {color:red} 0m 22s {color} | {color:red} hbase-server in the patch failed with JDK v1.8.0. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 9m 1s {color} | {color:green} hbase-shell in the patch passed with JDK v1.8.0. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 54s {color} | {color:green} hbase-client in the patch passed with JDK v1.7.0_79. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 19s {color} | {color:green} hbase-protocol in the patch passed with JDK v1.7.0_79. {color} | | {color:red}-1{color} | {color:red} unit {color} | {color:red} 0m 21s {color} | {color:red} hbase-server in the patch failed with JDK v1.7.0_79. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 8m 14s {color} | {color:green} hbase-shell in the patch passed with JDK v1.7.0_79. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 26s {color} | {color:green} Patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 92m 7s {color} | {color:black} {color} | \\ \\ || Reason || Tests || | FindBugs | module:hbase-server | | | Switch statement found in org.apache.hadoop.hbase.zookeeper.SwitchTrackerManager.setSwitchOn(boolean, Admin$SwitchType) where default case is missing At SwitchTrackerManager.java:Admin$SwitchType) where default case is missing At SwitchTrackerManager.java:[lines 82-87] | | | Unread field:SwitchTrackerManager.java:[line 50] | | | Unread field:SwitchTrackerManager.java:[line 49] | | | Unused field:SwitchTrackerManager.java | | | Should org.apache.hadoop.hbase.zookeeper.SwitchTrackerManager$SwitchStateTracker be a _static_ inner class? At SwitchTrackerManager.java:inner class? At SwitchTrackerManager.java:[lines 94-139] | \\ \\ || Subsystem || Report/Notes || | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12783559/HBASE-15128_v1.patch | | JIRA Issue | HBASE-15128 | | Optional Tests | asflicense javac javadoc unit findbugs hadoopcheck hbaseanti checkstyle compile cc hbaseprotoc rubocop ruby_lint | | uname | Linux asf908.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh | | git revision | master / 4bf6f83 | | findbugs | v3.0.0 | | findbugs | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/branch-findbugs-hbase-server-warnings.html | | mvninstall | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/patch-mvninstall-hbase-client.txt | | mvninstall | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/patch-mvninstall-hbase-server.txt | | compile | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/patch-compile-hbase-server-jdk1.8.0.txt | | cc | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/patch-compile-hbase-server-jdk1.8.0.txt | | javac | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/patch-compile-hbase-server-jdk1.8.0.txt | | compile | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/patch-compile-hbase-server-jdk1.7.0_79.txt | | cc | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/patch-compile-hbase-server-jdk1.7.0_79.txt | | javac | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/patch-compile-hbase-server-jdk1.7.0_79.txt | | checkstyle | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/diff-checkstyle-hbase-client.txt | | checkstyle | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/diff-checkstyle-hbase-server.txt | | whitespace | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/whitespace-eol.txt | | findbugs | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/new-findbugs-hbase-server.html | | javadoc | hbase-server-jdk1.8.0: https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/diff-javadoc-javadoc-hbase-server-jdk1.8.0.txt | | javadoc | hbase-server-jdk1.7.0_79: https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/diff-javadoc-javadoc-hbase-server-jdk1.7.0_79.txt | | unit | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/patch-unit-hbase-server-jdk1.8.0.txt | | unit | https://builds.apache.org/job/PreCommit-HBASE-Build/226/artifact/patchprocess/patch-unit-hbase-server-jdk1.7.0_79.txt | | JDK v1.7.0_79 Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/226/testReport/ | | modules | C: hbase-client hbase-protocol hbase-server hbase-shell U: . | | Max memory used | 192MB | | Powered by | Apache Yetus 0.1.0 http://yetus.apache.org | | Console output | https://builds.apache.org/job/PreCommit-HBASE-Build/226/console | This message was automatically generated. > Disable region splits and merges in HBCK > ---------------------------------------- > > Key: HBASE-15128 > URL: https://issues.apache.org/jira/browse/HBASE-15128 > Project: HBase > Issue Type: Bug > Reporter: Enis Soztutar > Assignee: Heng Chen > Fix For: 2.0.0, 1.3.0 > > Attachments: HBASE-15128.patch, HBASE-15128_v1.patch > > > In large clusters where region splits are frequent, and HBCK runs take longer, the concurrent splits cause further problems in HBCK since HBCK assumes a static state for the region partition map. We have just seen a case where HBCK undo's a concurrently splitting region causing number of inconsistencies to go up. > We can have a mode in master where splits and merges are disabled like the balancer and catalog janitor switches. Master will reject the split requests if regionservers decide to split. This switch can be turned on / off by the admins and also automatically by HBCK while it is running (similar to balancer switch being disabled by HBCK). > HBCK should also disable the Catalog Janitor just in case. -- This message was sent by Atlassian JIRA (v6.3.4#6332)