Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C06CB17FA6 for ; Sun, 25 Jan 2015 17:51:35 +0000 (UTC) Received: (qmail 60615 invoked by uid 500); 25 Jan 2015 17:51:35 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 60571 invoked by uid 500); 25 Jan 2015 17:51:35 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 60559 invoked by uid 99); 25 Jan 2015 17:51:35 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 25 Jan 2015 17:51:35 +0000 Date: Sun, 25 Jan 2015 17:51:35 +0000 (UTC) From: "Andrew Purtell (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-12891) have hbck do region consistency checks in parallel MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-12891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-12891: ----------------------------------- Fix Version/s: (was: 0.98.10) 0.98.11 I can reproduce these failures upon the first run of TestHBaseFsck locally. {noformat} ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.hadoop.hbase.util.TestHBaseFsck Tests run: 49, Failures: 4, Errors: 0, Skipped: 1, Time elapsed: 264.92 sec <<< FAILURE! - in org.apache.hadoop.hbase.util.TestHBaseFsck testHbckWithExcessReplica(org.apache.hadoop.hbase.util.TestHBaseFsck) Time elapsed: 3.016 sec <<< FAILURE! java.lang.AssertionError: expected:<[]> but was:<[NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:144) at org.apache.hadoop.hbase.util.hbck.HbckTestingUtil.assertNoErrors(HbckTestingUtil.java:89) at org.apache.hadoop.hbase.util.TestHBaseFsck.testHbckWithExcessReplica(TestHBaseFsck.java:676) testHbckWithFewerReplica(org.apache.hadoop.hbase.util.TestHBaseFsck) Time elapsed: 3.042 sec <<< FAILURE! java.lang.AssertionError: expected:<[]> but was:<[NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:144) at org.apache.hadoop.hbase.util.hbck.HbckTestingUtil.assertNoErrors(HbckTestingUtil.java:89) at org.apache.hadoop.hbase.util.TestHBaseFsck.testHbckWithFewerReplica(TestHBaseFsck.java:652) testNotInHdfsWithReplicas(org.apache.hadoop.hbase.util.TestHBaseFsck) Time elapsed: 1.487 sec <<< FAILURE! java.lang.AssertionError: expected:<[NOT_IN_HDFS]> but was:<[NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:144) at org.apache.hadoop.hbase.util.hbck.HbckTestingUtil.assertErrors(HbckTestingUtil.java:97) at org.apache.hadoop.hbase.util.TestHBaseFsck.testNotInHdfsWithReplicas(TestHBaseFsck.java:1335) testHbckWithRegionReplica(org.apache.hadoop.hbase.util.TestHBaseFsck) Time elapsed: 1.991 sec <<< FAILURE! java.lang.AssertionError: expected:<[]> but was:<[NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:144) at org.apache.hadoop.hbase.util.hbck.HbckTestingUtil.assertNoErrors(HbckTestingUtil.java:89) at org.apache.hadoop.hbase.util.TestHBaseFsck.testHbckWithRegionReplica(TestHBaseFsck.java:639) Results : Failed tests: TestHBaseFsck.testHbckWithExcessReplica:676 expected:<[]> but was:<[NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]> TestHBaseFsck.testHbckWithFewerReplica:652 expected:<[]> but was:<[NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]> TestHBaseFsck.testHbckWithRegionReplica:639 expected:<[]> but was:<[NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]> TestHBaseFsck.testNotInHdfsWithReplicas:1335 expected:<[NOT_IN_HDFS]> but was:<[NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]> Tests run: 49, Failures: 4, Errors: 0, Skipped: 1 {noformat} Moving out of 0.98.10. > have hbck do region consistency checks in parallel > -------------------------------------------------- > > Key: HBASE-12891 > URL: https://issues.apache.org/jira/browse/HBASE-12891 > Project: HBase > Issue Type: Improvement > Affects Versions: 2.0.0, 0.98.10, 1.1.0 > Reporter: churro morales > Assignee: churro morales > Fix For: 1.0.0, 2.0.0, 1.1.0, 0.98.11 > > Attachments: HBASE-12891.98.patch, HBASE-12891.patch, HBASE-12891.patch > > > We have a lot of regions on our cluster ~500k and noticed that hbck took quite some time in checkAndFixConsistency(). [~davelatham] patched our cluster to do this check in parallel to speed things up. I'll attach the patch. -- This message was sent by Atlassian JIRA (v6.3.4#6332)