hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12891) have hbck do region consistency checks in parallel
Date Wed, 21 Jan 2015 05:23:34 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285185#comment-14285185
] 

Ted Yu commented on HBASE-12891:
--------------------------------

If there're many regions to check, there would be considerable load on master, right ?
Should there be some limit on the number of concurrent threads ?

> have hbck do region consistency checks in parallel
> --------------------------------------------------
>
>                 Key: HBASE-12891
>                 URL: https://issues.apache.org/jira/browse/HBASE-12891
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 2.0.0, 0.98.10, 1.1.0
>            Reporter: churro morales
>            Assignee: churro morales
>         Attachments: HBASE-12891.98.patch, HBASE-12891.patch
>
>
> We have a lot of regions on our cluster ~500k and noticed that hbck took quite some time
in checkAndFixConsistency().  [~davelatham] patched our cluster to do this check in parallel
to speed things up.  I'll attach the patch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message