hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-10401) [hbck] perform overlap group merges in parallel
Date Wed, 22 Jan 2014 22:32:23 GMT

    [ https://issues.apache.org/jira/browse/HBASE-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879281#comment-13879281
] 

Lars Hofhansl commented on HBASE-10401:
---------------------------------------

This should go into 0.94 as well.

> [hbck] perform overlap group merges in parallel
> -----------------------------------------------
>
>                 Key: HBASE-10401
>                 URL: https://issues.apache.org/jira/browse/HBASE-10401
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.92.2, 0.98.0, 0.94.16, 0.99.0, 0.96.1.1
>            Reporter: Jonathan Hsieh
>            Assignee: Jonathan Hsieh
>         Attachments: hbase-10401.10400.patch, hbase-10401.patch
>
>
> In a recent support case, we encountered a corrupt hbase that had thousands of "overlap
groups" (regions that had overlapping key ranges).  The current implementation repairs these
by serially taking a group, perorming a merge and then moving on to the next group.  Because
assignments and hdfs nn operations are involved each merge could take on the order of seconds.
 With thousands of overlap groups, this could take hours to complete.
> This patch makes it so that these independent merge groups are merged in parallel.  It
uses the same thread pool for other fs info-gathering operations.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message