hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Janos Gub (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16621) HBCK should have -fixHFileLinks
Date Mon, 17 Oct 2016 22:03:01 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15583628#comment-15583628

Janos Gub commented on HBASE-16621:

No as https://issues.apache.org/jira/browse/HBASE-16529 says also. I changed the contract
of this filter in my next patch only to filter paths (implements PathFilter instead of extending
AbstractFileStatusFilter). In this way it is guaranteed that it will return everything that
looks like an HFileLink (file or directory). Also I added a test case, where we create a directory,
which name looks like an HFileLink and also contains some files. Now it is also sidelined
(I am not sure if it is a valid test case).

> HBCK should have -fixHFileLinks
> -------------------------------
>                 Key: HBASE-16621
>                 URL: https://issues.apache.org/jira/browse/HBASE-16621
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Enis Soztutar
>            Assignee: Janos Gub
>              Labels: beginner, operability
>             Fix For: 2.0.0, 1.4.0
>         Attachments: HBASE-16621.patch, refactor-2.patch
> Similar to {{-fixReferenceFiles}}, HBCK should be able to sideline dangling HFile Links
as well. 
> We have seen a couple of cases, where due to HDFS-level fsck run which deleted files
with missing blocks, the cluster is left with dangling HFIle Links, and regions cannot be
opened because of these. Only a manual and error-prone finding and clearing of HFileLinks
can save the tables regions. 

This message was sent by Atlassian JIRA

View raw message