hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jingcheng Du (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-13806) Check the mob files when there are mob-enabled columns in HFileCorruptionChecker
Date Mon, 01 Jun 2015 02:19:17 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14566883#comment-14566883

Jingcheng Du commented on HBASE-13806:

Thanks guys for comments.
bq. The idea here is that we read a hfile, and if we have the mob refs present on a cell,
we verify that the corresponding mob file is present. Furthermore, we could verify if the
mob value cell is present
I think in this patch, we should do same things as what is done in HFileCorruptionChecker
where only opening a reader to a HFile. We can file another JIRA to detect the missed mob
files which needs a full table scan I am afraid (In the current implementation of HFile.main()
it does the full table scan, we need resolve the reference to mob file in that scan).

bq. But this tool just try create a reader on the HFiles and not really reading Cells out
of it. So may be we will have the ref cell -> mob cell check as an other tool or so? Or
am I missing some thing?
You are right Anoop. This one is just to find all the mob files and check whether they are
corrupt. We need another JIRA to check the missed mob cells.

bq. But this would need a full table scan also? Are you just plan to check the integrity of
the MOB files?
This is used to check the corruption of mob files, we need another JIRA to check the integrity,
I am afraid we have to do a full table scan like what has been implemented for normal tables
(We need to resolve the reference cell to the mob cell if any).

> Check the mob files when there are mob-enabled columns in HFileCorruptionChecker
> --------------------------------------------------------------------------------
>                 Key: HBASE-13806
>                 URL: https://issues.apache.org/jira/browse/HBASE-13806
>             Project: HBase
>          Issue Type: Sub-task
>          Components: mob
>    Affects Versions: hbase-11339
>            Reporter: Jingcheng Du
>            Assignee: Jingcheng Du
>             Fix For: hbase-11339
> Now in HFileCorruptionChecker, it only checks the files in regions. We need check the
mob files too if there are mob-enabled columns in that table.

This message was sent by Atlassian JIRA

View raw message