hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Himanshu Vashishtha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-7704) migration tool that checks presence of HFile V1 files
Date Thu, 04 Apr 2013 20:34:15 GMT

    [ https://issues.apache.org/jira/browse/HBASE-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13622751#comment-13622751
] 

Himanshu Vashishtha commented on HBASE-7704:
--------------------------------------------

Did the nits. Made the executor a local parameter and passed it along.
Output:
a) When there is no hfile v1, or corrupted file in the root.dir:
{code}
./bin/hbase org.apache.hadoop.hbase.util.HFileV1Detector
No HFile V1 Found
{code}

b) When there is a hfile v1 and a corrupted file in the target directory
{code}
./bin/hbase org.apache.hadoop.hbase.util.HFileV1Detector -p /hbase

Following regions has HFileV1 and needs to be Major Compacted:

hdfs://localhost:41020/hbase/usertable/fa02dac1f38d03577bd0f7e666f12812
hdfs://localhost:41020/hbase/usertable/ecdd3eaee2d2fcf8184ac025555bb2af


Following HFileV1 are found:

hdfs://localhost:41020/hbase/usertable/fa02dac1f38d03577bd0f7e666f12812/family/249450144068442524
hdfs://localhost:41020/hbase/usertable/ecdd3eaee2d2fcf8184ac025555bb2af/family/249450144068442524


Following HFiles are corrupted as their version is unknown:

hdfs://localhost:41020/hbase/usertable/fa02dac1f38d03577bd0f7e666f12812/family/1

{code}

Help section usage is in the previous comment. Added Class level docs on how to use it.

bq.   List<Future<Path>> l 
Yea, it can be better. Can you please suggest some. Thanks.
                
> migration tool that checks presence of HFile V1 files
> -----------------------------------------------------
>
>                 Key: HBASE-7704
>                 URL: https://issues.apache.org/jira/browse/HBASE-7704
>             Project: HBase
>          Issue Type: Task
>            Reporter: Ted Yu
>            Assignee: Himanshu Vashishtha
>            Priority: Blocker
>             Fix For: 0.95.1
>
>         Attachments: HBase-7704-v1.patch, HBase-7704-v2.patch
>
>
> Below was Stack's comment from HBASE-7660:
> Regards the migration 'tool', or 'tool' to check for presence of v1 files, I imagine
it as an addition to the hfile tool http://hbase.apache.org/book.html#hfile_tool2 The hfile
tool already takes a bunch of args including printing out meta. We could add an option to
print out version only – or return 1 if version 1 or some such – and then do a bit of
code to just list all hfiles and run this script against each. Could MR it if too many files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message