hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "churro morales (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-15321) Ability to open a HRegion from hdfs snapshot.
Date Wed, 10 Jan 2018 21:15:00 GMT

     [ https://issues.apache.org/jira/browse/HBASE-15321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

churro morales updated HBASE-15321:
    Attachment: HBASE-15321.v5.patch

> Ability to open a HRegion from hdfs snapshot.
> ---------------------------------------------
>                 Key: HBASE-15321
>                 URL: https://issues.apache.org/jira/browse/HBASE-15321
>             Project: HBase
>          Issue Type: New Feature
>    Affects Versions: 2.0.0, 3.0.0, 1.5.0
>            Reporter: churro morales
>            Assignee: churro morales
>         Attachments: HBASE-15321-v1.patch, HBASE-15321-v2.patch, HBASE-15321-v3.patch,
HBASE-15321-v4.patch, HBASE-15321.patch, HBASE-15321.v5.patch
> Now that hdfs snapshots are here, we started to run our mapreduce jobs over hdfs snapshots.
 The thing is, hdfs snapshots are read-only point-in-time copies of the file system.  Thus
we had to modify the section of code that initialized the region internals in HRegion.   We
have to skip cleanup of certain directories if the HRegion is backed by a hdfs snapshot. 
I have a patch for trunk with some basic tests if folks are interested.  

This message was sent by Atlassian JIRA

View raw message