hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15321) Ability to open a HRegion from hdfs snapshot.
Date Thu, 25 Feb 2016 04:27:18 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15166708#comment-15166708
] 

Ted Yu commented on HBASE-15321:
--------------------------------

{code}
6353	  public static HRegion openReadOnlyFileSystemHRegion(final Configuration conf, final
FileSystem fs,
6354	      final Path rootDir, final Path tableDir, final HRegionInfo info, final HTableDescriptor
htd, final WAL wal)
{code}
How would the above method be called ?
Show example, please.

> Ability to open a HRegion from hdfs snapshot.
> ---------------------------------------------
>
>                 Key: HBASE-15321
>                 URL: https://issues.apache.org/jira/browse/HBASE-15321
>             Project: HBase
>          Issue Type: New Feature
>    Affects Versions: 2.0.0
>            Reporter: churro morales
>             Fix For: 2.0.0
>
>         Attachments: HBASE-15321.patch
>
>
> Now that hdfs snapshots are here, we started to run our mapreduce jobs over hdfs snapshots.
 The thing is, hdfs snapshots are read-only point-in-time copies of the file system.  Thus
we had to modify the section of code that initialized the region internals in HRegion.   We
have to skip cleanup of certain directories if the HRegion is backed by a hdfs snapshot. 
I have a patch for trunk with some basic tests if folks are interested.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message