hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nick Dimiduk (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11484) Provide a way in TableSnapshotInputFormat, not to restore the regions to a path for running MR every time, rather reuse a already restored path
Date Wed, 09 Jul 2014 21:01:05 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056753#comment-14056753
] 

Nick Dimiduk commented on HBASE-11484:
--------------------------------------

Hi [~dvdreddy]. The work on adding support for Hive is happening on HIVE-6584. If you have
design and use-case comments, please add them over there. It looks like the patches may need
a refresh though. We can also accommodate HBase improvements as necessary.

>From the perspective of my contribution, I was planning to abstract away the restore directory
from the Hive user once I have a working implementation. Patches welcome ;)

> Provide a way in TableSnapshotInputFormat, not to restore the regions to a path for running
MR every time, rather reuse a already restored path
> -----------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-11484
>                 URL: https://issues.apache.org/jira/browse/HBASE-11484
>             Project: HBase
>          Issue Type: New Feature
>          Components: mapreduce
>            Reporter: deepankar
>            Priority: Minor
>
> We are trying to back a Hive Table by the Map Reduce over snapshots  and we don't want
to restore the snapshot to a restoreDir every time we want to execute a query. It would be
nice if there is boolean in the function 
> *TableSnapshotInputFormat.setInput* and exposed outside in the
> *TableMapReduceUtil.initTableSnapshotMapperJob*, with this boolean
> it will check whether the snapshot and the restore dir are in sync, rather than restoring
again. 
> Is this Idea looks Ok to you guys or you have any other suggestions, I will put up a
patch for this if this idea is ok for guys



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message