hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-13159) Consider RangeReferenceFiles with transformations
Date Thu, 05 Mar 2015 20:30:38 GMT

     [ https://issues.apache.org/jira/browse/HBASE-13159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Lars Hofhansl updated HBASE-13159:
----------------------------------
    Description: 
Currently we have References used by HalfStoreReaders and HFileLinks.
For various use cases we have here we have need for a RangeReferences with simple transformation
of the keys.
That would allow us to map HFiles between regions or even tables without copying any data.

We can probably combine HalfStores, HFileLinks, and RangeReferences into a single concept:
* RangeReference = arbitrary start and stop row, arbitrary key transformation
* HFileLink = start and stop keys set to the linked file's start/stop key, transformation
= identity
* (HalfStore) References = start/stop key set according to top or bottom reference, transformation
= identity

Note this is a *brainstorming* issue. :)
(Could start with just references with arbitrary start/stop keys, and do transformations later)

  was:
Currently we have References used by HalfStoreReaders and HFileLinks.
For various use case we have here we have need for a RangeReferences with simple transformation
of the keys.
That would allow us to map HFiles between region or even tables without copying any data.

We can probably combine HalfStores, HFileLinks, and RangeReferences into a single concept:
* RangeReference = arbitrary start and stop row, arbitrary key transformation
* HFileLink = start and stop keys set to the linked file's start/stop key, transformation
= identity
* (HalfStore) References = start/stop key set according to top or bottom reference, transformation
= identity

Note this is a *brainstorming* issue. :)
(Could start with just references with arbitrary start/stop keys, and do transformations later)


> Consider RangeReferenceFiles with transformations
> -------------------------------------------------
>
>                 Key: HBASE-13159
>                 URL: https://issues.apache.org/jira/browse/HBASE-13159
>             Project: HBase
>          Issue Type: Brainstorming
>            Reporter: Lars Hofhansl
>
> Currently we have References used by HalfStoreReaders and HFileLinks.
> For various use cases we have here we have need for a RangeReferences with simple transformation
of the keys.
> That would allow us to map HFiles between regions or even tables without copying any
data.
> We can probably combine HalfStores, HFileLinks, and RangeReferences into a single concept:
> * RangeReference = arbitrary start and stop row, arbitrary key transformation
> * HFileLink = start and stop keys set to the linked file's start/stop key, transformation
= identity
> * (HalfStore) References = start/stop key set according to top or bottom reference, transformation
= identity
> Note this is a *brainstorming* issue. :)
> (Could start with just references with arbitrary start/stop keys, and do transformations
later)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message