hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Atri Sharma <atri.j...@gmail.com>
Subject Re: Online merging of Regions
Date Sun, 02 Mar 2014 03:00:19 GMT
Thanks guys.

Is there anything I could work on? I was searching for a project to
contribute but couldn't find it. Please help

Regards,

Atri

On Sunday, March 2, 2014, Jonathan Hsieh <jon@cloudera.com> wrote:

> It is in 0.95/0.96/0.98 releases.
>
>
> On Sat, Mar 1, 2014 at 12:01 PM, Atri Sharma <atri.jiit@gmail.com<javascript:;>>
> wrote:
>
> > Hi all,
> >
> > Just as a theoretical interest, do we support online merging of Regions
> in
> > any way? Are there ways to merge Regions while still supporting reads and
> > writes to them?
> >
> > If not, can we do them in the following manner:
> >
> > At each major delete/explicit order from user to merge Regions, we can
> > create a new empty memstore which will take any reads for the Region in
> > discussion. Then, we can build a leftist tree of the Region and store it
> in
> > the memory itself. We so not need to write it into disk yet. This shall
> > also allow us to serve reads using the Region itself without any extra
> > additional copies.
> >
> > We do it for all the Regions being merged and then merge the leftist
> trees
> > made ordered by the range of keys served by the Regions. We then traverse
> > the final all merged leftist tree, write its data to a HFile and write
> the
> > new memstore being used for write's data into the HFile as well.
> >
> > It's just a thought.Please let me know your feedback and comments on it.
> >
> > Regards,
> >
> > Atri
> >
> >
> >
> > --
> > Regards,
> >
> > Atri
> > *l'apprenant*
> >
>
>
>
> --
> // Jonathan Hsieh (shay)
> // HBase Tech Lead, Software Engineer, Cloudera
> // jon@cloudera.com <javascript:;> // @jmhsieh
>


-- 
Regards,

Atri
*l'apprenant*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message