hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Online merging of Regions
Date Sun, 02 Mar 2014 03:13:31 GMT
Atri:
What level of project do you want to work on ?
Do you have access to cluster ?

There're many open JIRAs in HBase.
Recommendation can be made based on your interest.



On Sat, Mar 1, 2014 at 7:00 PM, Atri Sharma <atri.jiit@gmail.com> wrote:

> Thanks guys.
>
> Is there anything I could work on? I was searching for a project to
> contribute but couldn't find it. Please help
>
> Regards,
>
> Atri
>
> On Sunday, March 2, 2014, Jonathan Hsieh <jon@cloudera.com> wrote:
>
> > It is in 0.95/0.96/0.98 releases.
> >
> >
> > On Sat, Mar 1, 2014 at 12:01 PM, Atri Sharma <atri.jiit@gmail.com
> <javascript:;>>
> > wrote:
> >
> > > Hi all,
> > >
> > > Just as a theoretical interest, do we support online merging of Regions
> > in
> > > any way? Are there ways to merge Regions while still supporting reads
> and
> > > writes to them?
> > >
> > > If not, can we do them in the following manner:
> > >
> > > At each major delete/explicit order from user to merge Regions, we can
> > > create a new empty memstore which will take any reads for the Region in
> > > discussion. Then, we can build a leftist tree of the Region and store
> it
> > in
> > > the memory itself. We so not need to write it into disk yet. This shall
> > > also allow us to serve reads using the Region itself without any extra
> > > additional copies.
> > >
> > > We do it for all the Regions being merged and then merge the leftist
> > trees
> > > made ordered by the range of keys served by the Regions. We then
> traverse
> > > the final all merged leftist tree, write its data to a HFile and write
> > the
> > > new memstore being used for write's data into the HFile as well.
> > >
> > > It's just a thought.Please let me know your feedback and comments on
> it.
> > >
> > > Regards,
> > >
> > > Atri
> > >
> > >
> > >
> > > --
> > > Regards,
> > >
> > > Atri
> > > *l'apprenant*
> > >
> >
> >
> >
> > --
> > // Jonathan Hsieh (shay)
> > // HBase Tech Lead, Software Engineer, Cloudera
> > // jon@cloudera.com <javascript:;> // @jmhsieh
> >
>
>
> --
> Regards,
>
> Atri
> *l'apprenant*
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message