hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Rebuild HBASE Table to reduce Regions per RS
Date Tue, 14 Jan 2014 19:24:28 GMT
HBASE-7403 provided online merge capability.

The usage is:
HBaseAdmin#mergeRegions

Note: online merge is in 0.96 and above releases.


On Tue, Jan 14, 2014 at 11:00 AM, Vladimir Rodionov
<vladrodionov@gmail.com>wrote:

> Nice. Ted. Is there any reason why we can't do it online?
>
>
> On Tue, Jan 14, 2014 at 10:47 AM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > Upender:
> > For 15.2.2 Merge, please note the following condition:
> >
> >     LOG.info("Verifying that HBase is not running...");
> >     try {
> >       HBaseAdmin.checkHBaseAvailable(getConf());
> >       LOG.fatal("HBase cluster must be off-line.");
> >
> > Cheers
> >
> >
> > On Tue, Jan 14, 2014 at 10:40 AM, Vladimir Rodionov
> > <vladrodionov@gmail.com>wrote:
> >
> > > I have never tried this before but I think the following should work:
> > >
> > > 1. Alter your table:
> > >
> > > habse> alter 't1', METHOD => 'table_att', MAX_FILESIZE => '5000000000'
> > > (place your own number here)
> > >
> > > 2. Merge regions:
> > >
> > > http://hbase.apache.org/book/ops.regionmgt.html
> > >
> > >
> > >
> > >
> > > On Tue, Jan 14, 2014 at 7:21 AM, Upender Nimbekar <
> > > nimbekar.upender@gmail.com> wrote:
> > >
> > > > Hi,
> > > > Does anyone have any experience rebuidling the HBASE table to reduce
> > the
> > > > number of regions. I am currently dealing with a situation where the
> > no.
> > > of
> > > > regions per RS have gone up quite significantly (500 per RS) and
> > thereby
> > > > causing some performance issues. This is how I am thinking of
> bringing
> > it
> > > > down:
> > > >
> > > > increase the hbase.hregion.max.filesize from 500 MB to 2 GB
> > > >
> > > > And the rebuild the HBASE table. I am assuming if after table
> rebuild,
> > I
> > > > should see the no. of regions come down to more than half. I would
> > > > basically like to stay within HBASE suggested no. of regions per RS
> > which
> > > > is about 50-200.
> > > >
> > > > Please suggest if someone has any experience doing it.
> > > >
> > > > Thanks
> > > > Upen
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message