hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manjeet Singh <manjeet.chand...@gmail.com>
Subject Re: Query regarding pre-split Major compaction
Date Sat, 10 Sep 2016 00:35:35 GMT
Yeah its in weekdays
Yeah default is 10 gb so what is the way/forumla to knw what shuld be the
size of RS
On 9 Sep 2016 19:03, "Ted Yu" <yuzhihong@gmail.com> wrote:

> Can you clarify whether the incoming data rate is for weekdays ?
>
> At 6-7 Gb /Hour, you need to set larger region size.
> Default is 10GB.
>
> If you know roughly how the key space would be filled, presplit your table
> accordingly.
>
> On Thu, Sep 8, 2016 at 11:24 PM, Manjeet Singh <manjeet.chandhok@gmail.com
> >
> wrote:
>
> > Hi All
> >
> > I have some basic question can anyone help me out
> >
> > Q1. this is my understanding To perform splitting  I need to create table
> > like below
> > create 'test_table','c1', SPLITS=>['#", '!', '$'']
> >
> > and I have to design row key in this way
> > #_123456789
> > !_123456789
> > $_123456789
> >
> > so my data distributed on cluster
> >
> > My requirement is very simple I want to equally distributed data on
> regions
> > as per my rowkey only
> >
> > So please correct me if I am missing any thing?
> >
> >
> > Q2 If i have 5 regions on my each region server and I give 100 MB space
> by
> > using  hbase.hregion.max.filesize property
> >
> > what will happen when my all regions fill with 100 MB data
> > Please note I have cron job secluded on every weekend and my Incoming
> data
> > rate is 6-7 Gb /Hour. so my region get filled very fast
> >
> >
> >
> >
> >
> > Thanks
> > Manjeet
> >
> >
> >
> >
> > --
> > luv all
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message