hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Query regarding pre-split Major compaction
Date Sat, 10 Sep 2016 00:56:21 GMT
Please take a look at:

http://hbase.apache.org/book.html#table_schema_rules_of_thumb
http://hbase.apache.org/book.html#arch.regions.size
http://hbase.apache.org/book.html#ops.capacity.regions
http://hbase.apache.org/book.html#ops.capacity.regions.total

On Fri, Sep 9, 2016 at 5:35 PM, Manjeet Singh <manjeet.chandhok@gmail.com>
wrote:

> Yeah its in weekdays
> Yeah default is 10 gb so what is the way/forumla to knw what shuld be the
> size of RS
> On 9 Sep 2016 19:03, "Ted Yu" <yuzhihong@gmail.com> wrote:
>
> > Can you clarify whether the incoming data rate is for weekdays ?
> >
> > At 6-7 Gb /Hour, you need to set larger region size.
> > Default is 10GB.
> >
> > If you know roughly how the key space would be filled, presplit your
> table
> > accordingly.
> >
> > On Thu, Sep 8, 2016 at 11:24 PM, Manjeet Singh <
> manjeet.chandhok@gmail.com
> > >
> > wrote:
> >
> > > Hi All
> > >
> > > I have some basic question can anyone help me out
> > >
> > > Q1. this is my understanding To perform splitting  I need to create
> table
> > > like below
> > > create 'test_table','c1', SPLITS=>['#", '!', '$'']
> > >
> > > and I have to design row key in this way
> > > #_123456789
> > > !_123456789
> > > $_123456789
> > >
> > > so my data distributed on cluster
> > >
> > > My requirement is very simple I want to equally distributed data on
> > regions
> > > as per my rowkey only
> > >
> > > So please correct me if I am missing any thing?
> > >
> > >
> > > Q2 If i have 5 regions on my each region server and I give 100 MB space
> > by
> > > using  hbase.hregion.max.filesize property
> > >
> > > what will happen when my all regions fill with 100 MB data
> > > Please note I have cron job secluded on every weekend and my Incoming
> > data
> > > rate is 6-7 Gb /Hour. so my region get filled very fast
> > >
> > >
> > >
> > >
> > >
> > > Thanks
> > > Manjeet
> > >
> > >
> > >
> > >
> > > --
> > > luv all
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message