hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Scott Whitecross <swhitecr...@gmail.com>
Subject Re: how many regions a regionserver can support
Date Sun, 29 Aug 2010 04:00:42 GMT
Can you explain this a bit more?  I thought one benefit to small regions was
increased performance pulling blocks?  Is there an upper limit to the number
of regions per region server that is recommended?

On Sat, Aug 28, 2010 at 4:05 PM, Ryan Rawson <ryanobjc@gmail.com> wrote:

> The only downside to having so many regions on a regionserver is
> opening and reassigning them is not as fast as you'd like.
>
> In the future with increased parallelism and other things we will be
> able to speed it up.
>
>
>
> On Fri, Aug 27, 2010 at 10:55 AM, Jonathan Gray <jgray@facebook.com>
> wrote:
> > There is no fixed limit, it has much more to do with the read/write load
> than the actual dataset size.
> >
> > HBase is usually fine having very densely packed RegionServers, if much
> of the data is rarely accessed.  If you have extremely high numbers of
> regions per server and you are writing to all of these regions, or even
> reading from all of them, you could have issues.  Though storage capacity
> needs to be considered, capacity planning often has much more to do with how
> much memory you need to support the read/write load you expect.  Reads
> mostly from a performance POV but for writes, there are some important
> considerations related to the number of regions per server (and thus data
> density and determining your max region size).
> >
> > In any case, you should probably increase your max size to 1GB or so and
> can go higher if necessary.
> >
> > JG
> >
> >> -----Original Message-----
> >> From: Jinsong Hu [mailto:jinsong_hu@hotmail.com]
> >> Sent: Friday, August 27, 2010 10:03 AM
> >> To: user@hbase.apache.org
> >> Subject: how many regions a regionserver can support
> >>
> >> Hi, There :
> >>    Does anybody know how many region a regionserver can support ? I
> >> have
> >> regionservers with 8G ram and 1.5T disk and 4 core CPU.
> >> I searched http://www.facebook.com/note.php?note_id=142473677002 and
> >> they
> >> say google target is 100 regions of 200M for each
> >> regionserver.
> >>   In my case, I have 2700 regions spread to 6 regionservers. each
> >> region is
> >> set to default size of 256M . and it seems it is still running fine. I
> >> am
> >> running CDH3.  I just wonder what is the upper limit so that I can do
> >> capacity planning. Does anybody know this ?
> >>
> >> Jimmy.
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message