hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: trimming RegionLoad fields
Date Thu, 17 Mar 2011 21:53:12 GMT
I agree that it is useful information.
Can we retrieve it from HRegion which is in HRegionServer.onlineRegions ?

  protected final Map<String, HRegion> onlineRegions =
    new HashMap<String, HRegion>();

Thanks

On Thu, Mar 17, 2011 at 2:47 PM, Andrew Purtell <apurtell@apache.org> wrote:

> memstoreSizeMB is part of the output printed by the shell when you do
> status 'detailed'.
>
> I use that.
>
> Isn't that information useful to others?
>
>  - Andy
>
> --- On Thu, 3/17/11, Ryan Rawson <ryanobjc@gmail.com> wrote:
>
> > From: Ryan Rawson <ryanobjc@gmail.com>
> > Subject: Re: trimming RegionLoad fields
> > To: dev@hbase.apache.org
> > Cc: "Ted Yu" <yuzhihong@gmail.com>
> > Date: Thursday, March 17, 2011, 2:37 PM
> > How much memory does profiling
> > indicating these objects use?  How much
> > are you expecting to save?
> >
> > Saving 4-8 bytes even on a 10k region cluster is still only
> > 80k of ram, not really significant.
> >
> >
> > On Thu, Mar 17, 2011 at 2:32 PM, Ted Yu <yuzhihong@gmail.com>
> > wrote:
> > > Hi,
> > > See email thread 'One of the regionserver aborted,
> > then the master shut down
> > > itself' for background.
> > > I am evaluating various ways of trimming the memory
> > footprint of RegionLoad
> > > because there would be so many regions in production
> > cluster.
> > >
> > > Looking at field memstoreSizeMB of RegionLoad, I only
> > found this reference -
> > > AvroUtil.hslToASL()
> > > Load balancer currently isn't checking this metric.
> > And HRegion has
> > > memstoreSize field.
> > >
> > > I wonder whether we can trim field memstoreSizeMB off
> > RegionLoad.
> > >
> > > Please comment.
> > >
> >
>
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message