Return-Path: Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: (qmail 15294 invoked from network); 17 Mar 2011 21:53:40 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 17 Mar 2011 21:53:40 -0000 Received: (qmail 23514 invoked by uid 500); 17 Mar 2011 21:53:39 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 23489 invoked by uid 500); 17 Mar 2011 21:53:39 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 23481 invoked by uid 99); 17 Mar 2011 21:53:39 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Mar 2011 21:53:39 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com designates 209.85.161.41 as permitted sender) Received: from [209.85.161.41] (HELO mail-fx0-f41.google.com) (209.85.161.41) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Mar 2011 21:53:33 +0000 Received: by fxm18 with SMTP id 18so4086933fxm.14 for ; Thu, 17 Mar 2011 14:53:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=zwaKtcRxXOku0c7kA+JK9rSoRbxXLertx8ITqwqAfmU=; b=YVfRDtdHNyVHSpokDtPhr8pvSXfsEPi/X0mVfpytKoyexRuCy/3fzEuVyYUCOKpVpR 9vuzX1j2o37v6WJZ+CjVJPdSLtPnzhDO7rj8EnXgm1xXhvGJ8XIxy1GRpm+LEg+1S/Tu ew5N9Ayycj5aGYe/c/WqyIvEGU62Y0qHW3AnE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=InFRz3Vjit8ORLfZu8HIlTYP3oOoONks72qBNnz6rWVJAM9SAu46lVv+uKNhk1I7RI vTysJZ1qyPx9+JJ1PSdYdNcTLpQgF8U9UVnuTZTMX3gG+sJ/+Ro2Z5Z6azseMEO4uo6e 7QjbsffSuwnTQjwzTwHwX9H/Aq3JMjveE6DvY= MIME-Version: 1.0 Received: by 10.223.16.82 with SMTP id n18mr358599faa.48.1300398792346; Thu, 17 Mar 2011 14:53:12 -0700 (PDT) Received: by 10.223.83.196 with HTTP; Thu, 17 Mar 2011 14:53:12 -0700 (PDT) In-Reply-To: <580372.51043.qm@web65512.mail.ac4.yahoo.com> References: <580372.51043.qm@web65512.mail.ac4.yahoo.com> Date: Thu, 17 Mar 2011 14:53:12 -0700 Message-ID: Subject: Re: trimming RegionLoad fields From: Ted Yu To: dev@hbase.apache.org, apurtell@apache.org Content-Type: multipart/alternative; boundary=00151747862e158b32049eb4b0cf --00151747862e158b32049eb4b0cf Content-Type: text/plain; charset=ISO-8859-1 I agree that it is useful information. Can we retrieve it from HRegion which is in HRegionServer.onlineRegions ? protected final Map onlineRegions = new HashMap(); Thanks On Thu, Mar 17, 2011 at 2:47 PM, Andrew Purtell wrote: > memstoreSizeMB is part of the output printed by the shell when you do > status 'detailed'. > > I use that. > > Isn't that information useful to others? > > - Andy > > --- On Thu, 3/17/11, Ryan Rawson wrote: > > > From: Ryan Rawson > > Subject: Re: trimming RegionLoad fields > > To: dev@hbase.apache.org > > Cc: "Ted Yu" > > Date: Thursday, March 17, 2011, 2:37 PM > > How much memory does profiling > > indicating these objects use? How much > > are you expecting to save? > > > > Saving 4-8 bytes even on a 10k region cluster is still only > > 80k of ram, not really significant. > > > > > > On Thu, Mar 17, 2011 at 2:32 PM, Ted Yu > > wrote: > > > Hi, > > > See email thread 'One of the regionserver aborted, > > then the master shut down > > > itself' for background. > > > I am evaluating various ways of trimming the memory > > footprint of RegionLoad > > > because there would be so many regions in production > > cluster. > > > > > > Looking at field memstoreSizeMB of RegionLoad, I only > > found this reference - > > > AvroUtil.hslToASL() > > > Load balancer currently isn't checking this metric. > > And HRegion has > > > memstoreSize field. > > > > > > I wonder whether we can trim field memstoreSizeMB off > > RegionLoad. > > > > > > Please comment. > > > > > > > > > --00151747862e158b32049eb4b0cf--