Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com
 designates 209.85.160.169 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <002201cf7883$c2d19e00$4874da00$@com>
References: <002c01cf7638$a4c7aff0$ee570fd0$@com>
	<CALte62wcf1DF_UR91o3HZgmP1J6xHwinkM6zg+jtmUosQNZwKg@mail.gmail.com>
	<005201cf7650$9251f660$b6f5e320$@com>
	<CALte62xNquQkioP=HUgt_s3AvrcbzBAbJauF6Hq2fjEc-6ZcgQ@mail.gmail.com>
	<002201cf7883$c2d19e00$4874da00$@com>
Date: Sun, 25 May 2014 22:10:00 -0700
Message-ID: 
 <CALte62zXM6g4Nnby4R3kDPuspFkiBxDw3_VHhjQA9ewyCu9_qA@mail.gmail.com>
Subject: 
 =?UTF-8?B?UmU6IOetlOWkjTog562U5aSNOiB3aGF0IGluIHJlZ2lvbnNlcnZlcidzIFVzZWQgSGVhcA==?=
From: Ted Yu <yuzhihong@gmail.com>
To: "user@hbase.apache.org" <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=20cf304353a858b9a204fa469711

--20cf304353a858b9a204fa469711
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Some metrics2 classes show up in the histogram.

I am digging into these classes and polling developers who are more
familiar with metrics2 system.

FYI


On Sun, May 25, 2014 at 6:42 PM, sunweiwei <sunww@asiainfo-linkage.com>wrot=
e:

> Hi
>
> This is jmap -histo result.
> num     #instances         #bytes  class name
> ----------------------------------------------
>    1:      14917882     3396492464  [C
>    2:       1996994     2118021808  [B
>
>  num     #instances         #bytes  class name
> ----------------------------------------------
>    1:      14917882     3396492464  [C
>    2:       1996994     2118021808  [B
>    3:      43341650     1733666000  java.util.LinkedHashMap$Entry
>    4:      14453983     1156550896  [Ljava.util.HashMap$Entry;
>    5:      14446577      924580928
>  org.apache.hadoop.metrics2.lib.Interns$CacheWith2Keys$2
>    6:      14816939      474142048  java.lang.String
>    7:      14463510      347124240
>  org.apache.hadoop.metrics2.lib.MetricsInfoImpl
>    8:       6380066      255202640  org.apache.hadoop.hbase.KeyValue
>    9:       7274264      174582336
>  java.util.concurrent.ConcurrentSkipListMap$Node
>   10:       3412039       81888936
>  java.util.concurrent.ConcurrentSkipListMap$Index
>   11:          9208       28516704  [I
>   12:        259293       26673528  [Ljava.lang.Object;
>   13:        424072       20355456  java.nio.HeapByteBuffer
>   14:        418655       20095440  java.nio.HeapCharBuffer
>   15:        657703       15784872
>  org.apache.hadoop.metrics2.impl.MetricGaugeDouble
>   16:        589926       14158224
>  org.apache.hadoop.metrics2.impl.MetricCounterLong
>   17:        522366       12536784
>  org.apache.hadoop.metrics2.impl.MetricGaugeLong
>   18:        504238       12101712  java.lang.Double
>   19:        436872       10484928  com.google.protobuf.LiteralByteString
>   20:         72414        9990968  <constMethodKlass>
>   21:         72414        9857616  <methodKlass>
>   22:         55752        9354400
>  [Ljava.util.concurrent.ConcurrentHashMap$HashEntry;
>   23:        103154        7427088
>  org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MutationProto
>   24:        145924        7004352
>  org.apache.hadoop.hbase.monitoring.MonitoredTaskImpl
>   25:          5322        6835120  <constantPoolKlass>
>   26:        251260        6030240  java.util.ArrayList
>   27:         94355        5979040  <symbolKlass>
>   28:        103170        5777520
>  org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MutationProto$Co=
lumnValue$QualifierValue
>   29:        238244        5717856
>  java.util.Collections$UnmodifiableRandomAccessList
>   30:        130150        5206000  java.util.TreeMap$Entry
>   31:        103160        4951680
>  org.apache.hadoop.hbase.protobuf.generated.ClientProtos$MutationProto$Co=
lumnValue
>
>
> Thanks
> -----=E9=82=AE=E4=BB=B6=E5=8E=9F=E4=BB=B6-----
> =E5=8F=91=E4=BB=B6=E4=BA=BA: Ted Yu [mailto:yuzhihong@gmail.com]
> =E5=8F=91=E9=80=81=E6=97=B6=E9=97=B4: 2014=E5=B9=B45=E6=9C=8823=E6=97=A5 =
22:34
> =E6=94=B6=E4=BB=B6=E4=BA=BA: user@hbase.apache.org
> =E4=B8=BB=E9=A2=98: Re: =E7=AD=94=E5=A4=8D: what in regionserver's Used H=
eap
>
> You can use jmap with -histo option to find out heap consumption:
> http://docs.oracle.com/javase/7/docs/technotes/tools/share/jmap.html
>
> Please pastebin jmap output.
>
> Cheers
>
>
> On Thu, May 22, 2014 at 11:30 PM, sunweiwei <sunww@asiainfo-linkage.com
> >wrote:
>
> > Hi Ted
> >
> > I have checked regionsever:60030/rs-status#regionMemstoreStats. Memstor=
e
> > and Cache Size is very small.
> > But Used Heap is very large.
> > Is there Any other thing in the Used Heap, and use lots of heaps?
> >
> > Thanks
> >
> > -----=E9=82=AE=E4=BB=B6=E5=8E=9F=E4=BB=B6-----
> > =E5=8F=91=E4=BB=B6=E4=BA=BA: Ted Yu [mailto:yuzhihong@gmail.com]
> > =E5=8F=91=E9=80=81=E6=97=B6=E9=97=B4: 2014=E5=B9=B45=E6=9C=8823=E6=97=
=A5 11:59
> > =E6=94=B6=E4=BB=B6=E4=BA=BA: user@hbase.apache.org
> > =E4=B8=BB=E9=A2=98: Re: what in regionserver's Used Heap
> >
> > On regionsever:60030/rs-status#regionMemstoreStats, you should be able =
to
> > see how much memstore each region uses.
> >
> > You can also use ganglia, etc to view the metrics.
> > See http://hbase.apache.org/book.html#hbase_metrics (15.4.4.3 and
> > 15.4.4.7)
> >
> > Cheers
> >
> >
> > On Thu, May 22, 2014 at 8:39 PM, sunweiwei <sunww@asiainfo-linkage.com
> > >wrote:
> >
> > > Hi
> > >
> > >
> > >
> > > I'm using hbase0.96.
> > >
> > >
> > >
> > > In hbase web, I see :
> > >
> > > Max Heap is 16.0 G
> > >
> > > Memstore Size is 208.6 M
> > >
> > > Cache Size is  138M
> > >
> > > Cache Free is 6.2G
> > >
> > >
> > >
> > > And Used Heap is 10.2 G.
> > >
> > >
> > >
> > > Used Heap is  large.  I want to know  what   could be  in  then Used
> > Heap.
> > >
> > >
> > >
> > >
> > > Thanks.
> > >
> > >
> >
> >
>
>

--20cf304353a858b9a204fa469711--