hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan Rawson <ryano...@gmail.com>
Subject Re: memory usage too high in regionserver
Date Mon, 09 Aug 2010 22:07:15 GMT
Unfortunately 'usedHeap' includes the unfound garbage...

Perhaps you can post more of your GC log.

On Mon, Aug 9, 2010 at 3:02 PM, Jinsong Hu <jinsong_hu@hotmail.com> wrote:
> Hi, There:
>
>  I am using cloudera cdh3 regionserver and today, I noticed that one of the
> regionserver memory usage is very high:
>
> request=8.8, regions=60, stores=61, storefiles=67, storefileIndexSize=142,
> memstoreSize=58, compactionQueueSize=0, usedHeap=5869, maxHeap=6127,
> blockCacheSize=1061944288, blockCacheFree=223059360, blockCacheCount=16239,
> blockCacheHitRatio=14
>
> this shows that only 60 regions calused close to 6G of memory usage. This is
> very high.
>
> the gc-hbase.log shows:
>
> 1461575.642: [GC 1461575.643: [ParNew: 143538K->17024K(153344K), 0.0487050
> secs]
> 5948479K->5846957K(6274432K) icms_dc=0 , 0.0488210 secs] [Times: user=0.33
> sys=
> 0.00, real=0.05 secs]
> 1461693.726: [GC 1461693.726: [ParNew: 153344K->17024K(153344K), 0.0454440
> secs]
> 5983277K->5875331K(6274432K) icms_dc=0 , 0.0455680 secs] [Times: user=0.31
> sys=
> 0.01, real=0.05 secs]
>
>
> This shows that the regionserver is indeed using 6G of memory. very close to
> the setting of -Xmx6G limit.
> and very soon the regionserver will be OOME.
>
>
> if the above holds true, that means a regionserver can only support around
> 60 regions. I configured the region size to be default 256M.
>
> I checked the load on the server and the load is very light. cpu and disk
> usage is very low. What can I do to drastically increase the number of
> regions
> supported per regionserver in hbase ?
>
>
> Jimmy
>

Mime
View raw message