hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jian zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-3906) When HMaster is running,there are a lot of RegionLoad instances(far greater than the regions),it has risk of OOME.
Date Thu, 26 May 2011 03:01:48 GMT

     [ https://issues.apache.org/jira/browse/HBASE-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

jian zhang updated HBASE-3906:
------------------------------

    Attachment: HBASE-3906.patch

The 24M objects are all live,not include dead objects.
I have test senarios below with this new patch:
1,start cluster normally,insert data and then dump hmaster memory;
2,when cluster is running,kill active hmaster and standby hmaster switch to active hmaster,then
dump the new active hmaster memory;
3,kill or join new regionserver to running cluster,when balance finished,dump hmaster memory.

All senarios above,the hmaster does not have unnessessary HServerLoad objects and the balance
can work too.


> When HMaster is running,there are a lot of RegionLoad instances(far greater than the
regions),it has risk of OOME.
> ------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-3906
>                 URL: https://issues.apache.org/jira/browse/HBASE-3906
>             Project: HBase
>          Issue Type: Improvement
>          Components: master
>    Affects Versions: 0.90.2, 0.90.3
>         Environment: 1 hmaster,4 regionserver,about 100,000 regions.
>            Reporter: jian zhang
>             Fix For: 0.90.4
>
>         Attachments: HBASE-3906.patch, HBASE-3906.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> 1、Start hbase cluster;
> 2、After hmaster finish regions assignement,use jmap to dump the memory of hmaster;
> 3、Use MAT to analyse the dump file,there are too many RegionLoad instances,and these
instances occupy more than 3G memory;

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message