hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Gray (JIRA)" <j...@apache.org>
Subject [jira] Created: (HBASE-900) Regionserver memory leak causing OOME during relatively modest bulk importing
Date Wed, 24 Sep 2008 23:53:46 GMT
Regionserver memory leak causing OOME during relatively modest bulk importing
-----------------------------------------------------------------------------

                 Key: HBASE-900
                 URL: https://issues.apache.org/jira/browse/HBASE-900
             Project: Hadoop HBase
          Issue Type: Bug
    Affects Versions: 0.18.0, 0.2.1
            Reporter: Jonathan Gray
            Priority: Critical
             Fix For: 0.18.1


I have recreated this issue several times and it appears to have been introduced in 0.2.

During an import to a single table, memory usage of individual region servers grows w/o bounds
and when set to the default 1GB it will eventually die with OOME.  This has happened to me
as well as Daniel Ploeg on the mailing list.  In my case, I have 10 RS nodes and OOME happens
w/ 1GB heap at only about 30-35 regions per RS.  In previous versions, I have imported to
several hundred regions per RS with default heap size.

I am able to get past this by increasing the max heap to 2GB.  However, the appearance of
this in newer versions leads me to believe there is now some kind of memory leak happening
in the region servers during import.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message