hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Created: (HBASE-3551) Loaded hfile indexes occupy a good chunk of heap; look into shrinking the amount used and/or evicting unused indices
Date Sun, 20 Feb 2011 05:14:38 GMT
Loaded hfile indexes occupy a good chunk of heap; look into shrinking the amount used and/or
evicting unused indices
--------------------------------------------------------------------------------------------------------------------

                 Key: HBASE-3551
                 URL: https://issues.apache.org/jira/browse/HBASE-3551
             Project: HBase
          Issue Type: Improvement
            Reporter: stack


I hung with a user Marc and we were looking over configs and his cluster profile up on ec2.
 One thing we noticed was that his 100+ 1G regions of two families had ~2.5G of heap resident.
 We did a bit of math and couldn't get to 2.5G so that needs looking into.  Even still, 2.5G
is a bunch of heap to give over to indices (He actually OOME'd when he had his RS heap set
to just 3G; we shouldn't OOME, we should just run slower).  It sounds like he needs the indices
loaded but still, for some cases we should drop indices for unaccessed files.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message