hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ryan rawson (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-2500) Block indexes and meta blocks should be put into the LRU
Date Wed, 28 Apr 2010 21:47:53 GMT

    [ https://issues.apache.org/jira/browse/HBASE-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12861954#action_12861954

ryan rawson commented on HBASE-2500:

Right now the block index does not have multiple sub-blocks. Even if it did, any operation
requiring the block index would have to load the entire block index because it does a binary
search.  The block index is not really designed to be usable "in-situ" like the data blocks,
so something extra fancy with callbacks when blocks are evicted might be required.

> Block indexes and meta blocks should be put into the LRU
> --------------------------------------------------------
>                 Key: HBASE-2500
>                 URL: https://issues.apache.org/jira/browse/HBASE-2500
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Jonathan Gray
>             Fix For: 0.20.5, 0.21.0
> Currently we are not tracking the heap usage of block indexes.  We're just relying on
the fact that we leave a large percentage of total heap as part of "everything else" not in
memstores or the block cache.  The "everything else" portion should be left for ephemeral/transient
memory usage, not long-lived objects like block indexes.  Introduction of blooms will extend
this issue to meta blocks in general.
> All of this should be moved into an LRU.  Either the existing block cache LRU or a new

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message