hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liyin Tang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-3856) Build a tree structure data block index inside of the HFile
Date Thu, 05 May 2011 17:17:03 GMT
Build a tree structure data block index inside of the HFile
-----------------------------------------------------------

                 Key: HBASE-3856
                 URL: https://issues.apache.org/jira/browse/HBASE-3856
             Project: HBase
          Issue Type: New Feature
            Reporter: Liyin Tang
            Assignee: Liyin Tang


The motivation is the data block index is too large to hold into memory. In our cases, each
region server hold almost 6G block index in the memory. So we propose to build a tree structure
data block index and only hold the root level in the memory. All the intermediate level will
be cached in an LRU cache. In the leaf level, we will write the block index inline inside
of the data section. In this way, there is no need to hold all the block index in the memory.



--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message