hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jim Kellerman (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-1398) Add in-memory caching of data
Date Mon, 21 May 2007 18:28:16 GMT
Add in-memory caching of data
-----------------------------

                 Key: HADOOP-1398
                 URL: https://issues.apache.org/jira/browse/HADOOP-1398
             Project: Hadoop
          Issue Type: New Feature
          Components: contrib/hbase
            Reporter: Jim Kellerman
            Priority: Minor


Bigtable provides two in-memory caches: one for row/column data and one for disk block caches.

The size of each cache should be configurable, data should be loaded lazily, and the cache
managed by an LRU mechanism.

One complication of the block cache is that all data is read through a SequenceFile.Reader
which ultimately reads data off of disk via a RPC proxy for ClientProtocol. This would imply
that the block caching would have to be pushed down to either the DFSClient or SequenceFile.Reader


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message