hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jim Kellerman (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-1398) Add in-memory caching of data
Date Mon, 21 May 2007 18:28:16 GMT
Add in-memory caching of data

                 Key: HADOOP-1398
                 URL: https://issues.apache.org/jira/browse/HADOOP-1398
             Project: Hadoop
          Issue Type: New Feature
          Components: contrib/hbase
            Reporter: Jim Kellerman
            Priority: Minor

Bigtable provides two in-memory caches: one for row/column data and one for disk block caches.

The size of each cache should be configurable, data should be loaded lazily, and the cache
managed by an LRU mechanism.

One complication of the block cache is that all data is read through a SequenceFile.Reader
which ultimately reads data off of disk via a RPC proxy for ClientProtocol. This would imply
that the block caching would have to be pushed down to either the DFSClient or SequenceFile.Reader

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message