Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hadoop-dev@lucene.apache.org
Message-ID: <28911305.1179772096114.JavaMail.jira@brutus>
Date: Mon, 21 May 2007 11:28:16 -0700 (PDT)
From: "Jim Kellerman (JIRA)" <jira@apache.org>
To: hadoop-dev@lucene.apache.org
Subject: [jira] Created: (HADOOP-1398) Add in-memory caching of data
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Add in-memory caching of data
-----------------------------

                 Key: HADOOP-1398
                 URL: https://issues.apache.org/jira/browse/HADOOP-1398
             Project: Hadoop
          Issue Type: New Feature
          Components: contrib/hbase
            Reporter: Jim Kellerman
            Priority: Minor


Bigtable provides two in-memory caches: one for row/column data and one for disk block caches.

The size of each cache should be configurable, data should be loaded lazily, and the cache managed by an LRU mechanism.

One complication of the block cache is that all data is read through a SequenceFile.Reader which ultimately reads data off of disk via a RPC proxy for ClientProtocol. This would imply that the block caching would have to be pushed down to either the DFSClient or SequenceFile.Reader


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.