hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jay Booth (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-516) Low Latency distributed reads
Date Fri, 31 Jul 2009 20:54:14 GMT
Low Latency distributed reads

                 Key: HDFS-516
                 URL: https://issues.apache.org/jira/browse/HDFS-516
             Project: Hadoop HDFS
          Issue Type: New Feature
            Reporter: Jay Booth
            Priority: Minor

I created a method for low latency random reads using NIO on the server side and simulated
OS paging with LRU caching and lookahead on the client side.  Some applications could include
lucene searching (term->doc and doc->offset mappings are likely to be in local cache,
thus much faster than nutch's current FsDirectory impl and binary search through record files
(bytes at 1/2, 1/4, 1/8 marks are likely to be cached)

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message