hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Ranganathan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-6874) Implement prefetching for scanners
Date Tue, 25 Sep 2012 00:34:07 GMT
Karthik Ranganathan created HBASE-6874:
------------------------------------------

             Summary: Implement prefetching for scanners
                 Key: HBASE-6874
                 URL: https://issues.apache.org/jira/browse/HBASE-6874
             Project: HBase
          Issue Type: Improvement
            Reporter: Karthik Ranganathan
            Assignee: Karthik Ranganathan


I did some quick experiments by scanning data that should be completely in memory and found
that adding pre-fetching increases the throughput by about 50% from 26MB/s to 39MB/s.

The idea is to perform the next in a background thread, and keep the result ready. When the
scanner's next comes in, return the pre-computed result and issue another background read.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message