hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Pratt (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-8691) High-Throuhput Streaming Scan API
Date Wed, 05 Jun 2013 08:09:20 GMT
Sandy Pratt created HBASE-8691:

             Summary: High-Throuhput Streaming Scan API
                 Key: HBASE-8691
                 URL: https://issues.apache.org/jira/browse/HBASE-8691
             Project: HBase
          Issue Type: Improvement
          Components: Scanners
    Affects Versions: 0.95.0
            Reporter: Sandy Pratt
         Attachments: HRegionServlet.java, README.txt, RecordReceiver.java, ScannerTest.java,
StreamHRegionServer.java, StreamReceiverDirect.java, StreamServletDirect.java

I've done some working testing various ways to refactor and optimize Scans in HBase, and have
found that performance can be dramatically increased by the addition of a streaming scan API.
 The attached code constitutes a proof of concept that shows performance increases of almost
4x in some workloads.

I'd appreciate testing, replication, and comments.  If the approach seems viable, I think
such an API should be built into some future version of HBase.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message