hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhan Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-14796) Enhance the Gets in the connector
Date Wed, 23 Dec 2015 19:42:46 GMT

     [ https://issues.apache.org/jira/browse/HBASE-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Zhan Zhang updated HBASE-14796:
    Attachment: HBASE-14976.patch

We have use case where bulkget may consists of thousands of gets. Move BulkGet to executor
side from driver, which will improve the  failure recovery, and potentially improve the performance
as well when the gets number is big.

> Enhance the Gets in the connector
> ---------------------------------
>                 Key: HBASE-14796
>                 URL: https://issues.apache.org/jira/browse/HBASE-14796
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Ted Malaska
>            Assignee: Zhan Zhang
>            Priority: Minor
>         Attachments: HBASE-14976.patch
> Current the Spark-Module Spark SQL implementation gets records from HBase from the driver
if there is something like the following found in the SQL.
> rowkey = 123
> The reason for this original was normal sql will not have many equal operations in a
single where clause.
> Zhan, had brought up too points that have value.
> 1. The SQL may be generated and may have many many equal statements in it so moving the
work to an executor protects the driver from load
> 2. In the correct implementation the drive is connecting to HBase and exceptions may
cause trouble with the Spark application and not just with the a single task execution

This message was sent by Atlassian JIRA

View raw message