hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karan Mehta (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-18097) Save bandwidth on partial_flag_per_result in ScanResponse proto
Date Wed, 31 May 2017 17:26:04 GMT

     [ https://issues.apache.org/jira/browse/HBASE-18097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Karan Mehta updated HBASE-18097:
--------------------------------
    Description: 
Currently the {{ScanResponse}} proto sends out 1 bit per {{Result}} that it has embeds inside
the {{CellScanner}} to indicate if it is partial or not. 
{code}
    // In every RPC response there should be at most a single partial result. Furthermore,
if
    // there is a partial result, it is guaranteed to be in the last position of the array.
{code}
According to client, only the last result can be partial, thus this repeated bool can be converted
to a bool, thus reducing overhead of serialization and deserialization of the array. This
will break wire compatibility therefore this is something to look for in upcoming versions.

  was:
Starting version 1.3, HBase automatically closes scanner on server side whenever the results
are exhausted and corresponding bits are set in the {{ScanResponse}} proto returned to the
client. We can use that info to eliminate the closeScanRequest RPC call, thereby saving 1
RPC per region per scan. This can be particularly useful for tables with more regions.

Also, currently the {{ScanResponse}} proto sends out 1 bit per {{Result}} that it has embeds
inside the {{CellScanner}} to indicate if it is partial or not. 
{code}
    // In every RPC response there should be at most a single partial result. Furthermore,
if
    // there is a partial result, it is guaranteed to be in the last position of the array.
{code}
According to client, only the last result can be partial, thus this repeated bool can be converted
to a bool, thus reducing overhead of serialization and deserialization of the array. This
will break wire compatibility therefore this is something to look for in upcoming versions.


> Save bandwidth on partial_flag_per_result in ScanResponse proto
> ---------------------------------------------------------------
>
>                 Key: HBASE-18097
>                 URL: https://issues.apache.org/jira/browse/HBASE-18097
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 1.3.2
>            Reporter: Karan Mehta
>
> Currently the {{ScanResponse}} proto sends out 1 bit per {{Result}} that it has embeds
inside the {{CellScanner}} to indicate if it is partial or not. 
> {code}
>     // In every RPC response there should be at most a single partial result. Furthermore,
if
>     // there is a partial result, it is guaranteed to be in the last position of the
array.
> {code}
> According to client, only the last result can be partial, thus this repeated bool can
be converted to a bool, thus reducing overhead of serialization and deserialization of the
array. This will break wire compatibility therefore this is something to look for in upcoming
versions.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message