tephra-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Xiaoman Huang (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Deleted] (TEPHRA-246) Implement better transaction codecs
Date Tue, 09 Jan 2018 08:51:00 GMT

     [ https://issues.apache.org/jira/browse/TEPHRA-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Patrick Xiaoman Huang updated TEPHRA-246:
    Comment: was deleted

(was: Maybe we can try TCompactProtocol first.
Default TBinaryProtocol write long with 8byte, and TCompactProtocol transform i64 to zigzag
int, then write with 10byte var int.)

> Implement better transaction codecs
> -----------------------------------
>                 Key: TEPHRA-246
>                 URL: https://issues.apache.org/jira/browse/TEPHRA-246
>             Project: Tephra
>          Issue Type: Improvement
>          Components: core, manager
>    Affects Versions: 0.12.0-incubating
>            Reporter: Andreas Neumann
>            Assignee: Andreas Neumann
> The current codec simply uses Thrift. However, with large invalid lists, the encoded
byte array cvan become very large, Using compression techniques such as delta encoding, variable
length integer encoding, or simple compression can greatly reduce the size of the encoded
byte array, as well as the time it takes to encode, transmit, and decode the transaction.

> This can be applied to the transactions in the Thrift protocol as well as to the transactions
that are attached to the HBase operations. 

This message was sent by Atlassian JIRA

View raw message