hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "binlijin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14323) Encoding rpc payload instead of compression
Date Thu, 27 Aug 2015 08:02:46 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716246#comment-14716246
] 

binlijin commented on HBASE-14323:
----------------------------------

{code}
    int numRow = 1000000;
    int qualifierNum = 10;
    int valueLength = 100;

FastDiffDeltaKeyValueCodec size 30
KeyValueCodec size 84
org.apache.hadoop.hbase.codec.FastDiffDeltaKeyValueCodec encodeTime 3459 decodeTime 2557,
total size 1063000000, avg size 1063
Thu Aug 27 15:56:13 CST 2015 avg encodeTime 3459 ns, avg decodeTime 2557 ns
org.apache.hadoop.hbase.codec.FastDiffDeltaKeyValueCodec encodeTime 3069 decodeTime 2334,
total size 1063000000, avg size 1063

Thu Aug 27 15:56:39 CST 2015 avg encodeTime 3069 ns, avg decodeTime 2334 ns
org.apache.hadoop.hbase.codec.KeyValueCodec encodeTime 1643 decodeTime 1061, total size 1350000000,
avg size 1350
Thu Aug 27 15:57:02 CST 2015 avg encodeTime 1643 ns, avg decodeTime 1061 ns
org.apache.hadoop.hbase.codec.KeyValueCodec encodeTime 1803 decodeTime 1114, total size 1350000000,
avg size 1350
Thu Aug 27 15:57:28 CST 2015 avg encodeTime 1803 ns, avg decodeTime 1114 ns

Compression org.apache.hadoop.hbase.codec.KeyValueCodec encodeTime 81695 decodeTime 16951,
total size 892463832, avg size 892
Thu Aug 27 15:59:41 CST 2015 avg encodeTime 81695 ns, avg decodeTime 16951 ns
Compression org.apache.hadoop.hbase.codec.KeyValueCodec encodeTime 80586 decodeTime 16489,
total size 892467912, avg size 892
Thu Aug 27 16:01:50 CST 2015 avg encodeTime 80586 ns, avg decodeTime 16489 ns
{code}

> Encoding rpc payload instead of compression
> -------------------------------------------
>
>                 Key: HBASE-14323
>                 URL: https://issues.apache.org/jira/browse/HBASE-14323
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: binlijin
>         Attachments: HBASE-14323-test.patch
>
>
> Current HFile block support both encoding and compression, but rpc support only compression
and it is slow. If we add encoding in rpc we can slow a little but may use much less network.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message