hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "binlijin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14323) Encoding rpc payload instead of compression
Date Thu, 27 Aug 2015 07:54:45 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716237#comment-14716237
] 

binlijin commented on HBASE-14323:
----------------------------------

'''
    int numRow = 1000000;  
   int qualifierNum = 10;
    int valueLength = 10;
FastDiffDeltaKeyValueCodec size 30
KeyValueCodec size 84
org.apache.hadoop.hbase.codec.FastDiffDeltaKeyValueCodec encodeTime 3457 decodeTime 2794,
total size 163000000, avg size 163
Thu Aug 27 15:47:24 CST 2015 avg encodeTime 3457 ns, avg decodeTime 2794 ns
org.apache.hadoop.hbase.codec.FastDiffDeltaKeyValueCodec encodeTime 2827 decodeTime 2488,
total size 163000000, avg size 163
Thu Aug 27 15:47:34 CST 2015 avg encodeTime 2827 ns, avg decodeTime 2488 ns

org.apache.hadoop.hbase.codec.KeyValueCodec encodeTime 1105 decodeTime 943, total size 450000000,
avg size 450
Thu Aug 27 15:47:41 CST 2015 avg encodeTime 1105 ns, avg decodeTime 943 ns
org.apache.hadoop.hbase.codec.KeyValueCodec encodeTime 1069 decodeTime 873, total size 450000000,
avg size 450
Thu Aug 27 15:47:48 CST 2015 avg encodeTime 1069 ns, avg decodeTime 873 ns

Compression org.apache.hadoop.hbase.codec.KeyValueCodec encodeTime 61465 decodeTime 6097,
total size 196333884, avg size 196
Thu Aug 27 15:49:14 CST 2015 avg encodeTime 61465 ns, avg decodeTime 6097 ns
Compression org.apache.hadoop.hbase.codec.KeyValueCodec encodeTime 59453 decodeTime 5779,
total size 196334653, avg size 196
Thu Aug 27 15:50:36 CST 2015 avg encodeTime 59453 ns, avg decodeTime 5779 ns
'''


> Encoding rpc payload instead of compression
> -------------------------------------------
>
>                 Key: HBASE-14323
>                 URL: https://issues.apache.org/jira/browse/HBASE-14323
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: binlijin
>         Attachments: HBASE-14323-test.patch
>
>
> Current HFile block support both encoding and compression, but rpc support only compression
and it is slow. If we add encoding in rpc we can slow a little but may use much less network.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message