hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8737) [replication] Change replication RPC to use cell blocks
Date Mon, 01 Jul 2013 23:06:21 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13697299#comment-13697299
] 

stack commented on HBASE-8737:
------------------------------

bq. ...but when do we not get that and can we make any assumptions about the size of the data?

Could look at first few and come up w/ some heuristics... 

bq. I may be trying to generalize too much though 

Maybe (smile).

Or rather, for another issue.  This one is about getting replication up on cellblocks.

As is, we'll spew if lots of resizing.  Current option would be to up the default buffer size...
or work on some heuristic.... for later I'd say?

Any chance of a +1?

Good on you Jesse.
                
> [replication] Change replication RPC to use cell blocks
> -------------------------------------------------------
>
>                 Key: HBASE-8737
>                 URL: https://issues.apache.org/jira/browse/HBASE-8737
>             Project: HBase
>          Issue Type: Improvement
>          Components: Replication
>            Reporter: Chris Trezzo
>            Assignee: stack
>            Priority: Critical
>             Fix For: 0.98.0, 0.95.2
>
>         Attachments: 0001-HBASE-8737-replication-Change-replication-RPC-to-use.patch,
8737.txt, 8737v3.txt, 8737v4.txt, 8737v5.txt
>
>
> Currently, the replication rpc that ships edits simply dumps the byte value of WAL edit
key/value pairs into a protobuf message.
> Modify the replication rpc mechanism to use cell blocks so it can leverage encoding and
compression.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message