hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-12988) [Replication]Parallel apply edits on row-level
Date Tue, 30 Jun 2015 17:12:05 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14608676#comment-14608676
] 

Lars Hofhansl edited comment on HBASE-12988 at 6/30/15 5:11 PM:
----------------------------------------------------------------

The WALKey (formerly HLogKey) also has logSeqNum and writeTime. Right now the sink only uses
the writeTime to update ageOfLastAppliedOp.
If ever we want to use them - for ordering or other guarantees - we cannot disentangle them
from the WALEdits; i.e. we cannot regroup Cell between WALEdits.

So in the end I think that we do the grouping by table or by region (as I have done here)...
or don't do it at all.

[~apurtell], [~hongyu.bi], comments?



was (Author: lhofhansl):
The WALKey (formerly HLogKey) also has logSeqNum and writeTime. Right now the sink doesn't
use those.
_But_ if ever we want to use them - for ordering or other guarantees - we cannot disentangle
them from the WALEdits; i.e. we cannot regroup Cell between WALEdits.

So in the end I think that we do the grouping by table or by region (as I have done here)...
or don't do it at all.

[~apurtell], [~hongyu.bi], comments?


> [Replication]Parallel apply edits on row-level
> ----------------------------------------------
>
>                 Key: HBASE-12988
>                 URL: https://issues.apache.org/jira/browse/HBASE-12988
>             Project: HBase
>          Issue Type: Improvement
>          Components: Replication
>            Reporter: hongyu bi
>            Assignee: Lars Hofhansl
>         Attachments: 12988-v2.txt, 12988-v3.txt, 12988.txt, HBASE-12988-0.98.patch, ParallelReplication-v2.txt
>
>
> we can apply  edits to slave cluster in parallel on table-level to speed up replication
.
> update : per conversation blow , it's better to apply edits on row-level in parallel



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message