hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12988) [Replication]Parallel apply edits on row-level
Date Tue, 30 Jun 2015 17:10:09 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14608676#comment-14608676

Lars Hofhansl commented on HBASE-12988:

The WALKey (formerly HLogKey) also has logSeqNum and writeTime. Right now the sink doesn't
use those.
_But_ if ever we want to use them - for ordering or other guarantees - we cannot disentangle
them from the WALEdits; i.e. we cannot regroup Cell between WALEdits.

So in the end I think that we do the grouping by table or by region (as I have done here)...
or don't do it at all.

[~apurtell], [~hongyu.bi], comments?

> [Replication]Parallel apply edits on row-level
> ----------------------------------------------
>                 Key: HBASE-12988
>                 URL: https://issues.apache.org/jira/browse/HBASE-12988
>             Project: HBase
>          Issue Type: Improvement
>          Components: Replication
>            Reporter: hongyu bi
>            Assignee: Lars Hofhansl
>         Attachments: 12988-v2.txt, 12988-v3.txt, 12988.txt, HBASE-12988-0.98.patch, ParallelReplication-v2.txt
> we can apply  edits to slave cluster in parallel on table-level to speed up replication
> update : per conversation blow , it's better to apply edits on row-level in parallel

This message was sent by Atlassian JIRA

View raw message