hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-12988) [Replication]Parallel apply edits on row-level
Date Sat, 06 Jun 2015 19:58:01 GMT

     [ https://issues.apache.org/jira/browse/HBASE-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Lars Hofhansl updated HBASE-12988:
----------------------------------
    Attachment: 12988.txt

Here's a version that groups by region instead. This should reduce out of order delivery,
but obviously will not eliminate it. Regions will split and the same row may end up in two
different region on the same machine.

Also make sure that we do not send too few edits in an rpc request (minimum hardcoded to 100
for now).

I think this is as good as we can get it, without a major rewrite, and without rewriting all
the waledits at the source side.

> [Replication]Parallel apply edits on row-level
> ----------------------------------------------
>
>                 Key: HBASE-12988
>                 URL: https://issues.apache.org/jira/browse/HBASE-12988
>             Project: HBase
>          Issue Type: Improvement
>          Components: Replication
>            Reporter: hongyu bi
>            Assignee: Lars Hofhansl
>         Attachments: 12988.txt, ParallelReplication-v2.txt
>
>
> we can apply  edits to slave cluster in parallel on table-level to speed up replication
.
> update : per conversation blow , it's better to apply edits on row-level in parallel



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message