hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15995) Separate replication WAL reading from shipping
Date Thu, 26 Jan 2017 19:09:24 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840239#comment-15840239

Andrew Purtell commented on HBASE-15995:

I think review on this is settling down. There might be more comment, but we are pretty far

if you'd be so inclined [~vincentpoon] would you consider putting up a patch also for branch-1?

Also, I would be interested in how you generated those network activity graphs for when I
go to reproduce your results locally. 

> Separate replication WAL reading from shipping
> ----------------------------------------------
>                 Key: HBASE-15995
>                 URL: https://issues.apache.org/jira/browse/HBASE-15995
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Replication
>    Affects Versions: 2.0.0
>            Reporter: Vincent Poon
>            Assignee: Vincent Poon
>             Fix For: 2.0.0
>         Attachments: HBASE-15995.master.v1.patch, HBASE-15995.master.v2.patch, HBASE-15995.master.v3.patch,
HBASE-15995.master.v4.patch, HBASE-15995.master.v6.patch, replicationV1_100ms_delay.png, replicationV2_100ms_delay.png
> Currently ReplicationSource reads edits from the WAL and ships them in the same thread.
> By breaking out the reading from the shipping, we can introduce greater parallelism and
lay the foundation for further refactoring to a pipelined, streaming model.

This message was sent by Atlassian JIRA

View raw message