hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15995) Separate replication WAL reading from shipping
Date Wed, 08 Feb 2017 00:18:41 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15857088#comment-15857088
] 

Hudson commented on HBASE-15995:
--------------------------------

SUCCESS: Integrated in Jenkins build HBase-Trunk_matrix #2463 (See [https://builds.apache.org/job/HBase-Trunk_matrix/2463/])
HBASE-15995 Separate replication WAL reading from shipping (tedyu: rev c55fce00f3a5757c706ce50ed42980c7f6c4b97b)
* (add) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/ClusterMarkingEntryFilter.java
* (add) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/WALEntryStream.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
* (add) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSourceWALReaderThread.java
* (delete) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationWALReaderManager.java
* (add) hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestWALEntryStream.java
* (delete) hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationWALReaderManager.java


> Separate replication WAL reading from shipping
> ----------------------------------------------
>
>                 Key: HBASE-15995
>                 URL: https://issues.apache.org/jira/browse/HBASE-15995
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Replication
>    Affects Versions: 2.0.0
>            Reporter: Vincent Poon
>            Assignee: Vincent Poon
>             Fix For: 2.0.0
>
>         Attachments: HBASE-15995.master.v1.patch, HBASE-15995.master.v2.patch, HBASE-15995.master.v3.patch,
HBASE-15995.master.v4.patch, HBASE-15995.master.v6.patch, HBASE-15995.master.v7.patch, replicationV1_100ms_delay.png,
replicationV2_100ms_delay.png
>
>
> Currently ReplicationSource reads edits from the WAL and ships them in the same thread.
> By breaking out the reading from the shipping, we can introduce greater parallelism and
lay the foundation for further refactoring to a pipelined, streaming model.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message