hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11568) Async WAL replication for region replicas
Date Fri, 06 Feb 2015 16:40:35 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309405#comment-14309405
] 

Hudson commented on HBASE-11568:
--------------------------------

FAILURE: Integrated in HBase-1.1 #149 (See [https://builds.apache.org/job/HBase-1.1/149/])
HBASE-11568. Async WAL replication for region replicas (Enis Soztutar) (ddas: rev 055f5a95e46e55412e05892f86fc0e0e2792356c)
* hbase-server/src/main/java/org/apache/hadoop/hbase/util/ServerRegionReplicaUtil.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerNoMaster.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/CreateTableHandler.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALMethods.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCaller.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/ReplicationProtbufUtil.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionReplicas.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
* hbase-common/src/main/resources/hbase-default.xml
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java


> Async WAL replication for region replicas
> -----------------------------------------
>
>                 Key: HBASE-11568
>                 URL: https://issues.apache.org/jira/browse/HBASE-11568
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Enis Soztutar
>            Assignee: Enis Soztutar
>             Fix For: 2.0.0, 1.1.0
>
>         Attachments: 11568-2-branch-1.txt, 11568-branch-1.txt, hbase-11568_v2.patch,
hbase-11568_v3.patch
>
>
> As mentioned in parent issue, and design docs for phase-1 (HBASE-10070) and Phase-2 (HBASE-11183),
implement asynchronous WAL replication from the WAL files of the primary region to the secondary
region replicas. 
> The WAL replication will build upon the pluggable replication framework introduced in
HBASE-11367, and the distributed WAL replay. 
> Upon having some experience with the patch, we changed the design so that there is only
one replication queue for doing the async wal replication to secondary replicas rather than
having a queue per region replica. This is due to the fact that, we do not want to tail the
logs of every region server for a single region replica. 
> Handling of flushes/compactions and memstore accounting will be handled in other subtasks.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message