hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11367) Pluggable replication endpoint
Date Tue, 15 Jul 2014 02:06:06 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061546#comment-14061546
] 

Hudson commented on HBASE-11367:
--------------------------------

FAILURE: Integrated in HBase-1.0 #41 (See [https://builds.apache.org/job/HBase-1.0/41/])
HBASE-11367 Pluggable replication endpoint (enis: rev c76b528b6d5248ceb0ba06aa0238187ef24e5599)
* hbase-common/src/main/java/org/apache/hadoop/hbase/HBaseInterfaceAudience.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/ReplicationEndpoint.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationStateBasic.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/master/ReplicationLogCleaner.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/SystemTableWALEntryFilter.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/replication/ReplicationSourceDummy.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSinkManager.java
* hbase-protocol/src/main/protobuf/ZooKeeper.proto
* hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestPerTableCFReplication.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/TableCfWALEntryFilter.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/replication/VerifyReplication.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/replication/ReplicationPeers.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLog.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/ChainWALEntryFilter.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/replication/ReplicationPeerZKImpl.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/HBaseInterClusterReplicationEndpoint.java
* hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSourceInterface.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/replication/ReplicationPeersZKImpl.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWALEntryFilters.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/replication/ReplicationPeerConfig.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogKey.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/ScopeWALEntryFilter.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSourceManager.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKClusterId.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/client/replication/TestReplicationAdmin.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationTrackerZKImpl.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/BaseReplicationEndpoint.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/replication/ReplicationPeer.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/WALEntryFilter.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSinkManager.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALEdit.java


> Pluggable replication endpoint
> ------------------------------
>
>                 Key: HBASE-11367
>                 URL: https://issues.apache.org/jira/browse/HBASE-11367
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Enis Soztutar
>            Assignee: Enis Soztutar
>            Priority: Blocker
>             Fix For: 0.99.0, 2.0.0
>
>         Attachments: 0001-11367.patch, hbase-11367_v1.patch, hbase-11367_v2.patch, hbase-11367_v3.patch,
hbase-11367_v4.patch, hbase-11367_v4.patch, hbase-11367_v5.patch
>
>
> We need a pluggable endpoint for replication for more flexibility. See parent jira for
more context. 
> ReplicationSource tails the logs for each peer. This jira introduces ReplicationEndpoint
which is customizable per peer. ReplicationEndpoint is run in the same RS process and instantiated
per replication peer per region server. Implementations of this interface handle the actual
shipping of WAL edits to the remote cluster. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message