hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17543) Create additional ReplicationEndpoint WALEntryFilters by configuration
Date Tue, 31 Jan 2017 23:47:52 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847732#comment-15847732

Hudson commented on HBASE-17543:

SUCCESS: Integrated in Jenkins build HBase-Trunk_matrix #2421 (See [https://builds.apache.org/job/HBase-Trunk_matrix/2421/])
HBASE-17543 - Create additional ReplicationEndpoint WALEntryFilters by (tedyu: rev 5ebaadf1a6d8388f3c5633fb76ecfc8c0adc2da2)
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/replication/ReplicationManager.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/BaseReplicationEndpoint.java

> Create additional ReplicationEndpoint WALEntryFilters by configuration
> ----------------------------------------------------------------------
>                 Key: HBASE-17543
>                 URL: https://issues.apache.org/jira/browse/HBASE-17543
>             Project: HBase
>          Issue Type: Improvement
>          Components: Replication
>            Reporter: Geoffrey Jacoby
>            Assignee: Geoffrey Jacoby
>             Fix For: 2.0.0, 1.4.0
>         Attachments: HBASE-17543-branch-1.patch, HBASE-17543.patch, HBASE-17543.v2.patch,
> The existing BaseReplicationEndpoint creates a ChainWALEntryFilter containing a NamespaceTableCfWALEntryFilter
and a ScopeWALEntryFilter. Adding a custom WALEntryFilter type to this chain requires creating
an entirely new ReplicationEndpoint subclass and creating a new peer on the running cluster,
which can be operationally complex to transition to without data loss in cases such as master/master.
> For WALEntryFilters without constructor parameters, it would be straightforward to have
a Configuration option to list additional WALEntryFilter classes the operator wants to include
in the filter chain in the default endpoint, and then have the endpoint instantiate the filters
via reflection. Then filter logic could be added (or removed) with only a hbase-site.xml change
and a rolling restart. 

This message was sent by Atlassian JIRA

View raw message