hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17290) Potential loss of data for replication of bulk loaded hfiles
Date Wed, 11 Oct 2017 00:40:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16199624#comment-16199624
] 

Hudson commented on HBASE-17290:
--------------------------------

FAILURE: Integrated in Jenkins build HBase-1.3-JDK7 #302 (See [https://builds.apache.org/job/HBase-1.3-JDK7/302/])
HBASE-18900 Backport HBASE-17290 - revert due to incompatibility (tedyu: rev ccf9b85d040e9028bcab0d49321be104d67fc76e)
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSourceInterface.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestReplicationHFileCleaner.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/replication/ReplicationQueues.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/replication/ReplicationSourceDummy.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/HFileReplicator.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/Replication.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationStateBasic.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
* (delete) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationObserver.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/replication/ReplicationQueuesZKImpl.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSourceManager.java


> Potential loss of data for replication of bulk loaded hfiles
> ------------------------------------------------------------
>
>                 Key: HBASE-17290
>                 URL: https://issues.apache.org/jira/browse/HBASE-17290
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 1.3.0
>            Reporter: Ted Yu
>            Assignee: Ashish Singhi
>              Labels: replication
>             Fix For: 2.0.0, 1.4.0
>
>         Attachments: HBASE-17290.branch-1.patch, HBASE-17290.patch, HBASE-17290.v1.patch
>
>
> Currently the support for replication of bulk loaded hfiles relies on bulk load marker
written in the WAL.
> The move of bulk loaded hfile(s) (into region directory) may succeed but the write of
bulk load marker may fail.
> This means that although bulk loaded hfile is being served in source cluster, the replication
wouldn't happen.
> Normally operator is supposed to retry the bulk load. But relying on human retry is not
robust solution.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message