hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15425) Failing to write bulk load event marker in the WAL is ignored
Date Thu, 10 Mar 2016 03:04:40 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15188575#comment-15188575
] 

Anoop Sam John commented on HBASE-15425:
----------------------------------------

bq.For region replicas, missing a flush file or bulk load files is not a critical condition
(since eventually they will be picked up due to compactions)
Regarding the bulk load markers, that is not for Region replicas.. It is for replication across
cluster.  These wal marker cells also will be passed via the Replication path and the sink
cluster will read the cell and do load the file there also..  So a miss in writing this cell
to WAL while bulk load will result in all these bulk loaded data not getting available for
peer cluster. (And no time later also it can get available)

But ya what ur point of retry and loading the file again !  Need to see any impact.  So these
2 files will have diff seqIds?

> Failing to write bulk load event marker in the WAL is ignored
> -------------------------------------------------------------
>
>                 Key: HBASE-15425
>                 URL: https://issues.apache.org/jira/browse/HBASE-15425
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 1.3.0
>            Reporter: Ashish Singhi
>            Assignee: Ashish Singhi
>             Fix For: 2.0.0
>
>         Attachments: HBASE-15425.patch, HBASE-15425.v1.patch
>
>
> During LoadIncrementalHFiles process if we fail to write the bulk load event marker in
the WAL, it is ignored. So this will lead to data mismatch issue in source and peer cluster
in case of bulk loaded data replication scenario.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message