hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mubeen Afzal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-13588) ExportSnapshot should checksum data transferred
Date Mon, 04 May 2015 18:44:08 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527038#comment-14527038

Mubeen Afzal commented on HBASE-13588:

[~mbertozzi] I see a similar filechecksum compare prior to exporting snapshot without any
checks on file system. So there is no test where snapshot already exists on target prior to
exporting snapshot. I'm proposing making checksum compare optional with default <false>.
And just logging a warn if those are different when enabled. what do you think?

> ExportSnapshot should checksum data transferred
> -----------------------------------------------
>                 Key: HBASE-13588
>                 URL: https://issues.apache.org/jira/browse/HBASE-13588
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 2.0.0, 1.0.1, 0.98.13
>            Reporter: Mubeen Afzal
>            Assignee: Mubeen Afzal
>         Attachments: HBASE-13588.patch
> We sent quite a bit of data using ExportSnapshot and noticed some corruption.  We use
checksums to verify if we have transferred a particular file but never do any verification
after the file has been transferred.  I propose that we do a checksum upon completing file
transfer and if the checksums do not match up, I propose we fail by throwing an IOException.

This message was sent by Atlassian JIRA

View raw message