hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-1800) Extend image checksumming to function with multiple fsimage files
Date Thu, 07 Apr 2011 21:55:05 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13017173#comment-13017173
] 

Todd Lipcon commented on HDFS-1800:
-----------------------------------

bq. Could we put checksum as part of the image file name?

That seems a little strange/hackish to me. What would you see the advantage of this to be
over the option "1" above?

bq. If the md5 file not present (because upgrade), just keep going skipping the md5 check,
logging a warn? Your code doesn't seem to do this currently

Right, we should do something like that. I added the TODO since it will need verification
and a test for that case.


> Extend image checksumming to function with multiple fsimage files
> -----------------------------------------------------------------
>
>                 Key: HDFS-1800
>                 URL: https://issues.apache.org/jira/browse/HDFS-1800
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: name-node
>    Affects Versions: Edit log branch (HDFS-1073)
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: Edit log branch (HDFS-1073)
>
>         Attachments: hdfs-1800-prelim.txt
>
>
> HDFS-903 added the MD5 checksum of the fsimage to the VERSION file in each image directory.
This allows it to verify that the FSImage didn't get corrupted or accidentally replaced on
disk.
> With HDFS-1073, there may be multiple fsimage_N files in a storage directory corresponding
to different checkpoints. So having a single MD5 in the VERSION file won't suffice. Instead
we need to store an MD5 per image file.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message