From hdfs-issues-return-16548-apmail-hadoop-hdfs-issues-archive=hadoop.apache.org@hadoop.apache.org Fri Apr 01 21:07:46 2011 Return-Path: Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: (qmail 45694 invoked from network); 1 Apr 2011 21:07:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 1 Apr 2011 21:07:46 -0000 Received: (qmail 65458 invoked by uid 500); 1 Apr 2011 21:07:46 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 65415 invoked by uid 500); 1 Apr 2011 21:07:46 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 65407 invoked by uid 99); 1 Apr 2011 21:07:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 21:07:46 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 21:07:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id CB4728E9A7 for ; Fri, 1 Apr 2011 21:07:05 +0000 (UTC) Date: Fri, 1 Apr 2011 21:07:05 +0000 (UTC) From: "Todd Lipcon (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <253034534.29463.1301692025829.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <358551071.29457.1301691906126.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HDFS-1800) Extend image checksumming to function with multiple fsimage files MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HDFS-1800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1800: ------------------------------ Component/s: name-node Description: HDFS-903 added the MD5 checksum of the fsimage to the VERSION file in each image directory. This allows it to verify that the FSImage didn't get corrupted or accidentally replaced on disk. With HDFS-1073, there may be multiple fsimage_N files in a storage directory corresponding to different checkpoints. So having a single MD5 in the VERSION file won't suffice. Instead we need to store an MD5 per image file. Affects Version/s: Edit log branch (HDFS-1073) Fix Version/s: Edit log branch (HDFS-1073) > Extend image checksumming to function with multiple fsimage files > ----------------------------------------------------------------- > > Key: HDFS-1800 > URL: https://issues.apache.org/jira/browse/HDFS-1800 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: name-node > Affects Versions: Edit log branch (HDFS-1073) > Reporter: Todd Lipcon > Assignee: Todd Lipcon > Fix For: Edit log branch (HDFS-1073) > > > HDFS-903 added the MD5 checksum of the fsimage to the VERSION file in each image directory. This allows it to verify that the FSImage didn't get corrupted or accidentally replaced on disk. > With HDFS-1073, there may be multiple fsimage_N files in a storage directory corresponding to different checkpoints. So having a single MD5 in the VERSION file won't suffice. Instead we need to store an MD5 per image file. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira