Return-Path: Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: (qmail 41991 invoked from network); 21 Nov 2010 00:19:05 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 21 Nov 2010 00:19:05 -0000 Received: (qmail 47165 invoked by uid 500); 21 Nov 2010 00:19:37 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 47103 invoked by uid 500); 21 Nov 2010 00:19:36 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 47095 invoked by uid 99); 21 Nov 2010 00:19:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 21 Nov 2010 00:19:36 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 21 Nov 2010 00:19:35 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id oAL0JFVL011791 for ; Sun, 21 Nov 2010 00:19:15 GMT Message-ID: <30056958.217921290298755354.JavaMail.jira@thor> Date: Sat, 20 Nov 2010 19:19:15 -0500 (EST) From: "Konstantin Shvachko (JIRA)" To: hdfs-issues@hadoop.apache.org Subject: [jira] Commented: (HDFS-1481) NameNode should validate fsimage before rolling In-Reply-To: <30428442.92061288141220289.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934211#action_12934211 ] Konstantin Shvachko commented on HDFS-1481: ------------------------------------------- Looks like you are right. The new image checksum is verified against the one in the signature after the image is loaded from disk. So my suggestion would be an optimization for failing faster, but it is optional. +1 the patch looks good. It would be good to remove the unused import of InetAddress in Checkpointer. > NameNode should validate fsimage before rolling > ----------------------------------------------- > > Key: HDFS-1481 > URL: https://issues.apache.org/jira/browse/HDFS-1481 > Project: Hadoop HDFS > Issue Type: Improvement > Components: name-node > Affects Versions: 0.22.0 > Reporter: Hairong Kuang > Assignee: Hairong Kuang > Fix For: 0.22.0 > > Attachments: trunkValidateUpload.patch > > > We had an incident that the fsimage at secondary NameNode was truncated but got uploaded to the primary NameNode. The primary NameNode simply rolled the image without checking its integrity, therefore causing the fsimage to corrupt. The primary NameNode should check the new image's integrity before rolling fsimage. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.