Return-Path: Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: (qmail 75293 invoked from network); 2 Nov 2010 04:17:16 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 2 Nov 2010 04:17:16 -0000 Received: (qmail 42150 invoked by uid 500); 2 Nov 2010 04:17:47 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 42049 invoked by uid 500); 2 Nov 2010 04:17:47 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 42041 invoked by uid 99); 2 Nov 2010 04:17:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Nov 2010 04:17:46 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Nov 2010 04:17:46 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id oA24HQK3022578 for ; Tue, 2 Nov 2010 04:17:26 GMT Message-ID: <12365988.188381288671446048.JavaMail.jira@thor> Date: Tue, 2 Nov 2010 00:17:26 -0400 (EDT) From: "Lu Yilei (JIRA)" To: hdfs-issues@hadoop.apache.org Subject: [jira] Commented: (HDFS-1458) Improve checkpoint performance by avoiding unnecessary image downloads In-Reply-To: <21059483.148671287087753584.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927292#action_12927292 ] Lu Yilei commented on HDFS-1458: -------------------------------- To Hairong. Thanks your good idea. 1. We can generate a UUID when SNN save fsimage. And we can add new fields for the UUID. If the UUID of the NameNode is equal the UUID of the SNN, we can't download the fsimage of NameNode. 2. Can checksum be returned with rollEditLog? Yes. > Improve checkpoint performance by avoiding unnecessary image downloads > ---------------------------------------------------------------------- > > Key: HDFS-1458 > URL: https://issues.apache.org/jira/browse/HDFS-1458 > Project: Hadoop HDFS > Issue Type: Improvement > Components: name-node > Affects Versions: 0.22.0 > Reporter: Hairong Kuang > Assignee: Hairong Kuang > Fix For: 0.22.0 > > Attachments: checkpoint-checkfsimageissame.patch > > > If secondary namenode could verify that the image it has on its disk is the same as the one in the primary NameNode, it could skip downloading the image from the primary NN, thus completely eliminating the image download overhead. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.