Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0F55647E1 for ; Wed, 25 May 2011 08:16:52 +0000 (UTC) Received: (qmail 90497 invoked by uid 500); 25 May 2011 08:16:51 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 90444 invoked by uid 500); 25 May 2011 08:16:51 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 90436 invoked by uid 99); 25 May 2011 08:16:51 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 May 2011 08:16:51 +0000 X-ASF-Spam-Status: No, hits=0.6 required=5.0 tests=HTML_IMAGE_ONLY_28,HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of sreehari.g@huawei.com designates 119.145.14.66 as permitted sender) Received: from [119.145.14.66] (HELO szxga03-in.huawei.com) (119.145.14.66) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 May 2011 08:16:46 +0000 Received: from huawei.com (szxga03-in [172.24.2.9]) by szxga03-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTP id <0LLQ001XFRYAB9@szxga03-in.huawei.com> for hdfs-dev@hadoop.apache.org; Wed, 25 May 2011 16:08:34 +0800 (CST) Received: from szxeml202-edg.china.huawei.com ([172.24.2.119]) by szxga03-in.huawei.com (iPlanet Messaging Server 5.2 HotFix 2.14 (built Aug 8 2006)) with ESMTP id <0LLQ00K38RY8T7@szxga03-in.huawei.com> for hdfs-dev@hadoop.apache.org; Wed, 25 May 2011 16:08:34 +0800 (CST) Received: from SZXEML402-HUB.china.huawei.com (10.82.67.32) by szxeml202-edg.china.huawei.com (172.24.2.42) with Microsoft SMTP Server (TLS) id 14.1.270.1; Wed, 25 May 2011 16:08:27 +0800 Received: from blrnshtipl14nc (10.18.1.45) by SZXEML402-HUB.china.huawei.com (10.82.67.32) with Microsoft SMTP Server id 14.1.270.1; Wed, 25 May 2011 16:08:33 +0800 Date: Wed, 25 May 2011 13:38:32 +0530 From: Sreehari G Subject: HDFS-903 - Backupnode always downloading image from Namenode after this change X-Originating-IP: [10.18.1.45] To: hdfs-dev@hadoop.apache.org Reply-to: sreehari.g@huawei.com Message-id: <375E10975AF34C518938CE4407536ABE@china.huawei.com> Organization: Htipl MIME-version: 1.0 X-MIMEOLE: Produced By Microsoft MimeOLE V6.00.3790.4657 X-Mailer: Microsoft Office Outlook 11 Content-type: multipart/related; boundary="Boundary_(ID_Ckm6ZdRVegAA1zQrUb8t1g)" Thread-index: AcwasvAGSGRZ1wnnSfSq+SRQcp6wxA== --Boundary_(ID_Ckm6ZdRVegAA1zQrUb8t1g) Content-type: multipart/alternative; boundary="Boundary_(ID_9sEJbJdNrGN9DjXT+XcJQA)" --Boundary_(ID_9sEJbJdNrGN9DjXT+XcJQA) Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT Hi all , In HDFS-903 - ( md5 verification of fsimage ) , with this change , Backupnode is downloading the image & edit files from namenode everytime since the difference in checkpoint time is always maintined b/w Namenode and Backupnode . This happens since Namenode is resetting its checkpoint time everytime since we are ignoring renewCheckpointTime and passing true explicitly to rollFsimage during endcheckpoint .. Also , though a proposal for using md5 to decide whether to download image is also mentioned , it doesnt seeem to be implemented .. Isn't this downloading of image everytime a problem or am I missing something ? HUAWEI TECHNOLOGIES CO.,LTD. huawei_logo Solitaire Domlur Bangalore www.huawei.com ---------------------------------------------------------------------------- --------------------------------------------------------- This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! --Boundary_(ID_9sEJbJdNrGN9DjXT+XcJQA) Content-type: text/html; charset=us-ascii Content-transfer-encoding: 7BIT
Hi all ,
 
In HDFS-903 - ( md5 verification of fsimage ) , with this change , Backupnode is downloading the image & edit files from namenode everytime since the difference in checkpoint time is always maintined b/w Namenode and Backupnode . This happens since Namenode is resetting its checkpoint time everytime since we are ignoring renewCheckpointTime and passing true explicitly to rollFsimage during endcheckpoint ..
 
Also , though a proposal for using md5 to decide whether to download image is also mentioned , it doesnt seeem to be implemented ..
 
Isn't this downloading of image everytime a problem or am I missing something ?

HUAWEI TECHNOLOGIES CO.,LTD. huawei_logo


Solitaire
Domlur
Bangalore
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
 
--Boundary_(ID_9sEJbJdNrGN9DjXT+XcJQA)-- --Boundary_(ID_Ckm6ZdRVegAA1zQrUb8t1g)--