Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3E2BE7A49 for ; Tue, 29 Nov 2011 22:32:06 +0000 (UTC) Received: (qmail 25940 invoked by uid 500); 29 Nov 2011 22:32:06 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 25906 invoked by uid 500); 29 Nov 2011 22:32:06 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 25896 invoked by uid 99); 29 Nov 2011 22:32:06 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Nov 2011 22:32:06 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Nov 2011 22:32:01 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 683B5A748D for ; Tue, 29 Nov 2011 22:31:41 +0000 (UTC) Date: Tue, 29 Nov 2011 22:31:41 +0000 (UTC) From: "Todd Lipcon (Commented) (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <1478802487.23547.1322605901428.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <917270487.30946.1305909047543.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HDFS-1971) HA: Send block report from datanode to both active and standby namenodes MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159589#comment-13159589 ] Todd Lipcon commented on HDFS-1971: ----------------------------------- I'll file a separate JIRA for #1 above. Let me look into why I made that change with regard to #2 Regarding #3, the reasoning was that we used to grab references to a specific DatanodeProtocol proxy in BlockReceiver#verifyChunks. Now, we need to report that bad block to both NNs. So, it made more sense to add this new method to DataNode to pass the bad block info through to the correct BPOS, matching what we do for blockReceived, etc. > HA: Send block report from datanode to both active and standby namenodes > ------------------------------------------------------------------------ > > Key: HDFS-1971 > URL: https://issues.apache.org/jira/browse/HDFS-1971 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: data-node, name-node > Reporter: Suresh Srinivas > Assignee: Sanjay Radia > Attachments: DualBlockReports.pdf, daulBr1.patch, dualBr2.patch, dualBr3.patch, dualbr4.txt, dualbr5.txt > > > To enable hot standby namenode, the standby node must have current information for - namenode state (image + edits) and block location information. This jira addresses keeping the block location information current in the standby node. To do this, the proposed solution is to send block reports from the datanodes to both the active and the standby namenode. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira