Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B364A8AA0 for ; Mon, 22 Aug 2011 22:20:51 +0000 (UTC) Received: (qmail 74258 invoked by uid 500); 22 Aug 2011 22:20:51 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 74186 invoked by uid 500); 22 Aug 2011 22:20:50 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 74176 invoked by uid 99); 22 Aug 2011 22:20:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Aug 2011 22:20:50 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Aug 2011 22:20:49 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 775FCCAB44 for ; Mon, 22 Aug 2011 22:20:29 +0000 (UTC) Date: Mon, 22 Aug 2011 22:20:29 +0000 (UTC) From: "Sanjay Radia (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <1763072758.3107.1314051629485.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <917270487.30946.1305909047543.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HDFS-1971) HA: Send block report from datanode to both active and standby namenodes MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089075#comment-13089075 ] Sanjay Radia commented on HDFS-1971: ------------------------------------ @Uma descries a situation where the standby sends a command to DN when it receives a block info for a file under-construction before reading the the editsLog from the active NN for that file. The design posted in HDFS-1623 requires that the DN accepts commands only from the Active. Further the NN in standby state will not issue commands to any DN. However your scenario is a good one: a standby processing BRs from DNs and edits from Active NN may get them out of order. This scenario applies to HDFS-9175 that reads from a shared editsLog file system and also for Backup NN. > HA: Send block report from datanode to both active and standby namenodes > ------------------------------------------------------------------------ > > Key: HDFS-1971 > URL: https://issues.apache.org/jira/browse/HDFS-1971 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: data-node, name-node > Reporter: Suresh Srinivas > Assignee: Sanjay Radia > Attachments: DualBlockReports.pdf > > > To enable hot standby namenode, the standby node must have current information for - namenode state (image + edits) and block location information. This jira addresses keeping the block location information current in the standby node. To do this, the proposed solution is to send block reports from the datanodes to both the active and the standby namenode. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira