Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4717F981C for ; Mon, 28 Nov 2011 02:39:05 +0000 (UTC) Received: (qmail 39815 invoked by uid 500); 28 Nov 2011 02:39:05 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 39756 invoked by uid 500); 28 Nov 2011 02:39:05 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 39739 invoked by uid 99); 28 Nov 2011 02:39:04 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Nov 2011 02:39:04 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Nov 2011 02:39:02 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 48E39A3A5A for ; Mon, 28 Nov 2011 02:38:41 +0000 (UTC) Date: Mon, 28 Nov 2011 02:38:41 +0000 (UTC) From: "Todd Lipcon (Updated) (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <513639414.15967.1322447921315.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <917270487.30946.1305909047543.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HDFS-1971) HA: Send block report from datanode to both active and standby namenodes MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HDFS-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1971: ------------------------------ Attachment: dualbr5.txt This patch just has a few small cleanups from dualbr4.patch. It still leaves the refreshNamenodes bit TODO, and adds a few more TODOs where we have to sort out what to do in terms of HA. I think it's worth committing this now, even with the TODOs, so we can address the TODOs in parallel. It will unblock other work and allow us to start figuring out more subtle issues. I can file follow-up JIRAs for each of the TODOs when this is committed. I've been testing this patch on top of HDFS-2582 and HDFS-2591 in that order, though I think it only strictly depends on HDFS-2582 > HA: Send block report from datanode to both active and standby namenodes > ------------------------------------------------------------------------ > > Key: HDFS-1971 > URL: https://issues.apache.org/jira/browse/HDFS-1971 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: data-node, name-node > Reporter: Suresh Srinivas > Assignee: Sanjay Radia > Attachments: DualBlockReports.pdf, daulBr1.patch, dualBr2.patch, dualBr3.patch, dualbr4.txt, dualbr5.txt > > > To enable hot standby namenode, the standby node must have current information for - namenode state (image + edits) and block location information. This jira addresses keeping the block location information current in the standby node. To do this, the proposed solution is to send block reports from the datanodes to both the active and the standby namenode. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira