Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 65468 invoked from network); 13 Apr 2008 07:16:03 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 13 Apr 2008 07:16:03 -0000 Received: (qmail 51290 invoked by uid 500); 13 Apr 2008 07:16:02 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 51266 invoked by uid 500); 13 Apr 2008 07:16:02 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 51257 invoked by uid 99); 13 Apr 2008 07:16:02 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 13 Apr 2008 00:16:02 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 13 Apr 2008 07:15:28 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 23578234C0C1 for ; Sun, 13 Apr 2008 00:13:06 -0700 (PDT) Message-ID: <1123975569.1208070786143.JavaMail.jira@brutus> Date: Sun, 13 Apr 2008 00:13:06 -0700 (PDT) From: "dhruba borthakur (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-3201) namenode should be able to retrieve block metadata from a datanode In-Reply-To: <444030845.1207592124238.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-3201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12588370#action_12588370 ] dhruba borthakur commented on HADOOP-3201: ------------------------------------------ I like the idea of HreatbeatResponse. But it would be better if we change the name to HeartbeatResponse. > namenode should be able to retrieve block metadata from a datanode > ------------------------------------------------------------------ > > Key: HADOOP-3201 > URL: https://issues.apache.org/jira/browse/HADOOP-3201 > Project: Hadoop Core > Issue Type: New Feature > Components: dfs > Reporter: dhruba borthakur > Assignee: Tsz Wo (Nicholas), SZE > > The Append design (HADOOP-1700) requires that the namenode be able to contact the datanode when a lease expires. > When a lease expires, the namenode has to fix up the size of the last block of the file that was being written to. The namenode contacts the datanodes, retrieves the block generation stamp and the length of the lastblock of all known replicas, determines which replicas are good and which one are to be deleted, stamps the winning replicas with a new generation stamp and deletes losing replicas. Once this process is complete, the namenode can allow a new writer to append to this file. Details of this design are in HADOOP-1700. > A few options available to us: > 1. The namenode sends the request as a response to the next heartbeat RPC from the datanode. This methodology is currently used for requesting block reports from datanodes. > 2. The datanode has an RPC server. A pool of threads in the namenode can be used to make RPCs to the datanodes. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.