Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 94074 invoked from network); 12 May 2009 19:03:09 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 12 May 2009 19:03:09 -0000 Received: (qmail 38248 invoked by uid 500); 12 May 2009 19:03:08 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 38154 invoked by uid 500); 12 May 2009 19:03:08 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 38134 invoked by uid 99); 12 May 2009 19:03:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 May 2009 19:03:08 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 May 2009 19:03:06 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id E8275234C4AE for ; Tue, 12 May 2009 12:02:45 -0700 (PDT) Message-ID: <1943470543.1242154965950.JavaMail.jira@brutus> Date: Tue, 12 May 2009 12:02:45 -0700 (PDT) From: "Raghu Angadi (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-5724) Datanode should report deletion of blocks to Namenode explicitly In-Reply-To: <528602147.1240435247660.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-5724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12708572#action_12708572 ] Raghu Angadi commented on HADOOP-5724: -------------------------------------- Also, if NN indeed deleted the blocks when the files are deleted, there is not much motivation/need for this jira. > Datanode should report deletion of blocks to Namenode explicitly > ---------------------------------------------------------------- > > Key: HADOOP-5724 > URL: https://issues.apache.org/jira/browse/HADOOP-5724 > Project: Hadoop Core > Issue Type: Bug > Reporter: Suresh Srinivas > Assignee: Suresh Srinivas > Fix For: 0.21.0 > > Attachments: blockdel.patch, blockdel.patch > > > Currently datanode notifies namenode newly added blocks and the blocks that are corrupt. There is no explicit message from the datanode to the namenode to indicate the deletion of blocks. Block reports from the datanode is the only way for the namenode to learn about the deletion of blocks at a datanode. With the addition of explicit request to indicate to block deletion, block report interval (which is currently 1 hour) can be increased to a longer duration. This reduces load on both namenode and datanodes. > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.