hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-5724) Datanode should report deletion of blocks to Namenode explicitly
Date Thu, 18 Jun 2009 17:44:07 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-5724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Suresh Srinivas updated HADOOP-5724:
------------------------------------

    Release Note: 
* When a file is deleted, the corresponding blocks from the blocksMap on Namenode is also
deleted
* Block reports from datanode was a way to indicate deletion of block to the namenode. With
this change namenode no longer depends on the block report. Hence reducing the frequency of
block reports by increasing the block report interval from current 1 hour to 6 hours.
          Status: Patch Available  (was: Open)

> Datanode should report deletion of blocks to Namenode explicitly
> ----------------------------------------------------------------
>
>                 Key: HADOOP-5724
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5724
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: dfs
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>             Fix For: 0.21.0
>
>         Attachments: blockdel-1.patch, blockdel-2.patch, blockdel.patch, blockdel.patch
>
>
> Currently datanode notifies namenode newly added blocks and the blocks that are corrupt.
There is no explicit message from the datanode to the namenode to indicate the deletion of
blocks. Block reports from the datanode is the only way for the namenode to learn about the
deletion of blocks at a datanode. With the addition of explicit request to indicate to block
deletion, block report interval (which is currently 1 hour) can be increased to a longer duration.
This reduces load on both namenode and datanodes.
>  

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message