hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmytro Molkov (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-1143) Implement Background deletion
Date Tue, 11 May 2010 18:53:42 GMT
Implement Background deletion

                 Key: HDFS-1143
                 URL: https://issues.apache.org/jira/browse/HDFS-1143
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Dmytro Molkov
            Assignee: Scott Chen

Right now if you try to delete massive number of files from the namenode it will freeze (sometimes
for minutes). Most of the time is spent going through the blocks map and invalidating all
the blocks.
This can probably be improved by having a background GC process. The deletion will basically
just remove the inode being deleted and then give the subtree that was just deleted to the
background thread running cleanup.
This way the namenode becomes available for the clients soon after deletion, and all the heavy
operations are done in the background.


This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message