hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-173) Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes
Date Fri, 21 Aug 2009 16:54:14 GMT

    [ https://issues.apache.org/jira/browse/HDFS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746083#action_12746083
] 

Suresh Srinivas commented on HDFS-173:
--------------------------------------

Additionally the approach Raghu is proposing will have the following side effects compared
to the previous solution:
# After a client issues delete for a directory, some parts of the directory that are not deleted
are still available for other clients to create files, modify files and other operations
# During delete, if the namenode dies in the middle, the deletion of the directory is partial.
When namenode comes up, it will come up with partial directories. Not sure how client can
recover from this, other than remembering that it had tried delete and needs to delete the
directory again.

> Recursively deleting a directory with millions of files makes NameNode unresponsive for
other commands until the deletion completes
> -----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-173
>                 URL: https://issues.apache.org/jira/browse/HDFS-173
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>         Attachments: HDFS-173.patch
>
>
> Delete a directory with millions of files. This could take several minutes (observed
12 mins for 9 million files). While the operation is in progress FSNamesystem lock is held
and the requests from clients are not handled until deletion completes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message