hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Marquardt (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14769) WASB: delete recursive should not fail if a file is deleted
Date Tue, 15 Aug 2017 18:05:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16127651#comment-16127651

Thomas Marquardt commented on HADOOP-14769:

This patch fixes issues encountered with HBASE where it calls WASB and WASB fails to delete
a directory recursively.  

I think we agree that delete recursive should return true if 1) the directory exists and 2)
the directory and its content is successfully deleted.  It should return true when those conditions
are met, even if one of the child entries did not exist when an attempt was made to delete

> WASB: delete recursive should not fail if a file is deleted
> -----------------------------------------------------------
>                 Key: HADOOP-14769
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14769
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/azure
>            Reporter: Thomas Marquardt
>            Assignee: Thomas Marquardt
>         Attachments: HADOOP-14769-001.patch
> FileSystem.delete(Path path) and delete(Path path, boolean recursive) return false if
the path does not exist.  The WASB implementation of recursive delete currently fails if one
of the entries is deleted by an external agent while a recursive delete is in progress.  For
example, if you try to delete all of the files in a directory, which can be a very long process,
and one of the files contained within is deleted by an external agent, the recursive directory
delete operation will fail if it tries to delete that file and discovers that it does not
exist.  This is not desirable.  A recursive directory delete operation should succeeed if
the directory initially exists and when the operation completes, the directory and all of
its entries do not exist.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message