hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaoyu Yao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12358) FSShell should prompt before deleting directories bigger than a configured size
Date Wed, 26 Aug 2015 16:58:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14715145#comment-14715145

Xiaoyu Yao commented on HADOOP-12358:

Thanks [~aw] for the feedback. I really appreciate it. Some earlier ones regarding compatibility
have included in my 1st patch as [~andrew.wang] has mentioned. 

bq. Between snapshots and trash, there are plenty of ways to protect against this situation.

What if these are not configured or not configured correctly by ops and used correctly by
users (-skipTrash)?

bq. You can't protect the user from making every single mistake without turning the system
into a 'nanny system' that makes you verify every single thing.

We don't want to build a 'nanny system'. The purpose of this JIRA is to protect/warn against
*bulk deletion* only on *misconfigured* cluster (without trash/snapshot) or *misuse* (trash
is skipped), which is hard to recover. 

> FSShell should prompt before deleting directories bigger than a configured size
> -------------------------------------------------------------------------------
>                 Key: HADOOP-12358
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12358
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>            Reporter: Xiaoyu Yao
>            Assignee: Xiaoyu Yao
>         Attachments: HADOOP-12358.00.patch
> We have seen many cases with customers deleting data inadvertently with -skipTrash. The
FSShell should prompt user if the size of the data or the number of files being deleted is
bigger than a threshold even though -skipTrash is being used.

This message was sent by Atlassian JIRA

View raw message